[ubuntu-cloud] Apt S3 mirrors creation

[Ben Howard]

On 04/23/2012 11:17 AM, Ivan Mincik wrote:
> Thanks for information. I did not expect such complex code.
There are some very tricky problems that you have work around with S3
and most of the reasons the code is the way it is because I needed
something that was fast. For example, if you "flip" a mirror active, you
could break the mirrors unless you basically try to ram-rod things
through. In general it can mirror the archive in about 20 minutes or so.
The other factor that makes it complex is that S3 is not atomic and you
can't use symlinks, so I wanted to prevent an error from propagating and
that involves

The code defaults to doing things with 16 workers. You might want scale
those back unless you are speaking terms with Amazon, otherwise you can
get "slow down errors". 8 to 12 workers should be good for most people.
>
> Ivan
>

-- 


Ben Howard
ben.howard at canonical.com
Canonical
GPG ID 0x5406A866




-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 836 bytes
Desc: OpenPGP digital signature
URL: <https://lists.ubuntu.com/archives/ubuntu-cloud/attachments/20120423/10b9c021/attachment.pgp>