Merge eats memory

[Michael Ellerman]

On Wed, 1 Jun 2005 01:28, John A Meinel wrote:
> John A Meinel wrote:
> Ignore my last email, I just figured out what refs.log was saying, and I
> do indeed have it incorrect.

Sorry I munged the format to make it easier to parse later, but didn't explain 
what the hell it meant.

It's just two lines per 10 seconds, with the names of the most ref'ed classes, 
and then the number of refs, all colon seperated.

But this is all you really need to see:

> > Refs	Class
> > ----------------------------------------
> > 157370	bzrlib.merge.SourceFile
> > 157368	bzrlib.inventory.InventoryEntry
> > 95615	bzrlib.changeset.ChangesetEntry
> > 95614	bzrlib.changeset.ReplaceContents
> > 93164	bzrlib.changeset.ChangeUnixPermissions
> > 93164	bzrlib.changeset.FileCreate
> > 134	bzrlib.commands.Command
> > 48	exceptions.Exception
> > 34	random.Random
> > 27	threading._Verbose
>
> If I understand your finds correctly, you only have:
> 102243-51127-33751=17365 (17k) source files. Though at one point you
> were including the .git and thus had 50k files.

No I am versioning the .git, so I have ~50k files.

> It seems like we are keeping somewhere between 3 - 10 copies of all of
> the files. Which does indeed seem a little much.

Yeah, that was my reading of the numbers.

> Do you have this repository somewhere we can get at it. I would be
> interested in profiling it a little bit if possible.

Not really. I started uploading it to my web server, but at 700M Stephen (sys 
admin) will kill me if you try to suck it down.

It's pretty easy to reproduce though. You just pull Linus' git repository, 
then bzr init; bzr add .; bzr ci -m "Import everything".

I'll see if I can find the instructions for "pull Linus' git repository" 
somewhere. It was less than dead easy (but that was about a month ago), there 
should be better instructions somewhere by now.

cheers

-- 
Michael Ellerman
IBM OzLabs

email: michael:ellerman.id.au
inmsg: mpe:jabber.org
wwweb: http://michael.ellerman.id.au
phone: +61 2 6212 1183 (tie line 70 21183)

We do not inherit the earth from our ancestors,
we borrow it from our children. - S.M.A.R.T Person
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: not available
Url : https://lists.ubuntu.com/archives/bazaar/attachments/20050601/c66b4cac/attachment.pgp