Gentoo Archives: gentoo-scm

From: "Robin H. Johnson" <robbat2@g.o>
To: gentoo-scm@l.g.o
Subject: [gentoo-scm] repo layout & graft / split-history
Date: Mon, 01 Nov 2010 04:40:11
Message-Id: 20101101043958.GA1264@orbis-terrarum.net
In Reply to: Re: [gentoo-scm] meeting followup: repo layout by Donnie Berkholz
On Fri, Oct 29, 2010 at 09:28:34PM -0500, Donnie Berkholz wrote:
> With 4K blocks, that works out at roughly 500 MB (CVS) to 2 GB (SVN, > Git) of inode overhead. I have a hard time imagining people so hard up > for disk space that they can fit the whole git repo but can't find > another 1.5 GB.
I'd like to ask the embedded arch folk how they feel about that size proposal. I know some of the MIPS team were running 2.1GB SCSI drives, and complaining already.
> Based on my current git conversion with a pack size of 1.7 GB, I suppose > that means the total repo in a git world could vary from ~2 GB all the > way up to ~4 GB.
There is one oversimplification here, that the pack will actually be that large... I'm playing with graft points, and the tree as it stands, with no history (single commit), is a single 66MiB pack. I've included some more numbers for going further back in history: Command I've used to generate the numbers below: # ( cd gentoo-x86-git-authors.git/ ; git fast-export ${START}..HEAD ) | \ ( rm -rf trim ; mkdir trim ; cd trim ; git init ; \ time git fast-import --stats ; \ du .git ; \ time git gc --aggressive ; \ du .git ) End point: Tue Oct 26 15:43:01 2010 +0000 Pack sizes by starting point: Tue Oct 26 15:43:01 2010 +0000: 71016 KiB (single commit) Fri Oct 01 00:25:21 2010 +0000: 81760 KiB Wed Sep 01 02:20:31 2010 +0000: 92636 KiB Sun Aug 01 00:45:49 2010 +0000: 103248 KiB Fri Jan 01 00:00:39 2010 +0000: 182440 KiB ... Approximately 11MiB/month of growth in the packfile. Is the packfile of the kernel sources an acceptable size? It's presently ~800MiB. If we start with zero or minimal history (6 months maybe). This gives us a fairly small tree... Still needed with the above: - Document _very_ well how to graft history back together if you want the full history. - Prevent full history from being pushed back. -- Robin Hugh Johnson Gentoo Linux: Developer, Trustee & Infrastructure Lead E-Mail : robbat2@g.o GnuPG FP : 11AC BA4F 4778 E3F6 E4ED F38E B27B 944E 3488 4E85

Replies

Subject Author
Re: [gentoo-scm] repo layout & graft / split-history Mike Auty <ikelos@g.o>
Re: [gentoo-scm] repo layout & graft / split-history Donnie Berkholz <dberkholz@g.o>
Re: [gentoo-scm] repo layout & graft / split-history Caleb Cushing <xenoterracide@×××××.com>