Gentoo Logo
Gentoo Spaceship




Note: Due to technical difficulties, the Archives are currently not up to date. GMANE provides an alternative service for most mailing lists.
c.f. bug 424647
List Archive: gentoo-scm
Navigation:
Lists: gentoo-scm: < Prev By Thread Next > < Prev By Date Next >
Headers:
To: gentoo-scm@g.o
From: "Robin H. Johnson" <robbat2@g.o>
Subject: repo layout & graft / split-history
Date: Mon, 1 Nov 2010 04:39:58 +0000
On Fri, Oct 29, 2010 at 09:28:34PM -0500, Donnie Berkholz wrote:
> With 4K blocks, that works out at roughly 500 MB (CVS) to 2 GB (SVN, 
> Git) of inode overhead. I have a hard time imagining people so hard up 
> for disk space that they can fit the whole git repo but can't find 
> another 1.5 GB.
I'd like to ask the embedded arch folk how they feel about that size
proposal. I know some of the MIPS team were running 2.1GB SCSI drives,
and complaining already.

> Based on my current git conversion with a pack size of 1.7 GB, I suppose 
> that means the total repo in a git world could vary from ~2 GB all the 
> way up to ~4 GB.
There is one oversimplification here, that the pack will actually be
that large...

I'm playing with graft points, and the tree as it stands, with no
history (single commit), is a single 66MiB pack. I've included some more
numbers for going further back in history:

Command I've used to generate the numbers below:

# ( cd gentoo-x86-git-authors.git/ ; git fast-export ${START}..HEAD ) | \
( rm -rf trim ; mkdir trim ; cd trim ; git init ; \
time git fast-import --stats ; \
du .git ; \
time git  gc --aggressive ; \
du .git )

End point: Tue Oct 26 15:43:01 2010 +0000
Pack sizes by starting point:
Tue Oct 26 15:43:01 2010 +0000: 71016 KiB (single commit)
Fri Oct 01 00:25:21 2010 +0000: 81760 KiB
Wed Sep 01 02:20:31 2010 +0000: 92636 KiB
Sun Aug 01 00:45:49 2010 +0000: 103248 KiB
Fri Jan 01 00:00:39 2010 +0000: 182440 KiB
...

Approximately 11MiB/month of growth in the packfile.

Is the packfile of the kernel sources an acceptable size?
It's presently ~800MiB. If we start with zero or minimal history (6
months maybe). This gives us a fairly small tree...

Still needed with the above:
- Document _very_ well how to graft history back together if you want
  the full history.
- Prevent full history from being pushed back.

-- 
Robin Hugh Johnson
Gentoo Linux: Developer, Trustee & Infrastructure Lead
E-Mail     : robbat2@g.o
GnuPG FP   : 11AC BA4F 4778 E3F6 E4ED  F38E B27B 944E 3488 4E85
Attachment:
pgpF6Bm2z9gzg.pgp (PGP signature)
Replies:
Re: repo layout & graft / split-history
-- Donnie Berkholz
Re: repo layout & graft / split-history
-- Mike Auty
Re: repo layout & graft / split-history
-- Caleb Cushing
References:
Notes from a recent meeting; Updated conversion
-- Donnie Berkholz
Re: Notes from a recent meeting; Updated conversion
-- Robin H. Johnson
meeting followup: repo layout
-- Robin H. Johnson
Re: meeting followup: repo layout
-- Donnie Berkholz
Navigation:
Lists: gentoo-scm: < Prev By Thread Next > < Prev By Date Next >
Previous by thread:
Re: meeting followup: repo layout
Next by thread:
Re: repo layout & graft / split-history
Previous by date:
Updated upload-pack patches
Next by date:
Re: repo layout & graft / split-history


Updated May 23, 2012

Summary: Archive of the gentoo-scm mailing list.

Donate to support our development efforts.

Copyright 2001-2013 Gentoo Foundation, Inc. Questions, Comments? Contact us.