| 1 |
On Thu, Jan 14, 2010 at 07:07:01PM -0500, Paul Arthur wrote: |
| 2 |
> On 2010-01-14, Nirbheek Chauhan <nirbheek@g.o> wrote: |
| 3 |
> > On Wed, Jan 13, 2010 at 9:24 PM, Mike Frysinger <vapier@g.o> wrote: |
| 4 |
> >> i think our current work flows also significantly impede the smooth running of |
| 5 |
> >> this. Â if we had were using a dscm (git) on gentoo-x86, i feel like it'd be a |
| 6 |
> >> much smoother ride for Gentoo devs to pull from a proxy maintainer and push on |
| 7 |
> >> their behalf. |
| 8 |
> > |
| 9 |
> > In theory, yes. In practice, git is too slow to handle 30,000 files. |
| 10 |
> > Even simple operations like git add become painful even if you put the |
| 11 |
> > whole of portage on tmpfs since git does a stat() on every single file |
| 12 |
> > in the repository with every operation. |
| 13 |
> > |
| 14 |
> > Simple test: do a git init followed by git add && git commit -m |
| 15 |
> > "Initial commit" in your portage dir (.gitignore packages/ and |
| 16 |
> > distfiles/) |
| 17 |
> > |
| 18 |
> > Once this is done, you can test how it'll feel like to use a DSCM on |
| 19 |
> > portage (without history). Unless you have a really fast SSD and |
| 20 |
> > processor, you'll want to go back to the good old days of CVS with its |
| 21 |
> > network-bound latencies on just 5-6 files in the current dir. |
| 22 |
> |
| 23 |
> Ouch. I wanted to test this in a fairly bad scenario, so I gave it a |
| 24 |
> try on my old, low-spec fileserver. |
| 25 |
You didn't repack or at least run git-gc between the huge add and your |
| 26 |
everyday operations. Do that, and then measure the ops with both cold |
| 27 |
and hot cache. |
| 28 |
|
| 29 |
The initial packing and adding are very intensive, even on fast |
| 30 |
machines, but that's because they are dealing with a lot of small pieces |
| 31 |
of data. Packing has benefited immensely from being fully multi-threaded |
| 32 |
in Git. |
| 33 |
|
| 34 |
I'd love somebody to do the SoC stats again: |
| 35 |
http://www.gentoo.org/proj/en/infrastructure/cvs-migration.xml?style=printable |
| 36 |
|
| 37 |
Using the git repo conversion I did: |
| 38 |
http://git-exp.overlays.gentoo.org/gitweb/?p=exp/gentoo-x86.git;a=summary |
| 39 |
|
| 40 |
-- |
| 41 |
Robin Hugh Johnson |
| 42 |
Gentoo Linux: Developer, Trustee & Infrastructure Lead |
| 43 |
E-Mail : robbat2@g.o |
| 44 |
GnuPG FP : 11AC BA4F 4778 E3F6 E4ED F38E B27B 944E 3488 4E85 |
Archives