Gentoo Archives: gentoo-project

From: Raymond Jennings <shentino@×××××.com>
To: gentoo-project@l.g.o, antarus@g.o
Cc: Zac Medico <zmedico@g.o>
Subject: Re: [gentoo-project] RFC: Dropping rsync as a tree distribution method
Date: Sun, 16 Dec 2018 06:50:51
Message-Id: CAGDaZ_r+u=+cH+e3akevdshOWEyn9Er3uGY98rgUxDgA5ej0yg@mail.gmail.com
In Reply to: Re: [gentoo-project] RFC: Dropping rsync as a tree distribution method by Alec Warner
1 I filed a bug on this suggestion myself recently, here:
2
3 https://bugs.gentoo.org/671174
4
5 The commentary there from the others may prove useful in this conversation.
6
7 On Sat, Dec 15, 2018 at 9:18 PM Alec Warner <antarus@g.o> wrote:
8 >
9 >
10 >
11 > On Sun, Dec 16, 2018 at 12:13 AM Georgy Yakovlev <gyakovlev@g.o> wrote:
12 >>
13 >> On Saturday, December 15, 2018 8:40:38 PM PST Matt Turner wrote:
14 >> > On Sat, Dec 15, 2018 at 11:16 PM Alec Warner <antarus@g.o> wrote:
15 >> > > - Disk usage for git vs rsync
16 >> >
17 >> > This is why I have not switched. With git you pull down increasing
18 >> > amounts of history, whereas with rsync the data fits easily in a <1GB
19 >> > partition.
20 >>
21 >> Recent portage can use sync-depth = 1
22 >> repo dir no longer grows as it used to and it's works fine unlike initial
23 >> implementation that was giving trouble
24 >>
25 >> https://bugs.gentoo.org/552814
26 >>
27 >> du -hs /var/db/repos/gentoo
28 >> 350M /var/db/repos/gentoo
29 >>
30 >> example /etc/portage/repos.conf/gentoo.conf :
31 >> [DEFAULT]
32 >> main-repo = gentoo
33 >>
34 >> [gentoo]
35 >> auto-sync = yes
36 >> location = /var/db/repos/gentoo
37 >> sync-type = git
38 >> sync-uri = https://github.com/gentoo-mirror/gentoo.git
39 >> sync-depth = 1
40 >> sync-git-clone-extra-opts = -b master
41 >> sync-git-verify-commit-signature = true
42 >>
43 >>
44 >> sync is almost instantaneous compared to rsync, but some folks not going to
45 >> like github as a mirror in this case.
46 >
47 >
48 > I don't plan on using github for the mirror, so I'm not overly worried about that portion.
49 >
50 > +Zac Medico
51 >
52 > My recollection was that git doesn't ship with ebuild metadata by default, so even if we make the first sync fast (by using depth=1 in the clone) do we have a good story for ebuild metadata? Is portage just faster than in the past for ebuilds with missing metadata? Does emerge --sync handle metadata regen for syncs with git origins?
53 >
54 > -A
55 >
56 >>
57 >>
58 >>
59 >> --
60 >> Georgy Yakovlev
61 >> Gentoo Linux Developer

Replies

Subject Author
Re: [gentoo-project] RFC: Dropping rsync as a tree distribution method Raymond Jennings <shentino@×××××.com>