Gentoo Archives: gentoo-portage-dev

From: Ned Ludd <solar@g.o>
To: gentoo-portage-dev@l.g.o
Subject: Re: [gentoo-portage-dev] Package compression header for binhosts
Date: Tue, 01 Jun 2010 20:01:57
Message-Id: 1275422465.24611.9.camel@hangover
In Reply to: Re: [gentoo-portage-dev] Package compression header for binhosts by Brian Harring
1 On Mon, 2010-05-31 at 22:16 -0700, Brian Harring wrote:
2 > On Mon, May 31, 2010 at 08:32:34PM -0700, Zac Medico wrote:
3 > > Hi,
4 > >
5 > > In order to support alternative compression types for binhost
6 > > packages, I was thinking about adding support for a header field in
7 > > the Packages index file. For example, a header line like
8 > > "PACKAGE_EXTENSION: txz" could be used to indicate that clients
9 > > should download files with txz extensions instead of tbz2
10 > > extensions. I'm planning to add support for both tgz [1] and txz
11 > > extensions.
12 > >
13 > > [1] http://bugs.gentoo.org/show_bug.cgi?id=142579
14 >
15 > 1) requires a version header bump
16
17 Agreed. But there were some other pending changes for "VERSION: 1"
18
19 Any planned changes to the format should be documented on
20 https://bugs.gentoo.org/show_bug.cgi?id=263994
21
22
23 > 2) a header alone isn't useful unless it's specifiable per cpv entry;
24 > thus it must be inheritable
25
26 Per CPV entries is going to bloat the format and make me carry around a
27 more data on a per pkg basis then I'd want to. How about we run with
28 zac's idea but use tools to convert a full repo over to $EXTENTION
29 This should keep the portage code fast as well as it checks for invalid
30 binpkgs all the time. Having to have portage process a ton of ever
31 growing extentions is just going to be slow.
32
33 > 3) PACKAGE_EXTENSION is overly verbose and unclear it's specifying
34 > the compressor too; it's intention is for compression, state it as
35 > such (I mention this in light of URI's existance where
36 > PACKAGE_EXTENSION would only be a hint of compressor)
37 >
38 > Re: #1, there is a decent set of optimizations I'm kicking around in
39 > pkgcore for the next version- a discussion should probably be started
40 > there.
41 >
42 > Offhand, having a compression specific header (a simple enumeration
43 > of known compressors) and a DEFAULT_URI that is python string
44
45 No go bro. The 'Packages' format should be independent of python.
46
47 > interpolation assembled (for example,
48 > DEFAULT_URI="%(host)s/%(category)s/%(pf)s.txz") seems wiser. Via
49 > doing what I'm suggesting, it would be possible to do binpkg
50 > repository 'views' w/out having to map each binpkg into the url space
51 > for it.
52 >
53 > ~harring
54
55 --
56 Ned Ludd <solar@g.o>
57 Gentoo Linux

Replies

Subject Author
Re: [gentoo-portage-dev] Package compression header for binhosts Brian Harring <ferringb@×××××.com>