[gentoo-commits] gentoo commit in xml/htdocs/proj/en/glep: glep-0058.html glep-0059.html glep-0060.html glep-0061.html

[Robin H. Johnson (robbat2)]

robbat2     10/01/31 08:50:53

  Modified:             glep-0058.html glep-0059.html glep-0060.html
                        glep-0061.html
  Log:
  Resync HTML for treesigning GLEPs.

Revision  Changes    Path
1.5                  xml/htdocs/proj/en/glep/glep-0058.html

file : http://sources.gentoo.org/viewcvs.py/gentoo/xml/htdocs/proj/en/glep/glep-0058.html?rev=1.5&view=markup
plain: http://sources.gentoo.org/viewcvs.py/gentoo/xml/htdocs/proj/en/glep/glep-0058.html?rev=1.5&content-type=text/plain
diff : http://sources.gentoo.org/viewcvs.py/gentoo/xml/htdocs/proj/en/glep/glep-0058.html?r1=1.4&r2=1.5

Index: glep-0058.html
===================================================================
RCS file: /var/cvsroot/gentoo/xml/htdocs/proj/en/glep/glep-0058.html,v
retrieving revision 1.4
retrieving revision 1.5
diff -p -w -b -B -u -u -r1.4 -r1.5
--- glep-0058.html	31 Jan 2010 07:53:41 -0000	1.4
+++ glep-0058.html	31 Jan 2010 08:50:52 -0000	1.5
@@ -366,7 +366,7 @@ Open Publication License, v1.0.</p>
 <div class="footer">
 <hr class="footer" />
 <a class="reference external" href="glep-0058.txt">View document source</a>.
-Generated on: 2010-01-31 07:53 UTC.
+Generated on: 2010-01-31 08:27 UTC.
 Generated by <a class="reference external" href="http://docutils.sourceforge.net/">Docutils</a> from <a class="reference external" href="http://docutils.sourceforge.net/rst.html">reStructuredText</a> source.
 
 </div>



1.7                  xml/htdocs/proj/en/glep/glep-0059.html

file : http://sources.gentoo.org/viewcvs.py/gentoo/xml/htdocs/proj/en/glep/glep-0059.html?rev=1.7&view=markup
plain: http://sources.gentoo.org/viewcvs.py/gentoo/xml/htdocs/proj/en/glep/glep-0059.html?rev=1.7&content-type=text/plain
diff : http://sources.gentoo.org/viewcvs.py/gentoo/xml/htdocs/proj/en/glep/glep-0059.html?r1=1.6&r2=1.7

Index: glep-0059.html
===================================================================
RCS file: /var/cvsroot/gentoo/xml/htdocs/proj/en/glep/glep-0059.html,v
retrieving revision 1.6
retrieving revision 1.7
diff -p -w -b -B -u -u -r1.6 -r1.7
--- glep-0059.html	31 Jan 2010 07:56:01 -0000	1.6
+++ glep-0059.html	31 Jan 2010 08:50:52 -0000	1.7
@@ -244,7 +244,7 @@ Open Publication License, v1.0.</p>
 <div class="footer">
 <hr class="footer" />
 <a class="reference external" href="glep-0059.txt">View document source</a>.
-Generated on: 2010-01-31 07:55 UTC.
+Generated on: 2010-01-31 08:27 UTC.
 Generated by <a class="reference external" href="http://docutils.sourceforge.net/">Docutils</a> from <a class="reference external" href="http://docutils.sourceforge.net/rst.html">reStructuredText</a> source.
 
 </div>



1.8                  xml/htdocs/proj/en/glep/glep-0060.html

file : http://sources.gentoo.org/viewcvs.py/gentoo/xml/htdocs/proj/en/glep/glep-0060.html?rev=1.8&view=markup
plain: http://sources.gentoo.org/viewcvs.py/gentoo/xml/htdocs/proj/en/glep/glep-0060.html?rev=1.8&content-type=text/plain
diff : http://sources.gentoo.org/viewcvs.py/gentoo/xml/htdocs/proj/en/glep/glep-0060.html?r1=1.7&r2=1.8

Index: glep-0060.html
===================================================================
RCS file: /var/cvsroot/gentoo/xml/htdocs/proj/en/glep/glep-0060.html,v
retrieving revision 1.7
retrieving revision 1.8
diff -p -w -b -B -u -u -r1.7 -r1.8
--- glep-0060.html	31 Jan 2010 07:57:09 -0000	1.7
+++ glep-0060.html	31 Jan 2010 08:50:52 -0000	1.8
@@ -391,7 +391,7 @@ Open Publication License, v1.0.</p>
 <div class="footer">
 <hr class="footer" />
 <a class="reference external" href="glep-0060.txt">View document source</a>.
-Generated on: 2010-01-31 07:57 UTC.
+Generated on: 2010-01-31 08:27 UTC.
 Generated by <a class="reference external" href="http://docutils.sourceforge.net/">Docutils</a> from <a class="reference external" href="http://docutils.sourceforge.net/rst.html">reStructuredText</a> source.
 
 </div>



1.5                  xml/htdocs/proj/en/glep/glep-0061.html

file : http://sources.gentoo.org/viewcvs.py/gentoo/xml/htdocs/proj/en/glep/glep-0061.html?rev=1.5&view=markup
plain: http://sources.gentoo.org/viewcvs.py/gentoo/xml/htdocs/proj/en/glep/glep-0061.html?rev=1.5&content-type=text/plain
diff : http://sources.gentoo.org/viewcvs.py/gentoo/xml/htdocs/proj/en/glep/glep-0061.html?r1=1.4&r2=1.5

Index: glep-0061.html
===================================================================
RCS file: /var/cvsroot/gentoo/xml/htdocs/proj/en/glep/glep-0061.html,v
retrieving revision 1.4
retrieving revision 1.5
diff -p -w -b -B -u -u -r1.4 -r1.5
--- glep-0061.html	13 Jan 2010 03:28:33 -0000	1.4
+++ glep-0061.html	31 Jan 2010 08:50:52 -0000	1.5
@@ -27,9 +27,9 @@
 </tr>
 <tr class="field"><th class="field-name">Title:</th><td class="field-body">Manifest2 compression</td>
 </tr>
-<tr class="field"><th class="field-name">Version:</th><td class="field-body">1.4</td>
+<tr class="field"><th class="field-name">Version:</th><td class="field-body">1.5</td>
 </tr>
-<tr class="field"><th class="field-name">Last-Modified:</th><td class="field-body"><a class="reference external" href="http://www.gentoo.org/cgi-bin/viewcvs.cgi/xml/htdocs/proj/en/glep/glep-0061.txt?cvsroot=gentoo">2010/01/13 03:26:53</a></td>
+<tr class="field"><th class="field-name">Last-Modified:</th><td class="field-body"><a class="reference external" href="http://www.gentoo.org/cgi-bin/viewcvs.cgi/xml/htdocs/proj/en/glep/glep-0061.txt?cvsroot=gentoo">2010/01/31 08:27:05</a></td>
 </tr>
 <tr class="field"><th class="field-name">Author:</th><td class="field-body">Robin Hugh Johnson &lt;robbat2&#32;&#97;t&#32;gentoo.org&gt;</td>
 </tr>
@@ -47,7 +47,7 @@
 </tr>
 <tr class="field"><th class="field-name">Updates:</th><td class="field-body">44</td>
 </tr>
-<tr class="field"><th class="field-name">Post-History:</th><td class="field-body">December 2009</td>
+<tr class="field"><th class="field-name">Post-History:</th><td class="field-body">December 2009, January 2010</td>
 </tr>
 </tbody>
 </table>
@@ -57,10 +57,15 @@
 <ul class="simple">
 <li><a class="reference internal" href="#abstract" id="id1">Abstract</a></li>
 <li><a class="reference internal" href="#motivation" id="id2">Motivation</a></li>
-<li><a class="reference internal" href="#specification" id="id3">Specification</a></li>
-<li><a class="reference internal" href="#backwards-compatibility" id="id4">Backwards Compatibility</a></li>
-<li><a class="reference internal" href="#references" id="id5">References</a></li>
-<li><a class="reference internal" href="#copyright" id="id6">Copyright</a></li>
+<li><a class="reference internal" href="#specification" id="id3">Specification</a><ul>
+<li><a class="reference internal" href="#creation-of-compressed-manifests" id="id4">Creation of compressed Manifests:</a></li>
+<li><a class="reference internal" href="#validation-of-manifests" id="id5">Validation of Manifests:</a></li>
+</ul>
+</li>
+<li><a class="reference internal" href="#example-results-with-a-32kib-cut-off-gzip-algorithm" id="id6">Example Results with a 32KiB cut-off, gzip algorithm</a></li>
+<li><a class="reference internal" href="#backwards-compatibility" id="id7">Backwards Compatibility</a></li>
+<li><a class="reference internal" href="#references" id="id8">References</a></li>
+<li><a class="reference internal" href="#copyright" id="id9">Copyright</a></li>
 </ul>
 </div>
 <div class="section" id="abstract">
@@ -72,12 +77,28 @@
 <p>With the introduction of MetaManifest, and full-tree Manifest coverage,
 we are faced with the possibility of having very large Manifests.</p>
 <p>Preliminary experiments with MetaManifest, show that with just the
-existing per-package Manifests, the full MetaManifest, for a tree
-including metadata/, exceeds 8MiB in size. Applying common compression
-can achieve a 50-60% reduction in this size.</p>
+existing per-package Manifests, the full MetaManifest (top-level only,
+no first-level sub directories), for a tree including metadata/, exceeds
+8MiB in size. Applying common compression can achieve a 50-60% reduction
+in this size.</p>
+<p>Additionally, some of the larger already-existing Manifests in the tree
+can also be reduced.</p>
 </div>
 <div class="section" id="specification">
 <h1><a class="toc-backref" href="#id3">Specification</a></h1>
+<div class="section" id="creation-of-compressed-manifests">
+<h2><a class="toc-backref" href="#id4">Creation of compressed Manifests:</a></h2>
+<p>32KiB is suggested as a arbitrary cut-off point to start generating
+compressed Manifest2 files.</p>
+<p>The compression must only applied during the creation of a tree intended
+for end users. No Manifests stored in a VCS should be compressed in the
+VCS. For the main gentoo-portage tree, this means that the compressed
+Manifests should be generated using the CVS to Rsync process.</p>
+<p>The Manifest compression process is required to ensure that inconsistent
+compressed versions do not exist.</p>
+</div>
+<div class="section" id="validation-of-manifests">
+<h2><a class="toc-backref" href="#id5">Validation of Manifests:</a></h2>
 <p>When searching for a Manifest2 file, if the basename form does not
 exist, the package manager should search in the same location using
 common compressed suffixes, and use the compressed file in place of the
@@ -86,11 +107,71 @@ Manifest2.</p>
 platform. In the case that multiple versions exist, the package manager
 should simply pick one - they should be identical, differing only in
 compression.</p>
-<p>The Manifest generation process is required to ensure that inconsistent
-compressed versions do not exist.</p>
+</div>
+</div>
+<div class="section" id="example-results-with-a-32kib-cut-off-gzip-algorithm">
+<h1><a class="toc-backref" href="#id6">Example Results with a 32KiB cut-off, gzip algorithm</a></h1>
+<p>As of 2010/01/30, the suggested cut-off would impact the following 21 existing
+Manifests, for a saving of nearly 900KiB:</p>
+<pre class="literal-block">
+Size   Path
+ 65788 app-doc/linux-gazette/Manifest
+ 75739 app-office/openoffice-bin/Manifest
+ 40534 app-text/texlive-core/Manifest
+ 41710 dev-texlive/texlive-bibtexextra/Manifest
+ 38197 dev-texlive/texlive-documentation-english/Manifest
+129610 dev-texlive/texlive-fontsextra/Manifest
+ 36022 dev-texlive/texlive-humanities/Manifest
+686118 dev-texlive/texlive-latexextra/Manifest
+ 43392 dev-texlive/texlive-latexrecommended/Manifest
+ 33375 dev-texlive/texlive-mathextra/Manifest
+ 39781 dev-texlive/texlive-pictures/Manifest
+ 69567 dev-texlive/texlive-pstricks/Manifest
+ 75460 dev-texlive/texlive-publishers/Manifest
+ 50879 dev-texlive/texlive-science/Manifest
+ 36711 kde-base/kde-l10n/Manifest
+ 36539 media-gfx/bootsplash-themes/Manifest
+ 33058 net-fs/autofs/Manifest
+ 39781 www-client/firefox-bin/Manifest
+ 48983 www-client/icecat/Manifest
+ 60213 www-client/mozilla-firefox/Manifest
+ 39065 x11-themes/gkrellm-themes/Manifest
+</pre>
+<p>Additionally, with the MetaManifest proposal, the following new manifests would
+also be compressed, for a saving of nearly 4MiB:</p>
+<pre class="literal-block">
+Size    Path
+  33442 app-admin/Manifest
+  71073 app-dicts/Manifest
+  35923 app-emacs/Manifest
+  45808 app-misc/Manifest
+  50169 app-text/Manifest
+ 112786 dev-java/Manifest
+  65581 dev-libs/Manifest
+  42619 dev-lisp/Manifest
+ 182163 dev-perl/Manifest
+  96198 dev-python/Manifest
+  58963 dev-ruby/Manifest
+  59736 dev-util/Manifest
+  58338 eclass/Manifest
+  55749 kde-base/Manifest
+ 110064 licenses/Manifest
+  35262 media-gfx/Manifest
+  53995 media-libs/Manifest
+  55607 media-plugins/Manifest
+  71911 media-sound/Manifest
+  34835 media-video/Manifest
+5747849 metadata/Manifest
+  47452 net-analyzer/Manifest
+  65989 net-misc/Manifest
+ 316787 profiles/Manifest
+  67784 sys-apps/Manifest
+  48971 x11-misc/Manifest
+  41475 x11-plugins/Manifest
+</pre>
 </div>
 <div class="section" id="backwards-compatibility">
-<h1><a class="toc-backref" href="#id4">Backwards Compatibility</a></h1>
+<h1><a class="toc-backref" href="#id7">Backwards Compatibility</a></h1>
 <p>The package Manifests should also be maintained as ONLY uncompressed in
 CVS.</p>
 <p>For processing of all existing per-package Manifests, if compression is
@@ -102,11 +183,10 @@ compressed versions are guaranteed to ex
 do not have an backwards compatibility issues.</p>
 <p>As a side note, this breaks all manual interaction with Manifests
 such as grep, and so should only be applied to large Manifest2 files,
-such as the MetaManifest. 384KiB is suggested as a arbitrary cut-off
-point to start generating compressed Manifest2 files.</p>
+such as the MetaManifest.</p>
 </div>
 <div class="section" id="references">
-<h1><a class="toc-backref" href="#id5">References</a></h1>
+<h1><a class="toc-backref" href="#id8">References</a></h1>
 <table class="docutils footnote" frame="void" id="glep44" rules="none">
 <colgroup><col class="label" /><col /></colgroup>
 <tbody valign="top">
@@ -116,7 +196,7 @@ point to start generating compressed Man
 </table>
 </div>
 <div class="section" id="copyright">
-<h1><a class="toc-backref" href="#id6">Copyright</a></h1>
+<h1><a class="toc-backref" href="#id9">Copyright</a></h1>
 <p>Copyright (c) 2008-2010 by Robin Hugh Johnson. This material may be
 distributed only subject to the terms and conditions set forth in the
 Open Publication License, v1.0.</p>
@@ -127,7 +207,7 @@ Open Publication License, v1.0.</p>
 <div class="footer">
 <hr class="footer" />
 <a class="reference external" href="glep-0061.txt">View document source</a>.
-Generated on: 2010-01-13 03:27 UTC.
+Generated on: 2010-01-31 08:27 UTC.
 Generated by <a class="reference external" href="http://docutils.sourceforge.net/">Docutils</a> from <a class="reference external" href="http://docutils.sourceforge.net/rst.html">reStructuredText</a> source.
 
 </div>