Gentoo Archives: gentoo-dev

From: "Chí-Thanh Christopher Nguyễn" <chithanh@g.o>
To: gentoo-dev@l.g.o
Subject: Re: [gentoo-dev] sources.gentoo.org instability
Date: Mon, 05 Dec 2011 22:21:18
Message-Id: 4EDD43B1.5050803@gentoo.org
In Reply to: Re: [gentoo-dev] sources.gentoo.org instability by Alec Warner
Alec Warner schrieb:
>> Seriously, what do we gain from crawlers accessing sources.gentoo.org? I cant >> really remember seeing it once in a google query result... > > We want the site searchable.
>>> The majority of the expensive requests are related to package.mask and >>> use.local.desc queries by crawlers. Like crawling the entire 13000 rev >>> history for package.mask (or similar.)
Would it be feasible to use mod_rewrite to direct the most expensive requests to a static copy, which is re-generated every ${REASONABLE_TIMEFRAME}? Best regards, Chí-Thanh Christopher Nguyễn

Replies

Subject Author
Re: [gentoo-dev] sources.gentoo.org instability Alec Warner <antarus@g.o>