Re: [gentoo-dev] Request for Help

[Felipe Ghellar]

Spider wrote:
> Now.. .for my main source of irritation and something I'd require help
> with. in this update, they also saw fit to remove the /latest directory,
> which previously had a nice "sort by date" in the http interface, and
> thus was really simple to keep abreast with added and changed packages
> between our tree and theirs..  Now this is the question of listing all
> packages one by one for each "major" version and checking against our
> supported versions.  as you can imagine this is nothing I look forward
> to doing.
>
> So, I request the help of the creative scripters in the -dev list to
> come up with a way to track changes in a ftp tree between two days, and
> listing the new packages between dates.
>
> ls */*/*.tar* >$DATE ; diff $DATE(TODAY) $DATE(TODAY-1) :
> or something ;)


I don't have the time to actually write and test the scripts right now, 
so I'm just going to throw in some ideas, in the hope that they will be 
helpful:

1) Explore the gnome source tree.

wget -m -R "*.md5,*.zip,*.bz2,*.gz,*.tgz,*.tbz2" 
ftp://ftp.gnome.org/mirror/gnome.org/sources/

(All in a single line, of course)

This will create the directory structure 
"ftp.gnome.org/mirror/gnome.org/sources/*" in the current directory. 
Inside "sources/", each directory will contain a file called ".listing" 
and possibly a symbolic link called "LATEST-IS-<something>" (not all of 
them will have this) , but none of the actual files will be downloaded.

2) Build a list of files.

for i in `find . -name ".listing"`
do
a=${i##*sources}
a=${a%%.listing}
for x in `cat $i | grep -v "^total" | awk '{print $(NF)}'`
do
echo "$a$x"
done
done | sort -u

The commands above recombine the directory names with the contents of 
the ".listing" files to output something like what the results of a 
"find" command would be. The "LATEST-IS-*" symlinks are ignored.

3) Find out what's new.

Running the script in (2) e.g. once a day and saving its output to a 
file make it possible to use diff/comm to find out what changed.

The command

comm -1 -3 yesterday.txt today.txt

will output only lines unique to today.txt, while

comm -2 -3 yesterday.txt today.txt

will output only lines unique to yesterday.txt.




That's what I have for now. I hope this will be helpful. When I get the 
time, if nobody has done it yet, I'll be happy to write the actual scripts.

[]'s
Felipe Ghellar


-- 


_______________________________________________________________________
Yahoo! GeoCities
Tudo para criar o seu site: ferramentas fáceis de usar, espaço de sobra e acessórios.
http://br.geocities.yahoo.com/