Gentoo Archives: gentoo-mirrors

From: Tobias Klausmann <klausman@××××××××××××.de>
To: gentoo-mirrors@l.g.o
Subject: Re: [gentoo-mirrors] rsyncstats
Date: Wed, 06 Oct 2004 08:06:57
Message-Id: 20041006080635.GA1777@eric.schwarzvogel.de
In Reply to: [gentoo-mirrors] rsyncstats by Andreas Herrmann
Hi! 

On Tue, 05 Oct 2004, Andreas Herrmann wrote:
> I searched the web for a nice tool to generate stats from rsync.log > The rsyncstats script from rsync crashes with following error: >
[...]
> I have over 100 syncs per day. Does somebody know a working solution for > analysing the rsync logs?
That largely depends on what kind of statistics you need. I wrote a tool that reports the top ten users and very basic overall statistics like these (I edited the IPs and hostnames to protect the guilty): [...snip...] Total traffic: 45.35 GBytes Total number of unique IPs: 4931 Log seems to span 30.00 days. Top 10 Hosts by bytes bytes ( MBytes ) IP-Adress (Hostname) ------------------------------------------------ 342422302 ( 326.56M) 00.00.00.00 (UNKNOWN) 378355766 ( 360.83M) 00.00.00.00 (UNKNOWN) 402690213 ( 384.04M) 00.00.00.00 (UNKNOWN) 474043815 ( 452.08M) 00.00.00.00 (UNKNOWN) 717244240 ( 684.02M) 00.00.00.00 (UNKNOWN) 759872340 ( 724.67M) 00.00.00.00 (UNKNOWN) 1389014265 (1324.67M) 00.00.00.00 (UNKNOWN) 2151855076 (2052.17M) 00.00.00.00 (UNKNOWN) 3164767044 (3018.16M) 00.00.00.00 (UNKNOWN) 5941073841 (5665.85M) 00.00.00.00 (UNKNOWN) ------------------------------------------------ Top 5% of IPs (246) account for 28718099102 bytes (26.75GB) of traffic. Which is 58.97% of the total traffic. Top 10 Hosts by number of sessions Sessions per day IP-Adress (Hostname) ------------------------------------- 246 8.20 00.00.00.00 (UNKNOWN) 309 10.30 00.00.00.00 (UNKNOWN) 321 10.70 00.00.00.00 (UNKNOWN) 328 10.93 00.00.00.00 (UNKNOWN) 695 23.17 00.00.00.00 (UNKNOWN) 823 27.43 00.00.00.00 (UNKNOWN) 1055 35.17 00.00.00.00 (UNKNOWN) 1372 45.73 00.00.00.00 (UNKNOWN) 1419 47.30 00.00.00.00 (UNKNOWN) 2759 91.97 00.00.00.00 (UNKNOWN) ------------------------------------- Total number of sessions..........: 26932 Average number of sessions per day: 897.73 Top 5% of IPs (251) account for 15488 sessions. Which is 57.51% of the total number of sessions. Analyzed 56027 lines in 7.62 seconds, 7351.30 lines per second [...snap...] Currently this piece of... software is in no releasable shape, but if there's need, I'll get it into shape. Greets, Tobias PS: That performance is on a PIII/550 which is doing other stuff, too. -- export DISPLAY=vt100 -- gentoo-mirrors@g.o mailing list

Replies

Subject Author
Re: [gentoo-mirrors] rsyncstats Rob Baxter <burn@××××××.ca>