Gentoo Logo
Gentoo Spaceship




Note: Due to technical difficulties, the Archives are currently not up to date. GMANE provides an alternative service for most mailing lists.
c.f. bug 424647
List Archive: gentoo-mirrors
Navigation:
Lists: gentoo-mirrors: < Prev By Thread Next > < Prev By Date Next >
Headers:
To: gentoo-mirrors@g.o
From: Tobias Klausmann <klausman@...>
Subject: Re: rsyncstats
Date: Wed, 6 Oct 2004 10:06:35 +0200
Hi! 

On Tue, 05 Oct 2004, Andreas Herrmann wrote:
> I searched the web for a nice tool to generate stats from rsync.log
> The rsyncstats script from rsync crashes with following error:
> 
[...]
> I have over 100 syncs per day. Does somebody know a working solution for 
> analysing the rsync logs?

That largely depends on what kind of statistics you need. I wrote
a tool that reports the top ten users and very basic overall
statistics like these (I edited the IPs and hostnames to protect
the guilty):

[...snip...]
Total traffic: 45.35 GBytes
Total number of unique IPs: 4931
Log seems to span 30.00 days.

 Top 10 Hosts by bytes
     bytes ( MBytes )     IP-Adress   (Hostname)
------------------------------------------------
 342422302 ( 326.56M) 00.00.00.00 (UNKNOWN)
 378355766 ( 360.83M) 00.00.00.00 (UNKNOWN)
 402690213 ( 384.04M) 00.00.00.00 (UNKNOWN)
 474043815 ( 452.08M) 00.00.00.00 (UNKNOWN)
 717244240 ( 684.02M) 00.00.00.00 (UNKNOWN)
 759872340 ( 724.67M) 00.00.00.00 (UNKNOWN)
1389014265 (1324.67M) 00.00.00.00 (UNKNOWN)
2151855076 (2052.17M) 00.00.00.00 (UNKNOWN)
3164767044 (3018.16M) 00.00.00.00 (UNKNOWN)
5941073841 (5665.85M) 00.00.00.00 (UNKNOWN)
------------------------------------------------
Top 5% of IPs (246) account for 28718099102 bytes (26.75GB) of traffic.
Which is 58.97% of the total traffic.

 Top 10 Hosts by number of sessions
Sessions   per day    IP-Adress   (Hostname)
-------------------------------------
   246       8.20 00.00.00.00 (UNKNOWN)
   309      10.30 00.00.00.00 (UNKNOWN)
   321      10.70 00.00.00.00 (UNKNOWN)
   328      10.93 00.00.00.00 (UNKNOWN)
   695      23.17 00.00.00.00 (UNKNOWN)
   823      27.43 00.00.00.00 (UNKNOWN)
  1055      35.17 00.00.00.00 (UNKNOWN)
  1372      45.73 00.00.00.00 (UNKNOWN)
  1419      47.30 00.00.00.00 (UNKNOWN)
  2759      91.97 00.00.00.00 (UNKNOWN)
-------------------------------------
Total number of sessions..........: 26932
Average number of sessions per day: 897.73

Top 5% of IPs (251) account for 15488 sessions.
Which is 57.51% of the total number of sessions.

Analyzed 56027 lines in 7.62 seconds, 7351.30 lines per second
[...snap...]

Currently this piece of... software is in no releasable shape,
but if there's need, I'll get it into shape.

Greets,
Tobias

PS: That performance is on a PIII/550 which is doing other stuff,
    too.

-- 
export DISPLAY=vt100

--
gentoo-mirrors@g.o mailing list

Replies:
Re: rsyncstats
-- Rob Baxter
References:
rsyncstats
-- Andreas Herrmann
Navigation:
Lists: gentoo-mirrors: < Prev By Thread Next > < Prev By Date Next >
Previous by thread:
rsyncstats
Next by thread:
Re: rsyncstats
Previous by date:
rsyncstats
Next by date:
Re: new rsync hardware for rsync16.de


Updated Jun 17, 2009

Summary: Archive of the gentoo-mirrors mailing list.

Donate to support our development efforts.

Copyright 2001-2013 Gentoo Foundation, Inc. Questions, Comments? Contact us.