Gentoo Archives: gentoo-user

From: thelma@×××××××××××.com
To: gentoo-user@l.g.o
Subject: Re: [gentoo-user] network transfer speed
Date: Fri, 15 Jan 2021 17:36:47
Message-Id: f3e97e6f-5107-8bc3-af27-866b0a9470df@sys-concept.com
In Reply to: Re: [gentoo-user] network transfer speed by Jack
1 On 1/15/21 9:55 AM, Jack wrote:
2 > On 1/15/21 11:51 AM, thelma@×××××××××××.com wrote:
3 >> On 1/15/21 2:58 AM, Michael wrote:
4 >>> On Friday, 15 January 2021 08:42:16 GMT bobwxc wrote:
5 >>>> 在 2021/1/15 下午4:27, Raffaele BELARDI 写道:
6 >>>>>> -----Original Message-----
7 >>>>>> From: bobwxc <bobwxc@××.com>
8 >>>>>> Sent: Friday, January 15, 2021 08:57
9 >>>>>> To: gentoo-user@l.g.o
10 >>>>>> Subject: Re: [gentoo-user] network transfer speed
11 >>>>>>
12 >>>>>> 在 2021/1/15 下午2:56, thelma@×××××××××××.com 写道:
13 >>>>>>> On both of my systems the network card speed is showing 1000
14 >>>>>>> cat /sys/class/net/enp4s0/speed   1000
15 >>>>>>>
16 >>>>>>> but when I do rsync larage file I only see about: 20 to 22MB/s On my
17 >>>>>>> home network I get about 110MB/s between PC's
18 >>>>>>>
19 >>>>>>> Both PC's have SSD  and the swith is Gigabit (I think).
20 >>>>>>> How to find a the bottleneck?
21 >>>>>> 1000Mbps network card's maximum theoretical speed is about 125MiB/s.
22 >>>>>> It only works in short distances.
23 >>>>> Correct but that's the line speed that you'll never reach, when you take
24 >>>>> into account Ethernet frame overhead, IP (and possibly TCP) header
25 >>>>> overhead and application ( rsync, FTP, SMB, NFS) overhead you get lower
26 >>>>> figures. In my experience 900Mbps (110MiBps) on a 1000Mbps line is more
27 >>>>> realistic for 'normal' transfers.
28 >>>> Yes, you are right. So it is just *theoretical* speed :-)
29 >>>>
30 >>>> I don't know where does the file he sync from.
31 >>>> If you sync a file from a server in other city, for a 20 to 22MB/s speed
32 >>>> is very normal. But if in home, that is not good.
33 >>>>
34 >>>> And for ftp and rsync.
35 >>>>       ftp is better for transferring a single large file once.
36 >>>>       rsync is better for a long-term, incremental synchronization. The
37 >>>> file verification of rsync may take a lot of time for first sync.
38 >>> There is a theoretical network speed as already mentioned.  There is a
39 >>> protocol speed, which may limit throughput if it has e.g. heavy encryption/
40 >>> compression and the CPU is anaemic.  Finally, there is a MoBo bus (SCSI/SATA/
41 >>> USB) and the media storage limit.  If using USB 1.1 or 2.0 and/or the disks
42 >>> are slow or experience write amplification, you'll find this will constrain
43 >>> the final transfer speed significantly.
44 >> The computers on this network are 2-meters apart and they both use SSD Drive (so USB limitation doesn't come under consideration).
45 >> Like I said, on my home network when I transfer the 24GB file I get about 110MiBps transfer, so I was expecting the same in remote location).
46 >> Some units are connected to a router Ausus RT-AC66U B1 but these ports are gigabit too.
47 > When you say the computers are remote, is it possible the file is passing through your local computer on the way between the two remote machines?  Where are you actually running the rsync command?
48
49 I ssh over VPN to remote computers and run "rsync" there. Will it effect the speed?