Gentoo Archives: gentoo-user

From: thelma@×××××××××××.com
To: gentoo-user@l.g.o
Subject: Re: [gentoo-user] is "scp" reliable?
Date: Sun, 30 May 2021 00:42:45
Message-Id: 8e8edccb-5266-0d8f-4a67-0e77859c34a7@sys-concept.com
In Reply to: Re: [gentoo-user] is "scp" reliable? by cal
1 >> Another mystery.
2 >> I copied the file to USB 1TB sandisk.
3 >> md5sum check OK same as my computer
4 >>
5 >>
6 >> md5sum /run/media/joseph/SSD-1TB/business/backup/VDI/windows-7_pro_May-23-21.ova
7 >> 6f3348f1fb915af9c45806d947558a37 /run/media/joseph/SSD-1TB/business/backup/VDI/windows-7_pro_May-23-21.ova
8 >>
9 >> I mount the same USB 1TB sandisk on another computer and running md5sum on same file gives me different number, why???
10 >>
11 >> md5sum /run/media/fd/SSD-1TB/business/backup/VDI/windows-7_pro_May-23-21.ova
12 >> c478cb48e2f7961cb0e3eb452df6e642 /run/media/fd/SSD-1TB/business/backup/VDI/windows-7_pro_May-23-21.ova
13 >>
14 > Did you sync and unmount the partition before ejecting the drive from
15 > the first computer? With a file this large being copied, it is likely
16 > that a large amount of data remains buffered/cached and will not be
17 > fully written to the flash memory even after the copy command completes.
18 >
19 > On the first machine, you would still see the correct md5sum because the
20 > kernel abstracts this fact away from you. But if you rip out the drive
21 > and take it somewhere else without flushing those caches, you're going
22 > to get an incomplete file.
23 >
24 > Check if the file on the drive still md5sums the same if you plug it
25 > back into the first machine. Check what size it is, and whether there
26 > are a lot of 0s at the end indicating an unfinished write.
27 >
28 > cal
29
30 Yes, I unmounted the USB device every time.
31 And yes, I plug the USB device back to original machine and md5sum is correct, same as the original.
32
33 I copied the large file over network to another box and md5sum of: windows-7_pro_May-23-21.ova is correct same as on the original box.
34
35 I run this: "rsync -avh [source] [destination] && rsync -avhc [source] [destination]"
36
37 above code rsync files folder on first run and if complete without issue, will run rsync again immediately while performing same file name comparison by using hash of entire file.
38
39 This i what I got:
40
41 rsync -avh windows-7_pro_May-29-21.ova fd@10.0.0.138:/home/fd/business/VDI/ && rsync -avhc windows-7_pro_May-29-21.ova fd@10.0.0.138:/home/fd/business/VDI/
42 sending incremental file list
43 windows-7_pro_May-29-21.ova
44
45 sent 30.29G bytes received 35 bytes 115.81M bytes/sec
46 total size is 30.28G speedup is 1.00
47 sending incremental file list
48 windows-7_pro_May-29-21.ova
49 WARNING: windows-7_pro_May-29-21.ova failed verification -- update discarded (will try again).
50 windows-7_pro_May-29-21.ova
51 ERROR: windows-7_pro_May-29-21.ova failed verification -- update discarded.
52
53 sent 33.44M bytes received 6.47M bytes 123.38K bytes/sec
54 total size is 30.28G speedup is 758.62
55 rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1330) [sender=3.2.3]

Replies

Subject Author
Re: [gentoo-user] is "scp" reliable? cal <cal@×××××××××.technology>