From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 57040158042 for ; Fri, 15 Nov 2024 15:36:26 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 7251DE0AE2; Fri, 15 Nov 2024 15:36:20 +0000 (UTC) Received: from cow.ash.relay.mailchannels.net (cow.ash.relay.mailchannels.net [23.83.222.41]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 80940E0ABF for ; Fri, 15 Nov 2024 15:36:19 +0000 (UTC) X-Sender-Id: thundermail|x-authsender|confabulate@kintzios.com Received: from relay.mailchannels.net (localhost [127.0.0.1]) by relay.mailchannels.net (Postfix) with ESMTP id 58726323FCA for ; Fri, 15 Nov 2024 15:36:18 +0000 (UTC) ARC-Seal: i=1; s=arc-2022; d=mailchannels.net; t=1731684977; a=rsa-sha256; cv=none; b=6NEIAbOBSCMrPiXw4NjmxVM/6BzhBShtp2JovtxtidgVKf4Ha7ImvtwfKxFV6k9oJo67B5 k7LmJdk4WiIT7lq/EmzYMH1ckxbPZJ4K1N64l7Cw/JaNloYWCxof8Kd+0szQ2X2o9ZAOa/ 516S6lF51Vlxc4h1hKlC2yd+AhEyj5IZ9FwNe2/QxiikOjbU0bBDHcW8GRfrCi3YFBV7Aa 5hjFdq6SnY/SdjayCK3pT7ywoQZrjXZre5Y+Ne+wWZQ6kgtJPscoeVpK7DimUDpnE9K/hy WhILlnox6Z0rdrDTakEVywki7Itw0JSgo4bTq3u3NxwMAv/272Vit7L6+X2BUw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=mailchannels.net; s=arc-2022; t=1731684977; h=from:from:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references; bh=7Yh1+5fWzX970rwxtvbEVrMRiajhAfydhPIdsXLMTtg=; b=l2t2lr2qtm27X2tyD9N9SCiSQtvoEk4u6uAousmqOc0+7OcLybAS19hAlr1/wKFn+qwsNO hVWgjwDGuA6EyGuILjwacoaVwXZZUJf0+ksB/aDPFVl3px8PiszjTqz+z3bib5qUco8UnA G97fs3TDvmNBZVSmmmIonNUW1G8OP02YwxrFGg2PIXn/oclgwQ5ZZSWVTSKfnUqUif2U3e JhTD8Io+htyoqtNk8MVQ6do1TNERVwKUQlJirAvHQ6/J0ztdF6O2IDD0j0bxReSOOC6ZXF jllWAYuQJ9KoiiW5/XkR8KAXWALMvmDSLc7ndzy7/W1zdTkR2tEPg+EpRRwczg== ARC-Authentication-Results: i=1; rspamd-7456989c76-gt2j8; auth=pass smtp.auth=thundermail smtp.mailfrom=confabulate@kintzios.com X-Sender-Id: thundermail|x-authsender|confabulate@kintzios.com X-MC-Relay: Neutral X-MailChannels-SenderId: thundermail|x-authsender|confabulate@kintzios.com X-MailChannels-Auth-Id: thundermail X-Spill-Snatch: 20b07d0143a6a2f8_1731684977900_1606167813 X-MC-Loop-Signature: 1731684977900:3324737170 X-MC-Ingress-Time: 1731684977899 Received: from mailclean11.thundermail.uk (mailclean11.thundermail.uk [149.255.60.66]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384) by 100.112.137.74 (trex/7.0.2); Fri, 15 Nov 2024 15:36:17 +0000 Received: from cloud238.thundercloud.uk (cloud238.thundercloud.uk [149.255.62.116]) by mailclean11.thundermail.uk (Postfix) with ESMTPS id 832081E0005 for ; Fri, 15 Nov 2024 15:36:15 +0000 (GMT) Authentication-Results: cloud238.thundercloud.uk; spf=pass (sender IP is 217.169.3.230) smtp.mailfrom=confabulate@kintzios.com smtp.helo=rogueboard.localnet Received-SPF: pass (cloud238.thundercloud.uk: connection is authenticated) From: Michael To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] Seagate hard drives with dual actuators. Date: Fri, 15 Nov 2024 15:35:53 +0000 Message-ID: <115451235.nniJfEyVGO@rogueboard> In-Reply-To: <471aaa99-dcd1-e9e6-dcc8-725664363b62@gmail.com> References: <2965683.e9J7NaK4W3@rogueboard> <471aaa99-dcd1-e9e6-dcc8-725664363b62@gmail.com> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart2486496.jE0xQCEvom"; micalg="pgp-sha256"; protocol="application/pgp-signature" X-PPP-Message-ID: <173168497414.1905762.17934989968936213188@cloud238.thundercloud.uk> X-PPP-Vhost: kintzios.com X-Spamd-Result: default: False [-1.51 / 999.00]; SIGNED_PGP(-2.00)[]; MID_RHS_NOT_FQDN(0.50)[]; ONCE_RECEIVED(0.20)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; MX_GOOD(-0.01)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_TLS_ALL(0.00)[]; DMARC_POLICY_ALLOW(0.00)[kintzios.com,none]; FROM_HAS_DN(0.00)[]; FUZZY_RATELIMITED(0.00)[rspamd.com]; REPLYTO_DOM_NEQ_TO_DOM(0.00)[]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MISSING_XM_UA(0.00)[]; ASN(0.00)[asn:34931, ipnet:149.255.60.0/22, country:GB]; MIME_TRACE(0.00)[0:+,1:+,2:~]; TO_DN_NONE(0.00)[]; REPLYTO_ADDR_EQ_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[gentoo-user@lists.gentoo.org]; R_DKIM_NA(0.00)[]; NEURAL_HAM(-0.00)[-0.999]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(0.00)[+mx]; HAS_REPLYTO(0.00)[confabulate@kintzios.com] X-Rspamd-Queue-Id: 832081E0005 X-Rspamd-Action: no action X-Rspamd-Server: mailclean11 X-Archives-Salt: dbfbb341-09a0-45bf-8cba-6e25774b382b X-Archives-Hash: 13d3d39ff5128745f516c770e5d01fc6 --nextPart2486496.jE0xQCEvom Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="utf-8"; protected-headers="v1" From: Michael To: gentoo-user@lists.gentoo.org Reply-To: confabulate@kintzios.com Subject: Re: [gentoo-user] Seagate hard drives with dual actuators. Date: Fri, 15 Nov 2024 15:35:53 +0000 Message-ID: <115451235.nniJfEyVGO@rogueboard> In-Reply-To: <471aaa99-dcd1-e9e6-dcc8-725664363b62@gmail.com> MIME-Version: 1.0 On Friday 15 November 2024 11:59:34 GMT Dale wrote: > Michael wrote: > > On Friday 15 November 2024 05:53:53 GMT Dale wrote: > >> The thing about my data, it's mostly large video files. If I were > >> storing documents or something, then SSD or something would be a good > >> option. Plus, I mostly write once, then it either sits there a while or > >> gets read on occasion. > > > > For a write once - read often use case, the SMR drives are a good > > solution. > > They were designed for this purpose. Because of their shingled layers > > they > > provide higher storage density than comparable CMR drives. > > True but I don't like when I'm told a write is done, it kinda isn't. I > recall a while back I reorganized some stuff, mostly renamed directories > but also moved some files. Some were Youtube videos. It took about 30 > minutes to update the data on the SMR backup drive. The part I see > anyway. Right there is your problem, "... SMR backup drive". SMRs are best suited to sequential writes. With repeat random writes they go into a read-modify-write cycle and slow down. Consequently, they are well suited to storage of media files, archiving data long term and such write-once read-often applications. They are not suited to heavy transactional loads and frequently overwritten data. > It sat there for a hour at least doing that bumpy thing before > it finally finished. I realize if I just turn the drive off, the data > is still there. Still, I don't like it appearing to be done when it > really is still working on it. SMR drives have to read a whole band of shingled tracks, modify the small region where the data has changed and then write the whole band of tracks back on the disk in one go. The onboard cache on drive managed SMRs (DM-SMR) is meant to hide this from the OS by queuing up writes before writing them on the disk in a sequential stream, but if you keep hammering it with many random writes you will soon exhaust the onboard cache and performance then becomes glacial. Host managed SMRs (HM-SMR) require the OS and FS to be aware of the need for sequential writes and manage submitted data sympathetically to this limitation of the SMR drive, by queuing up random writes in batches and submitting these as a sequential stream. I understand the ext4-lazy option and some patches on btrfs have improved performance of these filesystems on SMR drivers, but perhaps f2fs will perform better? :-/ > Another thing, I may switch to RAID one > of these days. If I do, that drive isn't a good option. Ugh! RAID striping will combine shingled bands across drives. A random write on one drive will cause other drives to read-modify-write bands. Whatever speed benefit is meant to be derived from striping will be reversed. On a NAS application, where many users could be accessing the storage simultaneously trying to save their interwebs downloads, etc., the SMR performance will nose dive. > When I update my backups, I start the one I do with my NAS setup first. > Then I start the home directory backup with the SMR drive. I then > backup everything else I backup on other drives. I do that so that I > can leave the SMR drive at least powered on while it does it's bumpy > thing and I do other backups. Quite often, the SMR drive is the last > one I put back in the safe. That bumpy thing can take quite a while at > times. Instead of using the SMR for your /home fs backup, you would do better if you repurposed it for media files and document backups which do not change as frequently. --nextPart2486496.jE0xQCEvom Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part. Content-Transfer-Encoding: 7Bit -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEXqhvaVh2ERicA8Ceseqq9sKVZxkFAmc3alkACgkQseqq9sKV ZxlRXA//cFvP/HeA9FzchtzdrtAae7q3MQsF1YY9b7M7G5bphbK+qgIda+ZTmWHl FzkazDpk3rileFf3QrHarXvtrsCz/xghXKAjHoPHzdtm9QNiDlDeFZm/6STSNcky hHu1u0husnq2PoIhg2AtsvVf6A9ZTytvNQfehMBUcO7WgTQ63Fz/pcn7S0IMvR2V jtf2sLnsPrmx9rgU8IUJUqnouhkBf5143vf1t0m7ycikO/miDEdWtwiX+Ev+i+28 XRp/AgDLY18SxIgyvpMQ9M8qz2fF0TfRMMNZ5DIundl2bCUenArmO0uO/eCyiM98 B8IJXUwu7g/Yv3qeBJkHx4ocVlaMItNsRtJ8X6A0lRsVdfkVyLzMGeFaiWY1CHS4 zbbR2EVn08mMj6tmWRLw6JG5gb+yVkPm18Ra7PuPwQhCvJYThrEPVfFmn29d8VMA VjkkLS2WAiEBOtPZ9UWjS92wwplVmc8jeHztq7I8PZTWb272j18CA7xS6/G71CHz 6bxpPIzoFOVDEIt3BCnB0+BZtR/52G8/4kJwdbEUXOY6UVzmYYmH/KAXHsIJQLNq s1K7J7mbtFuXf8JQ645GgQOt3ES4AujwsVDisSp2K+pC7Cttb5U0hDW2Um6Bv/Te On9B1Lkn4YJFVQnOlR7qTqFn/DtT1QOaGE1KYUOLC/OX93ZE8f8= =3REc -----END PGP SIGNATURE----- --nextPart2486496.jE0xQCEvom--