From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 5F410158042 for ; Fri, 15 Nov 2024 05:54:04 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 78109E0982; Fri, 15 Nov 2024 05:53:57 +0000 (UTC) Received: from mail-yb1-xb30.google.com (mail-yb1-xb30.google.com [IPv6:2607:f8b0:4864:20::b30]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 3276FE096A for ; Fri, 15 Nov 2024 05:53:57 +0000 (UTC) Received: by mail-yb1-xb30.google.com with SMTP id 3f1490d57ef6-e382350652bso520930276.3 for ; Thu, 14 Nov 2024 21:53:57 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1731650036; x=1732254836; darn=lists.gentoo.org; h=content-transfer-encoding:in-reply-to:mime-version:user-agent:date :message-id:autocrypt:from:references:to:subject:from:to:cc:subject :date:message-id:reply-to; bh=q6TBrtD8HGai7m8+g4EIKQTj18RYWaVj4yc0mD+CcY0=; b=MW1yqyrbZIcxzDYDcTV23U+pjGT1BunVBhiXvMLISBQZOgSyw+OmrdPZBCQ/q9JknZ jERUDmRD9dK+l+YaLUqxX0MRW87kjmNiXCbcqcpj4lhgejl6tPVpQQTj9t3axu6xHGUO b/HOw5/AudhSWRtHl49TBJf+7bKmJ1seZQYFVN24yZOW3Ic77E9JSRBD68Noqzb4szaY imRyxoMH4QqgoDGy/zHyUsqHyJvR9An0vDPCMJnDfEvwiE1IqCd+qG16xi8fc/b1ReZS /Ss38+ONJtBA7PkjcZyxSFiLRifhk2ssELQ4y/3MxrQCKsezEc1r6yIWaURAmVfYdorn JyZg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1731650036; x=1732254836; h=content-transfer-encoding:in-reply-to:mime-version:user-agent:date :message-id:autocrypt:from:references:to:subject:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=q6TBrtD8HGai7m8+g4EIKQTj18RYWaVj4yc0mD+CcY0=; b=Dhyx3PWsEbH7TATTKLYdwHa1llU08xmH8gkraG5U/Dp5j9X9t51QB/nCbua8Uhh4XN MZhybPM0CpTL1C2LXgaQ4oTyqMD/lm19H9MoU2bJG5UjVpA66+b1xBIQgVek++8V4lOe RW9FmxiVRvVtJDtwBCykuvAFzuH9Z7XgfjwFLbmx6pe759azPHw8lKmaQh/vnyW9i8sR 02mlQD7tDLNKTFmz2JMYdXXhv/1JTlypCDB4m5bHSGsL0MEqvKfP1bF94uZPxZ2/ypuO FOotmIVnDm3j5DgGm8CS7qExyyOOmYekrm0/mckjFVrHmaSA+m3VSrljrncQgKe0eqr8 eZbA== X-Gm-Message-State: AOJu0YzQ5H85kLRIuTtQpe2qRqXLEK4ABSY/osVP7utduNRnMZo4BLJV uQSSzxxZmvhHPU3T1AclrLJH4MPSQopFPeN2nTMW2vRdujc2Y2aL X-Google-Smtp-Source: AGHT+IGMRXEAO6+czMSObBZozSI45NAMa6IM/uyPt4OyMQUXxKEqrd6FQ1Mmrb2wUDexWBgkyNU8SA== X-Received: by 2002:a05:6902:c09:b0:e38:19a6:bbb7 with SMTP id 3f1490d57ef6-e382612c2a7mr1668667276.18.1731650036254; Thu, 14 Nov 2024 21:53:56 -0800 (PST) Received: from [10.8.8.10] ([92.119.19.11]) by smtp.gmail.com with ESMTPSA id 3f1490d57ef6-e384d703f4fsm24444276.10.2024.11.14.21.53.54 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 14 Nov 2024 21:53:55 -0800 (PST) Subject: Re: [gentoo-user] Seagate hard drives with dual actuators. To: gentoo-user@lists.gentoo.org References: <1879585.atdPhlSkOF@rogueboard> <5835905.DvuYhMxLoT@rogueboard> <6461ae0f-3a98-6325-9915-3c78b0df237a@gmail.com> <63e3fac6-1758-b5c2-2c92-312d64d547e3@gmail.com> From: Dale Autocrypt: addr=rdalek1967@gmail.com; prefer-encrypt=mutual; keydata= mQINBGFSciYBEADcEGMyJBSuavKO/XKUVvgkxck7Nl8Iuu8N2lcnRji/rSKg5c1Acix1ll9i oW8JBCHwvn0+Xy60BvEsqcup3YSHw5STl/bR1ePEehtnYrg8FdjdS91+B805RfnKMm69rFVI wLSBHQrSG1yxHd8CloWoEdhmVtP24buajbh114bgXd9ahtpZrCVMrWdWYUg2mEXguGV5uNAh Rf8SWxDNc79w24JxsV34a8niMUYMjzWr0rafIbzk732X38vGjVMLo/2mMpkbp9mPp++LHoY+ 0Pet8zxxdXPJSCd475kza1AD+hhSyBZXB9yknYWgyY3cZe1rGmooJSi2KX4QxO7npwLThcO1 be6KKRkd35+Fi/a1BzVOHsZMiK/gcwxEFoMd27gir4ehaeHJfFXl+65w4hj0EsOZSxrJrm2C R50g5By2czSKP1bADEygFNpIJj51AR+wM88NImG2RPtlT2maYBzazvF05g65cdHXGp1C7W5P wwwKU2DgABB2t7N7z5A69LnryBRw4zUYDRRYLTYlBlYgg+xILm2c0OrBdxJgLJa7JE50Eo25 d3PFwt9J0gYvqy6sPFLl9So0sDg9zm0hKQtXOP5kgropUFGrNoJI+mjwF4rYLRBVzZwNAvlO OhEvHubBo3mEllv4x+FeptwXZxlk7gUsdqI8AxnFB8K9wi6FVQARAQABtBtEYWxlIDxyZGFs ZWsxOTY3QGdtYWlsLmNvbT6JAk4EEwEIADgCGyMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AW IQQSG1h01ruv/WNXc3Q3RqOgiQH1GwUCYVJy8gAKCRA3RqOgiQH1G+waEACeTZCt77jnRAmQ AV7otKuZekDWiLi3Eig8tj5ZJiCNSYA/hIxzmexRP0GMqjitcXK1iGwWcvMzzvIq30GAjIfB 4BR38cnXbtBa6fNewiT7QaZe/Hn6yBRldXNQypzbHy+/o27bUEy+oX4rE7etUgEHQAjuw7xz XFWg4tH1/KJvsOVY5upnWc5LdxYhsuQ3dQD4b22GsK0pOBDfb9PiirYM8eGKvrVuq4E/c75z lDDFhINl18lNZ9D0ZFL3IkTjHsAAqFH9uhnnEB8CWdHbBewPEfRaOhBUYWZ3Q8uTkmDgZT8q D9jlvLEdw7Nh2ApdxoepnI/4D+ql2Gr4DtH7SEPydr5gcf1Qr/2bXRb1hAYnIVcbncs/Bm3Z bkRKPVWMfE3Fusa+p5hMzixk0YysMaTHlc7mYRYAEZGnPMXnmcCbetwARU7A0yz1M1kCMOAQ Lsz8KH5kv3cRenMB6SFfjND2JfAK61H5TtnPq3L8noS2ZykRYxq9Nm3X64O1tJojIKBoZFr8 AwYNCvqC6puUyGMuzHPh7jPof8glfrrEKIYUvNPGMDoVX3IGetxh/9l6NcxgFA4JGoR+LS3C zmeNrwlllAe3OEUfKoWVQ+pagpSdM+8hHolaSda4Ys66Z3fCR4ZvcTqfhTAVskpqdXa4isAk 7vTcXu3L499ttywEp7rJTbkCDQRhUnImARAAncUdVhmtRr59zqpTUppKroQYlzR0jv8oa7DG K4gakTAT2N7evnI9wpssmzyVk8VEiLzhnFQ/Ol3FRt6hZCXDJt0clyHOyTfvz/MNFttWuZTc mLpSvmRR6VRjAH+Tz3Eam2xUw3PGuH97BcXQ3NnX3msv1UDxtxxBu6e2YrdeOhrCUSgzokcJ 98ChUNy934cgepPybAI12lSWqVFQ1aG7jExZfiUk+333fPSDbpKoZbTW5YJLXbycmW/C1IWL qYQyNjRWKaGoJtUWFhhmNiOQct7n90aKivNVPavmN+UQ9LlMaINtf9T6XCzLfogCFsulDCDJ 0yNQLDTurHaB4E71xoctgXmLLq9z1RQ0W2XiVAAOZQj6K3+d0AOUjDhCQ2QW8dUSq0ckkZXV DKVJOGS8Nhf2eIWIqRnP3AcUiiaiFGqUaVUmUAZ6h/oJmgghEu/1S+pcuUKU5i69+XCZ3hH2 Jzwzbf7K+FAIkOhCfHncF8i1N1pk00pOVykNnqHTfFo3qFusHt0ZWgXVnnn4pYdXqZNoDhvF BRE5Vm4k/k96Pw8HRx6Os6eFSRrlqGzRgqsu86FekxusXB9UGv4lJhtU/J+8MRWsh22K718s DbQnABicGKFz1qQlWvcf59oTByhLINJCBt1WXl+TzJDXepr3QSkqmK41dO9Hob97C9dMiK8A EQEAAYkCNgQYAQgAIAIbDBYhBBIbWHTWu6/9Y1dzdDdGo6CJAfUbBQJhUnLyAAoJEDdGo6CJ AfUbVHIQAKSWw620vPhR3A/njU2z77F3z/Jk+HTKdE3fIyWSWdkYN7CBFL0NguOMP30WZ+qE sJhZu7T5hf251MwQUUt27xlfnKYOmQs7CqONlXuXlGZI6WufrUjxNcVz+5gJsqvUWuuJWsgg sDmE92IBnfG/f81fPHWQyfr/SF4wYDMyoFp5xCCQpp1zB63iuFvvrhxBkEHzmbRtVDOhl0Xp BVEDR1w3QRACw9QJD/KM05Czv9JNQYlwinWO/OaQ9cMlUpKLgswUPg9IZ5vucxScfuAUA5uC B1jlAQ8ZPlVukBmbEv5RGOv+lpuEbA3YDMVtEeH4YMFbjt/+vH3Cr2vTbp5JlpByLburJEH0 WXZLUawEfUsZvVwpOuJK75vaa2HYXee+Cb3iCIzwfIfctdlqzUcbGRczlRNM59hpvj4z29Gh 3kAxVHItAYq54ikxQ9l4hQ8s9sLYPbX/WtcBxNX8crBSw0FLnmzGleVEtBHyqtt5CLzQNgrj GYWl1vKDUmRPw1CdZ1c+fMN9CY11jOM5B5ZnqZWfDeVYO2iJ5SuvTycChexCb8WYn1bdCBIo bBtga2RBXbVt4Mh9E4owsszefn51MwfjXxB20Fc5k3GU1AVpTCMs3ayYCzo0b2pvEvdjtDcA CYLEFPWgaFX9iQAM/CDfKvTtvgGWpqtCL2raq/mQoJEU Message-ID: Date: Thu, 14 Nov 2024 23:53:53 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Firefox/91.0 SeaMonkey/2.53.19 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Archives-Salt: acaf783e-087c-4393-8ac1-fa604f33727c X-Archives-Hash: ed89ac27089fa091cc22527ec4e4551e Rich Freeman wrote: > On Thu, Nov 14, 2024 at 6:10 PM Dale wrote: >> The biggest downside to the large drives available now, even if SMART >> tells you a drive is failing, you likely won't have time to copy the >> data over to a new drive before it fails. On a 18TB drive, using >> pvmove, it can take a long time to move data. > Very true. This is why I'm essentially running RAID6. Well, that and > for various reasons you don't want to allow writes to Ceph without at > least one drive worth of redundancy, so having an extra replica means > that you can lose one and remain read-write, and then if you lose a > second during recovery you might be read-only but you still have data > integrity. (Don't want to get into details - it is a Ceph-specific > issue.) I think I did some math on this once.  I'm not positive on this and it could vary depending on system ability of moving data.  I think about 8TB is as large as you want if you get a 24 hour notice from SMART and see that notice fairly quickly to act on.  Anything beyond that and you may not have enough time to move data, if the data is even good still.  >> I don't even want to think what it would cost to put >> all my 100TBs or so on SSD or NVME drives. WOW!!! > # kubectl rook-ceph ceph osd df class ssd > ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP > META AVAIL %USE VAR PGS STATUS > 8 ssd 6.98630 1.00000 7.0 TiB 1.7 TiB 1.7 TiB 63 MiB 3.9 > GiB 5.3 TiB 24.66 1.04 179 up > 4 ssd 1.74660 1.00000 1.7 TiB 465 GiB 462 GiB 16 MiB 2.5 > GiB 1.3 TiB 25.99 1.10 45 up > 12 ssd 1.74660 1.00000 1.7 TiB 547 GiB 545 GiB 30 MiB 2.1 > GiB 1.2 TiB 30.57 1.29 52 up > 1 ssd 6.98630 1.00000 7.0 TiB 1.7 TiB 1.7 TiB 50 MiB 4.2 > GiB 5.3 TiB 24.42 1.03 177 up > 5 ssd 6.98630 1.00000 7.0 TiB 1.8 TiB 1.8 TiB 24 MiB 5.0 > GiB 5.2 TiB 25.14 1.07 180 up > 3 ssd 1.74660 1.00000 1.7 TiB 585 GiB 583 GiB 18 MiB 2.0 > GiB 1.2 TiB 32.70 1.39 57 up > 21 ssd 1.74660 1.00000 1.7 TiB 470 GiB 468 GiB 27 MiB 1.9 > GiB 1.3 TiB 26.26 1.11 52 up > 9 ssd 1.74660 1.00000 1.7 TiB 506 GiB 504 GiB 11 MiB 2.0 > GiB 1.3 TiB 28.29 1.20 49 up > 18 ssd 1.74660 1.00000 1.7 TiB 565 GiB 563 GiB 16 MiB 1.7 > GiB 1.2 TiB 31.59 1.34 55 up > 10 ssd 1.74660 1.00000 1.7 TiB 490 GiB 489 GiB 28 MiB 1.6 > GiB 1.3 TiB 27.42 1.16 53 up > 22 ssd 1.74660 1.00000 1.7 TiB 479 GiB 478 GiB 19 MiB 1.7 > GiB 1.3 TiB 26.80 1.14 50 up > 19 ssd 13.97249 1.00000 14 TiB 2.3 TiB 2.3 TiB 87 MiB 5.2 > GiB 12 TiB 16.81 0.71 262 up > TOTAL 49 TiB 12 TiB 12 TiB 388 MiB 34 > GiB 37 TiB 23.61 > > I'm getting there. Granted, at 3+2 erasure coding that's only a bit > over 30TiB usable space. > The thing about my data, it's mostly large video files.  If I were storing documents or something, then SSD or something would be a good option.  Plus, I mostly write once, then it either sits there a while or gets read on occasion.  I checked and I have some 56,000 videos.  That doesn't include Youtube videos.  This is also why I wanted to use that checksum script.  I do wish there was a easy way to make columns work when we copy and paste into email.  :/  Dale :-)  :-)