From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 402A3158083 for ; Sat, 14 Sep 2024 19:46:43 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 1277CE29BA; Sat, 14 Sep 2024 19:46:38 +0000 (UTC) Received: from mail-yw1-x1131.google.com (mail-yw1-x1131.google.com [IPv6:2607:f8b0:4864:20::1131]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id C49F9E29A6 for ; Sat, 14 Sep 2024 19:46:37 +0000 (UTC) Received: by mail-yw1-x1131.google.com with SMTP id 00721157ae682-6b47ff8a59aso16541127b3.2 for ; Sat, 14 Sep 2024 12:46:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1726343197; x=1726947997; darn=lists.gentoo.org; h=content-transfer-encoding:in-reply-to:mime-version:user-agent:date :message-id:autocrypt:from:references:to:subject:from:to:cc:subject :date:message-id:reply-to; bh=F1UTHIc4ZtH9nhlK9R4hSCujtAf5LY06i8grMsnjluM=; b=FgBb8tNhwSLV97CYO8eRIlBEg6lB/9hfYLOztQq0Q+VazXmS3RtAKGkhHrbb9W87Ak ylQEnq+9dTQHCqUG8rXh0gue3CxOjHTluvsOOXuxzjXL/u7D8OynIhQC6HkHdfs5NOyJ JHHHAfu/2GqQbIBza0gkjR5V40biP/4HeB/rH4Ks5B6ezUUcP65ZVW+CJcaECxQRzbWa cxHk6NO6J9TfeSUKoBIZZMZLnYHR1gFPkwfPvt6phuSvdIcYq23S5lizpMBgT20nsi/h b2nFd1HphK+gfoXbKbTzNfqlxyF0MbF28rChzAKZmM4mk00mfSj4kA5/hj8hlllDoOlm wfXw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1726343197; x=1726947997; h=content-transfer-encoding:in-reply-to:mime-version:user-agent:date :message-id:autocrypt:from:references:to:subject:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=F1UTHIc4ZtH9nhlK9R4hSCujtAf5LY06i8grMsnjluM=; b=voMZkZQiBttLw5IR/9hCHvCnACVHKgnOnpmO14tb1MLkZUww+fgw8g2l63tc8356ni Ulj0PHHstL1gyaSSYWB9JHp3b/feyBV8RMGUiHKqqKAGEH/zR2If9gdn5w6jpTdrMNST zQBlBiLlt11kZFfdnmnAMw9PxsXOzeLW4ps7Qod7+3zCDUhiGJNxfC/16uoo1vhdDRVo x0iZ5yGMF/MitijqiAu0lySIdPwGd7ZkMksJGbE+4CR56TXhfbQhK36ahvFA/unQ8s/f 0CvN0ulBHbNCb7nDNL5Jws9/4xfkoAuCC+Eex6NR2ChX7bKnuUDWT4ETAlOu5DtpY5cI rHsw== X-Gm-Message-State: AOJu0YzMFwZp6Y6EsJOMAIksfxRy+6QDn0P83xraLlvWqPhzQIqmIaFu pKh7/DnNWqeM3IA4kIx7g4VcZMoCK/3REzTUqmFhZpBmz1aDq9zr X-Google-Smtp-Source: AGHT+IEnWXQuS0hXa4Rtikdx42AB5IXRDQeCGq4WNADukOirYUBDyF19ZLoS6Tp6ayIYSsRQ+xplOA== X-Received: by 2002:a05:690c:6c93:b0:62c:c684:b1e1 with SMTP id 00721157ae682-6dbcc579b33mr58839697b3.29.1726343196680; Sat, 14 Sep 2024 12:46:36 -0700 (PDT) Received: from [10.8.8.3] ([195.181.171.239]) by smtp.gmail.com with ESMTPSA id 00721157ae682-6dbe49aff95sm2999977b3.90.2024.09.14.12.46.35 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sat, 14 Sep 2024 12:46:36 -0700 (PDT) Subject: Re: [gentoo-user] Re: Package compile failures with "internal compiler error: Segmentation fault". To: gentoo-user@lists.gentoo.org References: <8c26be16-d033-ea3f-06e1-a9ce84cbbafb@gmail.com> <7866172.lvqk35OSZv@rogueboard> <15276605.tv2OnDr8pf@rogueboard> From: Dale Autocrypt: addr=rdalek1967@gmail.com; prefer-encrypt=mutual; keydata= mQINBGFSciYBEADcEGMyJBSuavKO/XKUVvgkxck7Nl8Iuu8N2lcnRji/rSKg5c1Acix1ll9i oW8JBCHwvn0+Xy60BvEsqcup3YSHw5STl/bR1ePEehtnYrg8FdjdS91+B805RfnKMm69rFVI wLSBHQrSG1yxHd8CloWoEdhmVtP24buajbh114bgXd9ahtpZrCVMrWdWYUg2mEXguGV5uNAh Rf8SWxDNc79w24JxsV34a8niMUYMjzWr0rafIbzk732X38vGjVMLo/2mMpkbp9mPp++LHoY+ 0Pet8zxxdXPJSCd475kza1AD+hhSyBZXB9yknYWgyY3cZe1rGmooJSi2KX4QxO7npwLThcO1 be6KKRkd35+Fi/a1BzVOHsZMiK/gcwxEFoMd27gir4ehaeHJfFXl+65w4hj0EsOZSxrJrm2C R50g5By2czSKP1bADEygFNpIJj51AR+wM88NImG2RPtlT2maYBzazvF05g65cdHXGp1C7W5P wwwKU2DgABB2t7N7z5A69LnryBRw4zUYDRRYLTYlBlYgg+xILm2c0OrBdxJgLJa7JE50Eo25 d3PFwt9J0gYvqy6sPFLl9So0sDg9zm0hKQtXOP5kgropUFGrNoJI+mjwF4rYLRBVzZwNAvlO OhEvHubBo3mEllv4x+FeptwXZxlk7gUsdqI8AxnFB8K9wi6FVQARAQABtBtEYWxlIDxyZGFs ZWsxOTY3QGdtYWlsLmNvbT6JAk4EEwEIADgCGyMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AW IQQSG1h01ruv/WNXc3Q3RqOgiQH1GwUCYVJy8gAKCRA3RqOgiQH1G+waEACeTZCt77jnRAmQ AV7otKuZekDWiLi3Eig8tj5ZJiCNSYA/hIxzmexRP0GMqjitcXK1iGwWcvMzzvIq30GAjIfB 4BR38cnXbtBa6fNewiT7QaZe/Hn6yBRldXNQypzbHy+/o27bUEy+oX4rE7etUgEHQAjuw7xz XFWg4tH1/KJvsOVY5upnWc5LdxYhsuQ3dQD4b22GsK0pOBDfb9PiirYM8eGKvrVuq4E/c75z lDDFhINl18lNZ9D0ZFL3IkTjHsAAqFH9uhnnEB8CWdHbBewPEfRaOhBUYWZ3Q8uTkmDgZT8q D9jlvLEdw7Nh2ApdxoepnI/4D+ql2Gr4DtH7SEPydr5gcf1Qr/2bXRb1hAYnIVcbncs/Bm3Z bkRKPVWMfE3Fusa+p5hMzixk0YysMaTHlc7mYRYAEZGnPMXnmcCbetwARU7A0yz1M1kCMOAQ Lsz8KH5kv3cRenMB6SFfjND2JfAK61H5TtnPq3L8noS2ZykRYxq9Nm3X64O1tJojIKBoZFr8 AwYNCvqC6puUyGMuzHPh7jPof8glfrrEKIYUvNPGMDoVX3IGetxh/9l6NcxgFA4JGoR+LS3C zmeNrwlllAe3OEUfKoWVQ+pagpSdM+8hHolaSda4Ys66Z3fCR4ZvcTqfhTAVskpqdXa4isAk 7vTcXu3L499ttywEp7rJTbkCDQRhUnImARAAncUdVhmtRr59zqpTUppKroQYlzR0jv8oa7DG K4gakTAT2N7evnI9wpssmzyVk8VEiLzhnFQ/Ol3FRt6hZCXDJt0clyHOyTfvz/MNFttWuZTc mLpSvmRR6VRjAH+Tz3Eam2xUw3PGuH97BcXQ3NnX3msv1UDxtxxBu6e2YrdeOhrCUSgzokcJ 98ChUNy934cgepPybAI12lSWqVFQ1aG7jExZfiUk+333fPSDbpKoZbTW5YJLXbycmW/C1IWL qYQyNjRWKaGoJtUWFhhmNiOQct7n90aKivNVPavmN+UQ9LlMaINtf9T6XCzLfogCFsulDCDJ 0yNQLDTurHaB4E71xoctgXmLLq9z1RQ0W2XiVAAOZQj6K3+d0AOUjDhCQ2QW8dUSq0ckkZXV DKVJOGS8Nhf2eIWIqRnP3AcUiiaiFGqUaVUmUAZ6h/oJmgghEu/1S+pcuUKU5i69+XCZ3hH2 Jzwzbf7K+FAIkOhCfHncF8i1N1pk00pOVykNnqHTfFo3qFusHt0ZWgXVnnn4pYdXqZNoDhvF BRE5Vm4k/k96Pw8HRx6Os6eFSRrlqGzRgqsu86FekxusXB9UGv4lJhtU/J+8MRWsh22K718s DbQnABicGKFz1qQlWvcf59oTByhLINJCBt1WXl+TzJDXepr3QSkqmK41dO9Hob97C9dMiK8A EQEAAYkCNgQYAQgAIAIbDBYhBBIbWHTWu6/9Y1dzdDdGo6CJAfUbBQJhUnLyAAoJEDdGo6CJ AfUbVHIQAKSWw620vPhR3A/njU2z77F3z/Jk+HTKdE3fIyWSWdkYN7CBFL0NguOMP30WZ+qE sJhZu7T5hf251MwQUUt27xlfnKYOmQs7CqONlXuXlGZI6WufrUjxNcVz+5gJsqvUWuuJWsgg sDmE92IBnfG/f81fPHWQyfr/SF4wYDMyoFp5xCCQpp1zB63iuFvvrhxBkEHzmbRtVDOhl0Xp BVEDR1w3QRACw9QJD/KM05Czv9JNQYlwinWO/OaQ9cMlUpKLgswUPg9IZ5vucxScfuAUA5uC B1jlAQ8ZPlVukBmbEv5RGOv+lpuEbA3YDMVtEeH4YMFbjt/+vH3Cr2vTbp5JlpByLburJEH0 WXZLUawEfUsZvVwpOuJK75vaa2HYXee+Cb3iCIzwfIfctdlqzUcbGRczlRNM59hpvj4z29Gh 3kAxVHItAYq54ikxQ9l4hQ8s9sLYPbX/WtcBxNX8crBSw0FLnmzGleVEtBHyqtt5CLzQNgrj GYWl1vKDUmRPw1CdZ1c+fMN9CY11jOM5B5ZnqZWfDeVYO2iJ5SuvTycChexCb8WYn1bdCBIo bBtga2RBXbVt4Mh9E4owsszefn51MwfjXxB20Fc5k3GU1AVpTCMs3ayYCzo0b2pvEvdjtDcA CYLEFPWgaFX9iQAM/CDfKvTtvgGWpqtCL2raq/mQoJEU Message-ID: <5ad461dd-6122-ae67-5609-0a39d5a64fe1@gmail.com> Date: Sat, 14 Sep 2024 14:46:35 -0500 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Firefox/91.0 SeaMonkey/2.53.18.2 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Archives-Salt: 0b6da6af-f9c8-483c-9e40-b28251cd541b X-Archives-Hash: 982ebf51666245ebcf3204d1c84dcc88 Frank Steinmetzger wrote: > Am Fri, Sep 06, 2024 at 01:21:20PM +0100 schrieb Michael: > >>>> find path-to-directory/ -type f | xargs md5sum > digest.log >>>> >>>> then to compare with a backup of the same directory you could run: >>>> >>>> md5sum -c digest.log | grep FAILED > I had a quick look at the manpage: with md5sum --quiet you can omit the grep > part. > >>>> Someone more knowledgeable should be able to knock out some clever python >>>> script to do the same at speed. > And that is exactly what I have written for myself over the last 11 years. I > call it dh (short for dirhash). As I described in the previous mail, I use > it to create one hash files per directory. But it also supports one hash > file per data file and – a rather new feature – one hash file at the root of > a tree. Have a look here: https://github.com/felf/dh > Clone the repo or simply download the one file and put it into your path. > >>> I'll be honest here, on two points. I'd really like to be able to do >>> this but I have no idea where to or how to even start. My setup for >>> series type videos. In a parent directory, where I'd like a tool to >>> start, is about 600 directories. On a few occasions, there is another >>> directory inside that one. That directory under the parent is the name >>> of the series. > In its default, my tool ignores directories which have subdirectories. It > only hashes files in dirs that have no subdirs (leaves in the tree). But > this can be overridden with the -f option. > > My tool also has an option to skip a number of directories and to process > only a certain number of directories. > >>> Sometimes I have a sub directory that has temp files; >>> new files I have yet to rename, considering replacing in the main series >>> directory etc. I wouldn't mind having a file with a checksum for each >>> video in the top directory, and even one in the sub directory. As a >>> example. >>> >>> TV_Series/ >>> >>> ├── 77 Sunset Strip (1958) >>> │ └── torrent >>> ├── Adam-12 (1968) >>> ├── Airwolf (1984) > So with my tool you would do > $ dh -f -F all TV_Series > `-F all` causes a checksum file to be created for each data file. > >>> What >>> I'd like, a program that would generate checksums for each file under >>> say 77 Sunset and it could skip or include the directory under it. > Unfortunately I don’t have a skip feature yet that skips specific > directories. I could add a feature that looks for a marker file and then > skips that directory (and its subdirs). > I was running the command again and when I was checking on it, it stopped with this error.    File "/root/dh", line 1209, in     main()   File "/root/dh", line 1184, in main     directory_hash(dir_path, '', dir_files, checksums)   File "/root/dh", line 1007, in directory_hash     os.path.basename(old_sums[filename][1])                      ~~~~~~~~^^^^^^^^^^ KeyError: 'Some Video.mp4' I was doing a second run because I updated some files.  So, it was skipping some and creating new for some new ones.  This is the command I was running, which may not be the best way.  /root/dh -c -f -F 1Checksums.md5 -v That make any sense to you?  That's all it spit out.  Also, what is the best way to handle this type of situation.  Let's say I have a set of videos.  Later on I get a better set of videos, higher resolution or something.  I copy those to a temporary directory then use your dmv script from a while back to replace the old files with the new files but with identical names.  Thing is, file is different, sometimes a lot different.  What is the best way to get it to update the checksums for the changed files?  Is the command above correct?  I'm sometimes pretty good at finding software bugs.  But hey, it just makes your software better.  ;-)  Dale :-)  :-)