[gentoo-user] Shared distfiles directory between different virtual machines

[gentoo-user] Shared distfiles directory between different virtual machines

[whiteman808]

Hi,

Let's say I have a shared by NFS /var/cache/distfiles directory between 
miscellaneous Gentoo VMs whose purpose is to build binaries for 
different machines.

How can I prevent portage from overwriting the same source files in the 
distfiles directory and possible checksum mismatches caused by that 
behavior if I tell emerge to update @world simultaneously on these 
different binary package servers?

Thank you,
whiteman808

[gentoo-user] Re: Shared distfiles directory between different virtual machines

[Holger Hoffstätte]

On 2024-11-06 18:16, whiteman808 wrote:
> How can I prevent portage from overwriting the same source files in
> the distfiles directory and possible checksum mismatches caused by
> that behavior if I tell emerge to update @world simultaneously on
> these different binary package servers?

portage uses a lockfile for every download, so the problem does not exist.

-h

Re: [gentoo-user] Re: Shared distfiles directory between different virtual machines

[whiteman808]

What in case when two lock files are being created at the same time? How 
can I prevent in this case emerge fail?

On 11/6/24 18:24, Holger Hoffstätte wrote:
> On 2024-11-06 18:16, whiteman808 wrote:
>> How can I prevent portage from overwriting the same source files in
>> the distfiles directory and possible checksum mismatches caused by
>> that behavior if I tell emerge to update @world simultaneously on
>> these different binary package servers?
> 
> portage uses a lockfile for every download, so the problem does not exist.
> 
> -h
> 

Re: [gentoo-user] Re: Shared distfiles directory between different virtual machines

[Filip Kobierski]

[-- Attachment #1.1: Type: text/plain, Size: 835 bytes --]

AFAIR creating a file (adding an entry to a dir's list) is an atomic operation so that problem also is solved.


-------- Original Message --------
On 11/6/24 18:39, whiteman808 <whiteman808@paraboletancza.org> wrote:

>  What in case when two lock files are being created at the same time? How
>  can I prevent in this case emerge fail?
>  
>  On 11/6/24 18:24, Holger Hoffstätte wrote:
>  > On 2024-11-06 18:16, whiteman808 wrote:
>  >> How can I prevent portage from overwriting the same source files in
>  >> the distfiles directory and possible checksum mismatches caused by
>  >> that behavior if I tell emerge to update @world simultaneously on
>  >> these different binary package servers?
>  >
>  > portage uses a lockfile for every download, so the problem does not exist.
>  >
>  > -h
>  >
>  
>  
>

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 249 bytes --]

Re: [gentoo-user] Re: Shared distfiles directory between different virtual machines

[Grant Taylor]

On 11/6/24 11:39, whiteman808 wrote:
> What in case when two lock files are being created at the same time? How 
> can I prevent in this case emerge fail?

Have you actually experienced this type of failure?

Or are you just thinking about worst case?

I've been sharing distfiles between multiple systems over NFS for years 
and not had a problem.  Granted, usually the systems aren't emerging at 
the same time.



-- 
Grant. . . .