[gentoo-project] Re: [gentoo-core] dipper.gentoo.org outage post-mortem

[Benda Xu]

Kristian Fiskerstrand <k_f@g.o> writes:

> On 05/19/2016 08:44 PM, Robin H. Johnson wrote:
>> Summary
>> -------
>> - dipper.gentoo.org suffered a major motherboard failure on Friday, May 13th.
>> - The outage started around 2016/05/13 08h56 UTC, and was mostly resolved
>>   at 2016/05/14 20h53 UTC, approximately 36 hours in duration.
>> - During this time, no rsync updates were issued, nor were distfiles,
>>   releases or snapshots updated.
>> - New hardware purchasing is planned to recover capacity & mitigate
>>   hardware old-age.
>
> ...
>
>> Future actions to improve outcome:
>> - Move rsync & snapshot generation to a dedicated redundant VM
>> - Improve distfiles/release tarball process to have more redundancy,
>>   perhaps push-based.
>> - Encourage cleanups of roverlay/tinderbox/devbox VMs to shrink size.
>>
>
> Thank you for the post mortem on the failure Robin. I've said it before
> and I'll say it again; I think this outage was well handled!

Yeah, I would like to thank the infra team for their hard work.

I think this outage was well handled! +1

And thank you Robin for the well-summed-up post-mortem.

Benda