| 1 |
On 05/19/2016 08:44 PM, Robin H. Johnson wrote: |
| 2 |
> Summary |
| 3 |
> ------- |
| 4 |
> - dipper.gentoo.org suffered a major motherboard failure on Friday, May 13th. |
| 5 |
> - The outage started around 2016/05/13 08h56 UTC, and was mostly resolved |
| 6 |
> at 2016/05/14 20h53 UTC, approximately 36 hours in duration. |
| 7 |
> - During this time, no rsync updates were issued, nor were distfiles, |
| 8 |
> releases or snapshots updated. |
| 9 |
> - New hardware purchasing is planned to recover capacity & mitigate |
| 10 |
> hardware old-age. |
| 11 |
|
| 12 |
... |
| 13 |
|
| 14 |
> Future actions to improve outcome: |
| 15 |
> - Move rsync & snapshot generation to a dedicated redundant VM |
| 16 |
> - Improve distfiles/release tarball process to have more redundancy, |
| 17 |
> perhaps push-based. |
| 18 |
> - Encourage cleanups of roverlay/tinderbox/devbox VMs to shrink size. |
| 19 |
> |
| 20 |
|
| 21 |
Thank you for the post mortem on the failure Robin. I've said it before |
| 22 |
and I'll say it again; I think this outage was well handled! |
| 23 |
|
| 24 |
-- |
| 25 |
Kristian Fiskerstrand |
| 26 |
OpenPGP certificate reachable at hkp://pool.sks-keyservers.net |
| 27 |
fpr:94CB AFDD 3034 5109 5618 35AA 0B7F 8B60 E3ED FAE3 |
Archives