Lots of canary builders offline |
||||||
Issue descriptionLooking at the waterfall I see 15 of them: auron_paine-release, chell-release, cyan-release, etc. Assigning to the deputy to bring them back up
,
Mar 12 2018
,
Mar 12 2018
Rebooting them should fix it Name Builders BuildBot Admin Last heard from Connects/Hour Status build201-m2 betty-chrome-pfq - - 0 Not connected build234-m2 novato-arc64-release - - 0 Not connected cros-beefy24-c2 auron_paine-release - - 0 Not connected cros-beefy44-c2 lulu-release - - 0 Not connected cros-beefy61-c2 squawks-release - - 0 Not connected cros-beefy68-c2 ultima-release - - 0 Not connected cros-beefy72-c2 veyron_jerry-release - - 0 Not connected cros-beefy282-c2 fizz-release - - 0 Not connected cros-beefy345-c2 chell-release - - 0 Not connected cros-beefy360-c2 gru-release - - 0 Not connected cros-beefy366-c2 lars-release - - 0 Not connected cros-beefy388-c2 reef-release - - 0 Not connected cros-beefy449-c2 cyan-release - - 0 Not connected cros-beefy456-c2 eve-kvm-release - - 0 Not connected
,
Mar 13 2018
*c2 have been kicked
,
Mar 13 2018
Getting permissions to kick the two builders on a different network
,
Mar 13 2018
,
Mar 19 2018
,
Mar 19 2018
IIUC, all of the affected canaries have been fixed. Since we have a bug for the underlying root cause, and the outage is dealt with, I think this should be closed. |
||||||
►
Sign in to add a comment |
||||||
Comment 1 by ayatane@chromium.org
, Mar 12 2018