SoM/trooper incorrectly showing pending builds |
||||
Issue descriptionHi all, At the moment, SoM is incorrectly showing two builders as being idle with pending builds. However, the builders are online and processing builds just fine, only it looks like the buildbot master(s) may be confused over whether there are still pending builds or not. I'm not sure if this is a bug in SoM or a bug in buildbot and, if the latter, whether the best thing to do is restart the masters to see if things clear up. I've attached both the screenshot from S-o-M and from one of the two builders with the problem; you can see from the builder screenshot that the pending builds are from almost two weeks ago.
,
Jul 6 2017
Ryan, there was an issue with some masters not clearing pending builds a few weeks ago, right? Is this related? I remember you submitting a fix to improve flushing.
,
Jul 6 2017
fwiw it helps if you attach links in addition to screenshot. This is 728916, and it should be fixed with a master restart.
,
Jul 6 2017
The following revision refers to this bug: https://chrome-internal.googlesource.com/infradata/master-manager/+/acf35c981a0d560815a5549544be3f288cb81c62 commit acf35c981a0d560815a5549544be3f288cb81c62 Author: Ryan Tseng <hinoka@google.com> Date: Thu Jul 06 20:01:36 2017
,
Jul 7 2017
Is this still happening?
,
Jul 7 2017
It's still showing up for the bling chromium-autoroller builder, but the Android builder is gone. There are no pending builds showning on buildbot, but there are on milo: https://sheriff-o-matic.appspot.com/trooper https://luci-milo.appspot.com/buildbot/internal.bling.main/chromium-autoroller/ https://uberchromegw.corp.google.com/i/internal.bling.main/builders/chromium-autoroller
,
Jul 7 2017
The restart didn't go through: https://uberchromegw.corp.google.com/i/internal.bling.main/json/clock?as_text=1 will need to see whats up
,
Jul 7 2017
I restarted the internal.bling.main master manually and the milo view is accurate again. I checked SoM and saw that only chromium.android is the only one with long pending builds, but it is the same on buildbot. |
||||
►
Sign in to add a comment |
||||
Comment 1 by dpranke@chromium.org
, Jul 5 2017Components: Infra>Platform>Buildbot