build.chromium.org/p/tryserver.chromium.linux takes 60+ seconds to load |
|||||
Issue descriptionURL: https://build.chromium.org/p/tryserver.chromium.linux/builders/linux_chromium_asan_rel_ng/builds/358745 I filed a similar issue two months ago: https://bugs.chromium.org/p/chromium/issues/detail?id=692361 This was duped into https://bugs.chromium.org/p/chromium/issues/detail?id=692708 Which was fixed on 3/16. But I'm still seeing problems. This time it looks like "accepting_builds" is timing out at ~60s and then the rest of the page loads. Could we add some type of test that looks at load times for these pages? Or maybe there's server metrics that we need to alert on?
,
May 2 2017
90th %-tile for master.tryserver.chromium.linux is currently around 10-30s: http://shortn/_Yfg3XsNdX2 There have been some brief spikes into the 10m range over the past week, but nothing sustained over a long period of time. I don't think we have an SLA for buildbot master pages (especially since we're trying to replace buildbot with Milo etc), so I don't know what good an alert would do.
,
May 2 2017
What is the eta for Milo? The amortized cost in lost developer time over all Chromium developers is non-trivial.
,
May 4 2017
It seems like there's no good excuse for the 90th percentile to be > 5s. We should leave this open and look into it to see if there are things that can be fixed (e.g., bug 673208 to split up the master). In particular, I suspect that the performance gets worse over time, and if we were to restart the master, it'd get faster. However, I will clear the Troopers label for the moment if we think there isn't something going on *right now* to make it worse than normal.
,
May 12 2017
Maybe I'm in the 99th percentile or something, but I feel like I Regularly get 60+s loads, which really slows down the rate at which I can do anything related to tryjobs. https://build.chromium.org/p/tryserver.chromium.linux/builders/linux_chromium_chromeos_rel_ng/builds/424501
,
May 12 2017
If you want some relief before we can split things up consider this milo switcher extension to go to our fast mirror by default: https://chrome.google.com/webstore/detail/milo-ui-switcher/cblfkfndlmooinnegdbofihnlblodchb
,
May 14 2018
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue. Sorry for the inconvenience if the bug really should have been left as Available. For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
,
May 14 2018
We can close this now that things are on Milo, though I don't think we have these delays even on the buildbot UI anymore. |
|||||
►
Sign in to add a comment |
|||||
Comment 1 by dpranke@chromium.org
, Apr 27 2017Labels: -Pri-3 Infra-Troopers Pri-1