New issue
Advanced search Search tips

Issue 741804 link

Starred by 2 users

Issue metadata

Status: Fixed
Owner:
Closed: Jul 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Windows
Pri: 2
Type: Bug



Sign in to add a comment

Many tests are flaky on WebKit Win7 (dbg)

Project Member Reported by mark@chromium.org, Jul 12 2017

Issue description

This bot

https://build.chromium.org/p/chromium.webkit/builders/WebKit%20Win7%20%28dbg%29

has been experiencing test failures since this build

https://build.chromium.org/p/chromium.webkit/builders/WebKit%20Win7%20%28dbg%29/builds/10274

Not every build has a failure, but nearly every one does. This bot was much greener before that build. Now it’s nearly always red.

In that range, we have ee22b7dd3429 (https://chromium-review.googlesource.com/461722) which appears to have expanded the set of these tests that would run.

I’m going to try to revert that, but a previous attempt to do so (https://chromium-review.googlesource.com/566418) was abandoned, so I’m not sure how far I’ll get.

Jeff, can you take a look? This bot is red basically all the time.
 
It doesn't look like there's a consistent set of failing layout tests so looks like we can't just add to TestExpectations. Let me know if you need help in the revert.

Comment 2 by mark@chromium.org, Jul 12 2017

Looks like this was already reverted at 0dff02f926f6, actually? And we’re still seeing flake after that.

Comment 3 by junov@chromium.org, Jul 13 2017

Components: -Blink Blink>Infra
Status: WontFix (was: Assigned)
external/wpt/ is a pretty huge set of tests (all web-platform-tests); I think that it will be more useful to file individual bugs for smaller sets of tests which appear flaky.

The latest complete build had one failure in inspector/profiler/heap-snapshot-summary-expand-collapse.html, and that has a separate bug:  bug 742355 .

Comment 5 by mark@chromium.org, Jul 13 2017

Cc: jeffcarp@chromium.org
Labels: Sheriff-Chromium
Owner: ----
Status: Available (was: WontFix)
Summary: Many tests are flaky on WebKit Win7 (dbg) (was: webkit_tests external/wpt/* are flaky on WebKit Win7 (dbg))
OK, then maybe something else is wrong. This bot was pretty green until July 10, and now it’s almost always red.

https://build.chromium.org/p/chromium.webkit/builders/WebKit%20Win7%20%28dbg%29?numbuilds=100

Adding Sheriff-Chromium so that today’s sheriffs know about it, and reopening because…really…it looks like something’s wrong.
Owner: qyears...@chromium.org
Status: Assigned (was: Available)
Hm, yep, agreed that it does look suspicious.

It might still be possible that there just happened to be sequence of unrelated problems right next to each other, which may be mostly cleared up now... if that is the case, then the next few builds will probably be green; but if new different tests fails, but it's not consistently one test or another, then maybe the general rate of flakiness on Win7 (dbg) increased somehow.

Will keep an eye on it.
Labels: -Pri-1 Pri-2
Update: Last couple runs were green. The rate of flakiness is high, but I don't think it's due to any one cause.
Status: Fixed (was: Assigned)
General rate of flakiness is back down.

Sign in to add a comment