New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 877974 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Aug 29
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug

Blocking:
issue 837855



Sign in to add a comment

Flake Detection: Merge similar webkit layout tests bugs

Project Member Reported by liaoyuke@chromium.org, Aug 27

Issue description

In  crbug.com/877104 , there are quite a few flaky webkit layout tests that have different bugs filed for them, but actually, they should be merged into the same one.

For example:
external/wpt/editing/run/delete.html?1-1000
external/wpt/editing/run/delete.html?1001-2000
external/wpt/editing/run/delete.html?3001-4000
external/wpt/editing/run/delete.html?4001-5000
external/wpt/editing/run/delete.html?5001-6000
external/wpt/editing/run/delete.html?6001-last
external/wpt/editing/run/forward_delete.html?1-1000
external/wpt/editing/run/forward_delete.html?1001-2000
external/wpt/editing/run/forward_delete.html?2001-3000
external/wpt/editing/run/forward_delete.html?3001-4000
external/wpt/editing/run/forward_delete.html?4001-5000
external/wpt/editing/run/forward_delete.html?5001-6000
external/wpt/editing/run/forward_delete.html?6001-last
 
Cc: hayato@chromium.org foolip@chromium.org sclit...@chromium.org
+foolip@, +hayato@ and +sclittle@ for suggestions.

I think it's straightforward to me that: "external/wpt/editing/run/delete.html?x-y" should be merged into a meta bug, and "external/wpt/editing/run/forward_delete.html?x-y" should be merged into another meta bug, but it's not obvious to me that "external/wpt/editing/run/delete.html?x-y" and "external/wpt/editing/run/forward_delete.html?x-y" should also be merged into one bug, is there a reliable pattern that can be used to identify such similarities?
It would be a pretty good assumption that tests that differ only by the query parameters are sufficiently similar that if they're all flaky, the cause is the same. This won't always be the case, but creating separate bugs will be more annoying than useful, I suspect.
Thanks for the feedback foolip@!

I'm working on a new Flake Detection to replace the Chromium-try-flakes, and it will be online soon, I will make sure to merge similar webkit layout tests bugs in the new Flake Detection.
Project Member

Comment 4 by bugdroid1@chromium.org, Aug 29

Status: Fixed (was: Assigned)

Sign in to add a comment