New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 664840 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner: ----
Closed: Apr 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

[Resource Timing] http/tests/w3c/webperf/submission/Google/resource-timing/html/test_resource_script_types.html is flaky when run in random order

Project Member Reported by qyears...@chromium.org, Nov 14 2016

Issue description

The test:

http/tests/w3c/webperf/submission/Google/resource-timing/html/test_resource_script_types.html

appears to be flaky when run in random order. Steps to reproduce:

This should pass consistently:
Tools/Scripts/run-webkit-tests http/tests/w3c/webperf/submission/Google/resource-timing/html

This should fail intermittently:
Tools/Scripts/run-webkit-tests http/tests/w3c/webperf/submission/Google/resource-timing/html --order=random

We're working on removing order dependency from Blink layout tests. More context here:
https://docs.google.com/document/d/11-628Ny6hY__kfIv__zVD0m3rA0OB9tQLLC_gJI_PNg/edit
 
Description: Show this description
Project Member

Comment 2 by bugdroid1@chromium.org, Feb 7 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/b034403ab50b3a27bda35d6cf72efec57f2f1217

commit b034403ab50b3a27bda35d6cf72efec57f2f1217
Author: qyearsley <qyearsley@chromium.org>
Date: Tue Feb 07 17:50:47 2017

Remove flaky expectations with update-test-expectations script

The update-test-expectations script is meant to remove
flaky expectations when it appears that according to the
most recent results on the flakiness dashboard for that test,
the test is no longer flaky.

BUG= 491764 , 498539 , 575766 , 600248 ,658305, 663838 , 663840 ,663848, 663851 , 663853 , 663872 , 663874 , 663877 , 663879 ,664817,664839, 664840 , 664841 , 664842 , 664846 , 664850 , 664855 , 664856 , 666991 , 671480 , 671618 , 672204 , 673296 , 673632 , 674720 ,674858, 678488 , 683800 

Review-Url: https://codereview.chromium.org/2679543005
Cr-Commit-Position: refs/heads/master@{#448663}

[modify] https://crrev.com/b034403ab50b3a27bda35d6cf72efec57f2f1217/third_party/WebKit/LayoutTests/TestExpectations

Comment 3 by panicker@google.com, Apr 13 2017

Status: Available (was: Untriaged)
Summary: [Resource Timing] http/tests/w3c/webperf/submission/Google/resource-timing/html/test_resource_script_types.html is flaky when run in random order (was: http/tests/w3c/webperf/submission/Google/resource-timing/html/test_resource_script_types.html is flaky when run in random order)
Components: -Blink>PerformanceAPIs Blink>PerformanceAPIs>ResourceTiming

Comment 6 by maxlg@chromium.org, Apr 23 2018

The test is renamed to be resource_script_types.html. Given that the test is no longer flaky, should we close this issue?
Status: Fixed (was: Available)
Yep, this bug (664840) is no longer listed in TestExpectations and it may no longer be flaky.

Sign in to add a comment