14 tests in http/tests/fetch/window/thorough/ are flaky when run in random order |
|||
Issue descriptionThe tests: http/tests/fetch/window/thorough/access-control-base-https-other-https.html http/tests/fetch/window/thorough/access-control.html http/tests/fetch/window/thorough/auth-base-https-other-https.html http/tests/fetch/window/thorough/auth-other-https.html http/tests/fetch/window/thorough/auth.html http/tests/fetch/window/thorough/cookie-base-https-other-https.html http/tests/fetch/window/thorough/cookie-nocors-other-https.html http/tests/fetch/window/thorough/cors-preflight-base-https-other-https.html http/tests/fetch/window/thorough/cors-preflight2-base-https-other-https.html http/tests/fetch/window/thorough/cors-preflight2-other-https.html http/tests/fetch/window/thorough/redirect-base-https-other-https.html http/tests/fetch/window/thorough/redirect-password-other-https.html http/tests/fetch/window/thorough/scheme-blob.html http/tests/fetch/window/thorough/scheme-data-other-https.html appear to be flaky when run in random order. Steps to reproduce: This should pass consistently: Tools/Scripts/run-webkit-tests http/tests/fetch/window/thorough/ This should fail intermittently: Tools/Scripts/run-webkit-tests http/tests/fetch/window/thorough/ --order=random We're working on removing order dependency from Blink layout tests. More context here: https://docs.google.com/document/d/11-628Ny6hY__kfIv__zVD0m3rA0OB9tQLLC_gJI_PNg/edit Also let me know if this list of tests is too large and I can split them up into smaller chunks.
,
Nov 14 2016
,
Feb 7 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/b034403ab50b3a27bda35d6cf72efec57f2f1217 commit b034403ab50b3a27bda35d6cf72efec57f2f1217 Author: qyearsley <qyearsley@chromium.org> Date: Tue Feb 07 17:50:47 2017 Remove flaky expectations with update-test-expectations script The update-test-expectations script is meant to remove flaky expectations when it appears that according to the most recent results on the flakiness dashboard for that test, the test is no longer flaky. BUG= 491764 , 498539 , 575766 , 600248 ,658305, 663838 , 663840 ,663848, 663851 , 663853 , 663872 , 663874 , 663877 , 663879 ,664817,664839, 664840 , 664841 , 664842 , 664846 , 664850 , 664855 , 664856 , 666991 , 671480 , 671618 , 672204 , 673296 , 673632 , 674720 ,674858, 678488 , 683800 Review-Url: https://codereview.chromium.org/2679543005 Cr-Commit-Position: refs/heads/master@{#448663} [modify] https://crrev.com/b034403ab50b3a27bda35d6cf72efec57f2f1217/third_party/WebKit/LayoutTests/TestExpectations
,
Feb 7 2017
The flaky expectations have now been removed because in recent runs on the continuous builders the tests don't appear to be flaky (according to the flakiness dashboard). |
|||
►
Sign in to add a comment |
|||
Comment 1 by yhirano@chromium.org
, Nov 10 2016Status: Available (was: Untriaged)