media/avtrack/video-track-selected.html is flaky when run in random order on Windows |
|||||
Issue descriptionmedia/avtrack/video-track-selected.html appears to be flaky when run in random order. Example failing builds: https://luci-milo.appspot.com/buildbot/chromium.fyi/WebKit%20Win%20-%20RandomOrder/282 https://luci-milo.appspot.com/buildbot/chromium.fyi/WebKit%20Win%20-%20RandomOrder/286 https://luci-milo.appspot.com/buildbot/chromium.fyi/WebKit%20Win%20-%20RandomOrder/273 https://luci-milo.appspot.com/buildbot/chromium.fyi/WebKit%20Win%20-%20RandomOrder/290 https://luci-milo.appspot.com/buildbot/chromium.fyi/WebKit%20Win%20-%20RandomOrder/277 https://luci-milo.appspot.com/buildbot/chromium.fyi/WebKit%20Win%20-%20RandomOrder/276 https://luci-milo.appspot.com/buildbot/chromium.fyi/WebKit%20Win%20-%20RandomOrder/289 Steps to reproduce: This should pass consistently: Tools/Scripts/run-webkit-tests media/avtrack/ This should fail intermittently: Tools/Scripts/run-webkit-tests media/avtrack/ --order=random We're working on removing order dependency from Blink layout tests. More context here: https://docs.google.com/document/d/11-628Ny6hY__kfIv__zVD0m3rA0OB9tQLLC_gJI_PNg/edit
,
Dec 8 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/1e3956252e91599da90cc454ea6cd7ccac7c97fa commit 1e3956252e91599da90cc454ea6cd7ccac7c97fa Author: jeffcarp <jeffcarp@chromium.org> Date: Thu Dec 08 19:27:41 2016 Add media/avtrack/video-track-selected.html to Windows RandomOrderExpectations It has failed 7 out of the last 20 builds. BUG= 672204 Review-Url: https://codereview.chromium.org/2562543002 Cr-Commit-Position: refs/heads/master@{#437305} [modify] https://crrev.com/1e3956252e91599da90cc454ea6cd7ccac7c97fa/third_party/WebKit/LayoutTests/RandomOrderExpectations
,
Dec 16 2016
jeffcarp@, did CL in c#2 fix this bug? if so, can I resolve it as Fixed?
,
Dec 16 2016
,
Dec 20 2016
Sorry for the late reply - the CL in #2 only marked it as flaky. It's in TestExpectations with the expectation of Pass or Failure now: https://cs.chromium.org/chromium/src/third_party/WebKit/LayoutTests/TestExpectations?q=LayoutTests/Test&sq=package:chromium&l=2388
,
Feb 7 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/b034403ab50b3a27bda35d6cf72efec57f2f1217 commit b034403ab50b3a27bda35d6cf72efec57f2f1217 Author: qyearsley <qyearsley@chromium.org> Date: Tue Feb 07 17:50:47 2017 Remove flaky expectations with update-test-expectations script The update-test-expectations script is meant to remove flaky expectations when it appears that according to the most recent results on the flakiness dashboard for that test, the test is no longer flaky. BUG= 491764 , 498539 , 575766 , 600248 ,658305, 663838 , 663840 ,663848, 663851 , 663853 , 663872 , 663874 , 663877 , 663879 ,664817,664839, 664840 , 664841 , 664842 , 664846 , 664850 , 664855 , 664856 , 666991 , 671480 , 671618 , 672204 , 673296 , 673632 , 674720 ,674858, 678488 , 683800 Review-Url: https://codereview.chromium.org/2679543005 Cr-Commit-Position: refs/heads/master@{#448663} [modify] https://crrev.com/b034403ab50b3a27bda35d6cf72efec57f2f1217/third_party/WebKit/LayoutTests/TestExpectations
,
Jul 23
Closing as Won't Fix (No Repro/Stale). |
|||||
►
Sign in to add a comment |
|||||
Comment 1 by mlamouri@chromium.org
, Dec 8 2016