3 tests in http/tests/cachestorage/ are flaky when run in random order |
|||||
Issue descriptionThe tests: http/tests/cachestorage/window/cache-add.html http/tests/cachestorage/window/cache-storage.html http/tests/cachestorage/worker/cache-storage.html appear to be flaky when run in random order. Steps to reproduce: This should pass consistently: Tools/Scripts/run-webkit-tests http/tests/cachestorage/ This should fail intermittently: Tools/Scripts/run-webkit-tests http/tests/cachestorage/ --order=random We're working on removing order dependency from Blink layout tests. More context here: https://docs.google.com/document/d/11-628Ny6hY__kfIv__zVD0m3rA0OB9tQLLC_gJI_PNg/edit
,
Nov 10 2016
Testing on Ubuntu. Sorry I don't have a seed you can try but using --repeat-each got both cache-storage.html tests to fail for me (in random and default order). Tools/Scripts/run-webkit-tests http/tests/cachestorage/ --order=random --repeat-each=10
,
Nov 14 2016
,
Nov 19 2016
,
Nov 19 2016
Slightly more data available in issue 666991 which tracks importing the upstream version of some of these tests
,
Nov 21 2016
http/tests/cache-storage/*/cache-storage.html fails because it relies on a cache not existing, but it is implicitly created during the test by a bug in our implementation. I can't get http/tests/cachestorage/*/cache-add.html to fail. https://codereview.chromium.org/2520093002
,
Nov 21 2016
,
Nov 22 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/cfe8a0730ee7c02fa8ec082c821b738244b4dd74 commit cfe8a0730ee7c02fa8ec082c821b738244b4dd74 Author: jsbell <jsbell@chromium.org> Date: Tue Nov 22 20:00:07 2016 Make Cache Storage tests resilient to execution order BUG= 663871 R=jkarlin@chromium.org Review-Url: https://codereview.chromium.org/2520093002 Cr-Commit-Position: refs/heads/master@{#433949} [modify] https://crrev.com/cfe8a0730ee7c02fa8ec082c821b738244b4dd74/third_party/WebKit/LayoutTests/http/tests/cachestorage/resources/test-helpers.js [modify] https://crrev.com/cfe8a0730ee7c02fa8ec082c821b738244b4dd74/third_party/WebKit/LayoutTests/http/tests/cachestorage/script-tests/cache-storage.js
,
Nov 22 2016
Given no repro on http/tests/cachestorage/window/cache-add.html and not seeing it on the bots - http://test-results.appspot.com/dashboards/flakiness_dashboard.html#tests=http%2Ftests%2Fcachestorage%2Fwindow%2Fcache-add.html - I'm resolving this. |
|||||
►
Sign in to add a comment |
|||||
Comment 1 by jkarlin@chromium.org
, Nov 10 2016