New issue
Advanced search Search tips

Issue 663871 link

Starred by 2 users

Issue metadata

Status: Fixed
Owner:
Closed: Nov 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug

Blocked on:
issue 666991

Blocking:
issue 601332



Sign in to add a comment

3 tests in http/tests/cachestorage/ are flaky when run in random order

Project Member Reported by jeffcarp@chromium.org, Nov 9 2016

Issue description

The tests:

http/tests/cachestorage/window/cache-add.html
http/tests/cachestorage/window/cache-storage.html
http/tests/cachestorage/worker/cache-storage.html

appear to be flaky when run in random order. Steps to reproduce:

This should pass consistently:
Tools/Scripts/run-webkit-tests http/tests/cachestorage/

This should fail intermittently:
Tools/Scripts/run-webkit-tests http/tests/cachestorage/ --order=random

We're working on removing order dependency from Blink layout tests. More context here:
https://docs.google.com/document/d/11-628Ny6hY__kfIv__zVD0m3rA0OB9tQLLC_gJI_PNg/edit

 
I've tried to repro about 20 times using --order=random. Any chance you have a seed that shows the bug?
Testing on Ubuntu. Sorry I don't have a seed you can try but using --repeat-each got both cache-storage.html tests to fail for me (in random and default order).

Tools/Scripts/run-webkit-tests http/tests/cachestorage/ --order=random --repeat-each=10
Description: Show this description

Comment 4 by jsb...@chromium.org, Nov 19 2016

Blockedon: 666991

Comment 5 by jsb...@chromium.org, Nov 19 2016

Slightly more data available in  issue 666991  which tracks importing the upstream version of some of these tests

Comment 6 by jsb...@chromium.org, Nov 21 2016

http/tests/cache-storage/*/cache-storage.html fails because it relies on a cache not existing, but it is implicitly created during the test by a bug in our implementation.

I can't get http/tests/cachestorage/*/cache-add.html to fail.

https://codereview.chromium.org/2520093002

Comment 7 by jsb...@chromium.org, Nov 21 2016

Cc: jkarlin@chromium.org cmumford@chromium.org
Owner: jsb...@chromium.org
Status: Started (was: Untriaged)

Comment 9 by jsb...@chromium.org, Nov 22 2016

Status: Fixed (was: Started)
Given no repro on http/tests/cachestorage/window/cache-add.html and not seeing it on the bots - http://test-results.appspot.com/dashboards/flakiness_dashboard.html#tests=http%2Ftests%2Fcachestorage%2Fwindow%2Fcache-add.html - I'm resolving this.

Sign in to add a comment