New issue
Advanced search Search tips

Issue 663559 link

Starred by 2 users
Status: WontFix
Owner: ----
Closed: Nov 2016
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug

Blocked on:
issue 569709


Sign in to add a comment

bluetooth/notifications/event-after-starting.html is flaky when run in random order

Project Member Reported by jeffcarp@chromium.org, Nov 9 2016 
The test:
bluetooth/notifications/event-after-starting.html 

appears to be flaky when run in random order. Steps to reproduce:

This should pass consistently:
Tools/Scripts/run-webkit-tests bluetooth/notifications/

This should fail intermittently when run many times:
Tools/Scripts/run-webkit-tests bluetooth/notifications/ --order=random

We're working on removing order dependency from Blink layout tests. More context here:
https://docs.google.com/document/d/11-628Ny6hY__kfIv__zVD0m3rA0OB9tQLLC_gJI_PNg/edit#

Comment 1 by ortuno@chromium.org, Nov 10 2016 

More details would be appreciated:

1. What platform is this happening in?
2. Any bots where I can see the result? Did it timeout or is there an assert failure?
3. What seed was used or what was the test order that caused the test to fail?

I've been running the provided script all morning and I haven't gotten the test to fail.

Comment 2 by ortuno@chromium.org, Nov 10 2016

Blockedon: 569709
Status: Available (was: Untriaged)

Comment 3 by jeffcarp@chromium.org, Nov 10 2016 

Testing on Ubuntu. Not aware of any bot failures. I'm trying to repro it locally as well and can't get it to break.

I'm going to remove this test file from RandomOrderExpectations and watch the RandomOrder FYI bot over a period of time to see if it pops up again. Thanks for taking a look.
Project Member

Comment 4 by bugdroid1@chromium.org, Nov 11 2016 

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/3baf0674f2018448b9c3232520597f6cf40ec4b9

commit 3baf0674f2018448b9c3232520597f6cf40ec4b9
Author: jeffcarp <jeffcarp@chromium.org>
Date: Fri Nov 11 04:17:59 2016

Remove bluetooth/notifications/event-after-starting.html from RandomOrderExpectations

ortuno and I are unable to reproduce this locally. I think a good next step is to remove it from RandomOrderExpectations to 1. see if it pops up again, and 2. get the seed that caused the failure if it does.

BUG= 663559 

Review-Url: https://codereview.chromium.org/2492913003
Cr-Commit-Position: refs/heads/master@{#431494}

[modify] https://crrev.com/3baf0674f2018448b9c3232520597f6cf40ec4b9/third_party/WebKit/LayoutTests/RandomOrderExpectations

Comment 5 by jeffcarp@chromium.org, Nov 14 2016

Description: Show this description

Comment 6 by ortuno@chromium.org, Nov 22 2016

Status: WontFix (was: Available)
►

Sign in to add a comment