New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 773353 link

Starred by 1 user

Issue metadata

Status: Archived
Owner:
Closed: Dec 5
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Mac
Pri: 3
Type: Bug



Sign in to add a comment

http/tests/devtools/coverage/coverage-view.html flaky test

Project Member Reported by chenwilliam@chromium.org, Oct 10 2017

Issue description

http/tests/devtools/coverage/coverage-view.html is flaky on trybots. 

Example diff:
--- /b/s/w/ioAo5Scf/layout-test-results/http/tests/devtools/coverage/coverage-view-expected.txt
+++ /b/s/w/ioAo5Scf/layout-test-results/http/tests/devtools/coverage/coverage-view-actual.txt
@@ -5,5 +5,4 @@
 Reloading Page
 Page reloaded.
 http://127.0.0.1:8000/devtools/coverage/resources/coverage.js JS used: 354 unused: 214 total: 568
-http://127.0.0.1:8000/devtools/coverage/resources/highlight-in-source.css CSS used: 67 unused: 142 total: 209

Source: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=4ae9d060b937bed83a4dc6082f1652e67e62aed5&as=coverage-view-diff.txt

Flakiness dashboard: https://test-results.appspot.com/dashboards/flakiness_dashboard.html#testType=webkit_layout_tests&tests=http/tests/devtools/coverage/coverage-view.html

WebKit Mac - RandomOrder shows that this is flaky. I believe that trybots are run in random order w/ swarming which would explain why it's only flaky on CQ.

Disabling the test for now on Mac.
 
 
Project Member

Comment 1 by bugdroid1@chromium.org, Oct 10 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/17f169c6320d51db49ec0be997f841fa0a47938c

commit 17f169c6320d51db49ec0be997f841fa0a47938c
Author: Will Chen <chenwilliam@chromium.org>
Date: Tue Oct 10 23:14:36 2017

DevTools: disable flaky test http/tests/devtools/coverage/coverage-view.html

This test is flaky on Mac trybot.

TBR=caseq@chromium.org

Bug:  773353 
Change-Id: Ie2f8df1340532250c53b1c9c659ce36014a9f16b
Reviewed-on: https://chromium-review.googlesource.com/709917
Reviewed-by: Will Chen <chenwilliam@chromium.org>
Commit-Queue: Will Chen <chenwilliam@chromium.org>
Cr-Commit-Position: refs/heads/master@{#507819}
[modify] https://crrev.com/17f169c6320d51db49ec0be997f841fa0a47938c/third_party/WebKit/LayoutTests/TestExpectations

Project Member

Comment 2 by bugdroid1@chromium.org, Oct 11 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/7628694cafd529f4bcf40c6163d3d78f43831d3b

commit 7628694cafd529f4bcf40c6163d3d78f43831d3b
Author: Will Chen <chenwilliam@chromium.org>
Date: Wed Oct 11 21:40:03 2017

DevTools: disable flaky test virtual/mojo-loading/http/tests/devtools/coverage/coverage-view.html

This test is flaky on Mac trybot.

Forgot to include this in my previous CL:
https://chromium-review.googlesource.com/c/chromium/src/+/709917

TBR=caseq@chromium.org

Bug:  773353 
Change-Id: I58c58dbf6297db3f52ce156cda00820a793aa9cc
Reviewed-on: https://chromium-review.googlesource.com/713464
Reviewed-by: Will Chen <chenwilliam@chromium.org>
Commit-Queue: Will Chen <chenwilliam@chromium.org>
Cr-Commit-Position: refs/heads/master@{#508127}
[modify] https://crrev.com/7628694cafd529f4bcf40c6163d3d78f43831d3b/third_party/WebKit/LayoutTests/TestExpectations

Project Member

Comment 3 by bugdroid1@chromium.org, Jan 5 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/e286250b9e5c11b0a9e14d6b243dc206999c4a50

commit e286250b9e5c11b0a9e14d6b243dc206999c4a50
Author: Quinten Yearsley <qyearsley@chromium.org>
Date: Fri Jan 05 00:42:57 2018

Update TestExpectations with update-flaky-expectations

This CL was initially based on changes made by the third_party/WebKit/Tools/Scripts/update-flaky-expectations, but includes manual changes as well, including formatting changes and making expectations more specific based on visually checking the flakiness dashboard results.

Flakiness dashboard link:
https://test-results.appspot.com/dashboards/flakiness_dashboard.html#testType=webkit_tests&tests=http/tests/devtools/coverage/coverage-view.js,inspector-protocol/layout-fonts/cjk-ideograph-fallback-by-lang.js,http/tests/websocket/close-code-and-reason.html,external/wpt/css/css-writing-modes/writing-mode-vertical-rl-001.xht,external/wpt/css/css-writing-modes/writing-mode-vertical-rl-002.xht,external/wpt/css/css-fonts/font-display/font-display.html,fast/workers/chromium/worker-document-leak.html,fast/dom/Window/window-resize-contents.html,fast/text/ellipsis-in-relative-inline.html,fast/spatial-navigation/snav-1st-stop.html,fast/spatial-navigation/snav-display-contents-crash.html,fast/spatial-navigation/snav-div-in-anchor-and-img-crash.html,fast/spatial-navigation/snav-div-in-anchor.html,fast/spatial-navigation/snav-hidden-focusable-element.html,fast/spatial-navigation/snav-iframe-nested.html,fast/spatial-navigation/snav-iframe-no-focusable-content.html,fast/spatial-navigation/snav-iframe-no-scrollable-content.html,fast/spatial-navigation/snav-iframe-with-offscreen-focusable-element.html,fast/spatial-navigation/snav-media-elements.html,fast/spatial-navigation/snav-multiple-select-focusring.html,fast/spatial-navigation/snav-offscreen-content.html,fast/spatial-navigation/snav-only-clipped-overflow-content.html,fast/spatial-navigation/snav-simple-content-overflow.html,fast/spatial-navigation/snav-single-select-list.html,fast/spatial-navigation/snav-zero-margin-content.html,external/wpt/clear-site-data/storage.https.html,http/tests/devtools/network/network-xhr-same-url-as-main-resource.js,virtual/mouseevent_fractional/fast/events/touch/gesture/gesture-tap-hover-state-iframe.html

Bug:  518989 ,  520737 , 520739,  564109 ,  729836 ,  731535 ,  746904 , 757165, 767040,  767269 ,  773353 ,  785980 ,  795250 
Change-Id: I03ac7e658ee42ccf3798e7f3994d30fc74880565
Reviewed-on: https://chromium-review.googlesource.com/847835
Commit-Queue: Quinten Yearsley <qyearsley@chromium.org>
Reviewed-by: Philip Jägenstedt <foolip@chromium.org>
Cr-Commit-Position: refs/heads/master@{#527171}
[modify] https://crrev.com/e286250b9e5c11b0a9e14d6b243dc206999c4a50/third_party/WebKit/LayoutTests/TestExpectations

Project Member

Comment 4 by bugdroid1@chromium.org, Jan 11 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/6be27aa0128c754b4dfa89cbbaf5085eb8e5c4af

commit 6be27aa0128c754b4dfa89cbbaf5085eb8e5c4af
Author: Quinten Yearsley <qyearsley@chromium.org>
Date: Thu Jan 11 22:15:53 2018

Update test expectations with update-flaky-expectations

Recent test results history:
https://test-results.appspot.com/dashboards/flakiness_dashboard.html#testType=webkit_layout_tests&tests=http/tests/dev
tools/coverage/coverage-view.js,http/tests/media/video-load-metadata-decode-error.html,inspector-protocol/layout-fonts/fallback-pua-last-resort.js

Bug:  731111 ,  773353 ,  796926 
Change-Id: I3c3b4954f5eb89df2a918f67f4661d3b07c2ee34
Reviewed-on: https://chromium-review.googlesource.com/860532
Commit-Queue: Quinten Yearsley <qyearsley@chromium.org>
Reviewed-by: Robert Ma <robertma@chromium.org>
Cr-Commit-Position: refs/heads/master@{#528775}
[modify] https://crrev.com/6be27aa0128c754b4dfa89cbbaf5085eb8e5c4af/third_party/WebKit/LayoutTests/TestExpectations

Status: Archived (was: Assigned)
Test failures are processed as a part of a dedicated triage, bulk-closing the bugs.

Sign in to add a comment