Issue 705125 link

Starred by 2 users

Issue metadata

Status:	Available
Owner:	----
Components:	Blink>Infra
EstimatedDays:	----
NextAction:	----
OS:	----
Pri:	3
Type:	Bug
Hotlist-Recharge-Cold

Blocked on:
issue 709028

Some layout tests have test harness errors and results with non-deterministic order.

Project Member Reported by qyears...@chromium.org, Mar 24 2017

Issue description

Background: for some time, the layout test runner was not treating testharness.js tests with "harness errors" as failures ( bug 703331 ), and so no -expected.txt file was kept since all of the tests appeared to PASS.

After making "harness errors" count as failures, an -expected.txt would have to be kept, but can only be kept if the expected result is deterministic.

This is a tracking bug for tests that fail with harness errors and also don't have deterministic results.

Project Member

Comment 1 by bugdroid1@chromium.org, Mar 27 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/13c19c95a727c5dbb003bcc089e6089bdcbe96aa

commit 13c19c95a727c5dbb003bcc089e6089bdcbe96aa
Author: qyearsley <qyearsley@chromium.org>
Date: Mon Mar 27 23:07:57 2017

Fix testharness result parsing, make "Harness error" count as failure.

BUG= 703331 ,705125

Review-Url: https://codereview.chromium.org/2766823003
Cr-Commit-Position: refs/heads/master@{#459924}

[modify] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/TestExpectations
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/accessibility/name-calc-inputs-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/animations/interpolation/rotate-interpolation-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/css3/flexbox/style-change-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/css3/fonts/font-feature-settings-parsing-prefixed-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/css3/logical-props/logicalprops-quirklength-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/custom-elements/spec/create-element-defined-synchronous-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/custom-elements/spec/custom-elements-registry/when_defined-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/external/csswg-test/css-logical-properties-1/logicalprops-quirklength-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/external/wpt/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-set-src-networkState-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/external/wpt/shadow-dom/Document-prototype-currentScript-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/external/wpt/streams/piping/pipe-through-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/external/wpt/streams/piping/pipe-through.dedicatedworker-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/alignment/parse-align-self-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/alignment/parse-alignment-of-root-elements-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/alignment/parse-justify-self-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/canvas/canvas-blend-image-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/canvas/canvas-direction-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/canvas/canvas-fillRect-gradient-shadow-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/canvas/canvas-fillRect-shadow-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/canvas/canvas-hit-regions-basic-test-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/canvas/canvas-hit-regions-clip-test-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/canvas/canvas-hit-regions-css-transform-test-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/canvas/canvas-hit-regions-device-pixel-ratio-test-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/canvas/canvas-hit-regions-scale-factor-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/canvas/canvas-invalid-values-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/canvas/canvas-large-fills-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/canvas/canvas-scale-shadowBlur-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/canvas/canvas-strokePath-alpha-shadow-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/canvas/getPutImageDataPairTest-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/css/getComputedStyle/computed-style-cursor-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/css/invalidation/independent-inheritance-fast-path-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/css/parsing-color-quirk-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/css/parsing-unitless-length-quirk-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/css/variables/var-in-css-keyframe-responsive-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/dom/MutationObserver/observe-gc-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/dom/custom/svg-use-shadow-tree-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/dom/dataset-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/dom/geometry-interfaces-dom-matrix-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/dom/geometry-interfaces-dom-matrix-rotate-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/dom/geometry-interfaces-dom-matrix-scale-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/dom/geometry-interfaces-dom-matrix-setMatrixValue-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/dom/node-filter-use-counters-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/dynamic/position-change-to-absolute-with-positioned-child-crash-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/media/mq-js-update-media-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/peerconnection/RTCPeerConnection-createOffer-promise-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/shapedetection/shapedetection-empty-input-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/text/font-features/font-variant-shorthand-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/fast/writing-mode/text-combine-compress-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/budget/get-budget-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/credentialmanager/credentialscontainer-store-basics-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/credentialmanager/federatedcredential-basics-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/credentialmanager/passwordcredential-fetch-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/dom/promise-rejection-events-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/fetch/serviceworker/request-base-https-other-https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/fetch/serviceworker/request-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/fetch/serviceworker/response-base-https-other-https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/fetch/serviceworker/response-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/fetch/window/request-base-https-other-https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/fetch/window/request-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/fetch/window/response-base-https-other-https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/fetch/window/response-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/fetch/workers/request-base-https-other-https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/fetch/workers/request-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/fetch/workers/response-base-https-other-https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/fetch/workers/response-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/media/autoplay-crossorigin-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/origin_trials/sample-api-enabled-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/origin_trials/sample-api-enabled-header-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/origin_trials/sample-api-multiple-tokens-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/origin_trials/sample-api-multiple-tokens-header-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/origin_trials/sample-api-script-added-before-access-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/origin_trials/sample-api-script-added-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/origin_trials/sample-api-workers-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/security/canvas-read-blocked-by-setting-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/security/contentSecurityPolicy/register-bypassing-scheme-script.https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/security/cors-rfc1918/addressspace-document-csp-appcache-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/security/cors-rfc1918/internal-to-internal-xhr-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/security/offscreen-canvas-read-blocked-by-setting-expected.txt
[delete] https://crrev.com/6c18543914d549e025ef4200e25e09945eac692d/third_party/WebKit/LayoutTests/http/tests/security/suborigins/suborigin-invalid-options-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/serviceworker/chromium/xhr-is-not-exposed-to-service-workers-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/byte-length-queuing-strategy-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/count-queuing-strategy-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/piping/multiple-propagation.https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/bad-strategies-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/bad-underlying-sources-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/brand-checks-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/garbage-collection-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/general-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/readable-stream-reader-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/tee-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/writable-streams/aborting.https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/writable-streams/bad-strategies.https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/writable-streams/bad-underlying-sinks.https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/writable-streams/brand-checks.https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/writable-streams/byte-length-queuing-strategy.https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/writable-streams/close.https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/writable-streams/constructor.https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/writable-streams/count-queuing-strategy.https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/writable-streams/general.https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/writable-streams/start.https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/streams/writable-streams/write.https-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/w3c/webperf/submission/Google/resource-timing/html/test_resource_memory_cached-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/w3c/webperf/submission/Intel/user-timing/test_user_timing_clearMarks-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/w3c/webperf/submission/Intel/user-timing/test_user_timing_clearMeasures-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/w3c/webperf/submission/Intel/user-timing/test_user_timing_mark-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/w3c/webperf/submission/Intel/user-timing/test_user_timing_measure-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/w3c/webperf/submission/Intel/user-timing/test_user_timing_measure_associate_with_navigation_timing-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/webaudio/autoplay-crossorigin-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/http/tests/xmlhttprequest/send-entity-body-charset-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/intersection-observer/observer-attributes-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/media/encrypted-media/encrypted-media-requestmediakeysystemaccess-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/media/media-play-promise-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/payments/payment-request-interface-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/linux/editing/spelling/context_click_on_selected_misspelling-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/linux/virtual/gpu/fast/canvas/getPutImageDataPairTest-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/linux/virtual/mojo-loading/http/tests/origin_trials/sample-api-workers-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/linux/virtual/mojo-loading/http/tests/streams/count-queuing-strategy-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/linux/virtual/mojo-loading/http/tests/streams/readable-streams/general-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/linux/virtual/wheelscrolllatching/fast/events/wheel/wheel-scroll-latching-on-scrollbar-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/mac-mac10.10/virtual/mojo-loading/http/tests/streams/count-queuing-strategy-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/mac-mac10.9/virtual/gpu/fast/canvas/getPutImageDataPairTest-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/mac-mac10.9/virtual/mojo-loading/http/tests/security/cors-rfc1918/addressspace-document-csp-appcache-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/mac/editing/spelling/context_click_on_selected_misspelling-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/win/http/tests/shapedetection/shapedetection-cross-origin-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/win/shapedetection/detection-HTMLCanvasElement-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/win/shapedetection/detection-HTMLImageElement-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/win/shapedetection/detection-HTMLVideoElement-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/win/shapedetection/detection-ImageBitmap-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/win/shapedetection/detection-ImageData-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/win/shapedetection/detection-security-test-expected.txt
[delete] https://crrev.com/6c18543914d549e025ef4200e25e09945eac692d/third_party/WebKit/LayoutTests/platform/win/virtual/mojo-loading/http/tests/security/suborigins/suborigin-invalid-options-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/win/virtual/mojo-loading/http/tests/shapedetection/shapedetection-cross-origin-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/win7/virtual/gpu/fast/canvas/getPutImageDataPairTest-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/win7/virtual/mojo-loading/http/tests/streams/byte-length-queuing-strategy-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/platform/win7/virtual/mojo-loading/http/tests/streams/readable-streams/general-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/shadow-dom/range-caret-range-from-point-left-of-shadow-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/svg/css/baseline-shift-inherit-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/svg/css/path-element-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/svg/custom/getBBox-circle-has-one-zero-value-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/svg/custom/getBBox-ellipse-has-one-zero-value-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/svg/custom/getBBox-rect-has-one-zero-value-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/svg/dom/svgangle-units-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/svg/dom/tabindex-focus-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/svg/in-html/sizing/svg-inline-vertical-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/transforms/translate-parsing-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/vibration/vibration-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/vibration/vibration-iframe-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/virtual/mojo-loading/http/tests/streams/readable-streams/bad-underlying-sources-expected.txt
[add] https://crrev.com/13c19c95a727c5dbb003bcc089e6089bdcbe96aa/third_party/WebKit/LayoutTests/virtua

Project Member

Comment 2 by bugdroid1@chromium.org, Apr 4 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/9d48fc928e4b278649c3155f11749f100892ed70

commit 9d48fc928e4b278649c3155f11749f100892ed70
Author: jochen <jochen@chromium.org>
Date: Tue Apr 04 15:12:13 2017

Deflake suborigin-invalid-options.html

Just force the five tests to run in order.

BUG=705125, 671475 
R=mkwst@chromium.org

Review-Url: https://codereview.chromium.org/2796673003
Cr-Commit-Position: refs/heads/master@{#461719}

[modify] https://crrev.com/9d48fc928e4b278649c3155f11749f100892ed70/third_party/WebKit/LayoutTests/TestExpectations
[modify] https://crrev.com/9d48fc928e4b278649c3155f11749f100892ed70/third_party/WebKit/LayoutTests/http/tests/security/suborigins/suborigin-invalid-options.html

Comment 3 by schenney@chromium.org, Apr 6 2017

Blockedon: 709028

Project Member

Comment 4 by bugdroid1@chromium.org, Apr 11 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/f52866b40aca4279164a4415b74b71806dd669b8

commit f52866b40aca4279164a4415b74b71806dd669b8
Author: mkwst <mkwst@chromium.org>
Date: Tue Apr 11 14:08:57 2017

Skip flaky 'test_user_timing_clearMarks.html'.

BUG= 709028 ,705125
TBR=rouslan@chromium.org

Review-Url: https://codereview.chromium.org/2815513004
Cr-Commit-Position: refs/heads/master@{#463617}

[modify] https://crrev.com/f52866b40aca4279164a4415b74b71806dd669b8/third_party/WebKit/LayoutTests/TestExpectations

Project Member

Comment 5 by bugdroid1@chromium.org, Apr 13 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/ba36ef765de08362765f726520fbe52db23faf25

commit ba36ef765de08362765f726520fbe52db23faf25
Author: ricea <ricea@chromium.org>
Date: Thu Apr 13 06:20:06 2017

Remove Blink copies of readable-streams layout tests

web-platform-tests for ReadableStream are imported from upstream, so
remove our local copies.

writable-streams and piping tests are not removed in this CL, as the CLs
https://codereview.chromium.org/2772293002/ and
https://codereview.chromium.org/2796633002/ will delete them.

Issue 705125 is referenced because two of the deleted tests were
included in TextExpectations as having non-deterministic results.

BUG=705125

Review-Url: https://codereview.chromium.org/2808853003
Cr-Commit-Position: refs/heads/master@{#464317}

[modify] https://crrev.com/ba36ef765de08362765f726520fbe52db23faf25/third_party/WebKit/LayoutTests/TestExpectations
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/byte-length-queuing-strategy-expected.txt
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/byte-length-queuing-strategy.html
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/byte-length-queuing-strategy.js
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/count-queuing-strategy-expected.txt
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/count-queuing-strategy.html
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/count-queuing-strategy.js
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/bad-strategies-expected.txt
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/bad-strategies.html
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/bad-strategies.js
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/bad-underlying-sources-expected.txt
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/bad-underlying-sources.html
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/bad-underlying-sources.js
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/brand-checks-expected.txt
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/brand-checks.html
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/brand-checks.js
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/cancel.html
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/cancel.js
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/count-queuing-strategy-integration-expected.txt
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/count-queuing-strategy-integration.html
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/count-queuing-strategy-integration.js
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/garbage-collection-expected.txt
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/garbage-collection.html
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/garbage-collection.js
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/general-expected.txt
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/general.html
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/general.js
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/readable-stream-reader-expected.txt
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/readable-stream-reader.html
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/readable-stream-reader.js
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/tee-expected.txt
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/tee.html
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/tee.js
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/templated.html
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/readable-streams/templated.js
[delete] https://crrev.com/1e31d646391e0b4a897025d83a4d7ba5fdbbc175/third_party/WebKit/LayoutTests/http/tests/streams/resources/rs-test-templates.js

Project Member

Comment 6 by bugdroid1@chromium.org, May 22 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/a9244202f6597e42e2dc4ffb1a410114f5a16a9b

commit a9244202f6597e42e2dc4ffb1a410114f5a16a9b
Author: qyearsley <qyearsley@chromium.org>
Date: Mon May 22 20:11:47 2017

Remove flaky TestExpectations for tests which appear non-flaky recently.

This change was made by the update-test-expectations script.

Recent test results history:
https://test-results.appspot.com/dashboards/flakiness_dashboard.html#testType=webkit_layout_tests&tests=virtual/mojo-loading/http/tests/permissions/chromium/test-request-worker.html,http/tests/security/suborigins/crossorigin/suborigin-cors-xhr-failure-output.php,http/tests/navigation/image-load-in-unload-handler.html,external/wpt/IndexedDB/request-abort-ordering.html,external/wpt/service-workers/service-worker/referer.https.html,virtual/off-main-thread-fetch/external/wpt/service-workers/service-worker/referer.https.html,fast/css/fontfaceset-check-platform-fonts.html,inspector/animation/animation-transition-setTiming-crash.html,fast/css/font-family-case-insensitive.html

BUG= 538717 ,705125, 711529 ,626703, 658997 , 658997 , 722849 

Review-Url: https://codereview.chromium.org/2900793002
Cr-Commit-Position: refs/heads/master@{#473672}

[modify] https://crrev.com/a9244202f6597e42e2dc4ffb1a410114f5a16a9b/third_party/WebKit/LayoutTests/TestExpectations

Project Member

Comment 7 by bugdroid1@chromium.org, Sep 5 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/901e1a4292cc131f6c07cd87c2ce113305e0db5b

commit 901e1a4292cc131f6c07cd87c2ce113305e0db5b
Author: Yutaka Hirano <yhirano@chromium.org>
Date: Tue Sep 05 05:41:09 2017

Add query parameters to investigate suborigin test flakiness

Bug: 705125
Change-Id: Idf9fd1261982ba74f86372a4d63ae7a6b09cc840
Reviewed-on: https://chromium-review.googlesource.com/650126
Reviewed-by: Takeshi Yoshino <tyoshino@chromium.org>
Commit-Queue: Yutaka Hirano <yhirano@chromium.org>
Cr-Commit-Position: refs/heads/master@{#499568}
[modify] https://crrev.com/901e1a4292cc131f6c07cd87c2ce113305e0db5b/third_party/WebKit/LayoutTests/http/tests/security/suborigins/crossorigin/suborigin-cors-xhr-failure-output-expected.txt
[modify] https://crrev.com/901e1a4292cc131f6c07cd87c2ce113305e0db5b/third_party/WebKit/LayoutTests/http/tests/security/suborigins/crossorigin/suborigin-cors-xhr-failure-output.php

Comment 8 Deleted

Comment 9 by yini...@chromium.org, Sep 12 2017

Labels: -FailedLayoutMediaTest

Project Member

Comment 10 by bugdroid1@chromium.org, Sep 26 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/43d9c3bbad1f1195356b7495ba0862c1299a0e4a

commit 43d9c3bbad1f1195356b7495ba0862c1299a0e4a
Author: Yutaka Hirano <yhirano@chromium.org>
Date: Tue Sep 26 11:19:35 2017

Split suborigin-cors-xhr-failure-output.php into two

async_test can be executed out of order, which leads to flaky console
output. This CL splits the file to avoid the issue.

Bug: 705125
Change-Id: I3dda81b84e05a6c50e786030d1a883e085fb80a0
Reviewed-on: https://chromium-review.googlesource.com/677165
Reviewed-by: Jochen Eisinger <jochen@chromium.org>
Commit-Queue: Yutaka Hirano <yhirano@chromium.org>
Cr-Commit-Position: refs/heads/master@{#504337}
[modify] https://crrev.com/43d9c3bbad1f1195356b7495ba0862c1299a0e4a/third_party/WebKit/LayoutTests/TestExpectations
[add] https://crrev.com/43d9c3bbad1f1195356b7495ba0862c1299a0e4a/third_party/WebKit/LayoutTests/http/tests/security/suborigins/crossorigin/suborigin-cors-preflight-xhr-failure-output-expected.txt
[add] https://crrev.com/43d9c3bbad1f1195356b7495ba0862c1299a0e4a/third_party/WebKit/LayoutTests/http/tests/security/suborigins/crossorigin/suborigin-cors-preflight-xhr-failure-output.php
[modify] https://crrev.com/43d9c3bbad1f1195356b7495ba0862c1299a0e4a/third_party/WebKit/LayoutTests/http/tests/security/suborigins/crossorigin/suborigin-cors-xhr-failure-output-expected.txt
[modify] https://crrev.com/43d9c3bbad1f1195356b7495ba0862c1299a0e4a/third_party/WebKit/LayoutTests/http/tests/security/suborigins/crossorigin/suborigin-cors-xhr-failure-output.php

Project Member

Comment 11 by sheriffbot@chromium.org, Sep 26

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)

This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot

Comment 12 by lukebjerring@chromium.org, Sep 27

Status: Available (was: Untriaged)

►

Issue 705125 link

Issue metadata

Some layout tests have test harness errors and results with non-deterministic order.

Issue description

Comment 1 by bugdroid1@chromium.org, Mar 27 2017

Comment 1 Deleted

Comment 2 by bugdroid1@chromium.org, Apr 4 2017

Comment 2 Deleted

Comment 3 by schenney@chromium.org, Apr 6 2017

Comment 3 Deleted

Comment 4 by bugdroid1@chromium.org, Apr 11 2017

Comment 4 Deleted

Comment 5 by bugdroid1@chromium.org, Apr 13 2017

Comment 5 Deleted

Comment 6 by bugdroid1@chromium.org, May 22 2017

Comment 6 Deleted

Comment 7 by bugdroid1@chromium.org, Sep 5 2017

Comment 7 Deleted

Comment 8 Deleted

Comment 9 by yini...@chromium.org, Sep 12 2017

Comment 9 Deleted

Comment 10 by bugdroid1@chromium.org, Sep 26 2017

Comment 10 Deleted

Comment 11 by sheriffbot@chromium.org, Sep 26

Comment 11 Deleted

Comment 12 by lukebjerring@chromium.org, Sep 27

Comment 12 Deleted

Sign in to add a comment