About one failure per week? https://findit-for-me.appspot.com/waterfall/list-flakes?test_name=virtual%2Flazyload-policy%2Fexternal%2Fwpt%2Ffeature-policy%2Fexperimental-features%2Flazyload%2Flazyload-enabled-tentative.sub.html Example: https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Mac10.13%20Tests%20%28dbg%29/7320
My strong guess is that the 400ms timeout is not enough to determine "not loaded". It used to be worse at 100ms but Mark increased it and the flakes substantially reduced. I will increase it a bit more and see what happens.
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/6b1262920a7888fd0af5ae3b21b20d9da37adeac commit 6b1262920a7888fd0af5ae3b21b20d9da37adeac Author: Ehsan Karamad <ekaramad@chromium.org> Date: Fri Dec 14 23:14:35 2018 lazy-load: Increase timeout value to reduce flakes The test is still a bit flaky after increasing the value to 400ms ( which did in fact reduce flakiness substantially). This CL will increase the value even further (600ms) to further reduce the flakiness. TBR=iclelland@chromium.org Bug: 915236 Change-Id: I1ad650ed14dbf9b054a966324ec033a4bd2f47f8 Reviewed-on: https://chromium-review.googlesource.com/c/1379105 Reviewed-by: Ehsan Karamad <ekaramad@chromium.org> Commit-Queue: Ehsan Karamad <ekaramad@chromium.org> Cr-Commit-Position: refs/heads/master@{#616867} [modify] https://crrev.com/6b1262920a7888fd0af5ae3b21b20d9da37adeac/third_party/blink/web_tests/external/wpt/feature-policy/experimental-features/lazyload/lazyload-disabled-tentative.sub.html [modify] https://crrev.com/6b1262920a7888fd0af5ae3b21b20d9da37adeac/third_party/blink/web_tests/external/wpt/feature-policy/experimental-features/lazyload/lazyload-enabled-tentative.sub.html
Comment 1 by ekaramad@chromium.org
, Dec 14