Multiple HeadlessRenderBrowserTests are flaky on Linux dbg |
||||||
Issue descriptionFlakiness dashboard: https://test-results.appspot.com/dashboards/flakiness_dashboard.html#testType=headless_browsertests&tests=HeadlessRenderBrowserTest Failing tests are: HeadlessRenderBrowserTestCookieSetFromJs_NoCookies.RunAsyncTest HeadlessRenderBrowserTestRedirectInvalidUrl.RunAsyncTest HeadlessRenderBrowserTestServerRedirectToFailure.RunAsyncTest Seems to have started recently, first failing build: https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Linux%20Tests%20%28dbg%29%281%29/71801 I couldn't immediately find anything that looks related in the blamelist.
,
May 4 2018
FindIt analyses are currently running: https://findit-for-me.appspot.com/waterfall/flake?key=ag9zfmZpbmRpdC1mb3ItbWVyywELEhdNYXN0ZXJGbGFrZUFuYWx5c2lzUm9vdCKUAWNocm9taXVtLmxpbnV4L0xpbnV4IFRlc3RzIChkYmcpKDEpLzcxODAzL2hlYWRsZXNzX2Jyb3dzZXJ0ZXN0cy9TR1ZoWkd4bGMzTlNaVzVrWlhKQ2NtOTNjMlZ5VkdWemRFTnZiMnRwWlZObGRFWnliMjFLYzE5T2IwTnZiMnRwWlhNdVVuVnVRWE41Ym1OVVpYTjAMCxITTWFzdGVyRmxha2VBbmFseXNpcxgBDA https://findit-for-me.appspot.com/waterfall/flake?key=ag9zfmZpbmRpdC1mb3ItbWVyywELEhdNYXN0ZXJGbGFrZUFuYWx5c2lzUm9vdCKUAWNocm9taXVtLmxpbnV4L0xpbnV4IFRlc3RzIChkYmcpKDEpLzcxODAzL2hlYWRsZXNzX2Jyb3dzZXJ0ZXN0cy9TR1ZoWkd4bGMzTlNaVzVrWlhKQ2NtOTNjMlZ5VkdWemRGTmxjblpsY2xKbFpHbHlaV04wVkc5R1lXbHNkWEpsTGxKMWJrRnplVzVqVkdWemRBPT0MCxITTWFzdGVyRmxha2VBbmFseXNpcxgBDA
,
May 4 2018
+headless-dev@ to help triage while FindIt is trying to find the CL that caused this
,
May 4 2018
Might also be due to https://chromium-review.googlesource.com/c/chromium/src/+/988833 which was just reverted.
,
May 4 2018
Flakes have continued in builds (71808) after the revert landed(71807): https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Linux%20Tests%20%28dbg%29%281%29/71808 I'll put together a patch to disable the flaking tests until headless-dev@ can triage further.
,
May 4 2018
Starting with just the test that recently flaked, to see if the revert mentioned in #4 fixed the others. https://chromium-review.googlesource.com/c/chromium/src/+/1044303
,
May 4 2018
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/37711150a587c46d52e2cb8c7588e09d8f47befe commit 37711150a587c46d52e2cb8c7588e09d8f47befe Author: jonross <jonross@chromium.org> Date: Fri May 04 16:00:56 2018 Disable flaky HeadlessRenderBrowserTestCookieSetFromJs_NoCookies.RunAsyncTest A series of HeadlessRenderBrowserTests have been failing. A suspected fix to some of them has landed. However HeadlessRenderBrowserTestCookieSetFromJs_NoCookies.RunAsyncTest still fails. This disables it on Linux until the team can provide a fix. TEST=HeadlessRenderBrowserTestCookieSetFromJs_NoCookies.RunAsyncTest TBR=eseckler@chromium.org Bug: 839747 Change-Id: I526358528bd6b1922afc930db213be183426ae07 Reviewed-on: https://chromium-review.googlesource.com/1044303 Reviewed-by: Jonathan Ross <jonross@chromium.org> Commit-Queue: Jonathan Ross <jonross@chromium.org> Cr-Commit-Position: refs/heads/master@{#556072} [modify] https://crrev.com/37711150a587c46d52e2cb8c7588e09d8f47befe/headless/test/headless_render_browsertest.cc
,
May 4 2018
Setting eseckler@ as the owner based randomly on the owners file. Until headless-dev@ has a chance to triage. With the known flake disabled I'm removing the sheriff label, but will keep an eye out for others.
,
May 7 2018
These tests are flaky too: HeadlessRenderBrowserTestServerRedirectToFailure.RunAsyncTest HeadlessRenderBrowserTestRedirectInvalidUrl.RunAsyncTest Sample runs: https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Linux%20Tests%20%28dbg%29%281%29/71854 https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Linux%20Tests%20%28dbg%29%281%29/71855 https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Linux%20Tests%20%28dbg%29%281%29/71847
,
May 7 2018
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/fb054ef275af619e1790098622908e2d0d992ff9 commit fb054ef275af619e1790098622908e2d0d992ff9 Author: Guido Urdaneta <guidou@chromium.org> Date: Mon May 07 11:00:42 2018 Disable flaky HeadlessRenderBrowserTests on Linux TBR=eseckler@chromium.org Bug: 839747 Change-Id: Ic98a3b585163f663c983403d34d958460658c884 Reviewed-on: https://chromium-review.googlesource.com/1046597 Commit-Queue: Guido Urdaneta <guidou@chromium.org> Reviewed-by: Guido Urdaneta <guidou@chromium.org> Cr-Commit-Position: refs/heads/master@{#556410} [modify] https://crrev.com/fb054ef275af619e1790098622908e2d0d992ff9/headless/test/headless_render_browsertest.cc
,
May 8 2018
Off to caseq@ since all these tests seem to be network related and caseq is working on refactoring networking in headless for compatibility with the network service. I'm not sure if we should tackle these flakes before that's resolved, wdyt?
,
May 8 2018
,
Jan 10
These tests don't seem to be flaky anymore, likely as a result of both tests and underlying network interception layer being rewritten. |
||||||
►
Sign in to add a comment |
||||||
Comment 1 by treib@chromium.org
, May 4 2018