"external/wpt/editing/run/delete.html?1-1000" and related tests are flaky |
|||||||||||||||||||||
Issue description"external/wpt/editing/run/delete.html?1-1000" is flaky. This issue was created automatically by the chromium-try-flakes app. Please find the right owner to fix the respective test/step and assign this issue to them. If the step/test is infrastructure-related, please add Infra-Troopers label and change issue status to Untriaged. When done, please remove the issue from Sheriff Bug Queue by removing the Sheriff-Chromium label. We have detected 4 recent flakes. List of all flakes can be found at https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyNgsSBUZsYWtlIitleHRlcm5hbC93cHQvZWRpdGluZy9ydW4vZGVsZXRlLmh0bWw_MS0xMDAwDA. Flaky tests should be disabled within 30 minutes unless culprit CL is found and reverted. Please see more details here: https://sites.google.com/a/chromium.org/dev/developers/tree-sheriffs/sheriffing-bug-queues#triaging-auto-filed-flakiness-bugs
,
Aug 23
There are several other related tests that are also flaky, I'm combining them into this CL: external/wpt/editing/run/forwarddelete.html?4001-5000 external/wpt/editing/run/forwarddelete.html?1001-2000 external/wpt/editing/run/delete.html?3001-4000 external/wpt/editing/run/delete.html?1-1000 external/wpt/editing/run/delete.html?3001-4000
,
Aug 23
Oops, I meant that I'm combining them into this bug.
,
Aug 23
Issue 877230 has been merged into this issue.
,
Aug 23
Issue 877229 has been merged into this issue.
,
Aug 23
Issue 877256 has been merged into this issue.
,
Aug 23
From output of the test failures: [INFO:media_foundation_video_encode_accelerator_win.cc(346)] Windows versions earlier than 8 are not supported.
,
Aug 23
,
Aug 24
Ah, I've just found this kind of *metabug*. I'm landing the CLs which disable some of them in other CLs (and other bugs). Let me merge these bugs into this later.
,
Aug 24
,
Aug 24
Issue 877293 has been merged into this issue.
,
Aug 24
Issue 877292 has been merged into this issue.
,
Aug 24
Disabling tests at https://chromium-review.googlesource.com/c/chromium/src/+/1188059
,
Aug 24
,
Aug 24
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/ba288e55a0a73d8a894c78c943af14a7f336b5cc commit ba288e55a0a73d8a894c78c943af14a7f336b5cc Author: Hayato Ito <hayato@chromium.org> Date: Fri Aug 24 09:19:37 2018 Disable flaky tests in external/wpt/editing/run/ BUG= 877104 TBR=yosin@chromium.org Change-Id: Id80de4171d13f32333d3ce93b330cf308a3c561a Reviewed-on: https://chromium-review.googlesource.com/1188059 Reviewed-by: Hayato Ito <hayato@chromium.org> Commit-Queue: Hayato Ito <hayato@chromium.org> Cr-Commit-Position: refs/heads/master@{#585772} [modify] https://crrev.com/ba288e55a0a73d8a894c78c943af14a7f336b5cc/third_party/WebKit/LayoutTests/TestExpectations
,
Aug 24
,
Aug 24
Detected 4 new flakes for test/step "external/wpt/editing/run/forwarddelete.html?1001-2000". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyQAsSBUZsYWtlIjVleHRlcm5hbC93cHQvZWRpdGluZy9ydW4vZm9yd2FyZGRlbGV0ZS5odG1sPzEwMDEtMjAwMAw. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).
,
Aug 24
Detected 5 new flakes for test/step "external/wpt/editing/run/forwarddelete.html?4001-5000". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyQAsSBUZsYWtlIjVleHRlcm5hbC93cHQvZWRpdGluZy9ydW4vZm9yd2FyZGRlbGV0ZS5odG1sPzQwMDEtNTAwMAw. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).
,
Aug 24
Looking at the shards where these tests are failing, I'm going to disable all the related tests on Win7 bots too.
,
Aug 24
This is causing a very large % of trybot runs to fail on windows.
,
Aug 24
CL to update the TestExpectations is in the CQ: https://chromium-review.googlesource.com/c/chromium/src/+/1188896
,
Aug 24
This is a new example of different testcases from the same test code in webkit layout tests. We need to normalize them to file just one flake bug.
,
Aug 24
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/75a4d21e24696dfb7ed4934257d8c83a0307d656 commit 75a4d21e24696dfb7ed4934257d8c83a0307d656 Author: Scott Little <sclittle@chromium.org> Date: Fri Aug 24 23:43:36 2018 Update TestExpectations for flaky tests on Win7. The flaky tests are: external/wpt/editing/run/delete.html?1-1000 external/wpt/editing/run/delete.html?1001-2000 external/wpt/editing/run/delete.html?3001-4000 external/wpt/editing/run/delete.html?4001-5000 external/wpt/editing/run/delete.html?5001-6000 external/wpt/editing/run/delete.html?6001-last external/wpt/editing/run/forward_delete.html?1-1000 external/wpt/editing/run/forward_delete.html?1001-2000 external/wpt/editing/run/forward_delete.html?2001-3000 external/wpt/editing/run/forward_delete.html?3001-4000 external/wpt/editing/run/forward_delete.html?4001-5000 external/wpt/editing/run/forward_delete.html?5001-6000 external/wpt/editing/run/forward_delete.html?6001-last external/wpt/editing/run/delete.html?2001-3000 isn't in this list since it's already disabled elsewhere in this TestExpectations file. TBR=foolip@chromium.org Bug: 877104 Change-Id: I01dd8218bddc9c1c726da03a062a714fc4f1f56c Reviewed-on: https://chromium-review.googlesource.com/1188896 Reviewed-by: Scott Little <sclittle@chromium.org> Commit-Queue: Scott Little <sclittle@chromium.org> Cr-Commit-Position: refs/heads/master@{#586060} [modify] https://crrev.com/75a4d21e24696dfb7ed4934257d8c83a0307d656/third_party/WebKit/LayoutTests/TestExpectations
,
Aug 25
Detected 7 new flakes for test/step "external/wpt/editing/run/delete.html?3001-4000". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyOQsSBUZsYWtlIi5leHRlcm5hbC93cHQvZWRpdGluZy9ydW4vZGVsZXRlLmh0bWw_MzAwMS00MDAwDA. This message was posted automatically by the chromium-try-flakes app.
,
Aug 25
This latest flake from #24 above was a CL that was based from an earlier revision than https://chromium-review.googlesource.com/1188896, so https://chromium-review.googlesource.com/1188896 should hopefully get the win7 trybots moving.
,
Aug 25
Detected 3 new flakes for test/step "external/wpt/editing/run/forwarddelete.html?2001-3000". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyQAsSBUZsYWtlIjVleHRlcm5hbC93cHQvZWRpdGluZy9ydW4vZm9yd2FyZGRlbGV0ZS5odG1sPzIwMDEtMzAwMAw. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).
,
Aug 25
Detected 5 new flakes for test/step "external/wpt/editing/run/forwarddelete.html?4001-5000". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyQAsSBUZsYWtlIjVleHRlcm5hbC93cHQvZWRpdGluZy9ydW4vZm9yd2FyZGRlbGV0ZS5odG1sPzQwMDEtNTAwMAw. This message was posted automatically by the chromium-try-flakes app.
,
Aug 27
Issue 877732 has been merged into this issue.
,
Aug 27
there are some mac failures too - https://ci.chromium.org/p/chromium/builders/luci.chromium.try/mac_chromium_rel_ng/126564
,
Aug 27
,
Aug 27
,
Aug 27
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/fc3d6eb82388ead2414aa2484a252b3183eb6ad3 commit fc3d6eb82388ead2414aa2484a252b3183eb6ad3 Author: Trent Apted <tapted@chromium.org> Date: Mon Aug 27 08:05:56 2018 Widen suppressions for external/wpt/editing/run/[forward_]delete.html to Mac r586060 added suppressions for Win7 but these flake on Mac as well. TBR=foolip@chromium.org Bug: 877104 Change-Id: Ic2f72440b1194ab493c165882d9bc50455eb53fc Reviewed-on: https://chromium-review.googlesource.com/1189509 Reviewed-by: Trent Apted <tapted@chromium.org> Commit-Queue: Trent Apted <tapted@chromium.org> Cr-Commit-Position: refs/heads/master@{#586210} [modify] https://crrev.com/fc3d6eb82388ead2414aa2484a252b3183eb6ad3/third_party/WebKit/LayoutTests/TestExpectations
,
Aug 27
Detected 3 new flakes for test/step "external/wpt/editing/run/forwarddelete.html?2001-3000". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyQAsSBUZsYWtlIjVleHRlcm5hbC93cHQvZWRpdGluZy9ydW4vZm9yd2FyZGRlbGV0ZS5odG1sPzIwMDEtMzAwMAw. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).
,
Aug 27
Detected 3 new flakes for test/step "external/wpt/editing/run/forwarddelete.html?3001-4000". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyQAsSBUZsYWtlIjVleHRlcm5hbC93cHQvZWRpdGluZy9ydW4vZm9yd2FyZGRlbGV0ZS5odG1sPzMwMDEtNDAwMAw. This message was posted automatically by the chromium-try-flakes app.
,
Aug 27
I see another flake in * external/wpt/editing/run/forwarddelete.html?4001-5000 The test expectations says forward_delete.html but the test files are called forwarddelete.html
,
Aug 27
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/3e4ed553c59041d3b0bfb61bf8a0152e91a046bc commit 3e4ed553c59041d3b0bfb61bf8a0152e91a046bc Author: John Abd-El-Malek <jam@chromium.org> Date: Mon Aug 27 21:54:12 2018 Fix layout tests expectations. TBR=foolip@chromium.org NOTRY=true Bug: 877104 Change-Id: I268223223aabed6ef5b3f9068f90f82d06214004 Reviewed-on: https://chromium-review.googlesource.com/1192133 Commit-Queue: John Abd-El-Malek <jam@chromium.org> Reviewed-by: John Abd-El-Malek <jam@chromium.org> Cr-Commit-Position: refs/heads/master@{#586430} [modify] https://crrev.com/3e4ed553c59041d3b0bfb61bf8a0152e91a046bc/third_party/WebKit/LayoutTests/TestExpectations
,
Aug 27
Issue 878027 has been merged into this issue.
,
Aug 27
Issue 878137 has been merged into this issue.
,
Aug 27
,
Aug 28
Detected 3 new flakes for test/step "external/wpt/editing/run/forwarddelete.html?1001-2000". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyQAsSBUZsYWtlIjVleHRlcm5hbC93cHQvZWRpdGluZy9ydW4vZm9yd2FyZGRlbGV0ZS5odG1sPzEwMDEtMjAwMAw. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).
,
Aug 28
Detected 3 new flakes for test/step "external/wpt/editing/run/forwarddelete.html?4001-5000". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyQAsSBUZsYWtlIjVleHRlcm5hbC93cHQvZWRpdGluZy9ydW4vZm9yd2FyZGRlbGV0ZS5odG1sPzQwMDEtNTAwMAw. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).
,
Aug 28
Detected 8 new flakes for test/step "external/wpt/editing/run/forwarddelete.html?2001-3000". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyQAsSBUZsYWtlIjVleHRlcm5hbC93cHQvZWRpdGluZy9ydW4vZm9yd2FyZGRlbGV0ZS5odG1sPzIwMDEtMzAwMAw. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).
,
Aug 28
Detected 3 new flakes for test/step "external/wpt/editing/run/forwarddelete.html?3001-4000". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyQAsSBUZsYWtlIjVleHRlcm5hbC93cHQvZWRpdGluZy9ydW4vZm9yd2FyZGRlbGV0ZS5odG1sPzMwMDEtNDAwMAw. This message was posted automatically by the chromium-try-flakes app.
,
Aug 28
Reporting to stale-flakes-reports@google.com to investigate why this issue has been in the appropriate queue 5 times or more.
,
Aug 29
Isn't this test just slow?
,
Aug 29
I'm trying to mark this test as Slow.
,
Aug 29
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/1ddc95505bb73b13c6b2f5dc07b25d3167bc5e21 commit 1ddc95505bb73b13c6b2f5dc07b25d3167bc5e21 Author: Yuta Kitamura <yutak@chromium.org> Date: Wed Aug 29 09:36:41 2018 delete.html?XXXX-XXXX and forwarddelete.html?XXXX-XXXX are slow. These tests seem just slow. Marking them as Slow to give a longer timeout. TBR=nednguyen@chromium.org,foolip@chromium.org Bug: 877104 Change-Id: I970267eead46b3e40c1e8e04a8b95a2df2563336 No-Try: true Reviewed-on: https://chromium-review.googlesource.com/1195127 Reviewed-by: Yuta Kitamura <yutak@chromium.org> Commit-Queue: Yuta Kitamura <yutak@chromium.org> Cr-Commit-Position: refs/heads/master@{#587049} [modify] https://crrev.com/1ddc95505bb73b13c6b2f5dc07b25d3167bc5e21/third_party/WebKit/LayoutTests/SlowTests [modify] https://crrev.com/1ddc95505bb73b13c6b2f5dc07b25d3167bc5e21/third_party/WebKit/LayoutTests/TestExpectations
,
Aug 30
Issue 879027 has been merged into this issue.
,
Aug 30
The tests are green except delete.html?2001-3000, which I forgot to include accidentally (oops!). I'm going to make it Slow, and everything should be OK.
,
Aug 30
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/2142667428a9255521b9e13171297996921ec3f1 commit 2142667428a9255521b9e13171297996921ec3f1 Author: Yuta Kitamura <yutak@chromium.org> Date: Thu Aug 30 04:36:12 2018 Mark delete.html?2001-3000 as Slow. I forgot to include this test in crrev.com/c/1195127. TBR=foolip@chromium.org Bug: 877104 Change-Id: Ic0195561d01ff5f9983f623ba2097e13f5a71734 No-Try: true Reviewed-on: https://chromium-review.googlesource.com/1195305 Reviewed-by: Yuta Kitamura <yutak@chromium.org> Commit-Queue: Yuta Kitamura <yutak@chromium.org> Cr-Commit-Position: refs/heads/master@{#587443} [modify] https://crrev.com/2142667428a9255521b9e13171297996921ec3f1/third_party/WebKit/LayoutTests/SlowTests
,
Aug 30
Now all those tests should be OK.
,
Sep 5
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/51b234e286437c446c184e140df462d6dcc74d4c commit 51b234e286437c446c184e140df462d6dcc74d4c Author: Kent Tamura <tkent@chromium.org> Date: Wed Sep 05 07:51:41 2018 Set longer timeout to all tests in wpt/editing/run/ https://web-platform-tests.org/writing-tests/testharness-api.html#harness-timeout Bug: 877104 , 877300 , 698165 Change-Id: I994550295c15f9b42273abc7d1b11f47dc0bb0c7 Reviewed-on: https://chromium-review.googlesource.com/1205917 Commit-Queue: Kent Tamura <tkent@chromium.org> Reviewed-by: Yoichi Osato <yoichio@chromium.org> Cr-Commit-Position: refs/heads/master@{#588790} [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/SlowTests [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/TestExpectations [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/backcolor.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/bold.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/createlink.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/delete-list-items-in-table-cell.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/delete.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/fontname.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/fontsize.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/forecolor.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/formatblock.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/forwarddelete.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/hilitecolor.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/indent.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/insert-list-items-in-table-cell.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/inserthorizontalrule.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/inserthtml.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/insertimage.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/insertlinebreak.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/insertorderedlist.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/insertparagraph.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/inserttext.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/insertunorderedlist.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/italic.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/justifycenter.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/justifyfull.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/justifyleft.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/justifyright.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/misc.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/multitest.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/outdent.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/removeformat.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/strikethrough.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/subscript.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/superscript.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/underline.html [modify] https://crrev.com/51b234e286437c446c184e140df462d6dcc74d4c/third_party/WebKit/LayoutTests/external/wpt/editing/run/unlink.html |
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by sahel@chromium.org
, Aug 23