There are imperceptible pixel differences causing flakiness. example at: https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Mac10.12%20Tests/17164 flakiness dashbaord: https://test-results.appspot.com/dashboards/flakiness_dashboard.html#testType=webkit_layout_tests&tests=media%2Fcontrols%2Fbuttons-after-reset.html
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/9d688e69a01e00c72153046b4e93d100f59177db commit 9d688e69a01e00c72153046b4e93d100f59177db Author: Matt Falkenhagen <falken@chromium.org> Date: Fri Nov 30 03:30:31 2018 Gardening: media/controls/buttons-after-reset.html is flaky A virtual test was already marked as flaky, but the root test itself is also flaky. Bug: 910452 Change-Id: I579264a4b6ef4bab235028d1bce46ceeded8481d TBR: mlamouri No-Try: true Reviewed-on: https://chromium-review.googlesource.com/c/1355309 Reviewed-by: Matt Falkenhagen <falken@chromium.org> Commit-Queue: Matt Falkenhagen <falken@chromium.org> Cr-Commit-Position: refs/heads/master@{#612543} [modify] https://crrev.com/9d688e69a01e00c72153046b4e93d100f59177db/third_party/blink/web_tests/TestExpectations
media/controls/buttons-after-reset.html is flaky. Findit has detected 3 new flake occurrences of this test. List of all flake occurrences can be found at: https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyTwsSBUZsYWtlIkRjaHJvbWl1bUB3ZWJraXRfbGF5b3V0X3Rlc3RzQG1lZGlhL2NvbnRyb2xzL2J1dHRvbnMtYWZ0ZXItcmVzZXQuaHRtbAw. Since this test is still flaky, this issue has been moved back onto the Sheriff Bug Queue if it's not already there. If the result above is wrong, please file a bug using this link: https://bugs.chromium.org/p/chromium/issues/entry?status=Unconfirmed&labels=Pri-1,Test-Findit-Wrong&components=Tools%3ETest%3EFindit%3EFlakiness&summary=%5BFindit%5D%20Flake%20Detection%20-%20Wrong%20result%20for%20media/controls/buttons-after-reset.html&comment=Link%20to%20flake%20occurrences%3A%20https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyTwsSBUZsYWtlIkRjaHJvbWl1bUB3ZWJraXRfbGF5b3V0X3Rlc3RzQG1lZGlhL2NvbnRyb2xzL2J1dHRvbnMtYWZ0ZXItcmVzZXQuaHRtbAw Automatically posted by the findit-for-me app (https://goo.gl/Ot9f7N).
media/controls/buttons-after-reset.html is flaky. Findit has detected 9 new flake occurrences of this test. List of all flake occurrences can be found at: https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyTwsSBUZsYWtlIkRjaHJvbWl1bUB3ZWJraXRfbGF5b3V0X3Rlc3RzQG1lZGlhL2NvbnRyb2xzL2J1dHRvbnMtYWZ0ZXItcmVzZXQuaHRtbAw. Since this test is still flaky, this issue has been moved back onto the Sheriff Bug Queue if it's not already there. If the result above is wrong, please file a bug using this link: https://bugs.chromium.org/p/chromium/issues/entry?status=Unconfirmed&labels=Pri-1,Test-Findit-Wrong&components=Tools%3ETest%3EFindit%3EFlakiness&summary=%5BFindit%5D%20Flake%20Detection%20-%20Wrong%20result%20for%20media/controls/buttons-after-reset.html&comment=Link%20to%20flake%20occurrences%3A%20https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyTwsSBUZsYWtlIkRjaHJvbWl1bUB3ZWJraXRfbGF5b3V0X3Rlc3RzQG1lZGlhL2NvbnRyb2xzL2J1dHRvbnMtYWZ0ZXItcmVzZXQuaHRtbAw Automatically posted by the findit-for-me app (https://goo.gl/Ot9f7N).
media/controls/buttons-after-reset.html is flaky. Findit has detected 4 new flake occurrences of this test. List of all flake occurrences can be found at: https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyTwsSBUZsYWtlIkRjaHJvbWl1bUB3ZWJraXRfbGF5b3V0X3Rlc3RzQG1lZGlhL2NvbnRyb2xzL2J1dHRvbnMtYWZ0ZXItcmVzZXQuaHRtbAw. Since this test is still flaky, this issue has been moved back onto the Sheriff Bug Queue if it's not already there. If the result above is wrong, please file a bug using this link: https://bugs.chromium.org/p/chromium/issues/entry?status=Unconfirmed&labels=Pri-1,Test-Findit-Wrong&components=Tools%3ETest%3EFindit%3EFlakiness&summary=%5BFindit%5D%20Flake%20Detection%20-%20Wrong%20result%20for%20media/controls/buttons-after-reset.html&comment=Link%20to%20flake%20occurrences%3A%20https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyTwsSBUZsYWtlIkRjaHJvbWl1bUB3ZWJraXRfbGF5b3V0X3Rlc3RzQG1lZGlhL2NvbnRyb2xzL2J1dHRvbnMtYWZ0ZXItcmVzZXQuaHRtbAw Automatically posted by the findit-for-me app (https://goo.gl/Ot9f7N).
media/controls/buttons-after-reset.html is flaky. Findit has detected 11 new flake occurrences of this test. List of all flake occurrences can be found at: https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyTwsSBUZsYWtlIkRjaHJvbWl1bUB3ZWJraXRfbGF5b3V0X3Rlc3RzQG1lZGlhL2NvbnRyb2xzL2J1dHRvbnMtYWZ0ZXItcmVzZXQuaHRtbAw. Since this test is still flaky, this issue has been moved back onto the Sheriff Bug Queue if it's not already there. If the result above is wrong, please file a bug using this link: https://bugs.chromium.org/p/chromium/issues/entry?status=Unconfirmed&labels=Pri-1,Test-Findit-Wrong&components=Tools%3ETest%3EFindit%3EFlakiness&summary=%5BFindit%5D%20Flake%20Detection%20-%20Wrong%20result%20for%20media/controls/buttons-after-reset.html&comment=Link%20to%20flake%20occurrences%3A%20https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyTwsSBUZsYWtlIkRjaHJvbWl1bUB3ZWJraXRfbGF5b3V0X3Rlc3RzQG1lZGlhL2NvbnRyb2xzL2J1dHRvbnMtYWZ0ZXItcmVzZXQuaHRtbAw Automatically posted by the findit-for-me app (https://goo.gl/Ot9f7N).
media/controls/buttons-after-reset.html is flaky. Findit has detected 6 new flake occurrences of this test. List of all flake occurrences can be found at: https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyTwsSBUZsYWtlIkRjaHJvbWl1bUB3ZWJraXRfbGF5b3V0X3Rlc3RzQG1lZGlhL2NvbnRyb2xzL2J1dHRvbnMtYWZ0ZXItcmVzZXQuaHRtbAw. Since this test is still flaky, this issue has been moved back onto the Sheriff Bug Queue if it's not already there. If the result above is wrong, please file a bug using this link: https://bugs.chromium.org/p/chromium/issues/entry?status=Unconfirmed&labels=Pri-1,Test-Findit-Wrong&components=Tools%3ETest%3EFindit%3EFlakiness&summary=%5BFindit%5D%20Flake%20Detection%20-%20Wrong%20result%20for%20media/controls/buttons-after-reset.html&comment=Link%20to%20flake%20occurrences%3A%20https://findit-for-me.appspot.com/flake/occurrences?key=ag9zfmZpbmRpdC1mb3ItbWVyTwsSBUZsYWtlIkRjaHJvbWl1bUB3ZWJraXRfbGF5b3V0X3Rlc3RzQG1lZGlhL2NvbnRyb2xzL2J1dHRvbnMtYWZ0ZXItcmVzZXQuaHRtbAw Automatically posted by the findit-for-me app (https://goo.gl/Ot9f7N).
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/ee769cbb3d6ac9e65da1bb321d995a987a5a0781 commit ee769cbb3d6ac9e65da1bb321d995a987a5a0781 Author: Morten Stenshorne <mstensho@chromium.org> Date: Thu Dec 13 10:13:49 2018 Mark *media/controls/buttons-after-reset.html as flaky. Virtual tests don't inherit the expectation line for the base test. TBR=falken@chromium.org,mlamouri@chromium.org Bug: 910452 Change-Id: I2ef42f13f9fb69b6c2f653eada9c49bfa1bd4e0b Reviewed-on: https://chromium-review.googlesource.com/c/1374983 Reviewed-by: Morten Stenshorne <mstensho@chromium.org> Commit-Queue: Morten Stenshorne <mstensho@chromium.org> Cr-Commit-Position: refs/heads/master@{#616259} [modify] https://crrev.com/ee769cbb3d6ac9e65da1bb321d995a987a5a0781/third_party/blink/web_tests/TestExpectations
Comment 1 by bugdroid1@chromium.org
, Nov 30