texImage-imageBitmap-from-image-resize.html flaky on mac10.11 |
|||
Issue descriptionFiled by sheriff-o-matic@appspot.gserviceaccount.com on behalf of liberato@google.com ...... too many results, data snipped.... and 40 other(s) in webkit_layout_tests failing on chromium.webkit/WebKit Mac10.11 Builders failed on: - WebKit Mac10.11: https://build.chromium.org/p/chromium.webkit/builders/WebKit%20Mac10.11 Looks like the bottom quarter of the test image has small pixel differences, sometimes. (https://test-results.appspot.com/data/layout_results/WebKit_Mac10_11/28821/layout-test-results/results.html). first instance i see is on feb 11. will update with revision range.
,
Feb 12 2018
Hmm. That's definitely from that change, but it's not expected that the images are not stable. I'm surprised that only the one Mac 10.11 bot is flaky, and not the other Mac, Linux or Windows bots. Do you happen to know if these tests run on a variety of machines with different CPU feature sets? I thought we disabled our runtime CPU feature detection in layout tests... I'll have to double check. In the meantime, is it possible to disable this test or mark it as flaky? We should be getting plenty of coverage from the other x86 layout test bots, and as you can see this diff isn't really even visible.
,
Feb 12 2018
looks like just one (virtual?) bot on this builder: https://ci.chromium.org/buildbot/chromium.webkit/WebKit%20Mac10.11/ does seem to flake though: good: https://ci.chromium.org/buildbot/chromium.webkit/WebKit%20Mac10.11/28861 bad: https://ci.chromium.org/buildbot/chromium.webkit/WebKit%20Mac10.11/28843 as for disabling it, yes, it can be done. one may add an entry to third_party/WebKit/LayoutTests/TestExpectations with the os set to "Mac10.11". however, since there's just one bot, seems like seems like there's actually something nondeterministic going on. i suppose it could also be some uninteresting (to chrome, anyway) differences in the vm, which the infra folks might still care about.
,
Feb 12 2018
,
Feb 12 2018
I think this is fixed and the bot was just late to mention it? I landed the first version of this CL yesterday (beginning of a long steady run of red on https://ci.chromium.org/buildbot/chromium.webkit/WebKit%20Mac10.11/?limit=100), and it was also reverted yesterday (ending that run of red). I happened to reland the CL today after re-rebaselining, and I'm not seeing any new failures beyond one unrelated looking one (a timeout?). Please re-open if things still seem broken at head?
,
Feb 12 2018
I did double check and unless something's gone very wrong, we do unconditionally turn off CPU detection when running layout tests. Each binary should produce stable images across multiple machines, unless you get real GPUs involved... |
|||
►
Sign in to add a comment |
|||
Comment 1 by liber...@chromium.org
, Feb 12 2018Owner: mtklein@chromium.org
Status: Assigned (was: Available)