New issue
Advanced search Search tips

Issue 891456 link

Starred by 1 user

Issue metadata

Status: Available
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Android
Pri: 2
Type: Bug

Blocked on:
issue 898674



Sign in to add a comment

webgl_conformance_tests flaky on Android FYI Release bots

Project Member Reported by kylec...@chromium.org, Oct 2

Issue description

There has been a number of failing runs in webgl_conformance_tests for Android FYI Release (NVIDIA Shield TV):
https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Android%20FYI%20Release%20%28NVIDIA%20Shield%20TV%29?limit=200

This doesn't appear related to similar looking failures on mac in https://crbug.com/891249. The cause of that was reverted and mac bots are stable.

I see failures in the following tests:
WebglConformance_conformance_textures_video_tex_2d_rgb_rgb_unsigned_short_5_6_5
WebglConformance_conformance_extensions_oes_texture_float_with_video
WebglConformance_conformance_textures_image_bitmap_from_video_tex_2d_rgb_rgb_unsigned_short_5_6_5

Example failing run:
https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Android%20FYI%20Release%20%28NVIDIA%20Shield%20TV%29/7937

There is one similar failure on Android FYI Release (Nexus 5X) so it's probably not not be Nvida Shield specific.
https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Android%20FYI%20Release%20%28Nexus%205X%29/9597
 
Cc: ynovikov@chromium.org kainino@chromium.org
Components: Blink>WebGL
We've seen problems with these video tests in the past on Android and it seems that sometimes the video isn't playing properly, despite the test harness's best efforts to detect when the video is playing before attempting to upload it to WebGL.

Could you please mark these flaky on this device or these devices? I see WebglConformance_conformance_extensions_oes_texture_half_float_with_video failing too in https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Android%20FYI%20Release%20%28NVIDIA%20Shield%20TV%29/8050 . Thanks.

Owner: kylec...@chromium.org
Status: Assigned (was: Untriaged)
Assigning to pixel wrangler for suppressions. Feel free to move to Available once this is done.

Project Member

Comment 3 by bugdroid1@chromium.org, Oct 5

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/e976e2d37125e29e5a916d558232997f809ebb46

commit e976e2d37125e29e5a916d558232997f809ebb46
Author: kylechar <kylechar@chromium.org>
Date: Fri Oct 05 16:13:46 2018

Mark WebglConformance tests as flaky on Android.

Three video related tests are failing flakily on the Android FYI
trybots. Failures have been seen on Nexus 9 and Nvidia Shield primarily,
so will set them flaky for nvidia boards.

TBR: kbr@chromium.org
Bug: 891456
Cq-Include-Trybots: luci.chromium.try:android_optional_gpu_tests_rel;luci.chromium.try:linux_optional_gpu_tests_rel;luci.chromium.try:mac_optional_gpu_tests_rel;luci.chromium.try:win_optional_gpu_tests_rel
Change-Id: I64d768be4cabf246b6e0ab007c87c2292a8adf42
Reviewed-on: https://chromium-review.googlesource.com/c/1263037
Reviewed-by: kylechar <kylechar@chromium.org>
Commit-Queue: kylechar <kylechar@chromium.org>
Cr-Commit-Position: refs/heads/master@{#597155}
[modify] https://crrev.com/e976e2d37125e29e5a916d558232997f809ebb46/content/test/gpu/gpu_tests/webgl_conformance_expectations.py

Cc: jdarpinian@chromium.org
Owner: ----
Status: Available (was: Assigned)
A few notes for next weeks pixel wrangler:
1. I missed adding a suppression for conformance/extensions/oes-texture-float-with-video.html in #3. That test is still failing.
2. Looking at the bot runs for the weekend, there are more video related webgl_conformance_tests failing on the nvidia shield bot so I guess more tests need similar suppressions.
2. It also looks like the same set video webgl_conformance_tests failures are happening on the Nexus 6P and 5X bots too, just less frequently, so limiting the suppressions to nvidia chips might not be the right thing to have done. I was having trouble figuring how to handle overlapping suppressions that failed presubmit.
Owner: jdarpinian@chromium.org
Status: Assigned (was: Available)
Project Member

Comment 6 by bugdroid1@chromium.org, Oct 9

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/ba0631c39cdb57bc1c3c3f1bcd1655ff73e20986

commit ba0631c39cdb57bc1c3c3f1bcd1655ff73e20986
Author: James Darpinian <jdarpinian@chromium.org>
Date: Tue Oct 09 00:20:38 2018

Flaky WebGL test suppression for Android Nvidia

conformance/extensions/oes-texture-float-with-video.html is flaky.
Example flake: https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Android%20FYI%20Release%20(NVIDIA%20Shield%20TV)/8217

TBR: kbr@chromium.org
Bug: 891456
Cq-Include-Trybots: luci.chromium.try:android_optional_gpu_tests_rel;luci.chromium.try:linux_optional_gpu_tests_rel;luci.chromium.try:mac_optional_gpu_tests_rel;luci.chromium.try:win_optional_gpu_tests_rel
Change-Id: Iff4c8dd027dba5d21a74e96c7438a897ad0c22e0
Reviewed-on: https://chromium-review.googlesource.com/c/1269720
Reviewed-by: James Darpinian <jdarpinian@chromium.org>
Commit-Queue: James Darpinian <jdarpinian@chromium.org>
Cr-Commit-Position: refs/heads/master@{#597750}
[modify] https://crrev.com/ba0631c39cdb57bc1c3c3f1bcd1655ff73e20986/content/test/gpu/gpu_tests/webgl_conformance_expectations.py

Owner: ----
Status: Available (was: Assigned)
Labels: -Hotlist-PixelWrangler
Blockedon: 898674

Sign in to add a comment