Flaky (?) failure of deqp/functional/gles3/texturespecification/random_teximage2d_2d.html and random_teximage2d_cube.html |
|||||||||
Issue descriptionIn this tryjob: https://build.chromium.org/p/tryserver.chromium.linux/builders/linux_optional_gpu_tests_rel/builds/742 from this unrelated CL: https://codereview.chromium.org/2046833003/ the ported dEQP test deqp/functional/gles3/texturespecification/random_teximage2d_2d.html failed. The failure mode looks a little like that of fbomultisample.html which was discussed with Mobica. It seems that perhaps certain random seeds fail the comparison function. Is that possible? I don't see a suppression for this failure on Linux in src/content/test/gpu/gpu_tests/webgl2_conformance_expectations.py but see it passing in subsequent try jobs, so wanted to make sure that the cause of the failure is known.
,
Jul 8 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/039da87fc8fcf5124a454e20bad6c2e86f52709a commit 039da87fc8fcf5124a454e20bad6c2e86f52709a Author: cwallez <cwallez@chromium.org> Date: Fri Jul 08 01:00:58 2016 Update the WebGL2 CTS expectations after driver upgrade TBR=kbr@chromium.org TBR=zmo@chromium.org BUG= 606498 BUG=618447 BUG= 621178 BUG=622492 CQ_INCLUDE_TRYBOTS=tryserver.chromium.linux:linux_optional_gpu_tests_rel;tryserver.chromium.mac:mac_optional_gpu_tests_rel;tryserver.chromium.win:win_optional_gpu_tests_rel Review-Url: https://codereview.chromium.org/2128313002 Cr-Commit-Position: refs/heads/master@{#404284} [modify] https://crrev.com/039da87fc8fcf5124a454e20bad6c2e86f52709a/content/test/gpu/gpu_tests/webgl2_conformance_expectations.py
,
Aug 16 2016
It's still marked flaky in the webgl2_conformance_expectations.py.
self.Flaky('deqp/functional/gles3/texturespecification/' +
'random_teximage2d_2d.html',
['linux', 'amd', 'intel'], bug=618447)
,
Aug 16 2016
Qiankun, Yunchao: is there any chance you could try running this test repeatedly on your machines and see if you can reproduce random failures? Thanks.
,
Aug 26 2016
Thanks Qiankun for trying.
,
Sep 15 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/444b3d20c7af1b51db928b5ed65e9a099970d945 commit 444b3d20c7af1b51db928b5ed65e9a099970d945 Author: jmadill <jmadill@chromium.org> Date: Thu Sep 15 17:46:00 2016 WebGL: Mark a test flaky on Linux/ANGLE. BUG=618447 TBR=zmo@chromium.org CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.linux:linux_optional_gpu_tests_rel;master.tryserver.chromium.mac:mac_optional_gpu_tests_rel;master.tryserver.chromium.win:win_optional_gpu_tests_rel;master.tryserver.chromium.android:android_optional_gpu_tests_rel Review-Url: https://codereview.chromium.org/2345633003 Cr-Commit-Position: refs/heads/master@{#418899} [modify] https://crrev.com/444b3d20c7af1b51db928b5ed65e9a099970d945/content/test/gpu/gpu_tests/webgl2_conformance_expectations.py
,
Sep 17 2016
Generalizing this suppression; it's happening both with and without ANGLE.
,
Sep 17 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/d42e1b0d09fc6ad1a7d2c5ef8e57887716049163 commit d42e1b0d09fc6ad1a7d2c5ef8e57887716049163 Author: kbr <kbr@chromium.org> Date: Sat Sep 17 00:14:42 2016 Suppress flaky texturespecification/random_teximage2d_2d.html on Linux NVIDIA. BUG=618447, 619264 CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.linux:linux_optional_gpu_tests_rel;master.tryserver.chromium.mac:mac_optional_gpu_tests_rel;master.tryserver.chromium.win:win_optional_gpu_tests_rel;master.tryserver.chromium.android:android_optional_gpu_tests_rel TBR=cwallez@chromium.org, zmo@chromium.org NOTRY=true Review-Url: https://codereview.chromium.org/2350503002 Cr-Commit-Position: refs/heads/master@{#419339} [modify] https://crrev.com/d42e1b0d09fc6ad1a7d2c5ef8e57887716049163/content/test/gpu/gpu_tests/webgl2_conformance_expectations.py
,
Jan 12 2017
,
Jan 12 2017
,
Mar 9 2018
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue. Sorry for the inconvenience if the bug really should have been left as Available. If you change it back, also remove the "Hotlist-Recharge-Cold" label. For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
,
Mar 9 2018
,
Jun 28 2018
deqp/functional/gles3/texturespecification/random_teximage2d_cube.html observed to flake here: https://ci.chromium.org/p/chromium/builders/luci.chromium.try/linux_optional_gpu_tests_rel/5238 https://chromium-swarm.appspot.com/task?id=3e60f27089cb6410&refresh=10&show_raw=1 https://test-results.appspot.com/dashboards/flakiness_dashboard.html#testType=webgl2_conformance_tests&tests=gpu_tests.webgl_conformance_integration_test.WebGLConformanceIntegrationTest.WebglConformance_deqp_functional_gles3_texturespecification_random_teximage2d_cube Log: [128/138] gpu_tests.webgl_conformance_integration_test.WebGLConformanceIntegrationTest.WebglConformance_deqp_functional_gles3_texturespecification_random_teximage2d_cube failed unexpectedly 14.7394s: Traceback (most recent call last): _RunGpuTest at content/test/gpu/gpu_tests/gpu_integration_test.py:132 self.RunActualGpuTest(url, *args) RunActualGpuTest at content/test/gpu/gpu_tests/webgl_conformance_integration_test.py:185 getattr(self, test_name)(test_path, *args[1:]) _RunConformanceTest at content/test/gpu/gpu_tests/webgl_conformance_integration_test.py:199 self._CheckTestCompletion() _CheckTestCompletion at content/test/gpu/gpu_tests/webgl_conformance_integration_test.py:195 self.fail(self._WebGLTestMessages(self.tab)) fail at .swarming_module/lib/python2.7/unittest/case.py:410 raise self.failureException(msg) AssertionError: specification.random_teximage2d.cube.rg32ui: Image comparison failed Init testcase: specification Init testcase: specification.random_teximage2d.cube.rgba32i Init testcase: specification.random_teximage2d.cube.r32ui Init testcase: specification.random_teximage2d.cube.rg16i Init testcase: specification.random_teximage2d.cube.rg32ui FAIL specification.random_teximage2d.cube.rg32ui: Image comparison failed specification.random_teximage2d.cube.rg32ui: Verification failed FAIL specification.random_teximage2d.cube.rg32ui: Verification failed Init testcase: specification.random_teximage2d.cube.rgb32i Init testcase: specification.random_teximage2d.cube.rg16f Init testcase: specification.random_teximage2d.cube.rg8i Init testcase: specification.random_teximage2d.cube.rg16f Init testcase: specification.random_teximage2d.cube.r32ui Init testcase: specification.random_teximage2d.cube.rg16ui Suppressing.
,
Jun 29 2018
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/83c528e8e64375c76bd965421fb96f7bcebcfbb8 commit 83c528e8e64375c76bd965421fb96f7bcebcfbb8 Author: Kenneth Russell <kbr@chromium.org> Date: Fri Jun 29 04:34:26 2018 Suppress dEQP random_teximage2d_cube.html on Linux NVIDIA. Suppressing the following flaky test on Linux NVIDIA: deqp/functional/gles3/texturespecification/ random_teximage2d_cube.html Tbr: ynovikov@chromium.org Bug: 618447 Cq-Include-Trybots: luci.chromium.try:android_optional_gpu_tests_rel;luci.chromium.try:linux_optional_gpu_tests_rel;luci.chromium.try:mac_optional_gpu_tests_rel;luci.chromium.try:win_optional_gpu_tests_rel Change-Id: Ia22432c9cfd71fc4d26e21eea26576ecedfe8593 Reviewed-on: https://chromium-review.googlesource.com/1119542 Reviewed-by: Kenneth Russell <kbr@chromium.org> Reviewed-by: Yuly Novikov <ynovikov@chromium.org> Commit-Queue: Kenneth Russell <kbr@chromium.org> Cr-Commit-Position: refs/heads/master@{#571389} [modify] https://crrev.com/83c528e8e64375c76bd965421fb96f7bcebcfbb8/content/test/gpu/gpu_tests/webgl2_conformance_expectations.py |
|||||||||
►
Sign in to add a comment |
|||||||||
Comment 1 by kbr@chromium.org
, Jun 8 2016