"measurements.repaint_unittest.RepaintUnitTest.testRepaint" is flaky |
||||||||
Issue description"measurements.repaint_unittest.RepaintUnitTest.testRepaint" is flaky. This issue was created automatically by the chromium-try-flakes app. Please find the right owner to fix the respective test/step and assign this issue to them. If the step/test is infrastructure-related, please add Infra-Troopers label and change issue status to Untriaged. When done, please remove the issue from Sheriff Bug Queue by removing the Sheriff-Chromium label. We have detected 4 recent flakes. List of all flakes can be found at https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyRAsSBUZsYWtlIjltZWFzdXJlbWVudHMucmVwYWludF91bml0dGVzdC5SZXBhaW50VW5pdFRlc3QudGVzdFJlcGFpbnQM. Flaky tests should be disabled within 30 minutes unless culprit CL is found and reverted. Please see more details here: https://sites.google.com/a/chromium.org/dev/developers/tree-sheriffs/sheriffing-bug-queues#triaging-auto-filed-flakiness-bugs
,
Apr 27 2017
The test was not touched recently.
,
Apr 27 2017
The CL is https://codereview.chromium.org/2849513002 and it is being submitted right now.
,
Apr 27 2017
(I am disabling the test)
,
Apr 27 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/b5ef8f515cc03722022570a06b8601fac659f2ee commit b5ef8f515cc03722022570a06b8601fac659f2ee Author: vitaliii <vitaliii@chromium.org> Date: Thu Apr 27 13:09:03 2017 Disable measurements.repaint_unittest.RepaintUnitTest.testRepaint. Because flaky. TBR=nednguyen@google.com BUG=715962 Review-Url: https://codereview.chromium.org/2849513002 Cr-Commit-Position: refs/heads/master@{#467653} [modify] https://crrev.com/b5ef8f515cc03722022570a06b8601fac659f2ee/tools/perf/measurements/repaint_unittest.py
,
Apr 27 2017
,
Apr 27 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/d6ef52e3eb9f2545d880253597ec8360010d651a commit d6ef52e3eb9f2545d880253597ec8360010d651a Author: nednguyen <nednguyen@google.com> Date: Thu Apr 27 17:52:12 2017 Fix the repaint disabling decorator to be consistent with Telemetry disabling style BUG=715962 TBR=rnephew@chromium.org Review-Url: https://codereview.chromium.org/2850483002 Cr-Commit-Position: refs/heads/master@{#467730} [modify] https://crrev.com/d6ef52e3eb9f2545d880253597ec8360010d651a/tools/perf/measurements/repaint_unittest.py
,
May 11 2017
Since we still uses repaint cluster telemetry benchmark, I think we should try to fix the flakiness of this. Assign to Walter for triaging.
,
May 12 2017
I will likely not get to this until mid-July. Given it is marked as P1, passing to chrishtr@ for consideration and potential alternate routing or discussion. It sounds like it is flaky on Android specifically, so requires Android build/debug iteration.
,
May 12 2017
How critical is the flakiness?
,
May 17 2017
#10: we risk failing many pages when we run the repaint cluster telemetry benchmarks if we don't address the cause of the flakiness.
,
May 18 2017
Q -- who uses the repaint cluster telemetry benchmark? I have never used it, and pdr@ says he's unfamiliar with it as well.
,
May 21 2018
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue. Sorry for the inconvenience if the bug really should have been left as Available. For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot |
||||||||
►
Sign in to add a comment |
||||||||
Comment 1 by vitaliii@chromium.org
, Apr 27 2017Error log: === START === [2/2] measurements.repaint_unittest.RepaintUnitTest.testRepaint failed unexpectedly 15.3878s: [host]> /b/s/w/ir/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb devices [host]> /b/s/w/ir/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb devices [host]> /b/s/w/ir/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb devices [host]> /b/s/w/ir/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb devices [host]> /b/s/w/ir/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb kill-server Chrome build location for linux_x86_64 not found. Browser will be run without Flash. Tsproxy commandline: ['/usr/bin/python', '/b/s/w/ir/third_party/catapult/telemetry/third_party/tsproxy/tsproxy.py', '--port=0', '--desthost=127.0.0.1'] TsProxy port: 52172 Requested remote debugging port: 0 Starting Chrome ['/b/s/w/ir/out/Release/chrome', '--enable-gpu-benchmarking', '--enable-net-benchmarking', '--metrics-recording-only', '--no-default-browser-check', '--no-first-run', '--enable-gpu-benchmarking', '--disable-background-networking', '--proxy-server=socks://localhost:52172', '--ignore-certificate-errors', '--disable-component-extensions-with-background-pages', '--disable-default-apps', '--disable-search-geolocation-disclosure', '--remote-debugging-port=0', '--enable-crash-reporter-for-testing', '--disable-component-update', '--window-size=1280,1024', '--user-data-dir=/b/s/w/itsULdUK/tmpwIO5rD', '--trace-config-file=/b/s/w/itsULdUK/tmpMJWGC0/chrome-trace-config.json', 'about:blank'] Discovered ephemeral port 56854 OS: linux trusty GPU device 0: VENDOR = 0x0, DEVICE = 0x0 GPU Attributes: amd_switchable : False basic_info_state : 2 context_info_state : 2 direct_rendering : True driver_date : driver_vendor : driver_version : gl_extensions : gl_renderer : gl_reset_notification_strategy: 0 gl_vendor : gl_version : gl_ws_extensions : gl_ws_vendor : gl_ws_version : in_process_gpu : True initialization_time : 0 jpeg_decode_accelerator_supported: False max_msaa_samples : optimus : False passthrough_cmd_decoder: False pixel_shader_version: process_crash_count : 0 rgba_visual : 0 sandboxed : False software_rendering : False supports_overlays : False system_visual : 0 vertex_shader_version: video_decode_accelerator_flags: 0 Feature Status: 2d_canvas : enabled flash_3d : enabled flash_stage3d : enabled flash_stage3d_baseline: enabled gpu_compositing : enabled multiple_raster_threads: enabled_on native_gpu_memory_buffers: disabled_software rasterization : disabled_software video_decode : unavailable_software video_encode : unavailable_software vpx_decode : unavailable_software webgl : enabled webgl2 : enabled Driver Bug Workarounds: clear_uniforms_before_first_program_use disable_framebuffer_cmaa scalarize_vec_and_mat_constructor_args Issuing command to ts_proxy_server: set rtt 0 Issuing command to ts_proxy_server: set inkbps 0 Issuing command to ts_proxy_server: set outkbps 0 PageCacheTemperature: any Chrome version: 3082 Trace sizes in bytes: {'traceEvents': 4895, 'telemetry': 83534, 'tabIds': 40} No importer found for TraceDataPart("telemetry") Traceback (most recent call last): File "/b/s/w/ir/tools/perf/measurements/repaint_unittest.py", line 47, in testRepaint self.assertGreater(frame_times[0].GetRepresentativeNumber(), 0) File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/value/list_of_scalar_values.py", line 133, in GetRepresentativeNumber return _Mean(self.values) File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/value/list_of_scalar_values.py", line 63, in _Mean return float(sum(values)) / len(values) if len(values) > 0 else 0.0 TypeError: object of type 'NoneType' has no len() === END ===