New issue
Advanced search Search tips

Issue 792995 link

Starred by 1 user

Issue metadata

Status: Assigned
Owner:
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: ----



Sign in to add a comment

cc_perftests failing on chromium.perf/Android Nexus5 Perf

Project Member Reported by sheriff-...@appspot.gserviceaccount.com, Dec 7 2017

Issue description

Filed by sheriff-o-matic@appspot.gserviceaccount.com on behalf of simonhatch@chromium.org

cc_perftests failing on chromium.perf/Android Nexus5 Perf

Builders failed on: 
- Android Nexus5 Perf: 
  https://build.chromium.org/p/chromium.perf/builders/Android%20Nexus5%20Perf


 
Cc: enne@chromium.org
+enne owner

Looking at last few runs, TileManagerPerfTest.PrepareTiles failed


C  480.982s run_tests_on_device(0acc13b443e4b104)  Timed out. Dumping threads.
C  480.982s run_tests_on_device(0acc13b443e4b104)  ********************************************************************************
C  480.982s run_tests_on_device(0acc13b443e4b104)  Stack dump for thread 'TimeoutThread-1-for-run_tests_on_device(0acc13b443e4b104)'
C  480.982s run_tests_on_device(0acc13b443e4b104)  ********************************************************************************
C  480.982s run_tests_on_device(0acc13b443e4b104)  File: "/usr/lib/python2.7/threading.py", line 774, in __bootstrap
C  480.982s run_tests_on_device(0acc13b443e4b104)    self.__bootstrap_inner()
C  480.982s run_tests_on_device(0acc13b443e4b104)  File: "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
C  480.982s run_tests_on_device(0acc13b443e4b104)    self.run()
C  480.982s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/utils/reraiser_thread.py", line 81, in run
C  480.983s run_tests_on_device(0acc13b443e4b104)    self._ret = self._func(*self._args, **self._kwargs)
C  480.983s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/utils/timeout_retry.py", line 150, in <lambda>
C  480.983s run_tests_on_device(0acc13b443e4b104)    child_thread = reraiser_thread.ReraiserThread(lambda: func(*args, **kwargs),
C  480.983s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/android/decorators.py", line 47, in impl
C  480.983s run_tests_on_device(0acc13b443e4b104)    return f(*args, **kwargs)
C  480.983s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/android/device_utils.py", line 1217, in StartInstrumentation
C  480.983s run_tests_on_device(0acc13b443e4b104)    large_output=True)
C  480.983s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/android/decorators.py", line 51, in timeout_retry_wrapper
C  480.983s run_tests_on_device(0acc13b443e4b104)    return impl()
C  480.983s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/android/decorators.py", line 47, in impl
C  480.983s run_tests_on_device(0acc13b443e4b104)    return f(*args, **kwargs)
C  480.983s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/android/device_utils.py", line 1063, in RunShellCommand
C  480.983s run_tests_on_device(0acc13b443e4b104)    output = handle_large_output(cmd, large_output)
C  480.983s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/android/device_utils.py", line 1028, in handle_large_output
C  480.983s run_tests_on_device(0acc13b443e4b104)    handle_large_command(cmd)
C  480.983s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/android/device_utils.py", line 1020, in handle_large_command
C  480.983s run_tests_on_device(0acc13b443e4b104)    return handle_check_return('sh %s' % script.name_quoted)
C  480.983s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/android/device_utils.py", line 1005, in handle_check_return
C  480.983s run_tests_on_device(0acc13b443e4b104)    return run(cmd)
C  480.983s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/android/device_utils.py", line 1001, in run
C  480.983s run_tests_on_device(0acc13b443e4b104)    return self.adb.Shell(cmd)
C  480.983s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/android/sdk/adb_wrapper.py", line 505, in Shell
C  480.983s run_tests_on_device(0acc13b443e4b104)    output = self._RunDeviceAdbCmd(args, timeout, retries, check_error=False)
C  480.983s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/android/sdk/adb_wrapper.py", line 301, in _RunDeviceAdbCmd
C  480.983s run_tests_on_device(0acc13b443e4b104)    check_error=check_error)
C  480.983s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/android/decorators.py", line 51, in timeout_retry_wrapper
C  480.983s run_tests_on_device(0acc13b443e4b104)    return impl()
C  480.983s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/android/decorators.py", line 47, in impl
C  480.983s run_tests_on_device(0acc13b443e4b104)    return f(*args, **kwargs)
C  480.983s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/android/sdk/adb_wrapper.py", line 262, in _RunAdbCmd
C  480.983s run_tests_on_device(0acc13b443e4b104)    env=cls._ADB_ENV)
C  480.983s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/utils/cmd_helper.py", line 392, in GetCmdStatusAndOutputWithTimeout
C  480.983s run_tests_on_device(0acc13b443e4b104)    for data in _IterProcessStdout(process, timeout=timeout):
C  480.983s run_tests_on_device(0acc13b443e4b104)  File: "/b/swarming/w/ir/third_party/catapult/devil/devil/utils/cmd_helper.py", line 254, in _IterProcessStdoutFcntl
C  480.983s run_tests_on_device(0acc13b443e4b104)    [child_fd], [], [], iter_aware_poll_interval)
C  480.983s run_tests_on_device(0acc13b443e4b104)  ********************************************************************************
E  480.984s run_tests_on_device(0acc13b443e4b104)  gtest shard timed out.
Traceback (most recent call last):
  File "/b/swarming/w/ir/build/android/pylib/local/device/local_device_gtest_run.py", line 185, in Run
    self._component, extras=extras, raw=False, **kwargs)
  File "/b/swarming/w/ir/third_party/catapult/devil/devil/android/decorators.py", line 57, in timeout_retry_wrapper
    retry_if_func=retry_if_func)
  File "/b/swarming/w/ir/third_party/catapult/devil/devil/utils/timeout_retry.py", line 157, in Run
    error_log_func=error_log_func)
  File "/b/swarming/w/ir/third_party/catapult/devil/devil/utils/reraiser_thread.py", line 186, in JoinAll
    self._JoinAll(watcher, timeout)
  File "/b/swarming/w/ir/third_party/catapult/devil/devil/utils/reraiser_thread.py", line 151, in _JoinAll
    (len(alive_threads), len(self._threads)))
CommandTimeoutError: Timed out waiting for 1 of 1 threads.
Labels: -Sheriff-Chromium
Owner: vmp...@chromium.org
Status: Assigned (was: Available)
Seems to have begun failing consistently in https://ci.chromium.org/buildbot/chromium.perf/Android%20Nexus5%20Perf/737 , for which the blame range is https://chromium.googlesource.com/chromium/src/+log/b23fa286..7994385a .

Disabling this test, reassigning bug to vmpstr@ as last person to significantly touch the test (years ago) in hopes of better triage, and removing from sheriff queue.
Project Member

Comment 3 by bugdroid1@chromium.org, Dec 8 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/6c14186b52b9a606173a80c57b2272c02f5183ca

commit 6c14186b52b9a606173a80c57b2272c02f5183ca
Author: Peter Kasting <pkasting@chromium.org>
Date: Fri Dec 08 03:02:10 2017

Disable failing test.

Bug: 792995
Cq-Include-Trybots: master.tryserver.blink:linux_trusty_blink_rel;master.tryserver.chromium.android:android_optional_gpu_tests_rel
Change-Id: I2a0824af47a4ce5a221b7e1fe907270bfe17995c
TBR: vmpstr
Reviewed-on: https://chromium-review.googlesource.com/815948
Reviewed-by: Peter Kasting <pkasting@chromium.org>
Commit-Queue: Peter Kasting <pkasting@chromium.org>
Cr-Commit-Position: refs/heads/master@{#522691}
[modify] https://crrev.com/6c14186b52b9a606173a80c57b2272c02f5183ca/cc/tiles/tile_manager_perftest.cc

Cc: vmp...@chromium.org
 Issue 775260  has been merged into this issue.
Project Member

Comment 5 by bugdroid1@chromium.org, Apr 20 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/87711633bd43436dea338b0869f5ab89c89d758d

commit 87711633bd43436dea338b0869f5ab89c89d758d
Author: Sadrul Habib Chowdhury <sadrul@chromium.org>
Date: Fri Apr 20 19:10:30 2018

cc_perftests: Stop running on the perf bots.

The tests have not been very useful, and has remain disabled on a
number of bots for a while. So stop running the tests on the perf
bots altogether. The tests can still be used locally to watch for
improvements/regressions for specific changes as desired/needed.

BUG= 784454 ,  721757 ,  736150 
BUG= 698831 , 792995,  723821 

Change-Id: Ifede89a3f7a87d96bbb726e0911e1df26e6f9a6b
Reviewed-on: https://chromium-review.googlesource.com/1021653
Reviewed-by: enne <enne@chromium.org>
Reviewed-by: Ned Nguyen <nednguyen@google.com>
Reviewed-by: Dirk Pranke <dpranke@chromium.org>
Commit-Queue: Ned Nguyen <nednguyen@google.com>
Cr-Commit-Position: refs/heads/master@{#552422}
[modify] https://crrev.com/87711633bd43436dea338b0869f5ab89c89d758d/testing/buildbot/chromium.perf.json
[modify] https://crrev.com/87711633bd43436dea338b0869f5ab89c89d758d/testing/buildbot/gn_isolate_map.pyl
[modify] https://crrev.com/87711633bd43436dea338b0869f5ab89c89d758d/tools/perf/benchmark.csv
[modify] https://crrev.com/87711633bd43436dea338b0869f5ab89c89d758d/tools/perf/core/perf_data_generator.py

Sign in to add a comment