angle_perftests failing on multiple builders |
|||
Issue descriptionFiled by sheriff-o-matic@appspot.gserviceaccount.com on behalf of oysteine@google.com angle_perftests failing on multiple builders Builders failed on: - Android Nexus5 Perf: https://ci.chromium.org/p/chrome/builders/luci.chrome.ci/Android%20Nexus5%20Perf - Win 7 Nvidia GPU Perf: https://ci.chromium.org/p/chrome/builders/luci.chrome.ci/Win%207%20Nvidia%20GPU%20Perf
,
Nov 15
😿 Pinpoint job stopped with an error. https://pinpoint-dot-chromeperf.appspot.com/job/14c20b47e40000 All of the runs failed. The most common error (20/20 runs) was: SwarmingTestError: The test failed. No Python exception was found in the log.
,
Nov 16
dtu: Is this a Pinpoint problem or am I doing something dumb?
Running ['./angle_perftests', '--test-launcher-print-test-stdio=always', '--test-launcher-jobs=1', '--test-launcher-retry-limit=0', '--gtest_repeat=1', '--non-telemetry', 'true', '--verbose'] in None (env: {'ADDRFAM': 'inet', 'IFACE': 'em1', 'UPSTART_EVENTS': 'local-filesystems net-device-up', 'HOME': '/home/chrome-bot', 'BOTO_CONFIG': '/home/chrome-bot/.boto', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/bin:/usr/sbin:/sbin:/bin', 'SWARMING_BOT_ID': 'build222-b7', 'LANG': 'en_US.UTF-8', 'TERM': 'linux', 'SWARMING_SERVER': 'https://chrome-swarming.appspot.com', 'CHROME_DEVEL_SANDBOX': '/opt/chromium/chrome_sandbox', 'SWARMING_HEADLESS': '1', 'UPSTART_INSTANCE': '', 'LUCI_CONTEXT': '/b/s/w/iteubPVM/luci_ctx.gXK81P.json', 'METHOD': 'dhcp', 'SWARMING_TASK_ID': '4132137028b8b111', 'UPSTART_JOB': 'swarming', 'NO_GCE_CHECK': 'False', 'CHROME_HEADLESS': '1', 'TMPDIR': '/b/s/w/iteubPVM', 'CIPD_PROTOCOL': 'v2', 'LOGICAL': 'em1', 'PWD': '/'})
/usr/bin/env: vpython: No such file or directory
Command ['./angle_perftests', '--test-launcher-print-test-stdio=always', '--test-launcher-jobs=1', '--test-launcher-retry-limit=0', '--gtest_repeat=1', '--non-telemetry', 'true', '--verbose'] returned exit code 127
,
Nov 16
Looks like there's a bug in Pinpoint. Uploaded a fix: https://chromium-review.googlesource.com/c/catapult/+/1338310
,
Nov 16
The following revision refers to this bug: https://chromium.googlesource.com/catapult/+/2f079fa41e97a8e4bdc507efd9c7145b0903e9ca commit 2f079fa41e97a8e4bdc507efd9c7145b0903e9ca Author: Dave Tu <dtu@chromium.org> Date: Fri Nov 16 10:20:15 2018 [pinpoint] Fix CIPD / vpython arguments to Swarming. The arguments should be under "properties" instead of the top level. Bug: chromium:905807 Change-Id: I242a4dfebbfeeec2172a2d3a4a0d1885f22532b5 Reviewed-on: https://chromium-review.googlesource.com/c/1338310 Auto-Submit: Dave Tu <dtu@chromium.org> Reviewed-by: Juan Antonio Navarro Pérez <perezju@chromium.org> Commit-Queue: Juan Antonio Navarro Pérez <perezju@chromium.org> [modify] https://crrev.com/2f079fa41e97a8e4bdc507efd9c7145b0903e9ca/dashboard/dashboard/pinpoint/models/quest/run_test_test.py [modify] https://crrev.com/2f079fa41e97a8e4bdc507efd9c7145b0903e9ca/dashboard/dashboard/pinpoint/models/quest/run_test.py
,
Nov 16
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/ee1eb7d38fd6d91239e5b5c8acd746add5100955 commit ee1eb7d38fd6d91239e5b5c8acd746add5100955 Author: chromium-autoroll <chromium-autoroll@skia-public.iam.gserviceaccount.com> Date: Fri Nov 16 12:55:19 2018 Roll src/third_party/catapult 0c33d62e0821..b053faa13970 (3 commits) https://chromium.googlesource.com/catapult.git/+log/0c33d62e0821..b053faa13970 git log 0c33d62e0821..b053faa13970 --date=short --no-merges --format='%ad %ae %s' 2018-11-16 dtu@chromium.org [pinpoint] Show chart even if the job failed. 2018-11-16 dtu@chromium.org [pinpoint] Fix CIPD / vpython arguments to Swarming. 2018-11-16 perezju@chromium.org [soundwave] Migrate dashboard_services to luci_auth Created with: gclient setdep -r src/third_party/catapult@b053faa13970 The AutoRoll server is located here: https://autoroll.skia.org/r/catapult-autoroll Documentation for the AutoRoller is here: https://skia.googlesource.com/buildbot/+/master/autoroll/README.md If the roll is causing failures, please contact the current sheriff, who should be CC'd on the roll, and stop the roller if necessary. CQ_INCLUDE_TRYBOTS=luci.chromium.try:android_optional_gpu_tests_rel;luci.chromium.try:linux_optional_gpu_tests_rel;luci.chromium.try:mac_optional_gpu_tests_rel;luci.chromium.try:win_optional_gpu_tests_rel BUG= chromium:901630 ,chromium:905807, chromium:903026 TBR=sullivan@chromium.org Change-Id: I9aa456cfa9804629f7bc66b15091f6825fca4af7 Reviewed-on: https://chromium-review.googlesource.com/c/1340140 Reviewed-by: chromium-autoroll <chromium-autoroll@skia-public.iam.gserviceaccount.com> Commit-Queue: chromium-autoroll <chromium-autoroll@skia-public.iam.gserviceaccount.com> Cr-Commit-Position: refs/heads/master@{#608747} [modify] https://crrev.com/ee1eb7d38fd6d91239e5b5c8acd746add5100955/DEPS
,
Nov 16
📍 Pinpoint job started. https://pinpoint-dot-chromeperf.appspot.com/job/13130997e40000
,
Nov 16
📍 Pinpoint job started. https://pinpoint-dot-chromeperf.appspot.com/job/15bad3efe40000
,
Nov 16
😿 Pinpoint job stopped with an error. https://pinpoint-dot-chromeperf.appspot.com/job/13130997e40000 All of the runs failed. The most common error (20/20 runs) was: SwarmingTestError: The test failed. No Python exception was found in the log.
,
Nov 16
😿 Pinpoint job stopped with an error. https://pinpoint-dot-chromeperf.appspot.com/job/15bad3efe40000 All of the runs failed. The most common error (20/20 runs) was: SwarmingTestError: The test failed. No Python exception was found in the log.
,
Nov 16
📍 Pinpoint job started. https://pinpoint-dot-chromeperf.appspot.com/job/11ac3f47e40000
,
Nov 17
😿 Pinpoint job stopped with an error. https://pinpoint-dot-chromeperf.appspot.com/job/11ac3f47e40000 All of the runs failed. The most common error (20/20 runs) was: SwarmingTestError: The test failed. No Python exception was found in the log.
,
Nov 17
dtu: Same error, do I need to wait for the fix to roll out somewhere beyond normal chromium src? I tried re-running the Pinpoint job with the catapult roll CL applied too.
,
Nov 19
,
Nov 19
Next perf sheriff checking in: dtu, stgao, any progress on this?
,
Nov 20
The fix was not correct and I rolled it back. I uploaded https://chromium-review.googlesource.com/c/catapult/+/1343537
,
Nov 30
The following revision refers to this bug: https://chromium.googlesource.com/catapult/+/6f862e54f2a096450b7c32fb7c807e8932c01099 commit 6f862e54f2a096450b7c32fb7c807e8932c01099 Author: Dave Tu <dtu@chromium.org> Date: Fri Nov 30 23:43:01 2018 [pinpoint] Fix CIPD arguments. Arguments are copied from a Swarming job from the perf waterfall. Bug: chromium:905807 Bug: chromium:906853 Change-Id: I449ea199502c00a34d51abf394b852b3f00f4bd6 Reviewed-on: https://chromium-review.googlesource.com/c/1343537 Reviewed-by: John Budorick <jbudorick@chromium.org> Commit-Queue: Dave Tu <dtu@chromium.org> [modify] https://crrev.com/6f862e54f2a096450b7c32fb7c807e8932c01099/dashboard/dashboard/pinpoint/models/quest/run_test_test.py [modify] https://crrev.com/6f862e54f2a096450b7c32fb7c807e8932c01099/dashboard/dashboard/pinpoint/models/quest/run_test.py
,
Dec 1
👍 should work now
,
Dec 1
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/6dc55357255b5eb6b6195ba1a615447d54ae0f42 commit 6dc55357255b5eb6b6195ba1a615447d54ae0f42 Author: chromium-autoroll <chromium-autoroll@skia-public.iam.gserviceaccount.com> Date: Sat Dec 01 02:48:53 2018 Roll src/third_party/catapult 41dc60067326..6f862e54f2a0 (1 commits) https://chromium.googlesource.com/catapult.git/+log/41dc60067326..6f862e54f2a0 git log 41dc60067326..6f862e54f2a0 --date=short --no-merges --format='%ad %ae %s' 2018-11-30 dtu@chromium.org [pinpoint] Fix CIPD arguments. Created with: gclient setdep -r src/third_party/catapult@6f862e54f2a0 The AutoRoll server is located here: https://autoroll.skia.org/r/catapult-autoroll Documentation for the AutoRoller is here: https://skia.googlesource.com/buildbot/+/master/autoroll/README.md If the roll is causing failures, please contact the current sheriff, who should be CC'd on the roll, and stop the roller if necessary. CQ_INCLUDE_TRYBOTS=luci.chromium.try:android_optional_gpu_tests_rel;luci.chromium.try:linux_optional_gpu_tests_rel;luci.chromium.try:mac_optional_gpu_tests_rel;luci.chromium.try:win_optional_gpu_tests_rel BUG=chromium:905807, chromium:906853 TBR=sullivan@chromium.org Change-Id: I8e77873299ed2fd217b1fdc66d74d17ffe60d5e2 Reviewed-on: https://chromium-review.googlesource.com/c/1357660 Reviewed-by: chromium-autoroll <chromium-autoroll@skia-public.iam.gserviceaccount.com> Commit-Queue: chromium-autoroll <chromium-autoroll@skia-public.iam.gserviceaccount.com> Cr-Commit-Position: refs/heads/master@{#612914} [modify] https://crrev.com/6dc55357255b5eb6b6195ba1a615447d54ae0f42/DEPS |
|||
►
Sign in to add a comment |
|||
Comment 1 by 42576172...@developer.gserviceaccount.com
, Nov 15