New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 672524 link

Starred by 2 users

Issue metadata

Status: Untriaged
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug

Blocking:
issue 675550
issue 670227
issue 672404
issue 673330


Show other hotlists

Hotlists containing this issue:
speed-bisect


Sign in to add a comment

Bisect - Handling failing to install apk

Project Member Reported by simonhatch@chromium.org, Dec 8 2016

Issue description

https://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/974

This one failed trying to install ChromePublic.apk and aborted the entire bisect.
 
Blocking: 672404
Project Member

Comment 2 by bugdroid1@chromium.org, Dec 9 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build.git/+/fd494d26a68049c2bc579cb1aaeddc6b58eac8ba

commit fd494d26a68049c2bc579cb1aaeddc6b58eac8ba
Author: Simon <simonhatch@chromium.org>
Date: Fri Dec 09 22:12:26 2016

Bisect - Don't abort entire bisect if a test throws an exception.

BUG=672524

Change-Id: Id379b7a706d519deb8b1efe5e40a1fad75e7e943
Reviewed-on: https://chromium-review.googlesource.com/418500
Reviewed-by: Roberto Carrillo <robertocn@chromium.org>
Commit-Queue: Simon Hatch <simonhatch@chromium.org>

[modify] https://crrev.com/fd494d26a68049c2bc579cb1aaeddc6b58eac8ba/scripts/slave/recipe_modules/auto_bisect_staging/revision_state.py

Blocking: 670227
Project Member

Comment 4 by bugdroid1@chromium.org, Dec 14 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/e52d6c62b81278ea4cb0665a6a2f75cb9732cdc2

commit e52d6c62b81278ea4cb0665a6a2f75cb9732cdc2
Author: catapult-deps-roller <catapult-deps-roller@chromium.org>
Date: Wed Dec 14 00:24:30 2016

Roll src/third_party/catapult/ cdc30da12..87f283fcd (1 commit).

https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/cdc30da12936..87f283fcd1d3

$ git log cdc30da12..87f283fcd --date=short --no-merges --format='%ad %ae %s'
2016-12-13 simonhatch Dashboard - Guess commandline based on original bot name.

BUG=672524

Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+/master/autoroll/README.md

If the roll is causing failures, see:
http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls

CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel
TBR=catapult-sheriff@chromium.org

Review-Url: https://codereview.chromium.org/2572903002
Cr-Commit-Position: refs/heads/master@{#438357}

[modify] https://crrev.com/e52d6c62b81278ea4cb0665a6a2f75cb9732cdc2/DEPS

Blocking: 673330
Project Member

Comment 8 by 42576172...@developer.gserviceaccount.com, Dec 15 2016


===== BISECT JOB RESULTS =====
Status: failed


=== Bisection aborted ===
The bisect was aborted because Infra Failure: Step('Working on revision chromium@436736,v8@9c9c8d7bb5.install ChromePublic.apk') returned 2
Please contact the the team (see below) if you believe this is in error.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N  Good?
chromium@436736  7497.33  105.732  6  good
chromium@436737  7072.5   277.859  6  bad

Bisect job ran on: android_nexus5X_perf_bisect
Bug ID: 672524

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests octane
Test Metric: Total/Score
Relative Change: 5.67%

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5X_perf_bisect/builds/995
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8993187715030205280


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5878265682591744

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 9 by bugdroid1@chromium.org, Dec 17 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/dfa7fcd3449daed39bbbf490294364446d728c9c

commit dfa7fcd3449daed39bbbf490294364446d728c9c
Author: catapult-deps-roller <catapult-deps-roller@chromium.org>
Date: Sat Dec 17 06:35:11 2016

Roll src/third_party/catapult/ 42ba4dfff..4fc181694 (4 commits).

https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/42ba4dfff160..4fc181694898

$ git log 42ba4dfff..4fc181694 --date=short --no-merges --format='%ad %ae %s'
2016-12-16 dtu [pinpoint] Move Quests to their own modules.
2016-12-16 ssid Remove enable-memory-benchmarking flag from unittest
2016-12-16 bpastene devil: Make provision_devices.py complain when no devices are available.
2016-12-16 simonhatch Dashboard - Set recipe_tester_name on staging bots.

BUG= 513692 , 674473 ,672524

Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+/master/autoroll/README.md

If the roll is causing failures, see:
http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls

CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel
TBR=catapult-sheriff@chromium.org

Review-Url: https://codereview.chromium.org/2581703004
Cr-Commit-Position: refs/heads/master@{#439331}

[modify] https://crrev.com/dfa7fcd3449daed39bbbf490294364446d728c9c/DEPS

Blocking: 675550
Project Member

Comment 11 by bugdroid1@chromium.org, Dec 22 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build.git/+/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8

commit 3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8
Author: Simon <simonhatch@chromium.org>
Date: Thu Dec 22 01:18:23 2016

Push bisect changes from staging to prod.

These include changes to collapse steps on the build page, packing the json
with extra revision data, and gracefully handling test failures.

https://codereview.chromium.org/2588143002/ must land first.

BUG=668540,  665439 , 672524,  672880 

Change-Id: Id72657a4ff1227ef8e87bd4361db183320bd2236
Reviewed-on: https://chromium-review.googlesource.com/422433
Commit-Queue: Simon Hatch <simonhatch@chromium.org>
Reviewed-by: David Tu <dtu@chromium.org>

[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/__init__.py
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/bisector.py
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/basic_bisect_other_direction.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/basic_buildbot_bisect.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/basic_linux_bisect.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/basic_mac_bisect.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/basic_win32_bisect.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/basic_win64_bisect.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/failed_build.json
[add] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/failed_build_inconclusive_1.json
[add] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/failed_build_inconclusive_11.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/failed_buildbucket_get.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/gathering_references_no_values.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/no_repro.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/no_values.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/retest_bisect.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/return_code.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/return_code_fail.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/v8_roll_bisect.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.expected/v8_roll_bisect_bis.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/example.py
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/local_bisect.py
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipe_modules/auto_bisect/revision_state.py
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipes/bisection/android_bisect.expected/local_basic_recipe_basic_device.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipes/bisection/android_bisect.expected/local_basic_recipe_disconnected_device.json
[modify] https://crrev.com/3a4b4f28f0e8e866ccacbd8c1327bbf1977fabe8/scripts/slave/recipes/bisection/android_bisect.expected/local_basic_recipe_failed_device.json

Components: Speed>Bisection

Sign in to add a comment