New issue
Advanced search Search tips
Note: Color blocks (like █ or █) mean that a user may not be available. Tooltip shows the reason.

Issue 659800 link

Starred by 1 user
Status: Fixed
Owner:
█ robert...@chromium.org
Last visit > 30 days ago
Closed: Nov 2016
Cc:
simonhatch@chromium.org
st...@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug



Sign in to add a comment

Bisect buildbot output cluttered by test failures.

Project Member Reported by robert...@chromium.org, Oct 26 2016 
It is normal and even expected(in the case of return code bisects) that tests fail during a bisect job. These failures should not clutter the job status string (see attachment)
clutter.png
97.5 KB View Download
Project Member

Comment 1 by bugdroid1@chromium.org, Oct 27 2016 

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build.git/+/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1

commit 72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1
Author: robertocn <robertocn@chromium.org>
Date: Thu Oct 27 06:16:02 2016

Treat bisect/tryjob perf test failures as warnings.

This is so that they don't clutter the results of the bisect process.
(Which can succeed even if some test runs fail)

R=prasadv@chromium.org,dtu@chromium.org
BUG= 659800 

Review-Url: https://codereview.chromium.org/2456483005

[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipe_modules/auto_bisect_staging/example.expected/failed_reference_range.json
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipe_modules/auto_bisect_staging/example.expected/failed_revision.json
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipe_modules/auto_bisect_staging/example.expected/return_code.json
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipe_modules/bisect_tester_staging/perf_test.py
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipes/bisection/android_bisect_staging.expected/failure_in_ref_range.json
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipes/bisection/android_bisect_staging.expected/local_basic_recipe_disconnected_device.json
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_tryjob_failed_test_android_fyi_perf_bisect.json
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_tryjob_failed_test_android_nexus5X_perf_bisect.json
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_tryjob_failed_test_android_nexus5_perf_bisect.json
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_tryjob_failed_test_android_nexus6_perf_bisect.json
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_tryjob_failed_test_android_nexus7_perf_bisect.json
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_tryjob_failed_test_android_nexus9_perf_bisect.json
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_tryjob_failed_test_android_one_perf_bisect.json
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_tryjob_failed_test_android_s5_perf_bisect.json
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_tryjob_failed_test_android_s5_perf_cq.json
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_tryjob_failed_test_android_webview_arm64_aosp_perf_bisect.json
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_tryjob_failed_test_android_webview_nexus6_aosp_perf_bisect.json
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_tryjob_failed_test_staging_android_nexus5X_perf_bisect.json
[modify] https://crrev.com/72f7e3f630e0df6f08bd72f1ad112e5c1163a6e1/scripts/slave/recipes/bisection/desktop_bisect_staging.expected/perf_tryjob_failed_test.json

Comment 2 by dtu@chromium.org, Nov 2 2016

Status: Fixed (was: Started)

Comment 3 by benhenry@chromium.org, Feb 3 2017

Components: Speed>Bisection
►

Sign in to add a comment