New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 683336 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Feb 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

Remove CQ_EXTRA_TRYBOTS and related code.

Project Member Reported by simonhatch@chromium.org, Jan 20 2017

Issue description

Going forward, reviewers will request that changes to benchmarks be run via the perf try bots and link the results.
 
Or can we do s.t like CQ_EXTRA_TRYBOTS=benchmarkX:benchmarkY ... to trigger the benchmark run on all perf try bots?
I think in pinpoint something like #1 would be really hard, but we'd be able to have a nicer web interface for selecting benchmarks so maybe it's okay to go without?
Annie, what I meant for 1 is that it's manually specified by the code reviewers/author. Basically the work flow is s.t like:
Code author add modify benchmarks U & V
Code reviewer edit the description to add: CQ_EXTRA_TRYBOTS=benchmarkU:benchmarkV

Code reviewer can be sure that the change do not breaks benchmark U & V because now the CQ will run those two.
AFAIK that's what will be difficult, we won't have cq perf bots on the waterfall anymore. We'd need some new recipe or something that could communicate with Pinpoint to retain that functionality.
Simon: if the current pipeline allows you to specify which bots to run, why can't we tweak it to specify which benchmarks to run instead?
A couple of problems here:

1) CQ_EXTRA_TRYBOTS is a special format supported by infra, IIUC it only allows you to specify bot names of the trybots you want, not config like benchmark names.
2) When we migrate to pinpoint, there won't be "bots" in the same way, it'll be an app engine service, so the existing CQ_EXTRA_TRYBOTS functionality supported by infra won't work.
I might be misunderstanding something.

Currently, the cq perf trybots work by specifying CQ_EXTRA_TRYBOTS in the cl, which in turn sends the patch to the specified bots. These bots are on tryserver.chromium.perf waterfall, and are running the bisect recipe which can change functionality based on the incoming parameters/patch. From there its relatively straightforward, they request a build, analyze the patch a bit to get a list of benchmarks to run, and then run a straightforward perf try job.

But in the future Pinpoint world, there won't be bisect bots on the waterfall anymore. There will be an Appengine service communicating directly with swarming.
Cc: dpranke@chromium.org
Ah got it. So it seems like we currently don't have the ability to parameterize the tasks of the bots from the infra. 
It's fine to remove CQ_EXTRA_TRYBOTS for now as the false negative rate is too high.

+Dirk: is it possible to do things that I describe in #3?
No, it's not currently possible to do something like what you're asking for in comment #3.

I think it would be good if we could, but we're a ways away from being able to do that.
Just to confirm, from #c8 it sounds like you're on board then for just removing CQ_EXTRA_TRYBOTS then since it doesn't sound feasible to do the suggestions in #c3?
I'm not sure if #c10 was directed at me or nednguyen, but if me, yes, I'm fine w/ it.
Ah sorry was directed at Ned
Yes, I am on board with removing CQ_EXTRA_TRYBOTS
Owner: simonhatch@chromium.org
Status: Started (was: Untriaged)
So I think the parts here are:

 * Remove the code from PRESUBMIT that adds CQ_EXTRA_TRYBOTS
 * Remove the *_cq bots from tryserver.chromium.perf and reclaim the hardware.
 * Restart tryserver.chromium.perf
 * Tear out the cq recipe code.
 * Cleanup references to *_cq bots (such as in https://cs.chromium.org/chromium/src/tools/perf/core/trybot_command.py?l=43)
If we do all of that how can we "manually request cq runs via perf bots" as you wrote in the description?
We meant literally kick off try jobs offline, and link them in the CL comments.
Sorry maybe that original description isn't quite right. Going forward, reviewers would request that they run a perf try job and link the successful run.

./tools/perf/run_benchmark tryjob android_nexus9_perf_bisect foo.benchmark

The *_cq bots wouldn't be needed, only the existing bisect bots.
It looks like tryserver.chromium.perf contains bisect bots and cq bots; if you remove the cq bots, does that mean you'll kick off jobs using the bisect bots?

(Sorry, just trying to understand the pieces here).
Description: Show this description
Yep!
Project Member

Comment 21 by bugdroid1@chromium.org, Jan 25 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/d02596e4e33a888672800f6eb27588760191b476

commit d02596e4e33a888672800f6eb27588760191b476
Author: simonhatch <simonhatch@chromium.org>
Date: Wed Jan 25 01:44:04 2017

These don't have any ability to specify the exact benchmarks we want to run, and often take hours to come back since the bots are overloaded and running way too many benchmarks. Additionally, Pinpoint won't support these kind of trybots since it won't exist as a bot on the waterfall.

Going forward, reviewers will simply request perf try job results be linked in reviews.

BUG= 683336 

Review-Url: https://codereview.chromium.org/2654433008
Cr-Commit-Position: refs/heads/master@{#445906}

[modify] https://crrev.com/d02596e4e33a888672800f6eb27588760191b476/tools/perf/PRESUBMIT.py

Project Member

Comment 22 by bugdroid1@chromium.org, Jan 25 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/d02596e4e33a888672800f6eb27588760191b476

commit d02596e4e33a888672800f6eb27588760191b476
Author: simonhatch <simonhatch@chromium.org>
Date: Wed Jan 25 01:44:04 2017

These don't have any ability to specify the exact benchmarks we want to run, and often take hours to come back since the bots are overloaded and running way too many benchmarks. Additionally, Pinpoint won't support these kind of trybots since it won't exist as a bot on the waterfall.

Going forward, reviewers will simply request perf try job results be linked in reviews.

BUG= 683336 

Review-Url: https://codereview.chromium.org/2654433008
Cr-Commit-Position: refs/heads/master@{#445906}

[modify] https://crrev.com/d02596e4e33a888672800f6eb27588760191b476/tools/perf/PRESUBMIT.py

Project Member

Comment 23 by bugdroid1@chromium.org, Jan 26 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build.git/+/9ad2c6759c78fbd7e94b02362fddc4eb8ebc49c7

commit 9ad2c6759c78fbd7e94b02362fddc4eb8ebc49c7
Author: Simon <simonhatch@chromium.org>
Date: Wed Jan 25 00:09:22 2017

Remove the *_cq bots.

Moving to a workflow where reviewers will simply request a link to
a perf bot run with the benchmarks specified. I just moved the
slaves to the corresponding bisect bot to increase their pools.

Must land first: https://codereview.chromium.org/2654433008/

BUG= 683336 

Change-Id: I80586206122183ee403df959c53dca3920d87904
Reviewed-on: https://chromium-review.googlesource.com/431800
Commit-Queue: David Tu <dtu@chromium.org>
Reviewed-by: David Tu <dtu@chromium.org>

[modify] https://crrev.com/9ad2c6759c78fbd7e94b02362fddc4eb8ebc49c7/masters/master.tryserver.chromium.perf/master.cfg
[modify] https://crrev.com/9ad2c6759c78fbd7e94b02362fddc4eb8ebc49c7/masters/master.tryserver.chromium.perf/slaves.cfg
[modify] https://crrev.com/9ad2c6759c78fbd7e94b02362fddc4eb8ebc49c7/scripts/slave/recipe_modules/chromium_tests/tryserver_chromium_perf.py

Project Member

Comment 24 by bugdroid1@chromium.org, Feb 3 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/af83899ce3450b54d2d41159eb5a64fff8821fdf

commit af83899ce3450b54d2d41159eb5a64fff8821fdf
Author: simonhatch <simonhatch@chromium.org>
Date: Fri Feb 03 19:14:46 2017

Remove any references to *_cq from trybot_command.py.

These bots are gone and we don't need to filter them out.

BUG= 683336 

Review-Url: https://codereview.chromium.org/2657623003
Cr-Commit-Position: refs/heads/master@{#448036}

[modify] https://crrev.com/af83899ce3450b54d2d41159eb5a64fff8821fdf/tools/perf/core/trybot_command.py

Project Member

Comment 25 by bugdroid1@chromium.org, Feb 3 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/ce60cbed23ba03dbb0e6c115d8c9e13a5b78fe08

commit ce60cbed23ba03dbb0e6c115d8c9e13a5b78fe08
Author: Simon <simonhatch@chromium.org>
Date: Fri Feb 03 20:59:53 2017

Bisect - Strip CQ code out.

Going forward, reviewers will simply request perf try job results be linked in reviews.
The CQ bots have already been taken down, and the logic in presubmit.py has been removed.

TBR=dtu@chromium.org
BUG= 683336 

Change-Id: Id442f2bec79b830a92dab9993fea325580ab37c1
Reviewed-on: https://chromium-review.googlesource.com/436145
Commit-Queue: Simon Hatch <simonhatch@chromium.org>
Reviewed-by: Simon Hatch <simonhatch@chromium.org>

[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_benchmark_to_run_android_webview_nexus6_aosp_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/desktop_bisect_staging.expected/perf_cq_no_benchmark_to_run.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_run_benchmark_android_webview_arm64_aosp_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_changes_android_webview_nexus6_aosp_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_benchmark_to_run_staging_android_nexus5X_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_changes_android_nexus5_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_benchmark_to_run_android_one_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_changes_staging_android_nexus5X_perf_bisect.json
[modify] https://crrev.com/ce60cbed23ba03dbb0e6c115d8c9e13a5b78fe08/scripts/slave/recipe_modules/perf_try_staging/api.py
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_run_benchmark_android_fyi_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_run_benchmark_android_nexus5X_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_run_benchmark_staging_android_nexus5X_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_benchmark_to_run_android_nexus5_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_changes_android_webview_arm64_aosp_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_changes_android_nexus5X_perf_bisect.json
[rename] https://crrev.com/ce60cbed23ba03dbb0e6c115d8c9e13a5b78fe08/scripts/slave/recipes/bisection/desktop_bisect_staging.expected/perf_tryjob_no_config.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_benchmark_to_run_android_webview_arm64_aosp_perf_bisect.json
[modify] https://crrev.com/ce60cbed23ba03dbb0e6c115d8c9e13a5b78fe08/scripts/slave/recipes/bisection/desktop_bisect_staging.py
[modify] https://crrev.com/ce60cbed23ba03dbb0e6c115d8c9e13a5b78fe08/scripts/slave/recipes/bisection/android_bisect_staging.py
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_run_benchmark_android_nexus5_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_changes_android_nexus6_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/desktop_bisect_staging.expected/perf_cq_run_benchmark.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_run_benchmark_android_nexus6_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_benchmark_to_run_android_nexus7_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_changes_android_one_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_changes_android_nexus7_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_run_benchmark_android_nexus7_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_run_benchmark_android_one_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_changes_android_fyi_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_benchmark_to_run_android_fyi_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_benchmark_to_run_android_nexus5X_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_run_benchmark_android_webview_nexus6_aosp_perf_bisect.json
[delete] https://crrev.com/576c23c0931300d6ee7f24d1429db2f67bcaa99e/scripts/slave/recipes/bisection/android_bisect_staging.expected/perf_cq_no_benchmark_to_run_android_nexus6_perf_bisect.json

Components: Speed>Bisection
Project Member

Comment 27 by bugdroid1@chromium.org, Feb 6 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/0daf957272bb7c92a104cdb26290a27c06ff1c3b

commit 0daf957272bb7c92a104cdb26290a27c06ff1c3b
Author: Simon <simonhatch@chromium.org>
Date: Mon Feb 06 18:32:49 2017

Bisect - Push cq stripping to prod.

Perf Try: https://build.chromium.org/p/tryserver.chromium.perf/builders/staging_linux_perf_bisect/builds/93
Bisect: https://build.chromium.org/p/tryserver.chromium.perf/builders/staging_linux_perf_bisect/builds/92

BUG= 683336 

Change-Id: I06b97b2a0b53305f0d52540a3307cda881cfdb2f
Reviewed-on: https://chromium-review.googlesource.com/437804
Commit-Queue: Simon Hatch <simonhatch@chromium.org>
Reviewed-by: David Tu <dtu@chromium.org>

[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_benchmark_to_run_android_nexus6_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_changes_staging_android_nexus5X_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_run_benchmark_android_one_perf_bisect.json
[modify] https://crrev.com/0daf957272bb7c92a104cdb26290a27c06ff1c3b/scripts/slave/recipes/bisection/desktop_bisect.py
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_benchmark_to_run_android_fyi_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_benchmark_to_run_android_nexus5X_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_changes_android_fyi_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_benchmark_to_run_android_webview_arm64_aosp_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_changes_android_nexus5X_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_changes_android_webview_arm64_aosp_perf_bisect.json
[modify] https://crrev.com/0daf957272bb7c92a104cdb26290a27c06ff1c3b/scripts/slave/recipes/bisection/android_bisect.py
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_benchmark_to_run_android_nexus7_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_changes_android_webview_nexus6_aosp_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_run_benchmark_android_nexus5_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_benchmark_to_run_staging_android_nexus5X_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_changes_android_nexus5_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_run_benchmark_android_webview_arm64_aosp_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/desktop_bisect.expected/perf_cq_no_benchmark_to_run.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_changes_android_nexus7_perf_bisect.json
[rename] https://crrev.com/0daf957272bb7c92a104cdb26290a27c06ff1c3b/scripts/slave/recipes/bisection/desktop_bisect.expected/perf_tryjob_no_config.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_benchmark_to_run_android_webview_nexus6_aosp_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_benchmark_to_run_android_nexus5_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_run_benchmark_android_nexus7_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/desktop_bisect.expected/perf_cq_run_benchmark.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_changes_android_nexus6_perf_bisect.json
[modify] https://crrev.com/0daf957272bb7c92a104cdb26290a27c06ff1c3b/scripts/slave/recipe_modules/perf_try/api.py
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_changes_android_one_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_run_benchmark_android_fyi_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_run_benchmark_android_nexus6_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_run_benchmark_android_nexus5X_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_run_benchmark_staging_android_nexus5X_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_no_benchmark_to_run_android_one_perf_bisect.json
[delete] https://crrev.com/fcb92d221dcd07b1d828b27b3429447514492c53/scripts/slave/recipes/bisection/android_bisect.expected/perf_cq_run_benchmark_android_webview_nexus6_aosp_perf_bisect.json

Status: Fixed (was: Started)

Sign in to add a comment