New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 636179 link

Starred by 2 users

Issue metadata

Status: Duplicate
Merged: issue 662541
Owner:
Closed: Jan 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug

Blocking:
issue 636092



Sign in to add a comment

figure out a way to make buildbot testing json more usable

Project Member Reported by stip@chromium.org, Aug 10 2016

Issue description

The json files in https://chromium.googlesource.com/chromium/src/+/master/testing/buildbot/ are (rightfully) being used more and more to allow fast, trybottable configuration of the infrastructure. However, since they are in a simple format, significant infrastructure changes require copy-pasting code repeatedly.

This bug serves as a tracking bug for efforts to provide a simple, human-readable (and writable format. One requirement is that the 'end result' consumed by the process is in the flat json file format. This way, it's easy to determine if errors occurred while generating  the json, or while consuming it.
 
Cc: smut@chromium.org
Adding smut@ as well, because there's a fair amount of overlap between the //testing/buildbot/*.json files and the way the iOS recipes work (via ios/build/bots/*.json), and estaab@ and martiniss@ for interest in src-side recipes and expectations.

It's unclear exactly how this stuff would dovetail together w/ src-side recipes. Personally I'm not sure I agree that the JSON files are desirable in the end (cf. my well-documented rants against the -expected JSON files), but I can at least agree that we want them in the meantime and can leverage kbr@'s //content/test/gpu/generate_buildbot_json.py for this as well.
Components: Build

Comment 3 by kbr@chromium.org, Aug 10 2016

At one point I started looking at generating the rest of the src/testing/buildbot JSON files with a script similar to src/content/test/gpu/generate_buildbot_json.py. One issue I found was that there seemed to be quite a large number of exceptions -- in other words, it looked like the same exact tests weren't run in the exact same way across a large number of machines.

The first tool I was thinking of writing was something that ingested the JSON files and tried to automatically find commonalities between them.

Components: Infra>Client>Chrome

Comment 5 by stip@chromium.org, Jan 19 2017

Cc: stip@chromium.org
Owner: dpranke@chromium.org
Assigning to Dirk, please triage appropriately.
Mergedinto: 662541
Status: Duplicate (was: Assigned)
done :).

Sign in to add a comment