New issue
Advanced search Search tips

Issue 756677 link

Starred by 1 user

Issue metadata

Status: Archived
Owner: ----
Closed: Dec 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Linux
Pri: 2
Type: Bug



Sign in to add a comment

Test results missing from SOM

Project Member Reported by martiniss@chromium.org, Aug 18 2017

Issue description

Almost all test results seem to be missing from sheriff-o-matic for chromium.

I dug into this; it looks like the test results files are missing the "is_unexpected" flag. https://test-results.appspot.com/testfile?builder=Android+Tests&buildnumber=44894&master=chromium.linux&name=full_results.json&testtype=chrome_public_test_apk is an example, there's a failure, but it doesn't say unexpected, so maybe that's WAI.

I do see some test results, but it is missing a fair amount. Maybe something is misconfigured somewhere?
 
Yeah, the test_step analyzer checks for explicit is_unexpected values in a couple of places: https://cs.chromium.org/chromium/infra/go/src/infra/monitoring/analyzer/step/test_step.go

This was rolled out back in April though: https://chromium-review.googlesource.com/c/478056
The solution here may be to have SoM's test step analyzer implement the same logic that sets is_unexpected elsewhere (recipes or wherever), or have it only check is_unexpected for recipes that do set it.

Comment 3 by jojwang@google.com, Aug 18 2017

Labels: Milestone-Workflow
Status: Archived (was: Available)

Sign in to add a comment