Background: One of the major points of emphasis of Tricium is to encourage high-quality analyzers with low noise results. Currently in analyzer definitions, there are owners associated with each analyzer, but this isn't used yet.
We'll need to let analyzer contributors know about potential issues with their analyzer, including:
- High "not useful" rate for any category of results
- Failures in analyzer runs
- Other problems, e.g. analyzer posts comments with invalid ranges
Rough proposal: Store some kind of "analyzer health state" in datastore. Notify analyzer owners (maybe by email) when "health state" changes, i.e. if there are any new problems.
Comment 1 by qyears...@chromium.org
, Jun 15 2018