Moved from https://github.com/catapult-project/catapult/issues/3581
Code is complex, not totally clear if it works all the time, some unexpected effects like in:
crbug.com/718981
Anomaly configs were getting assigned to different sheriffs, since you can only have 1 config assigned to a test and it happens to prioritize alphabetically.
#3576
Sheriff monitoring patterns and tests marked as monitored has somehow gotten out of sync.
SheriffConfigs should have a list of owners who are allowed to modify it via a new menu in v2spa.
SheriffConfig should use v2spa's Descriptors instead of test path patterns.
AlertConfigs should be specified by SparseDiagnostics.