Set alert on benchmark_duration for all perf benchmarks with threshold of +5 minutes regressions |
|||||||
Issue descriptionTo keep the cycle time of all perf benchmarks in check, we should set alert on benchmark_duration for all perf benchmarks (including ref build) with threshold of +5 minutes regressions. I picked 5 minutes threshold without careful thought. We may need to tune the number a bit to make sure that benchmarking team is not overloaded with too many alerts. +Annie: is there a way to try a specific alert threshold & see how many alerts would have been raised with the past data?
,
Apr 17 2017
,
Apr 20 2017
,
Apr 20 2017
,
Apr 21 2017
This is done.
,
Apr 22 2017
The rate of alert is too high & it doesn't coalesce well, hence spamming the mailing list too much. I think we need to stop this for now to figure out how to better group the alert.
,
Apr 24 2017
We created a new list for the alerts and changed it to a daily summary. Marking fixed for now, but may reopen after discussion at tomorrow's meeting.
,
Apr 24 2017
|
|||||||
►
Sign in to add a comment |
|||||||
Comment 1 by nedngu...@google.com
, Apr 14 2017