Perf dashboard doesn't apply component if multiple benchmarks regress in same bug |
||
Issue descriptionI just filed bug 865996 with regressions in power.desktop and system_health.comon_desktop. The component Speed>Metrics>SystemHealthRegressions was not applied, even though it should be applied to all system_health.common_desktop benchmark regressions. I do see the label being applied when I filed bugs on just one benchmark, so it seems like the logic just needs to be expanded to cover the cases where there are multiple alerts when filing the bug, and when new alerts get added after filing?
,
Jul 20
Ah, I see now. I went through and re-triaged all the old bugs for this benchmark to have the right component (which is how I saw this alert that should have had its own bug, leading to me filing this one). So from my perspective, no action is needed here. Should I WontFix?
,
Jul 20
Yeah let's WontFix, open again if newer bugs aren't getting the right components. |
||
►
Sign in to add a comment |
||
Comment 1 by simonhatch@chromium.org
, Jul 20Owner: simonhatch@chromium.org
Status: Started (was: Untriaged)
+eakuefner So I dug into this via dev_console. I tried fetching the components for these alerts and kept coming up blank. The bug_components diagnostic exists, and has the expected values: test_key = utils.TestKey('ChromiumPerf/mac-10_12_laptop_low_end-perf/system_health.common_desktop') diagnostics = histogram.SparseDiagnostic.query( ndb.AND(histogram.SparseDiagnostic.end_revision == sys.maxint, histogram.SparseDiagnostic.test == test_key)).fetch() for d in diagnostics: print print d.name print '%s - %s' % (d.start_revision, d.end_revision) print json.dumps(d.data, indent=2) print bugComponents 576341 - sys.maxint { "type": "GenericSet", "guid": "9db84690-da64-41c6-ba14-c8e7c973f0f5", "values": [ "Speed>Metrics>SystemHealthRegressions" ] } But these alerts are from [571135 - 571201], some 5000 revisions before the bug component was first seen (as noted above, r576341). Right now, the diagnostic whose range overlaps with the alert's range is used, not the latest. I'd expect a new alert to have the right components, but right now this is WAI. We have a couple options, either just wait since all new alerts should get components as expected, we could also just force older alerts to lookup the components when filing a bug. As a side note Ethan, it's really nice to see the ranges for these diagnostics, made this really clear what happened.