Issue metadata
Sign in to add a comment
|
Many system_health.common_desktop perf tests are creeping up over time |
||||||||||||||||||||
Issue descriptionNo clear single change causing the problem. Looks to be caused by either: a) testing environment; or b) death by 1,000 cuts.
,
Nov 16 2017
📍 Pinpoint job started. https://pinpoint-dot-chromeperf.appspot.com/job/12be03b9f80000
,
Nov 16 2017
Ignore the bisect jobs: They are unlikely to return anything. This bug is about a general trend. Forwarding to owners of this test for further investigation...
,
Nov 16 2017
📍 Couldn't reproduce a difference. https://pinpoint-dot-chromeperf.appspot.com/job/12be03b9f80000
,
Jan 18 2018
That creep is really weird, but it does seem to have evened out. Charlie, Ned, what should we do here?
,
Jan 18 2018
If the bisect can reproduce the difference between revision (even if it might fail to pinpoint any cause), then this is a software issue. If not, then this is a test environment issue. Possibly the device hardware degrade & consume more power?
,
Jan 18 2018
My feeling is that this is a no-op (investigating regressions from several months ago seems really hard), but stresses the importance of having a working ref build on all benchmarks (which we don't have for system_health.common_desktop). The only extra data point I can provide is that the idle_platform story doesn't seem to exhibit this same creep, which seems to hint that it may have been real regressions rather than noise (https://chromeperf.appspot.com/report?sid=0de26e3eb52e89a439d2b092d0c30ff3ab41136c46d698ee5ea9e70359a98f15&start_rev=507308&end_rev=519034). Hard to say without the ref build, though, and that's only one data point.
,
Jan 18 2018
Bisect show the same power usage of the two revision points in #4. So I highly suspect that this is due to Mac hardware degrading. There is also sign of ref build creep up: https://screenshot.googleplex.com/eCErB0cfL8F.png I vote to mark this as WontFix since the creep up has stopped & stabilized. There is also evidence that this regression is not caused by software change.
,
Mar 21 2018
|
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by 42576172...@developer.gserviceaccount.com
, Nov 16 2017