New issue
Advanced search Search tips

Issue 637562 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner:
Closed: Aug 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

1%-48.2% regression in webrtc_perf_tests at 13626:13715

Project Member Reported by peah@chromium.org, Aug 13 2016

Issue description

See the link to graphs below.
 

Comment 1 by peah@chromium.org, Aug 13 2016

All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=637562

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICglrmhogoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg1tGRpQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICglqzgoQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg1pylogsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg1tGRpQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICglomJsQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICglq6rvQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg1tGNtAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgls6AugsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg1tyCpgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICglq6_ogoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICglsfDvwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICglpvd7ggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg1ty7oQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICglsfDvwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICglse5rgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgluO2sAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICglonWoAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICglrWkqwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg1qqGqAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg1tCDqQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg1qTJ7AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg9qaVrAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgtqmSqwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg1of74QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICgtv-89AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg9uHSuAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg9tSstQoM


Bot(s) for this bug's original alert(s):

webrtc-android-tests-nexus72
webrtc-android-tests-nexus9

Comment 2 by peah@chromium.org, Aug 15 2016

Owner: mflodman@chromium.org
mflodman@: I've done some digging on the causes of these perf regressions and I wonder if they could have been caused by the CL
https://codereview.webrtc.org/2165743003 ?

If not, do you have any other suggestion about what could have caused the regressions?



Cc: mflodman@chromium.org
Components: Blink>WebRTC>Video
Owner: holmer@chromium.org
I can't see that this CL should have any effect at all for this test, since the number of audio streams is 0 and this is an audio only change.

Stefan,
I'm assigning to you to decide the impact of this and next step for a possible investigation.
Cc: holmer@chromium.org
Owner: mflodman@chromium.org
Hmm, putting back on me for now to investigate.
Owner: peah@chromium.org
Per,
Not sure I'm reading this correctly or not, but this is what I see:

One of the two graphs points at something between 13625-13649, the CL above is 13527 and not in that range. 

The other is in the 13712-13715 range, so shouldn't be there either.

Comment 6 by peah@chromium.org, Aug 22 2016

Owner: holmer@chromium.org
holmer@: Could the webrtc-android-tests-nexus9 tests be related to the CL https://codereview.webrtc.org/2201093006? 

The webrtc-android-tests-nexus9 seems to possibly be related to that, but the 
webrtc-android-tests-nexus72 are likely caused by something else.

Please reassign back to me after having a look at the webrtc-android-tests-nexus9 tests, and I'll then have another look into the webrtc-android-tests-nexus72 tests.

Comment 7 by holmer@chromium.org, Aug 22 2016

Owner: peah@chromium.org
It's probably related to that and therefore I think it's ok to close. I expected metrics like those to be affected.

It's not impossible that the nexus7 metrics also are related to that CL.

Comment 8 by peah@chromium.org, Aug 22 2016

Status: WontFix (was: Assigned)
Great! Thanks!
I'll then close this.

Sign in to add a comment