New issue
Advanced search Search tips

Issue 697871 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Mar 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

26.6%-535.8% regression in scheduler.tough_scheduling_cases at 453116:453373

Project Member Reported by sullivan@chromium.org, Mar 2 2017

Issue description

See the link to graphs below.
 
All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=697871

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpJXelQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5ILjogoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpI7xtgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpLmGpgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpMXivgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpMvG9gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpNi_7AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpO3zpAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpKCNpwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpMaRvwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpMSQ6woM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpMaRvwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpODD-QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpODXpAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpLH96wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5Py7qAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpKqh8QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpKvZtQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgxLf0qgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpNenvwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpLWUvgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpKqh8QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgxKfw_wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpJ3WogoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpPPxsAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpIfxpgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpMmzrgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpNicsQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpJC1swsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpO7krgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5Pr4rAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpPyRsgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpO2BqAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpPW_uwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpLjn5gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpLjn5goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5Lz0vAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpPrmsQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpInd_QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpNeOpgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpNzo8wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpI6CugsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpLn1rgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpNCStwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpIuK7QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5MCQowoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpL7auQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpNj15AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpLnhtwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpJfhrAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpJOapwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpP-fsAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpLqqqwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpNirtQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpLnIqgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpN7prwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpK3iqwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpKe8vAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpK3iqwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpPz1qwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpNzoswsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpN7prwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpIuKrQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpNnXswoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpNmjogoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpN6OtgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpNzbrgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgxLfgswkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpKLHvwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpMSzvgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpKKEqgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpNm5vQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpN6OtgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpOnesgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpMuougoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpLHn-goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpO65sAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpLO-qgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgxLO3rAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpOC5qAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpJrlvwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpLOqswoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpPGLsQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpOOStAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpOnKowoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpPGLsQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpMDK-AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgpLyU4QgM


Bot(s) for this bug's original alert(s):

android-nexus5
android-nexus7v2
android-one
chromium-rel-win10
chromium-rel-win7-gpu-ati
chromium-rel-win7-gpu-intel
chromium-rel-win7-gpu-nvidia
chromium-rel-win7-x64-dual
chromium-rel-win8-dual
linux-release
win-high-dpi
win-zenbook
Note there are android input latency regressions in same revision range, tracking those in  bug 697873 .
Cc: tdres...@chromium.org
Cc-ing tdresser since this is a pretty widespread input latency regression.
Cc: dtapu...@chromium.org
Owner: dtapu...@chromium.org

=== Auto-CCing suspected CL author dtapuska@chromium.org ===

Hi dtapuska@chromium.org, the bisect results pointed to your CL, please take a look at the
results.


=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : dtapuska
  Commit : 53f9f4ee5790ce47bf43eee521fdd3536cd1763a
  Date   : Mon Feb 27 01:14:26 2017
  Subject: Add a passthrough touch event queue.

Bisect Details
  Configuration: winx64_zen_perf_bisect
  Benchmark    : smoothness.top_25_smooth
  Metric       : mean_input_event_latency/https___www.google.com_calendar_
  Change       : 536.06% | 2.91666666667 -> 18.5518333333

Revision             Result                   N
chromium@453128      2.91667 +- 0.212935      6      good
chromium@453131      2.932 +- 0.221955        6      good
chromium@453132      2.95233 +- 0.20784       6      good
chromium@453133      18.4887 +- 0.400806      6      bad       <--
chromium@453138      18.5943 +- 0.195533      6      bad
chromium@453147      18.5282 +- 0.184821      6      bad
chromium@453165      18.5518 +- 0.290329      6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=https...www.google.com.calendar. smoothness.top_25_smooth

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8986224382968432464

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=4851167584059392


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
I believe this is because of the way the mean_input_latency is calculated. We have moved the coalescing of events from the browser process into the renderer process with the change stated here. And I wonder if the greater number of ACKs being returned by the renderer is thus causing the mean to change.

I've started a bisect with tracing. Hopefully that will show us the different calculations.

tdresser@ is going to check the mean latency info code.
Project Member

Comment 7 by bugdroid1@chromium.org, Mar 3 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/abf462cdff2f095ab1ab69beb78c8b658bfb634a

commit abf462cdff2f095ab1ab69beb78c8b658bfb634a
Author: dtapuska <dtapuska@chromium.org>
Date: Fri Mar 03 03:46:57 2017

Disable the passthrough touch event queue for now.

Due to perf regressions disable the passthrough touch event queue
it causes GestureScrollUpdate events to take more time.

BUG= 697871 , 642368 

Review-Url: https://codereview.chromium.org/2722113007
Cr-Commit-Position: refs/heads/master@{#454504}

[modify] https://crrev.com/abf462cdff2f095ab1ab69beb78c8b658bfb634a/content/browser/renderer_host/input/input_router_impl.cc
[modify] https://crrev.com/abf462cdff2f095ab1ab69beb78c8b658bfb634a/content/browser/renderer_host/input/input_router_impl_unittest.cc

Status: Fixed (was: Untriaged)
Components: Blink>Input
Labels: Hotlist-Input-Dev
Labels: Merge-Request-58
Project Member

Comment 11 by sheriffbot@chromium.org, Mar 6 2017

Labels: -Merge-Request-58 Hotlist-Merge-Approved Merge-Approved-58
Your change meets the bar and is auto-approved for M58. Please go ahead and merge the CL to branch 3029 manually. Please contact milestone owner if you have questions.
Owners: amineer@(clank), cmasso@(bling), bhthompson@(cros), govind@(desktop)

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Project Member

Comment 12 by bugdroid1@chromium.org, Mar 6 2017

Labels: -merge-approved-58 merge-merged-3029
The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/6e69ab6bfafc78b6037ee64329e6af6974e3afb6

commit 6e69ab6bfafc78b6037ee64329e6af6974e3afb6
Author: Dave Tapuska <dtapuska@chromium.org>
Date: Mon Mar 06 15:23:26 2017

Disable the passthrough touch event queue for now.

Due to perf regressions disable the passthrough touch event queue
it causes GestureScrollUpdate events to take more time.

BUG= 697871 , 642368 

Review-Url: https://codereview.chromium.org/2722113007
Cr-Commit-Position: refs/heads/master@{#454504}
(cherry picked from commit abf462cdff2f095ab1ab69beb78c8b658bfb634a)

Review-Url: https://codereview.chromium.org/2731213003 .
Cr-Commit-Position: refs/branch-heads/3029@{#20}
Cr-Branched-From: 939b32ee5ba05c396eef3fd992822fcca9a2e262-refs/heads/master@{#454471}

[modify] https://crrev.com/6e69ab6bfafc78b6037ee64329e6af6974e3afb6/content/browser/renderer_host/input/input_router_impl.cc
[modify] https://crrev.com/6e69ab6bfafc78b6037ee64329e6af6974e3afb6/content/browser/renderer_host/input/input_router_impl_unittest.cc

Project Member

Comment 13 by bugdroid1@chromium.org, Mar 6 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/48123136ee6788085fc91bf856bf5e05f97da590

commit 48123136ee6788085fc91bf856bf5e05f97da590
Author: dtapuska <dtapuska@chromium.org>
Date: Mon Mar 06 22:28:30 2017

Re-enable passthrough touch event queue.

Async touchmoves were going to the main thread to be ack'd by the
compositor but this was useless and causing a regression in the
mean input event latency. Ack async touch moves right away just like
the LegacyTouchEventQueue did.

BUG= 697871 , 642368 

Review-Url: https://codereview.chromium.org/2734563002
Cr-Commit-Position: refs/heads/master@{#454977}

[modify] https://crrev.com/48123136ee6788085fc91bf856bf5e05f97da590/content/browser/renderer_host/input/input_router_impl.cc
[modify] https://crrev.com/48123136ee6788085fc91bf856bf5e05f97da590/content/browser/renderer_host/input/input_router_impl.h
[modify] https://crrev.com/48123136ee6788085fc91bf856bf5e05f97da590/content/browser/renderer_host/input/input_router_impl_perftest.cc
[modify] https://crrev.com/48123136ee6788085fc91bf856bf5e05f97da590/content/browser/renderer_host/input/input_router_impl_unittest.cc
[modify] https://crrev.com/48123136ee6788085fc91bf856bf5e05f97da590/content/renderer/input/input_event_filter_unittest.cc
[modify] https://crrev.com/48123136ee6788085fc91bf856bf5e05f97da590/content/renderer/render_widget_unittest.cc
[modify] https://crrev.com/48123136ee6788085fc91bf856bf5e05f97da590/ui/events/blink/web_input_event_traits.cc
[modify] https://crrev.com/48123136ee6788085fc91bf856bf5e05f97da590/ui/events/blink/web_input_event_traits.h

Sign in to add a comment