New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 680066 link

Starred by 1 user

Issue metadata

Status: Verified
Owner:
Last visit > 30 days ago
Closed: Jan 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug-Regression



Sign in to add a comment

19.9% regression in cheets_GFXBenchTest/gl_fill2 on cros-veyron_minnie at 29480000907800001:29490000907900000

Project Member Reported by hctsai@chromium.org, Jan 11 2017

Issue description

Performance dashboard identified a 19.9% regression in cheets_GFXBenchTest/gl_fill2 on cros-veyron_minnie at revision range 29480000907800001:29490000907900000. Graph: https://chromeperf.appspot.com/report?masters=ARC&bots=cros-veyron_minnie&tests=cheets_GFXBenchTest%2Fgl_fill2&checked=gl_fill2%2Cgl_fill2_ref%2Cref&rev=29490000907900000

There are also other platforms encounter the regression, for example, elm while cyan show better scores. I didn't enumerate all of them but here are the graph for reference:

https://chromeperf.appspot.com/report?sid=0a4656548a509eb434f963b765868bd3a25da02a51d9a42202d0882b161ebc0d&start_rev=29240190900002100&end_rev=29760000916600000
 

Comment 1 by hctsai@chromium.org, Jan 11 2017

After bisecting changes between Chrome 57.0.2949.0 and 57.0.2948.0 with ChromeOS R57-9079.0.0. The root cause is from this change: https://codereview.chromium.org/2493223002

chromium > git checkout 39fe426a5bec5352ddacab96ac10c6c33f9d5ac1
chromium > ninja -C out_${SDK_BOARD}/Release -j1000 chrome chrome_sandbox nacl_helper
chromium > deploy_chrome --build-dir=out_${SDK_BOARD}/Release --to=10.10.10.1
chromiumos > test_that minnie cheets_GFXBenchTest

This gets 1293.0

chromium > git checkout d8f4f642d72fc5fdb428f5a90ca207c2143a6f79
chromium > ninja -C out_${SDK_BOARD}/Release -j1000 chrome chrome_sandbox nacl_helper
chromium > deploy_chrome --build-dir=out_${SDK_BOARD}/Release --to=10.10.10.1
chromiumos > test_that minnie cheets_GFXBenchTest

This gets 1037.0

chromium> git log -2 d8f4f642d72fc5fdb428f5a90ca207c2143a6f79

commit d8f4f642d72fc5fdb428f5a90ca207c2143a6f79
Author: staraz <staraz@chromium.org>
Date:   Sat Dec 10 15:49:20 2016 -0800

    Moved exo::SurfaceFactoryOwner to its own file and renamed it to exo::CompositorFrameSink.
    
    CompositorFrameSink implements cc::mojom::MojoCompositorFrameSink.
    
    CompositorFrameSink is no longer a friend class of exo::Surface.
    
    Added exo::CompositorFrameSinkHolder class that implements cc::mojom::MojoCompositorFrameSinkClient.
    
    BUG= 659601 
    CQ_INCLUDE_TRYBOTS=master.tryserver.blink:linux_trusty_blink_rel
    
    Review-Url: https://codereview.chromium.org/2493223002
    Review-Url: https://codereview.chromium.org/2493223002
    Cr-Commit-Position: refs/heads/master@{#437780}

commit 39fe426a5bec5352ddacab96ac10c6c33f9d5ac1
Author: lpromero <lpromero@chromium.org>
Date:   Sat Dec 10 15:48:09 2016 -0800

    Handle storyboards in GN.
    
    BUG=none
    R=sdefresne@chromium.org,rohitrao@chromium.org
    
    Review-Url: https://codereview.chromium.org/2564023002
    Cr-Commit-Position: refs/heads/master@{#437779}

Comment 2 by hctsai@chromium.org, Jan 11 2017

Cc: staraz@chromium.org
+staraz

Hi staraz, the mentioned code change seems to lower the score of GFXBench on several cheets platforms. Could you please verify if this could be caused by the change https://codereview.chromium.org/2493223002 ? Thanks !
Cc: reve...@chromium.org
Labels: -Pri-2 Pri-1

Comment 4 by uekawa@chromium.org, Jan 11 2017

Labels: M-57

Comment 5 by staraz@chromium.org, Jan 12 2017

I ran the benchmark the newest chrome revision (score: 5228, 5867) against 
39fe426a5bec5352ddacab96ac10c6c33f9d5ac1 (the revision before my exo refactor) 
(score: 4880, 5854) on my samus device and didn't see the regression.

3 CLs have landed to address some issues introduced in my refactor. They could 
also solve the performance regression. 

samus is x86, so is cyan. I'll find a minnie or other arm devices to make sure. 
Ok, let's keep an eye on these perf tests to make sure they recover.

Comment 7 by staraz@chromium.org, Jan 12 2017

Cc: fsam...@chromium.org

Comment 8 by staraz@chromium.org, Jan 12 2017

The regression is still present on veyron-minnie (1287 vs 1040 old vs new)
Status: Fixed (was: Assigned)
Status: Verified (was: Fixed)
The graph shows that the performance score comes back. Thanks !
Cc: penghuang@chromium.org

Sign in to add a comment