New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 741137 link

Starred by 4 users

Issue metadata

Status: Assigned
Owner:
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Mac
Pri: 1
Type: Bug-Regression



Sign in to add a comment

CaptureScreenshotTests fails in Mac Continuous builder

Project Member Reported by ligim...@chromium.org, Jul 11 2017

Issue description

Below mentioned content_browsertests fails in Mac trunk builder

CaptureScreenshotTest.CaptureScreenshot
CaptureScreenshotTest.CaptureScreenshotArea
CaptureScreenshotTest.CaptureScreenshotJpeg

Link to the Builder
===================
https://uberchromegw.corp.google.com/i/official.desktop.continuous/builders/mac64%20trunk/builds/3118

Link to the log file
====================
https://uberchromegw.corp.google.com/i/official.desktop.continuous/builders/mac64%20trunk/builds/3118/steps/content_browsertests/logs/stdio

Error Log
=========
@@@STEP_LOG_LINE@CaptureScreenshotTest.CaptureScreenshotJpeg@[93781:775:0711/142504.212024:10851266412657:ERROR:devtools_protocol_browsertest.cc(604)] Error Bounding Box : 4,4 792x592@@@
@@@STEP_LOG_LINE@CaptureScreenshotTest.CaptureScreenshotJpeg@../../content/browser/devtools/protocol/devtools_protocol_browsertest.cc:647: Failure@@@
@@@STEP_LOG_LINE@CaptureScreenshotTest.CaptureScreenshotJpeg@Value of: MatchesBitmap(expected_bitmap, *result_bitmap, matching_mask, error_limit)@@@
@@@STEP_LOG_LINE@CaptureScreenshotTest.CaptureScreenshotJpeg@  Actual: false@@@
@@@STEP_LOG_LINE@CaptureScreenshotTest.CaptureScreenshotJpeg@Expected: true@@@
@@@STEP_LOG_LINE@CaptureScreenshotTest.CaptureScreenshotJpeg@[  FAILED  ] CaptureScreenshotTest.CaptureScreenshotJpeg, where TypeParam =  and GetParam() =  (447 ms)@@@
@@@STEP_LOG_LINE@CaptureScreenshotTest.CaptureScreenshotJpeg@@@@
@@@STEP_LOG_END@CaptureScreenshotTest.CaptureScreenshotJpeg@@@

Regression Information
======================

First Bad Build: https://uberchromegw.corp.google.com/i/official.desktop.continuous/builders/mac64%20trunk/builds/3072

Last Good Build: https://uberchromegw.corp.google.com/i/official.desktop.continuous/builders/mac64%20trunk/builds/3069

Flaky Information 
=================
The given test is not flaky as it did not cross of the flaky tolerance 30 percent.

Possible suspect
================
https://chromium.googlesource.com/chromium/src/+/bd74faae21bebdda0da67016c2977b4ce85fcef0

This is a recent regression. Pavel, could you please fix the test failure.
 
Labels: officialtest

Comment 2 by ajha@chromium.org, Jul 13 2017

Friendly ping to get an update on this.

Comment 3 by mmoss@chromium.org, Jul 17 2017

Cc: dimu@chromium.org
Looks like this has actually been happening since:

https://uberchromegw.corp.google.com/i/official.desktop.continuous/builders/mac64%20trunk/builds/2596

Comment 4 by mmoss@chromium.org, Jul 17 2017

Cc: ccameron@chromium.org
https://chromium.googlesource.com/chromium/src/+/1894d423068be735560e0171922c833c4091b5d1 is the only change there that looks like it could be related. +ccameron

Comment 5 by mmoss@chromium.org, Jul 17 2017

Cc: mmoss@chromium.org
FYI, bug 736869 may also be related.
Cc: ranjitkan@chromium.org
Just to update, this is still failing on MAC official builder for Build 62.0.3167.0:

BuilD URL:
==========
https://uberchromegw.corp.google.com/i/official.desktop/builders/mac64/builds/2020

Log URL:
========
https://uberchromegw.corp.google.com/i/official.desktop/builders/mac64/builds/2020/steps/content_browsertests/logs/stdio

Comment 8 by gov...@chromium.org, Jul 26 2017

URGENT - PTAL.
Your bug is labelled as Stable ReleaseBlock, pls make sure to land the fix and get it merged into the M61 branch #3163 ASAP to have enough baking time in Beta before Stable promotion. Thank you!

Know that this issue shouldn't block the release?  Remove the ReleaseBlock-Stable label.

Labels: -ReleaseBlock-Stable
-RBS

This is the same issue as issue 736628 -- our output is now dependent on the monitor's color profile. We need to force a specific monitor profile while running these tests -- see the workaround we did for GPU pixel tests in  issue 734255 .
Labels: Infra-Troopers
+Infra Troopers, to check if they could make necessary changes in builder as mentioned in -  Issue 734255 

We are trying to make the builders green, it would be great if you could prioritize and take action.
These particular tests are still failing on latest 'continuous' & 'official' Mac64 builds, so disabling these tests to make bots greener?

https://uberchromegw.corp.google.com/i/official.desktop.continuous/builders/mac64%20trunk/builds/6253
https://uberchromegw.corp.google.com/i/official.desktop/builders/mac64/builds/2194

Thank you!
Labels: -M-61 M-63
I can do this -- it's a matter of forcing a new color profile inside ContentBrowserTest::ContentBrowserTest and un-doing it in ContentBrowserTest::~ContentBrowserTest.

Lots of #ifdef Mac code, but not a huge deal.
Owner: ccameron@chromium.org

Sign in to add a comment