New issue
Advanced search Search tips

Issue 767264 link

Starred by 1 user

Issue metadata

Status: Untriaged
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

rebaseline-cl: When rebaselining a test with text diff but no image diff, only txt baseline should be downloaded

Project Member Reported by qyears...@chromium.org, Sep 21 2017

Issue description

When a test fails with a text failure but not an image failure, only the text baselines should be updated.

The current behavior appears to be that the png is also downloaded. The png can have differences in metadata even if the screenshot matches, which can cause problems.

Possible relevant section of the rebaseline code:
_suffixes_for_actual_failures
https://cs.chromium.org/chromium/src/third_party/WebKit/Tools/Scripts/webkitpy/tool/commands/rebaseline.py?l=458
 
Stefan, could you add a link to the CL where this happened?

Checking the source code linked above I couldn't find any obvious issues; it appears that baselines downloaded should generally be based on the result in teh results JSON (txt if the actual result contains TEXT and/or png if the actual result contains IMAGE).

Comment 2 by foolip@chromium.org, Dec 15 2017

Cc: robertm@chromium.org
Status: Available (was: Unconfirmed)
robertma@, can this ever be an issue for wpt-import?
Cc: -robertm@chromium.org robertma@chromium.org
Labels: -OS-Chrome
For WPT, there are no pixel tests, so there are never any png baselines to download, so I believe this issue wouldn't affect wpt-import.
Project Member

Comment 4 by sheriffbot@chromium.org, Dec 17

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot

Sign in to add a comment