New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 727778 link

Starred by 4 users

Issue metadata

Status: Verified
Owner:
Last visit 27 days ago
Closed: Jun 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Bug



Sign in to add a comment

[bvt-cq rambi] graphics_Sanity failing with 'perceptualdiff' command failed, rc=1, Command returned non-zero exit status.

Project Member Reported by ka...@chromium.org, May 30 2017

Issue description

Rambi boards started consistently failing the graphics_Sanity since R61-9601.0.0.
Test results view - https://screenshot.googleplex.com/CAHDHpMHLUf

 Issue 621427  was raised a year ago for the same reason.


Test sample logs: https://pantheon.corp.google.com/storage/browser/chromeos-autotest-results/120432218-chromeos-test/chromeos6-row1-rack6-host5/

Compared files are attached.

Test failure log:

05/30 08:50:01.345 DEBUG|             utils:0298| [stdout] Field of view is 45.000000 degrees
05/30 08:50:01.346 DEBUG|             utils:0298| [stdout] Threshold pixels is 100 pixels
05/30 08:50:01.347 DEBUG|             utils:0298| [stdout] The Gamma is 2.200000
05/30 08:50:01.347 DEBUG|             utils:0298| [stdout] The Display's luminance is 100.000000 candela per meter squared
05/30 08:50:01.348 DEBUG|             utils:0298| [stdout] Converting RGB to XYZ
05/30 08:50:01.348 DEBUG|             utils:0298| [stdout] Constructing Laplacian Pyramids
05/30 08:50:01.349 DEBUG|             utils:0298| [stdout] Performing test
05/30 08:50:01.349 DEBUG|             utils:0298| [stdout] FAIL: Images are visibly different
05/30 08:50:01.350 DEBUG|             utils:0298| [stdout] 3599 pixels are different
05/30 08:50:01.350 DEBUG|             utils:0298| [stdout] 
05/30 08:50:01.354 DEBUG|              test:0395| Test failed due to Command <perceptualdiff -verbose /usr/local/autotest/tests/graphics_Sanity/screenshot1_reference.png /usr/local/autotest/results/default/graphics_Sanity/results/screenshot1_generated_resized.png> failed, rc=1, Command returned non-zero exit status
* Command: 
    perceptualdiff -verbose
    /usr/local/autotest/tests/graphics_Sanity/screenshot1_reference.png /usr/l
    ocal/autotest/results/default/graphics_Sanity/results/screenshot1_generate
    d_resized.png
Exit status: 1
Duration: 0.138727903366

stdout:
Field of view is 45.000000 degrees
Threshold pixels is 100 pixels
The Gamma is 2.200000
The Display's luminance is 100.000000 candela per meter squared
Converting RGB to XYZ
Constructing Laplacian Pyramids
Performing test
FAIL: Images are visibly different
3599 pixels are different. Exception log follows the after_iteration_hooks.
05/30 08:50:01.355 DEBUG|              test:0398| starting after_iteration_hooks
05/30 08:50:01.356 DEBUG|             utils:0203| Running 'mkdir -p /usr/local/autotest/results/default/graphics_Sanity/sysinfo/iteration.1/var/spool'
05/30 08:50:01.364 DEBUG|             utils:0203| Running 'rsync --no-perms --chmod=ugo+r -a --exclude=autoserv* --safe-links --exclude=*.core /var/spool/crash /usr/local/autotest/results/default/graphics_Sanity/sysinfo/iteration.1/var/spool'
05/30 08:50:01.377 DEBUG|             utils:0203| Running 'rm -rf /var/spool/crash/*'
05/30 08:50:01.388 DEBUG|             utils:0203| Running 'logger "autotest finished iteration /usr/local/autotest/results/default/graphics_Sanity/sysinfo/iteration.1"'
05/30 08:50:01.397 DEBUG|              test:0401| after_iteration_hooks completed
05/30 08:50:01.398 WARNI|              test:0621| The test failed with the following exception
Traceback (most recent call last):
  File "/usr/local/autotest/common_lib/test.py", line 615, in _exec
    _call_test_function(self.execute, *p_args, **p_dargs)
  File "/usr/local/autotest/common_lib/test.py", line 823, in _call_test_function
    return func(*args, **dargs)
  File "/usr/local/autotest/common_lib/test.py", line 476, in execute
    dargs)
  File "/usr/local/autotest/common_lib/test.py", line 353, in _call_run_once_with_retry
    postprocess_profiled_run, args, dargs)
  File "/usr/local/autotest/common_lib/test.py", line 386, in _call_run_once
    self.run_once(*args, **dargs)
  File "/usr/local/autotest/tests/graphics_Sanity/graphics_Sanity.py", line 101, in run_once
    utils.system(diff_cmd % (screenshot1_reference, screenshot1_resized))
  File "/usr/local/autotest/common_lib/utils.py", line 1025, in system
    stdout_tee=TEE_TO_LOGS, stderr_tee=TEE_TO_LOGS).exit_status
  File "/usr/local/autotest/common_lib/utils.py", line 759, in run
    "Command returned non-zero exit status")
CmdError: Command <perceptualdiff -verbose /usr/local/autotest/tests/graphics_Sanity/screenshot1_reference.png /usr/local/autotest/results/default/graphics_Sanity/results/screenshot1_generated_resized.png> failed, rc=1, Command returned non-zero exit status
* Command: 
    perceptualdiff -verbose
    /usr/local/autotest/tests/graphics_Sanity/screenshot1_reference.png /usr/l
    ocal/autotest/results/default/graphics_Sanity/results/screenshot1_generate
    d_resized.png
Exit status: 1
Duration: 0.138727903366

stdout:
Field of view is 45.000000 degrees
Threshold pixels is 100 pixels
The Gamma is 2.200000
The Display's luminance is 100.000000 candela per meter squared
Converting RGB to XYZ
Constructing Laplacian Pyramids
Performing test
FAIL: Images are visibly different
 
screenshot1_generated_resized.png
2.7 KB View Download
screenshot2_generated_resized.png
5.1 KB View Download

Comment 1 by groeck@chromium.org, May 30 2017

Cc: seanpaul@chromium.org

Comment 2 by ka...@chromium.org, May 30 2017

Labels: M-61

Comment 3 by ihf@chromium.org, May 30 2017

Owner: tutankhamen@chromium.org
Robert, you already have experience with this test. Can you investigate how this broke?
https://wmatrix.googleplex.com/unfiltered?hide_missing=True&releases=tot&tests=graphics_Sanity

https://crosland.corp.google.com/log/9600.0.0..9601.0.0

Comment 4 by ihf@chromium.org, May 30 2017

Lots of Intel changes in the kernel.

Comment 5 by groeck@chromium.org, May 30 2017

Same (or similar) error seen on banjo-paladin:
https://uberchromegw.corp.google.com/i/chromiumos.tryserver/builders/paladin/builds/2932

Comment 7 by dbehr@chromium.org, May 30 2017

Cc: tarun.v...@intel.com wayne.bo...@intel.com intel@chromium.org
It looks like this bug was fixed along with flip buffers flickering issue. At least I can't reproduce it with 9620 om clapper and glimmer.
WFM as well since last Friday (6/2) on banjo-paladin.

Comment 10 Deleted

I just successfully performed 20x continues tests on two boards. So, changing status to fixed.

Comment 12 by ihf@chromium.org, Jun 5 2017

Cc: jrbarnette@chromium.org
I am wondering if bvt-cq does much these days to hold off bad kernel changes:

a) graphics_Sanity is part of bvt-cq
b) graphics_Sanity broke on many Intel devices due to Intel kernel change
https://bugs.chromium.org/p/chromium/issues/detail?id=727778
c) including breaking kip
https://wmatrix.googleplex.com/unfiltered?hide_missing=True&releases=tot&tests=graphics_Sanity&days_back=30
d) kip is part of _paladin_hwtest_testsharding_pairs
https://chromium-review.googlesource.com/#/c/522746/4/cbuildbot/chromeos_config.py

Looks like kip is marked experimental, like many other boards in paladin.
And paladin coverage for new architectures is very stingy.
> Looks like kip is marked experimental, like many other boards in paladin.
> And paladin coverage for new architectures is very stingy.

kip is marked experimental, and it absolutely shouldn't be;
see bugs  729668  and  696679 .

Project Member

Comment 14 by bugdroid1@chromium.org, Jun 6 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/chromite/+/259242ed15e6bd33a3e7ac44f810f01db7c81a4a

commit 259242ed15e6bd33a3e7ac44f810f01db7c81a4a
Author: Ilja H. Friedel <ihf@chromium.org>
Date: Tue Jun 06 06:49:38 2017

chromos_config: mark kip important.

This could have prevented the baytrail graphics failure.

BUG= chromium:727778 ,  chromium:729668 
TEST=None.

Change-Id: I337a5097c65ecdb3eab1bfa30188336d0c0e9c2d
Reviewed-on: https://chromium-review.googlesource.com/524037
Commit-Ready: Ilja H. Friedel <ihf@chromium.org>
Tested-by: Ilja H. Friedel <ihf@chromium.org>
Reviewed-by: Ilja H. Friedel <ihf@chromium.org>

[modify] https://crrev.com/259242ed15e6bd33a3e7ac44f810f01db7c81a4a/cbuildbot/config_dump.json
[modify] https://crrev.com/259242ed15e6bd33a3e7ac44f810f01db7c81a4a/cbuildbot/chromeos_config.py

Comment 15 by ihf@chromium.org, Jun 6 2017

Issue 727407 has been merged into this issue.
Issue 727412 has been merged into this issue.
Issue 727413 has been merged into this issue.
Issue 727414 has been merged into this issue.
Issue 727415 has been merged into this issue.
Issue 727416 has been merged into this issue.
Issue 727417 has been merged into this issue.
Issue 727418 has been merged into this issue.
Issue 727422 has been merged into this issue.
Issue 727429 has been merged into this issue.
Issue 727430 has been merged into this issue.
Issue 727510 has been merged into this issue.
Issue 727524 has been merged into this issue.
Issue 727525 has been merged into this issue.
Issue 727528 has been merged into this issue.
Issue 727529 has been merged into this issue.
Issue 727530 has been merged into this issue.
Issue 727531 has been merged into this issue.
Issue 727532 has been merged into this issue.
Issue 727543 has been merged into this issue.
Issue 727550 has been merged into this issue.
Issue 727608 has been merged into this issue.
Issue 727691 has been merged into this issue.
Issue 727694 has been merged into this issue.
Issue 727696 has been merged into this issue.
Issue 727697 has been merged into this issue.
Issue 727700 has been merged into this issue.
Issue 727701 has been merged into this issue.
Issue 727703 has been merged into this issue.
Issue 727706 has been merged into this issue.
Issue 727714 has been merged into this issue.
Issue 727719 has been merged into this issue.
Issue 727720 has been merged into this issue.
Issue 727736 has been merged into this issue.
Issue 727770 has been merged into this issue.
Issue 727965 has been merged into this issue.
Issue 728059 has been merged into this issue.
Issue 728073 has been merged into this issue.
Issue 728084 has been merged into this issue.
Issue 728089 has been merged into this issue.
Issue 728095 has been merged into this issue.
Issue 728100 has been merged into this issue.
Issue 728101 has been merged into this issue.
Issue 728367 has been merged into this issue.
Issue 728400 has been merged into this issue.
Issue 728403 has been merged into this issue.
Issue 728406 has been merged into this issue.
Issue 728407 has been merged into this issue.
Issue 728408 has been merged into this issue.
Issue 728420 has been merged into this issue.
Issue 728422 has been merged into this issue.
Issue 728423 has been merged into this issue.
Issue 728429 has been merged into this issue.
Issue 728437 has been merged into this issue.
Issue 728517 has been merged into this issue.
Issue 728521 has been merged into this issue.
Issue 728523 has been merged into this issue.
Issue 728531 has been merged into this issue.
Issue 728533 has been merged into this issue.
Issue 728550 has been merged into this issue.
Issue 728553 has been merged into this issue.
Issue 728555 has been merged into this issue.
Issue 728645 has been merged into this issue.
Issue 728646 has been merged into this issue.
Issue 728653 has been merged into this issue.
Issue 728661 has been merged into this issue.
Issue 728675 has been merged into this issue.
Issue 728676 has been merged into this issue.
Issue 728680 has been merged into this issue.
Issue 728688 has been merged into this issue.
Issue 728689 has been merged into this issue.
Issue 728746 has been merged into this issue.
Issue 728861 has been merged into this issue.
Issue 728862 has been merged into this issue.
Issue 728868 has been merged into this issue.
Issue 728871 has been merged into this issue.
Issue 728881 has been merged into this issue.
Issue 728884 has been merged into this issue.
Issue 728890 has been merged into this issue.
Issue 728900 has been merged into this issue.
Issue 728928 has been merged into this issue.
Issue 728932 has been merged into this issue.
Issue 728939 has been merged into this issue.
Issue 728943 has been merged into this issue.
Issue 728945 has been merged into this issue.
Issue 728946 has been merged into this issue.
Issue 728948 has been merged into this issue.
Issue 728950 has been merged into this issue.
Issue 728951 has been merged into this issue.
Issue 728959 has been merged into this issue.
Issue 728961 has been merged into this issue.
Issue 728962 has been merged into this issue.
Issue 728964 has been merged into this issue.

Comment 16 by ihf@chromium.org, Jun 6 2017

Issue 727404 has been merged into this issue.
Labels: VerifyIn-61

Sign in to add a comment