New issue
Advanced search Search tips

Issue 873849 link

Starred by 2 users

Issue metadata

Status: Fixed
Owner:
Closed: Aug 29
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: ----

Blocked on:
issue 873886
issue 873695



Sign in to add a comment

Make bvt-perbuild pass for release builder

Project Member Reported by xixuan@chromium.org, Aug 13

Issue description

A start point:

https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?buildbucketId=8938289840821046176

2018-08-13 15:04:09,589 INFO | video_MediaRecorderHWEncodeUsed.vp9               COMPLETED (FAILURE)
2018-08-13 15:04:09,589 INFO | video_JpegDecodeAccelerator                       COMPLETED (FAILURE)
2018-08-13 15:04:09,589 INFO | video_ChromeVidResChangeHWDecode.vp8              COMPLETED (FAILURE)
2018-08-13 15:04:09,589 INFO | desktopui_ScreenLocker                            COMPLETED (FAILURE)
2018-08-13 15:04:09,589 INFO | video_JpegEncodeAccelerator                       COMPLETED (FAILURE)
2018-08-13 15:04:09,589 INFO | video_ChromeVidResChangeHWDecode.h264             COMPLETED (FAILURE)
2018-08-13 15:04:09,589 INFO | video_VideoDecodeAccelerator.vp9_2                COMPLETED (FAILURE)
2018-08-13 15:04:09,589 INFO | video_VideoDecodeAccelerator.vp9                  COMPLETED (FAILURE)
2018-08-13 15:04:09,590 INFO | hardware_StorageWearoutDetect                     COMPLETED (FAILURE)
2018-08-13 15:04:09,590 INFO | graphics_HwOverlays.video                         COMPLETED (FAILURE)

2018-08-13 15:04:09,590 INFO | security_CpuVulnerabilities                       COMPLETED (FAILURE)
2018-08-13 15:04:09,591 INFO | login_SavePassword.nopassword                     COMPLETED (FAILURE)
2018-08-13 15:04:09,591 INFO | logging_CrashServices                             COMPLETED (FAILURE)
2018-08-13 15:04:09,591 INFO | video_VDASanity                                   COMPLETED (FAILURE)
2018-08-13 15:04:09,591 INFO | platform_HwImageBoardCheck                        COMPLETED (FAILURE)
2018-08-13 15:04:09,591 INFO | video_VideoSeek.h264.switchres                    COMPLETED (FAILURE)
2018-08-13 15:04:09,592 INFO | login_SavePassword                                COMPLETED (FAILURE)
2018-08-13 15:04:09,593 INFO | platform_CrosDisksArchive                         COMPLETED (FAILURE)
2018-08-13 15:04:09,593 INFO | touch_UpdateErrors.stylus                         COMPLETED (FAILURE)
2018-08-13 15:04:09,593 INFO | policy_AudioOutputAllowed.NotSet_Allow            COMPLETED (FAILURE)

2018-08-13 15:04:09,593 INFO | video_VideoEncodeAccelerator.vp8.bvt              COMPLETED (FAILURE)
2018-08-13 15:04:09,593 INFO | kernel_fs_Inplace                                 COMPLETED (FAILURE)
2018-08-13 15:04:09,594 INFO | video_VEAPerf.vp8.bvt                             COMPLETED (FAILURE)
2018-08-13 15:04:09,594 INFO | rlz_CheckPing                                     COMPLETED (FAILURE)
2018-08-13 15:04:09,594 INFO | touch_TouchscreenZoom                             COMPLETED (FAILURE)
2018-08-13 15:04:09,594 INFO | video_VideoSeek.vp9                               COMPLETED (FAILURE)
2018-08-13 15:04:09,594 INFO | video_VEAPerf.h264.bvt                            COMPLETED (FAILURE)
2018-08-13 15:04:09,594 INFO | touch_StylusTaps                                  COMPLETED (FAILURE)
2018-08-13 15:04:09,594 INFO | platform_LogoutPerf                               COMPLETED (FAILURE)
2018-08-13 15:04:09,595 INFO | platform_TLSDateActual                            COMPLETED (FAILURE)

2018-08-13 15:04:09,595 INFO | video_VideoEncodeAccelerator.h264.bvt             COMPLETED (FAILURE)
2018-08-13 15:04:09,595 INFO | touch_UpdateErrors.touchscreen                    COMPLETED (FAILURE)
2018-08-13 15:04:09,595 INFO | touch_TouchscreenScroll                           COMPLETED (FAILURE)
2018-08-13 15:04:09,596 INFO | platform_Pkcs11InitOnLogin                        COMPLETED (FAILURE)
2018-08-13 15:04:09,596 INFO | touch_HasInput.stylus                             COMPLETED (FAILURE)
2018-08-13 15:04:09,596 INFO | autoupdate_OmahaResponse.bad_sha256.full          COMPLETED (FAILURE)
2018-08-13 15:04:09,596 INFO | autoupdate_NonBlockingOOBEUpdate.delta            COMPLETED (FAILURE)
2018-08-13 15:04:09,596 INFO | tast.informational                                COMPLETED (FAILURE)
2018-08-13 15:04:09,596 INFO | autoupdate_OmahaResponse.backoff_disabled.full    COMPLETED (FAILURE)
2018-08-13 15:04:09,596 INFO | autoupdate_OmahaResponse.url_switch.full          COMPLETED (FAILURE)

2018-08-13 15:04:09,597 INFO | graphics_PowerConsumption                         COMPLETED (FAILURE)
2018-08-13 15:04:09,597 INFO | autoupdate_OmahaResponse.backoff_enabled.full     COMPLETED (FAILURE)
2018-08-13 15:04:09,597 INFO | autoupdate_OmahaResponse.bad_metadata_size.full   COMPLETED (FAILURE)
2018-08-13 15:04:09,597 INFO | autoupdate_Interruptions.full                     COMPLETED (FAILURE)
2018-08-13 15:04:09,597 INFO | autoupdate_ForcedOOBEUpdate.interrupt.full        COMPLETED (FAILURE)
2018-08-13 15:04:09,597 INFO | autoupdate_ForcedOOBEUpdate.delta                 COMPLETED (FAILURE)

46 failed tests.
 
Compare with bvt-perbuild in autotest (https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?buildbucketId=8939191291298192928):

ySQL [chromeos_autotest_db]> select test_name, status from tko_test_view_2 where afe_job_id=223647040 and status !='GOOD';

+-----------------------------------------------------------------------+---------+
| test_name                                                             | status  |
+-----------------------------------------------------------------------+---------+
| touch_HasInput.stylus                                                 | TEST_NA |
| cheets_AppCompatTest.clamshell.com.google.android.apps.youtube.gaming | TEST_NA |
| cheets_AppCompatTest.clamshell.com.google.android.gm                  | TEST_NA |
| cheets_AppCompatTest.clamshell.com.google.android.apps.plus           | TEST_NA |
| cheets_AppCompatTest.touchview.com.google.android.apps.plus           | TEST_NA |
| touch_StylusTaps                                                      | TEST_NA |
| touch_UpdateErrors.stylus                                             | TEST_NA |
| cheets_AppCompatTest.touchview.com.google.android.gm                  | TEST_NA |
| cheets_AppCompatTest.touchview.com.google.android.apps.youtube.gaming | TEST_NA |
| video_VideoEncodeAccelerator.h264                                     | FAIL    |
| video_VideoDecodeAccelerator                                          | TEST_NA |
| platform_TLSDateActual                                                | FAIL    |
| video_VEAPerf.h264                                                    | FAIL    |
| component_UpdateFlash                                                 | FAIL    |
| platform_LogoutPerf                                                   | FAIL    |
| video_VideoDecodeAccelerator                                          | TEST_NA |
| video_VideoSeek                                                       | TEST_NA |
| rlz_CheckPing                                                         | FAIL    |
| video_VEAPerf.vp8                                                     | FAIL    |
| graphics_HwOverlays                                                   | FAIL    |
| video_VideoEncodeAccelerator.vp8                                      | FAIL    |
| platform_CrosDisksArchive.zip                                         | FAIL    |
| platform_CrosDisksArchive.rar                                         | FAIL    |
| video_JpegEncodeAccelerator                                           | TEST_NA |
| video_JpegDecodeAccelerator                                           | TEST_NA |
| graphics_PowerConsumption                                             | FAIL    |
| touch_TouchscreenZoom                                                 | FAIL    |
| login_SavePassword                                                    | FAIL    |
| video_ChromeVidResChangeHWDecode.vp8                                  | ERROR   |
| desktopui_ScreenLocker                                                | FAIL    |
| desktopui_MediaAudioFeedback                                          | FAIL    |
| video_VideoSeek                                                       | ERROR   |
| video_VDASanity.vp9                                                   | TEST_NA |
| logging_CrashServices                                                 | ERROR   |
| graphics_HwOverlays                                                   | FAIL    |
| platform_DebugDaemonGetPerfData                                       | ERROR   |
| security_CpuVulnerabilities                                           | TEST_NA |
| video_MediaRecorderHWEncodeUsed.vp9                                   | TEST_NA |
| hardware_StorageWearoutDetect                                         | FAIL    |
| video_VideoDecodeAccelerator                                          | TEST_NA |
+-----------------------------------------------------------------------+---------+
35 tests both fail/TEST_NA:

(test_name, status in autotest, status in skylab):

('graphics_PowerConsumption', 'FAIL', 'FAIL')
('video_VideoEncodeAccelerator.h264', 'FAIL', 'FAIL')
('video_VideoDecodeAccelerator', 'TEST_NA', 'TEST_NA')
('platform_TLSDateActual', 'FAIL', 'ERROR')
('video_VideoDecodeAccelerator', 'TEST_NA', 'TEST_NA')
('component_UpdateFlash', 'FAIL', 'FAIL')
('touch_StylusTaps', 'TEST_NA', 'ERROR')
('video_VEAPerf.h264', 'FAIL', 'FAIL')
('video_VideoSeek', 'ERROR', 'TEST_NA')
('touch_TouchscreenZoom', 'FAIL', 'ERROR')
('rlz_CheckPing', 'FAIL', 'FAIL')
('video_VEAPerf.vp8', 'FAIL', 'FAIL')
('platform_LogoutPerf', 'FAIL', 'FAIL')
('video_VideoEncodeAccelerator.vp8', 'FAIL', 'FAIL')
('platform_CrosDisksArchive.zip', 'FAIL', 'FAIL')
('platform_CrosDisksArchive.rar', 'FAIL', 'FAIL')
('video_JpegEncodeAccelerator', 'TEST_NA', 'TEST_NA')
('desktopui_ScreenLocker', 'FAIL', 'FAIL')
('video_ChromeVidResChangeHWDecode.vp8', 'ERROR', 'ERROR')
('video_JpegDecodeAccelerator', 'TEST_NA', 'TEST_NA')
('video_VideoSeek', 'ERROR', 'ERROR')
('video_VDASanity.vp9', 'TEST_NA', 'TEST_NA')
('security_CpuVulnerabilities', 'TEST_NA', 'TEST_NA')
('video_MediaRecorderHWEncodeUsed.vp9', 'TEST_NA', 'TEST_NA')
('hardware_StorageWearoutDetect', 'FAIL', 'FAIL')
('logging_CrashServices', 'ERROR', 'ERROR')
('video_JpegEncodeAccelerator', 'TEST_NA', 'TEST_NA')
('video_JpegEncodeAccelerator', 'TEST_NA', 'TEST_NA')
('video_VideoDecodeAccelerator', 'TEST_NA', 'TEST_NA')
('video_VideoDecodeAccelerator', 'TEST_NA', 'TEST_NA')
('desktopui_ScreenLocker', 'FAIL', 'FAIL')
('video_JpegDecodeAccelerator', 'TEST_NA', 'TEST_NA')
('video_MediaRecorderHWEncodeUsed.vp9', 'TEST_NA', 'TEST_NA')
('desktopui_ScreenLocker', 'FAIL', 'FAIL')
('video_ChromeVidResChangeHWDecode.vp8', 'ERROR', 'ERROR')
Re #2, they almost fail for the reason based on information in tko.
Tests only fail in skylab:

autoupdate_ForcedOOBEUpdate
autoupdate_OmahaResponse
autoupdate_OmahaResponse
autoupdate_OmahaResponse
autoupdate_Interruptions
autoupdate_OmahaResponse
tast
touch_HasInput
autoupdate_OmahaResponse
autoupdate_NonBlockingOOBEUpdate
touch_UpdateErrors
autoupdate_ForcedOOBEUpdate
platform_Pkcs11InitOnLogin
video_ChromeVidResChangeHWDecode.h264
touch_StylusTaps
touch_UpdateErrors
policy_AudioOutputAllowed
video_ChromeVidResChangeHWDecode.h264
touch_HasInput, touch_StylusTaps, touch_UpdateErrors,stylus, touch_UpdateErrors.touchscreen fails due to skylab_suite doesn't pass dependencies in control file to swarming. File Issue 873886 for tracking this.
Blockedon: 873886
autoupdate_OmahaResponse related tests failed due to:

"gsutil ls gs://chromeos-image-archive/nyan_blaze-release-tryjob/R70-10965.0.0-b2840368/chromeos_R70-10965.0.0-b2840368*_full_*" failed to locate the artifacts. This is not related to skylab.


video_Chrome*** tests failed due to:

TestError: Media.GpuVideoDecoderInitializeStatus not loaded or histogram bucket not found or histogram bucket found at < 100%

Not related to skylab.
tast failed with the same reason in  Issue 873695 .
Blockedon: 873695
platform_Pkcs11InitOnLogin
Autotest client terminated unexpectedly: DUT rebooted during the test run.

Test failure, not related to skylab.

policy_AudioOutputAllowed
RMS difference not large enough between mute and ummute: 4.9e-05

This may be related to Issue 873886 as we miss to pass in dependencies in control file for this test.
Status: Fixed (was: Untriaged)
even if the blocker Issue 873886 is not completely finished, we can treat this bug as fixed since 1) bvt-perbuild is green 2) TEST_NA tests are marked as NO_RESOURCE now.

Sign in to add a comment