New issue
Advanced search Search tips

Issue 754747 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Aug 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

Telemetery ActualPageRunEndToEndTests.testTrafficSettings Fails on CrOS`

Project Member Reported by jonr...@chromium.org, Aug 11 2017

Issue description

Currently in telemetry_unittests one test is failing on each run of the Mojo FYI bots:

telemetry.page.page_run_end_to_end_unittest.ActualPageRunEndToEndTests.testTrafficSettings failed unexpectedly

This test is failing with the following error:

Traceback (most recent call last):
    File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/page/page_run_end_to_end_unittest.py", line 337, in testTrafficSettings
      latencies_by_page_in_ms['fast'] + 300 - 2)
  AssertionError: 304.795166015625 not greater than 470.79296875

While the latencies vary, it is always too slow on the Mojo FYI bots running CrOS.

Example logs with failure: https://luci-logdog.appspot.com/v/?s=chromium%2Fbb%2Fchromium.fyi%2FMojo_ChromiumOS%2F20906%2F%2B%2Frecipes%2Fsteps%2Ftelemetry_unittests%2F0%2Fstdout

I can reproduce this locally (flakily) with:

/usr/bin/python ../../testing/scripts/run_telemetry_as_googletest.py ../../tools/perf/run_telemetry_tests ActualPageRunEndToEndTests.testTrafficSettings -v --jobs=1 --chrome-root ../../ --browser=exact --browser-executable=./test_chrome --jobs=1 --isolated-script-test-output=../../../output.json  --extra-browser-args="--use-gl=egl"

I will look into disabling the test on CrOS.
 
Project Member

Comment 1 by bugdroid1@chromium.org, Aug 30 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/2c219f35c8240b214473e8e05c4e595600783d4c

commit 2c219f35c8240b214473e8e05c4e595600783d4c
Author: Jonathan <jonross@chromium.org>
Date: Wed Aug 30 16:16:20 2017

Update Mojo FYI Config to Skip Failing Telemetry Tests

While we are working on a more formal way to identify the hybrid linux-chromeos
build from within telemetry, we will skip the two known failing tests on the
FYI bots.

TBR=sky@chromium.org
TEST=telemetry_unittests telemetry_perf_unittests

Bug:  754747 
Change-Id: Ib6f736d7d4c44bb4ecd0c244b24ca8d514d6e31b
Reviewed-on: https://chromium-review.googlesource.com/641632
Commit-Queue: Jonathan Ross <jonross@chromium.org>
Reviewed-by: Sadrul Chowdhury <sadrul@chromium.org>
Cr-Commit-Position: refs/heads/master@{#498484}
[modify] https://crrev.com/2c219f35c8240b214473e8e05c4e595600783d4c/testing/buildbot/chromium.fyi.json

Status: Fixed (was: Assigned)
These are now being skipped on the Mojo FYI bots, which are now cycling green.
Components: -MUS Internals>Services>WindowService

Sign in to add a comment