Currently in telemetry_unittests one test is failing on each run of the Mojo FYI bots:
telemetry.page.page_run_end_to_end_unittest.ActualPageRunEndToEndTests.testTrafficSettings failed unexpectedly
This test is failing with the following error:
Traceback (most recent call last):
File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/page/page_run_end_to_end_unittest.py", line 337, in testTrafficSettings
latencies_by_page_in_ms['fast'] + 300 - 2)
AssertionError: 304.795166015625 not greater than 470.79296875
While the latencies vary, it is always too slow on the Mojo FYI bots running CrOS.
Example logs with failure: https://luci-logdog.appspot.com/v/?s=chromium%2Fbb%2Fchromium.fyi%2FMojo_ChromiumOS%2F20906%2F%2B%2Frecipes%2Fsteps%2Ftelemetry_unittests%2F0%2Fstdout
I can reproduce this locally (flakily) with:
/usr/bin/python ../../testing/scripts/run_telemetry_as_googletest.py ../../tools/perf/run_telemetry_tests ActualPageRunEndToEndTests.testTrafficSettings -v --jobs=1 --chrome-root ../../ --browser=exact --browser-executable=./test_chrome --jobs=1 --isolated-script-test-output=../../../output.json --extra-browser-args="--use-gl=egl"
I will look into disabling the test on CrOS.
Comment 1 by bugdroid1@chromium.org
, Aug 30 2017