New issue
Advanced search Search tips

Issue 919113 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Jan 10
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug

Blocking:
issue 881991



Sign in to add a comment

False rejects caused by telemetry unit_tests hitting timeout threshold

Project Member Reported by erikc...@chromium.org, Jan 4

Issue description

Example build:https://ci.chromium.org/p/chromium/builders/luci.chromium.try/chromeos-amd64-generic-rel/160895

Note that in 'without_patch', shard #2 passes in 1191 seconds [1200 second timeout]. In 'with_patch' and 'retry_with_patch', shard#2 times out after 1200 seconds [most tests ran and passed]
 
Blocking: 881991
This is the top source of INVALID_TEST_RESULTS in the last few days according to go/top-cq-flakes

https://datastudio.google.com/c/reporting/12dYEpcepJ5_6ZOhprbd5GpDNooiUJONV/page/AYfX
Screen Shot 2019-01-04 at 11.26.26 AM.png
129 KB View Download
I'm going to double the telemetry unit_tests timeout, given that the other shards are also within a factor of 2X of the timeout.
Project Member

Comment 3 by bugdroid1@chromium.org, Jan 4

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/f521c8c4c26d86aec60a2e1497d31c36f042d155

commit f521c8c4c26d86aec60a2e1497d31c36f042d155
Author: erikchen <erikchen@chromium.org>
Date: Fri Jan 04 20:03:09 2019

Double the timeout for telemetry_unittests on CrOS.

Shards regularly take ~900s to run, and some shards are sitting very close to
the 1200s threshold. This CL doubles the timeout to 2400s.

Bug:  919113 
Change-Id: I96597a6a33a7fb2143393ae9940956923f96fe79
Reviewed-on: https://chromium-review.googlesource.com/c/1396234
Reviewed-by: Stephen Martinis <martiniss@chromium.org>
Commit-Queue: Erik Chen <erikchen@chromium.org>
Cr-Commit-Position: refs/heads/master@{#620040}
[modify] https://crrev.com/f521c8c4c26d86aec60a2e1497d31c36f042d155/testing/buildbot/chromium.chromiumos.json
[modify] https://crrev.com/f521c8c4c26d86aec60a2e1497d31c36f042d155/testing/buildbot/test_suites.pyl

Status: Fixed (was: Untriaged)
Owner: erikc...@chromium.org

Sign in to add a comment