New issue
Advanced search Search tips

Issue 890031 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner:
Closed: Oct 25
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: iOS
Pri: 2
Type: Bug



Sign in to add a comment

ios tests are timing out on CQ but individual tests seem to all pass?!

Project Member Reported by gab@chromium.org, Sep 27

Issue description

I have a CL @ https://chromium-review.googlesource.com/c/chromium/src/+/1232518
where ios-simulator is the only failing bot (reliable) :

https://ci.chromium.org/p/chromium/builders/luci.chromium.try/ios-simulator/101160

but no tests seem to actually be failing... just the test suites say they've "timed out" but everything seems to have completed...

Not sure who can help but this is a pretty poor failure state...
 
What makes you say that everything seems to have completed?
There are no apparent failures or tests that timed out. The shard seems to have a completion timestamp ahead of its deadline.
Created	26/09/2018 à 16:51:09 (heure d’été de l’Est)
Started	26/09/2018 à 16:51:10 (heure d’été de l’Est)
Expires	26/09/2018 à 17:51:09 (heure d’été de l’Est)
Completed	26/09/2018 à 17:13:25 (heure d’été de l’Est)
Abandoned	‑‑
I think the timeouts are local to the tests and not swarming-based.

The following appears at the end of the stdout for the first failing step:

 [----------] 4 tests from TimerSequenceTest
 [ RUN ] TimerSequenceTest.OneShotTimerTaskOnPoolSequence
 [ OK ] TimerSequenceTest.OneShotTimerTaskOnPoolSequence (5 ms)
 WARNING:root:collect_cmd had non-zero return code: 255
 WARNING:root:No shard json files found in task_output_dir: '/b/s/w/ir/tmp/rt/0uN6HAy'
 Found ['/b/s/w/ir/tmp/rt/0uN6HAy/summary.json']
 [ RUN ] TimerSequenceTest.OneShotTimerUsedOnPoolSequence
 +------------------------------------------------------------------------+
 | End of shard 0 |
 | Pending: 1.4s Duration: 1387.1s Bot: vm874-m4 Exit: -1 TIMED_OUT |
 +------------------------------------------------------------------------+
 Total duration: 1387.1s
 Running ['/b/s/w/ir/cache/vpython/cbb391/bin/python', '/b/s/w/ir/kitchen-checkout/build/scripts/slave/recipe_modules/swarming/resources/noop_merge.py', '--summary-json', '/b/s/w/ir/tmp/rt/0uN6HAy/summary.json', '--task-output-dir', '/b/s/w/ir/tmp/rt/0uN6HAy', '-o', '/b/s/w/ir/tmp/t/tmpctSJ8P.json'] in None (env: None)
 Command ['/b/s/w/ir/cache/vpython/cbb391/bin/python', '/b/s/w/ir/kitchen-checkout/build/scripts/slave/recipe_modules/swarming/resources/noop_merge.py', '--summary-json', '/b/s/w/ir/tmp/rt/0uN6HAy/summary.json', '--task-output-dir', '/b/s/w/ir/tmp/rt/0uN6HAy', '-o', '/b/s/w/ir/tmp/t/tmpctSJ8P.json'] returned exit code 0
 step returned non-zero exit code: 255

There are not log lines for each of the 4 indicated tests from TimerSequenceTest and there's a clear time out message.
Components: Test
We suspect those are I/O timeouts, which means that no output was produced by the test for over 20 minutes. Is it possible that your change would cause these tests to hang or take a long time on ios?
Owner: gab@chromium.org
Status: Assigned (was: Untriaged)
Status: WontFix (was: Assigned)
CL is on hold and looks like flakes were its fault (still not sure how I was supposed to find the logs though...)

Sign in to add a comment