New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 693131 link

Starred by 2 users

Issue metadata

Status: Duplicate
Merged: issue 709374
Owner:
Closed: Jun 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: iOS
Pri: 1
Type: Bug



Sign in to add a comment

"gfx_unittests" is flaky

Project Member Reported by chromium...@appspot.gserviceaccount.com, Feb 16 2017

Issue description

"gfx_unittests" is flaky.

This issue was created automatically by the chromium-try-flakes app. Please find the right owner to fix the respective test/step and assign this issue to them. If the step/test is infrastructure-related, please add Infra-Troopers label and change issue status to Untriaged. When done, please remove the issue from Sheriff Bug Queue by removing the Sheriff-Chromium label.

We have detected 3 recent flakes. List of all flakes can be found at https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyGAsSBUZsYWtlIg1nZnhfdW5pdHRlc3RzDA.



This flaky test/step was previously tracked in  issue 637398 .
 
Components: Infra
Labels: -Sheriff-Chromium Infra-Troopers
This looks like an infra failure to me

stdio snippet:

@@@STEP_LINK@shard #0 timed out, took too much time to complete@https://chromium-swarm.appspot.com/user/task/345c662e199b2410@@@
@@@STEP_FAILURE@@@
@@@STEP_CLOSED@@@
@@@SEED_STEP@Uncaught Exception@@@
@@@STEP_CURSOR@Uncaught Exception@@@
@@@STEP_STARTED@@@
@@@STEP_LOG_LINE@exception@Traceback (most recent call last):@@@
@@@STEP_LINK@logdog-->exception@https://luci-logdog.appspot.com/v/?s=chromium%2Fbb%2Ftryserver.chromium.mac%2Fios-simulator%2F155937%2F%2B%2Frecipes%2Fsteps%2FUncaught_Exception%2F0%2Flogs%2Fexception%2F0@@@
@@@STEP_LOG_LINE@exception@  File "/b/build/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/run.py", line 502, in _old_run@@@
@@@STEP_LOG_LINE@exception@    recipe_result = recipe_script.run(api, properties)@@@
@@@STEP_LOG_LINE@exception@  File "/b/build/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/loader.py", line 82, in run@@@
@@@STEP_LOG_LINE@exception@    self.run_steps, properties, self.PROPERTIES, api=api)@@@
@@@STEP_LOG_LINE@exception@  File "/b/build/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/loader.py", line 550, in invoke_with_properties@@@
@@@STEP_LOG_LINE@exception@    **additional_args)@@@
@@@STEP_LOG_LINE@exception@  File "/b/build/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/loader.py", line 511, in _invoke_with_properties@@@
@@@STEP_LOG_LINE@exception@    return callable_obj(*props, **additional_args)@@@
@@@STEP_LOG_LINE@exception@  File "/b/build/scripts/slave/recipes/ios/try.py", line 30, in RunSteps@@@
@@@STEP_LOG_LINE@exception@    api.ios.test_swarming()@@@
@@@STEP_LOG_LINE@exception@  File "/b/build/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/recipe_api.py", line 578, in _inner@@@
@@@STEP_LOG_LINE@exception@    return func(*a, **kw)@@@
@@@STEP_LOG_LINE@exception@  File "/b/build/scripts/slave/recipe_modules/ios/api.py", line 705, in test_swarming@@@
@@@STEP_LOG_LINE@exception@    if swarming_summary.get('isolated_out', {}).get('view_url'):@@@
@@@STEP_LOG_LINE@exception@AttributeError: 'NoneType' object has no attribute 'get'@@@
@@@STEP_LOG_END@exception@@@
@@@STEP_CLOSED@@@
@@@SEED_STEP@Failure reason@@@
@@@STEP_CURSOR@Failure reason@@@
@@@STEP_STARTED@@@
@@@STEP_LOG_LINE@reason@Uncaught Exception: AttributeError("'NoneType' object has no attribute 'get'",)@@@
@@@STEP_LINK@logdog-->reason@https://luci-logdog.appspot.com/v/?s=chromium%2Fbb%2Ftryserver.chromium.mac%2Fios-simulator%2F155937%2F%2B%2Frecipes%2Fsteps%2FFailure_reason%2F0%2Flogs%2Freason%2F0@@@
@@@STEP_LOG_END@reason@@@
@@@STEP_CLOSED@@@
...
[E2017-02-15T13:21:48.404463-08:00 2385 0 subcommand_run.go:333] Command completed with non-zero return code. {"returnCode":255}
[I2017-02-15T13:21:48.562334-08:00 2385 0 main.go:349] Terminating.                                {"returnCode":255}
Traceback (most recent call last):
  File "../../../scripts/slave/annotated_run.py", line 365, in <module>
    sys.exit(shell_main(sys.argv))
  File "../../../scripts/slave/annotated_run.py", line 360, in shell_main
    return main(argv[1:])
  File "../../../scripts/slave/annotated_run.py", line 351, in main
    return _exec_recipe(rt, opts, stream, basedir, tdir, properties)
  File "../../../scripts/slave/annotated_run.py", line 297, in _exec_recipe
    with open(recipe_result_path, 'r') as f:
IOError: [Errno 2] No such file or directory: '/b/build/slave/ios-simulator/.recipe_runtime/tmp5tByGh/recipe_result.json'
Cc: smut@chromium.org
Components: -Infra Infra>Client>iOS
Labels: OS-iOS
Looks like a bug in the ios recipe module?

Comment 3 by s...@google.com, Feb 17 2017

There are two problems:
1. gfx_unittests is actually timing out. That's not my error, something is wrong with iossim.
2. When there's a timeout we try to display the isolated_out view_url but it doesn't exist resulting in the exception in #1 ('NoneType' object has no attribute 'get').

I can fix #2.
Cc: rohitrao@chromium.org
Owner: smut@chromium.org
Status: Assigned (was: Untriaged)
Assigning to smut to fix #1
+rohitrao as owner of iossim
Project Member

Comment 5 by bugdroid1@chromium.org, Feb 21 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/294dee1c042da6e1dd7207dfb14f544efcb2f25a

commit 294dee1c042da6e1dd7207dfb14f544efcb2f25a
Author: smut <smut@google.com>
Date: Tue Feb 21 23:33:08 2017

Do not try to show view_url when isolated_out is None

BUG= 693131 

Change-Id: Ice571e8f899a94588addebd48b38f372fd568a34
Reviewed-on: https://chromium-review.googlesource.com/444176
Reviewed-by: Sergey Berezin <sergeyberezin@chromium.org>

[modify] https://crrev.com/294dee1c042da6e1dd7207dfb14f544efcb2f25a/scripts/slave/recipe_modules/ios/api.py

Comment 6 by s...@google.com, Feb 21 2017

Cc: -rohitrao@chromium.org
Owner: rohitrao@chromium.org
#1 is done.
Project Member

Comment 7 by chromium...@appspot.gserviceaccount.com, Feb 27 2017

Detected 3 new flakes for test/step "gfx_unittests". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyGAsSBUZsYWtlIg1nZnhfdW5pdHRlc3RzDA. This message was posted automatically by the chromium-try-flakes app.

Comment 8 by kbr@chromium.org, Mar 21 2017

Cc: kbr@chromium.org
More targets than just gfx_unittests are failing to launch under iossim, and therefore timing out. See multiple failures on:
https://build.chromium.org/p/tryserver.chromium.mac/builders/ios-simulator?numbuilds=200

Example targets failing: ios_chrome_unittests, sql_unittests, and url_unittests :
https://chromium-swarm.appspot.com/task?id=35070a37bf173410&refresh=10&show_raw=1
https://chromium-swarm.appspot.com/task?id=35070e211171f310&refresh=10&show_raw=1
https://chromium-swarm.appspot.com/task?id=3507038891035c10&refresh=10&show_raw=1

These are causing random failures on the CQ. Please investigate. Thanks.

Project Member

Comment 9 by chromium...@appspot.gserviceaccount.com, Apr 5 2017

Detected 3 new flakes for test/step "gfx_unittests". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyGAsSBUZsYWtlIg1nZnhfdW5pdHRlc3RzDA. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 10 by chromium...@appspot.gserviceaccount.com, May 26 2017

Detected 3 new flakes for test/step "gfx_unittests". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyGAsSBUZsYWtlIg1nZnhfdW5pdHRlc3RzDA. This message was posted automatically by the chromium-try-flakes app.

Comment 11 by kbr@chromium.org, May 31 2017

Cc: rohitrao@chromium.org
Labels: -Pri-1 Pri-2
Owner: shrike@chromium.org
Jayson: could you please find someone to investigate these random failures of iossim? They don't seem that frequent any more (downgrading from P1 to P2) but there is clearly a problem that could be considered infrastructure-level -- it's not a problem in the harnesses themselves.

Owner: pinkerton@chromium.org
Passing to pinkerton@ for ios-related issues.
Labels: -Pri-2 Pri-1
Owner: liaoyuke@chromium.org
Yuke was looking at this.  Bumping to P1.
Project Member

Comment 14 by chromium...@appspot.gserviceaccount.com, Jun 15 2017

Detected 3 new flakes for test/step "gfx_unittests". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyGAsSBUZsYWtlIg1nZnhfdW5pdHRlc3RzDA. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 15 by chromium...@appspot.gserviceaccount.com, Jun 23 2017

Detected 3 new flakes for test/step "gfx_unittests". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyGAsSBUZsYWtlIg1nZnhfdW5pdHRlc3RzDA. This message was posted automatically by the chromium-try-flakes app.
Mergedinto: 709374
Status: Duplicate (was: Assigned)

Sign in to add a comment