Project: chromium Issues People Development process History Sign in
New issue
Advanced search Search tips
Starred by 3 users
Status: Fixed
Owner:
Closed: Oct 2016
Components:
EstimatedDays: ----
NextAction: ----
OS: All
Pri: 3
Type: Bug

Blocking:
issue 637904



Sign in to add a comment
Typ failed to load system health smoke test on windows, leading to flaky failure
Project Member Reported by nedngu...@google.com, Sep 22 2016 Back to list
Log:
https://chromium-swarm.appspot.com/user/task/3167aba8439d5d10
https://chromium-swarm.appspot.com/user/task/31617c4a6c27ef10

Example:
[5/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:media:dailymotion failed unexpectedly 0.0000s:
  Failed to load benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:media:dailymotion
[5/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:news:reddit queued
[6/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:news:reddit failed unexpectedly 0.0000s:
  Failed to load benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:news:reddit
[6/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:social:tumblr queued
[7/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:social:tumblr failed unexpectedly 0.0000s:
  Failed to load benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:social:tumblr
[7/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.search:portal:google queued
[8/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.search:portal:google failed unexpectedly 0.0000s:
  Failed to load benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.search:portal:google
[8/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.browse:social:facebook queued
[9/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.browse:social:facebook failed unexpectedly 0.0000s:
  Failed to load benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.browse:social:facebook
[9/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:media:youtube queued
[10/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:media:youtube failed unexpectedly 0.0000s:
  Failed to load benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:media:youtube
[10/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:search:baidu queued
[11/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:search:baidu failed unexpectedly 0.0000s:
  Failed to load benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:search:baidu
[11/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:tools:drive queued
[12/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:tools:drive failed unexpectedly 0.0000s:
  Failed to load benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:tools:drive

This doesn't happen very often though (twice in 9/20 to 9/21, https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyMAsSBUZsYWtlIiV0ZWxlbWV0cnlfcGVyZl91bml0dGVzdHMgKHdpdGggcGF0Y2gpDA)

Dirk: can we improve typ logging to figure out why it failed to load test here?
 
Probably :).
Project Member Comment 2 by sheriffbot@chromium.org, Sep 23 2016
Labels: Hotlist-Google
Status: Started
Patch for better logging in typ: https://codereview.chromium.org/2363773008/
Labels: OS-All
Project Member Comment 5 by bugdroid1@chromium.org, Oct 12 2016
The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/3d00791f42d2c9ce38016d56bdbb405c765e656b

commit 3d00791f42d2c9ce38016d56bdbb405c765e656b
Author: dpranke <dpranke@chromium.org>
Date: Wed Oct 12 00:21:37 2016

Roll //third_party/typ to v0.9.8.

This rolls 79fe79db..3df460d1 and picks up:

 3df460d1  Bump version to 0.9.8.
 13268526  Add better logging when failing to load a test.
 5d0fe133  Clean up formatting, rework run wrapper script to not use globals.

TBR=nednguyen@google.com
BUG= 649217 

Review-Url: https://codereview.chromium.org/2417433002
Cr-Commit-Position: refs/heads/master@{#424613}

[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/README.chromium
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/pylintrc
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/run
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/setup.py
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/tools/cov.py
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/typ/fakes/test_result_server_fake.py
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/typ/json_results.py
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/typ/runner.py
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/typ/tests/main_test.py
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/typ/tests/runner_test.py
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/typ/version.py

Status: Fixed
Okay, the logging should be better. Please re-open if there's more you want to do here.
Sign in to add a comment