Project: chromium Issues People Development process History Sign in
New issue
Advanced search Search tips
Issue 649217 Typ failed to load system health smoke test on windows, leading to flaky failure
Starred by 3 users Project Member Reported by nedngu...@google.com, Sep 22 Back to list
Status: Fixed
Owner:
Closed: Oct 12
Components:
EstimatedDays: ----
NextAction: ----
OS: All
Pri: 3
Type: Bug

Blocking:
issue 637904



Sign in to add a comment
Log:
https://chromium-swarm.appspot.com/user/task/3167aba8439d5d10
https://chromium-swarm.appspot.com/user/task/31617c4a6c27ef10

Example:
[5/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:media:dailymotion failed unexpectedly 0.0000s:
  Failed to load benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:media:dailymotion
[5/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:news:reddit queued
[6/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:news:reddit failed unexpectedly 0.0000s:
  Failed to load benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:news:reddit
[6/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:social:tumblr queued
[7/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:social:tumblr failed unexpectedly 0.0000s:
  Failed to load benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.load:social:tumblr
[7/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.search:portal:google queued
[8/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.search:portal:google failed unexpectedly 0.0000s:
  Failed to load benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop.search:portal:google
[8/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.browse:social:facebook queued
[9/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.browse:social:facebook failed unexpectedly 0.0000s:
  Failed to load benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.browse:social:facebook
[9/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:media:youtube queued
[10/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:media:youtube failed unexpectedly 0.0000s:
  Failed to load benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:media:youtube
[10/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:search:baidu queued
[11/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:search:baidu failed unexpectedly 0.0000s:
  Failed to load benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:search:baidu
[11/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:tools:drive queued
[12/24] benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:tools:drive failed unexpectedly 0.0000s:
  Failed to load benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile.load:tools:drive

This doesn't happen very often though (twice in 9/20 to 9/21, https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyMAsSBUZsYWtlIiV0ZWxlbWV0cnlfcGVyZl91bml0dGVzdHMgKHdpdGggcGF0Y2gpDA)

Dirk: can we improve typ logging to figure out why it failed to load test here?
 
Probably :).
Project Member Comment 2 by sheriffbot@chromium.org, Sep 23
Labels: Hotlist-Google
Status: Started
Patch for better logging in typ: https://codereview.chromium.org/2363773008/
Labels: OS-All
Project Member Comment 5 by bugdroid1@chromium.org, Oct 12
The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/3d00791f42d2c9ce38016d56bdbb405c765e656b

commit 3d00791f42d2c9ce38016d56bdbb405c765e656b
Author: dpranke <dpranke@chromium.org>
Date: Wed Oct 12 00:21:37 2016

Roll //third_party/typ to v0.9.8.

This rolls 79fe79db..3df460d1 and picks up:

 3df460d1  Bump version to 0.9.8.
 13268526  Add better logging when failing to load a test.
 5d0fe133  Clean up formatting, rework run wrapper script to not use globals.

TBR=nednguyen@google.com
BUG= 649217 

Review-Url: https://codereview.chromium.org/2417433002
Cr-Commit-Position: refs/heads/master@{#424613}

[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/README.chromium
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/pylintrc
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/run
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/setup.py
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/tools/cov.py
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/typ/fakes/test_result_server_fake.py
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/typ/json_results.py
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/typ/runner.py
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/typ/tests/main_test.py
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/typ/tests/runner_test.py
[modify] https://crrev.com/3d00791f42d2c9ce38016d56bdbb405c765e656b/third_party/typ/typ/version.py

Status: Fixed
Okay, the logging should be better. Please re-open if there's more you want to do here.
Sign in to add a comment