New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 665023 link

Starred by 2 users

Issue metadata

Status: Duplicate
Merged: issue 677843
Owner: ----
Closed: Feb 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Windows
Pri: 2
Type: Bug

Blocking:
issue 664480



Sign in to add a comment

Windows startup bisects not getting any results in chartjson

Project Member Reported by sullivan@chromium.org, Nov 14 2016

Issue description

This happens before and after the refactor. Splitting out from  bug 663911  which seems to have an unrelated issue which was resolved.

https://build.chromium.org/p/tryserver.chromium.perf/builders/winx64_zen_perf_bisect/builds/586
https://build.chromium.org/p/tryserver.chromium.perf/builders/win_perf_bisect/builds/7044

In both of these bisect, the test runs green all 5 runs with Captured Output that looks like this:
https://build.chromium.org/p/tryserver.chromium.perf/builders/win_perf_bisect/builds/7044/steps/Gathering%20reference%20values.Performance%20Test%201%20of%205/logs/Captured%20Output
C:\b\depot_tools\python276_bin\python.exe C:\b\rr\tmpjac2pr\rw\checkout\scripts\slave\runisolatedtest.py --test_name "" --builder_name win_perf_bisect --checkout_dir C:\b\c\b\win_perf_bisect C:\b\c\b\win_perf_bisect\src\tools\perf\run_benchmark -- C:\b\depot_tools\python276_bin\python.exe C:\b\c\b\win_perf_bisect\src\tools\perf\run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests startup.warm.blank_page --output-dir=C:\b\rr\tmpjac2pr\w\bisect_results\5e346441-ebb1-4b40-92b8-7c0bd6235088
...
[ RUN      ] blank_page.html
...
[       OK ] blank_page.html (10229 ms)
INFO:root:Successfully shut down browser cooperatively
[  PASSED  ] 1 test.


Then the chartjson it generates has no values:
https://build.chromium.org/p/tryserver.chromium.perf/builders/win_perf_bisect/builds/7044/steps/Gathering%20reference%20values.Reading%20chartjson%20results/logs/json.output
{
  "benchmark_description": "Measures warm startup time with a clean profile.", 
  "benchmark_metadata": {
    "description": "Measures warm startup time with a clean profile.", 
    "name": "startup.warm.blank_page", 
    "rerun_options": [], 
    "type": "telemetry_benchmark"
  }, 
  "benchmark_name": "startup.warm.blank_page", 
  "charts": {}, 
  "enabled": true, 
  "format_version": "0.1", 
  "next_version": "0.2", 
  "trace_rerun_options": []
}

There is no --story-filter passed in on the command line, so it's unlikely to be related to the work there.

The startup benchmark on Windows is unowned, so not sure what do do here. Nat, help?
 
Blocking: 664480
Components: Speed>Bisection
Mergedinto: 677843
Status: Duplicate (was: Untriaged)

Sign in to add a comment