New issue
Advanced search Search tips

Issue 782007 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner: ----
Closed: Nov 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

9.9% regression in idle-power-avg - media.desktop at 477876:483092

Project Member Reported by chcunningham@chromium.org, Nov 6 2017

Issue description

See the link to graphs below.
 
All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=782007

(For debugging:) Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?sid=5a833b16ec4a7d3f5e2ecc23a931eda5089a20e803f3a51b6d990cd621605f65


Bot(s) for this bug's original alert(s):

chromium-rel-mac-retina

=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: mac_retina_perf_bisect
  Benchmark    : media.desktop
  Metric       : idle:power_avg/video.html?src_crowd.ogg_type_audio


To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.crowd.ogg.type.audio media.desktop

More information on addressing performance regressions:
  http://g.co/ChromePerformanceRegressions

Debug information about this bisect:
  https://chromeperf.appspot.com/buildbucket_job_status/8963632674910525312


For feedback, file a bug with component Speed>Bisection

=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: mac_retina_perf_bisect
  Benchmark    : media.desktop
  Metric       : idle:power_avg/video.html?src_crowd.ogg_type_audio


To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.crowd.ogg.type.audio media.desktop

More information on addressing performance regressions:
  http://g.co/ChromePerformanceRegressions

Debug information about this bisect:
  https://chromeperf.appspot.com/buildbucket_job_status/8963628994221182208


For feedback, file a bug with component Speed>Bisection
Cc: crouleau@chromium.org
Components: Speed>Bisection
Bisect broken. No build bot link in the latest, but the earlier attempt is failing an assertion.

Traceback (most recent call last):
  File "/b/rr/tmphk05ZW/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/run.py", line 328, in _new_run
    recipe_result = recipe_script.run(api, properties)
  File "/b/rr/tmphk05ZW/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/loader.py", line 98, in run
    self.run_steps, properties, self.PROPERTIES, api=api)
  File "/b/rr/tmphk05ZW/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/loader.py", line 627, in invoke_with_properties
    **additional_args)
  File "/b/rr/tmphk05ZW/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/loader.py", line 588, in _invoke_with_properties
    return callable_obj(*props, **additional_args)
  File "/b/rr/tmphk05ZW/rw/checkout/scripts/slave/recipes/bisection/desktop_bisect.py", line 32, in RunSteps
    bot_config, disable_syntax_validation=True)
  File "/b/rr/tmphk05ZW/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/recipe_api.py", line 745, in _inner
    return func(*a, **kw)
  File "/b/rr/tmphk05ZW/rw/checkout/scripts/slave/recipe_modules/chromium_tests/api.py", line 242, in prepare_checkout
    bot_config.initialize_bot_db(self, bot_db, update_step)
  File "/b/rr/tmphk05ZW/rw/checkout/scripts/slave/recipe_modules/chromium_tests/bot_config_and_test_db.py", line 76, in initialize_bot_db
    chromium_tests_api.get_compile_targets_for_scripts()
  File "/b/rr/tmphk05ZW/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/recipe_api.py", line 745, in _inner
    return func(*a, **kw)
  File "/b/rr/tmphk05ZW/rw/checkout/scripts/slave/recipe_modules/chromium_tests/api.py", line 869, in get_compile_targets_for_scripts
    step_test_data=lambda: self.m.json.test_api.output({}))
  File "/b/rr/tmphk05ZW/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/recipe_api.py", line 745, in _inner
    return func(*a, **kw)
  File "/b/rr/tmphk05ZW/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_modules/python/api.py", line 61, in __call__
    return self.m.step(name, cmd + list(args or []), **kwargs)
  File "/b/rr/tmphk05ZW/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/recipe_api.py", line 788, in _inner
    return func(*a, **kw)
  File "/b/rr/tmphk05ZW/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_modules/step/api.py", line 191, in __call__
    for x in cmd)
AssertionError
I'm just realizing that this regression is the same for the ref graph. So from an alerts standpoint this is noise. But the assertion/bisect problem is still worth following up on.
Status: WontFix (was: Untriaged)
Probably bisect is just failing because we changed the benchmark name and it doesn't support that.

Sign in to add a comment