New issue
Advanced search Search tips

Issue 767595 link

Starred by 1 user

Issue metadata

Status: Duplicate
Merged: issue 759777
Owner:
Closed: Sep 2017
EstimatedDays: ----
NextAction: ----
OS: Android
Pri: 1
Type: Bug



Sign in to add a comment

V8.runtimestats.browsing_mobile failing on cnn story on webview bots

Project Member Reported by rnep...@chromium.org, Sep 21 2017

Issue description

Chrome is crashing. Starts at:
https://build.chromium.org/p/chromium.perf/builders/Android%20Nexus5X%20WebView%20Perf/builds/265

Previous runs have different failures, so hard to know if a bisect will be useful or not.
 
Project Member

Comment 2 by 42576172...@developer.gserviceaccount.com, Sep 21 2017


=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: android_webview_arm64_aosp_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile
  Metric       : API:count_avg/browse_news/browse_news_cnn


To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_mobile

More information on addressing performance regressions:
  http://g.co/ChromePerformanceRegressions

Debug information about this bisect:
  https://chromeperf.appspot.com/buildbucket_job_status/8967809078960026352


For feedback, file a bug with component Speed>Bisection
Project Member

Comment 5 by 42576172...@developer.gserviceaccount.com, Sep 21 2017

Mergedinto: 764614
Status: Duplicate (was: Untriaged)

=== BISECT JOB RESULTS ===
Test failure found with culprit

Suspected Commit
  Author : nednguyen
  Commit : aca6ca9eacf53d6d12f599ba6b9011951fde2017
  Date   : Mon Sep 11 16:56:48 2017
  Subject: Use --ignore-certificate-errors for webview

Bisect Details
  Configuration: android_webview_arm64_aosp_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile
  Metric       : API:count_avg/browse_news/browse_news_cnn

Revision                                 Exit Code      N
chromium@500980                          0 +- N/A       2      good
chromium@501011                          0 +- N/A       2      good
chromium@501011,catapult@59c0f71abc      0 +- N/A       2      good
chromium@501011,catapult@0ed6f7d08a      0 +- N/A       2      good
chromium@501011,catapult@aca6ca9eac      1 +- N/A       2      bad       <--
chromium@501012                          1 +- N/A       2      bad
chromium@501013                          1 +- N/A       2      bad
chromium@501015                          1 +- N/A       2      bad
chromium@501019                          1 +- N/A       2      bad
chromium@501027                          1 +- N/A       2      bad
chromium@501042                          1 +- N/A       2      bad
chromium@501104                          1 +- N/A       2      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_mobile

More information on addressing performance regressions:
  http://g.co/ChromePerformanceRegressions

Debug information about this bisect:
  https://chromeperf.appspot.com/buildbucket_job_status/8967806824834349648


For feedback, file a bug with component Speed>Bisection
Owner: nedngu...@google.com
Status: Assigned (was: Duplicate)
Bisect duped a test failure into a regression bug. Unduping and assigning. Ned, can you take a look (see #5)
Owner: mythria@chromium.org
Without that fix, all the webview bot fails because webview doesn't support --ignore-certificate-errors-spki-list flag (see  issue 763880 )

Since this is only crashing on v8.runtimestats.browsing_mobile & not system health, I assign to mythria@ for triaging this
Thanks Ned. It fails with in the following check related to collecting runtimecasll stats. 

# Fatal error in ../../v8/src/counters.cc, line 491
Check failed: stats->current_timer_.Value() == timer.

I will disable cnn on runtimestats for now. We have another bug( crbug.com/759777 ) tracking the same issue, I will merge this into the other bug once the disabling cl has landed.
Project Member

Comment 9 by bugdroid1@chromium.org, Sep 22 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/1935e6f272f50e5d37a3758072610e57dd73dc28

commit 1935e6f272f50e5d37a3758072610e57dd73dc28
Author: Mythri Alle <mythria@chromium.org>
Date: Fri Sep 22 11:53:05 2017

tools/perf: Disable cnn story on V8 browsing benchmark.

Bug:  chromium:767595 , chromium:759777 
Change-Id: I743f0af0e3c9191b3bc76036c06361c56a864573
Reviewed-on: https://chromium-review.googlesource.com/678716
Reviewed-by: Ned Nguyen <nednguyen@google.com>
Reviewed-by: Juan Antonio Navarro Pérez <perezju@chromium.org>
Commit-Queue: Mythri Alle <mythria@chromium.org>
Cr-Commit-Position: refs/heads/master@{#503716}
[modify] https://crrev.com/1935e6f272f50e5d37a3758072610e57dd73dc28/tools/perf/page_sets/system_health/expectations.py

Project Member

Comment 10 by 42576172...@developer.gserviceaccount.com, Sep 22 2017


=== BISECT JOB RESULTS ===
Bisect was unable to run to completion

Error: INFRA_FAILURE

The bisect was able to narrow the range, you can try running with:
  good_revision: 8fd52f8a5a7c60e676bde5880c2c25bdc3d32c26
  bad_revision : 73de3d3435d5cf196671f26c112afb8c3bdd812e

If failures persist contact the team (see below) and report the error.


Bisect Details
  Configuration: android_webview_nexus6_aosp_perf_bisect
  Benchmark    : v8.runtimestats.browsing_mobile
  Metric       : API:count_avg/browse_news/browse_news_cnn

Revision             Exit Code      N
chromium@500980      0 +- N/A       2      good
chromium@501042      1 +- N/A       2      bad
chromium@501104      1 +- N/A       2      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_mobile

More information on addressing performance regressions:
  http://g.co/ChromePerformanceRegressions

Debug information about this bisect:
  https://chromeperf.appspot.com/buildbucket_job_status/8967806826070548800


For feedback, file a bug with component Speed>Bisection
Project Member

Comment 11 by bugdroid1@chromium.org, Sep 22 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/6b3e2cc08c2b7d64b1e4de949535b4e664372c68

commit 6b3e2cc08c2b7d64b1e4de949535b4e664372c68
Author: rnephew <rnephew@chromium.org>
Date: Fri Sep 22 20:52:10 2017

[Telemetry] Disable cnn browsing story in v8.runtimestats.browsing_mobile benchmark.

Page appears to be crashing.

TBR=nednguyen@google.com

Bug:  767595 
Change-Id: I16f030adf947f8c07555778836e08e603aa691ea
Reviewed-on: https://chromium-review.googlesource.com/677746
Commit-Queue: rnephew <rnephew@chromium.org>
Reviewed-by: rnephew <rnephew@chromium.org>
Cr-Commit-Position: refs/heads/master@{#503845}
[modify] https://crrev.com/6b3e2cc08c2b7d64b1e4de949535b4e664372c68/tools/perf/page_sets/system_health/expectations.py

Mergedinto: -764614 759777
Status: Duplicate (was: Assigned)

Sign in to add a comment