New issue
Advanced search Search tips

Issue 712211 link

Starred by 2 users

Issue metadata

Status: Archived
Owner:
Closed: Oct 4
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Mac
Pri: 1
Type: Bug-Regression



Sign in to add a comment

8.4%-234.7% regression in v8.runtimestats.browsing_desktop_classic at 463910:464184

Project Member Reported by hablich@chromium.org, Apr 17 2017

Issue description

See the link to graphs below.
 
All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=712211

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwsqAnwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_J_i2QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwtzYkQgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggvLy1gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggq7rpgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggs-Y5AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwoyc4QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggp_OqwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggv3k6wsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwsjW_wsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwpiFpAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_LmvywgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwr7LtwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggs2w6QsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwrjDqQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwq7xsAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwrz3pwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgguvVtgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwrjDqQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwvblnwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggtWb9gsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggs75lAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgws6PtwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggs_biwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggpXjrQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggpuEoAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwoLXswsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwszn-gsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwpDGrgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggr_2owgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggvuTwwoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwsDg0wsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggq71xwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggreaqQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggtmXqwkM


Bot(s) for this bug's original alert(s):

chromium-rel-mac-retina
chromium-rel-mac11-air
chromium-rel-mac11-pro
Labels: -Pri-2 ReleaseBlock-Beta Pri-1
Project Member

Comment 4 by 42576172...@developer.gserviceaccount.com, Apr 17 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : Optimize:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      725.22 +- 65.8552       5      good
chromium@464050      734.761 +- 67.1645      2      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8982048969782334624

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5860523549130752


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 6 by 42576172...@developer.gserviceaccount.com, Apr 17 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : Optimize:duration_avg/browse_news/browse_news_cnn

Revision             Result              N
chromium@463966      650.022 +- 0.0      1      good
chromium@464050      763.029 +- 0.0      1      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8982035368574620992

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5860523549130752


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 8 by 42576172...@developer.gserviceaccount.com, Apr 19 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : API:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      635.882 +- 6.86389      2      good
chromium@464050      692.777 +- 39.9864      3      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981929666797448800

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5860523549130752


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 15 by 42576172...@developer.gserviceaccount.com, Apr 19 2017


=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: mac_pro_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : Optimize:duration_avg/browse_news/browse_news_cnn


To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981881044473333680

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5258055601618944


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 17 by 42576172...@developer.gserviceaccount.com, Apr 19 2017


=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: mac_pro_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : Optimize:duration_avg/browse_news/browse_news_cnn


To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981876823927405504

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5258055601618944


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 18 by 42576172...@developer.gserviceaccount.com, Apr 19 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : IC:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      1219.24 +- 17.9655      5      good
chromium@464050      1220.83 +- 0.0          1      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981881029330215536

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5782721491632128


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 19 by 42576172...@developer.gserviceaccount.com, Apr 19 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : Parse:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      2140.42 +- 94.9694      2      good
chromium@464050      2241.55 +- 50.1627      3      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981881038508174208

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6061864099774464


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 22 by 42576172...@developer.gserviceaccount.com, Apr 19 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : Total:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      25662.7 +- 114.783      3      good
chromium@464050      25426.4 +- 499.297      3      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981881018445970000

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5343082465198080


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 23 by 42576172...@developer.gserviceaccount.com, Apr 19 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : V8 C++:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      5370.87 +- 203.548      6      good
chromium@464050      5320.63 +- 196.14       5      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981881026056664416

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5237660345434112


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 26 by 42576172...@developer.gserviceaccount.com, Apr 19 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : Optimize:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      750.805 +- 15.7474      3      good
chromium@464050      720.275 +- 11.0408      2      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981881022693389040

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5312377743998976


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 28 by 42576172...@developer.gserviceaccount.com, Apr 20 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : IC:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      1235.17 +- 0.0          1      good
chromium@464050      1203.74 +- 25.4676      6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981865434804410048

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5782721491632128


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 29 by 42576172...@developer.gserviceaccount.com, Apr 20 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : Parse:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      2138.74 +- 88.6702      4      good
chromium@464050      2209.71 +- 116.882      4      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981865430378301136

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6061864099774464


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 30 by 42576172...@developer.gserviceaccount.com, Apr 20 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : V8 C++:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      5322.39 +- 0.0          1      good
chromium@464050      5371.56 +- 152.103      4      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981850334847782336

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5237660345434112


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Cc: nedngu...@google.com sullivan@chromium.org simonhatch@chromium.org
Examples #30, #22, #6: As a human I would continue the bisect because either the absolute value or the variance is completely different. "NO Perf regression found" seems to be the wrong state.

At that point I am not sure how to proceed.

SpeedOps folks, any clue whats going on?
Project Member

Comment 32 by 42576172...@developer.gserviceaccount.com, Apr 20 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : Total:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      24477.4 +- 2934.98      5      good
chromium@464050      25537.8 +- 404.572      3      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981850332258435360

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5343082465198080


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 33 by 42576172...@developer.gserviceaccount.com, Apr 20 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : Optimize:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      736.02 +- 17.095        3      good
chromium@464050      733.458 +- 43.6321      6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981839012814467200

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5312377743998976


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Cc: dtu@chromium.org
Simon, Dave, agreed with #31, especially the numbers in bisect from #6 seem to me like there should have been a regression detected. Can you take a look?
I think what's happening here is the test is failing to run in the vast majority of cases, leaving only a few samples (ie. in #30, we only got 1 and 4 samples total). It's doing both the gathering revisions step, and maxing out the re-testing steps before giving up.

Log snippet:


INFO:root:*************** BROWSER STANDARD OUTPUT ***************
INFO:root:2017-04-17 16:11:56.773 Google Chrome[80985:282995] NSWindow warning: adding an unknown subview: <FullSizeContentView: 0x7fd908d22ca0>. Break on NSLog to debug.
2017-04-17 16:11:56.773 Google Chrome[80985:282995] Call stack:
(
    "+callStackSymbols disabled for performance reasons"
)
2017-04-17 16:11:57.017 Google Chrome[80985:282995] Errors logged by ksadmin: KSKeyedPersistentStore store directory does not exist. [com.google.UpdateEngine.CommonErrorDomain:501 - '/Library/Google/GoogleSoftwareUpdate/TicketStore' - 'KSKeyedPersistentStore.m:372']
KSPersistentTicketStore failed to load tickets. (productID: com.google.Chrome) [com.google.UpdateEngine.CoreErrorDomain:1051 - '/Library/Google/GoogleSoftwareUpdate/TicketStore/Keystone.ticketstore'] (KSKeyedPersistentStore store directory does not exist. - '/Library/Google/GoogleSoftwareUpdate/TicketStore' [com.google.UpdateEngine.CommonErrorDomain:501])
ksadmin cannot access the ticket store:<KSUpdateError:0x100713c20
	domain="com.google.UpdateEngine.CoreErrorDomain"
	code=1051
	userInfo={
		function = "-[KSProductKeyedStore(ProtectedMethods) errorForStoreError:productID:message:timeoutMessage:]";
		date = 2017-04-17 23:11:57 +0000;
		productids = {(
			"com.google.Chrome"
		)};
		filename = "KSProductKeyedStore.m";
		line = 91;
		NSFilePath = "/Library/Google/GoogleSoftwareUpdate/TicketStore/Keystone.ticketstore";
		NSUnderlyingError = <KSError:0x10070e000
			domain="com.google.UpdateEngine.CommonErrorDomain"
			code=501
			userInfo={
				date = 2017-04-17 23:11:57 +0000;
				line = 372;
				filename = "KSKeyedPersistentStore.m";
				function = "-[KSKeyedPersistentStore(PrivateMethods) validateStorePath]";
				NSFilePath = "/Library/Google/GoogleSoftwareUpdate/TicketStore";
				NSLocalizedDescription = "KSKeyedPersistentStore store directory does not exist.";
			}
		>;
		NSLocalizedDescription = "KSPersistentTicketStore failed to load tickets.";
	}
>
[80992:47891:0417/161200.746918:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: data source error"}
[80992:47891:0417/161200.746995:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: open context failed"}
[80992:775:0417/161200.747157:ERROR:render_media_log.cc(30)] MediaEvent: PIPELINE_ERROR pipeline: read error
[80992:47891:0417/161204.765146:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: data source error"}
[80992:47891:0417/161204.765203:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: open context failed"}
[80992:775:0417/161204.765371:ERROR:render_media_log.cc(30)] MediaEvent: PIPELINE_ERROR pipeline: read error
[80992:47891:0417/161205.952012:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: open context failed"}
[80992:775:0417/161205.952975:ERROR:render_media_log.cc(30)] MediaEvent: PIPELINE_ERROR demuxer: could not open
[80992:47891:0417/161206.869646:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: data source error"}
[80992:47891:0417/161206.869719:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: open context failed"}
[80992:775:0417/161206.880602:ERROR:render_media_log.cc(30)] MediaEvent: PIPELINE_ERROR pipeline: read error
[80992:47891:0417/161213.580598:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: data source error"}
[80992:47891:0417/161213.580650:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: open context failed"}
[80992:775:0417/161213.580872:ERROR:render_media_log.cc(30)] MediaEvent: PIPELINE_ERROR pipeline: read error
[80992:47891:0417/161213.608750:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: data source error"}
[80992:47891:0417/161213.608805:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: open context failed"}
[80992:775:0417/161213.608933:ERROR:render_media_log.cc(30)] MediaEvent: PIPELINE_ERROR pipeline: read error

INFO:root:*********** END OF BROWSER STANDARD OUTPUT ************
INFO:root:********************* BROWSER LOG *********************
INFO:root:No log file
INFO:root:***************** END OF BROWSER LOG ******************
Traceback (most recent call last):
  File "/b/c/b/mac_air_perf_bisect/src/third_party/catapult/telemetry/telemetry/internal/story_runner.py", line 89, in _RunStoryAndProcessErrorIfNeeded
    state.RunStory(results)
  File "/b/c/b/mac_air_perf_bisect/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 75, in traced_function
    return func(*args, **kwargs)
  File "/b/c/b/mac_air_perf_bisect/src/third_party/catapult/telemetry/telemetry/page/shared_page_state.py", line 299, in RunStory
    self._current_page.Run(self)
  File "/b/c/b/mac_air_perf_bisect/src/third_party/catapult/telemetry/telemetry/page/__init__.py", line 112, in Run
    self.RunPageInteractions(action_runner)
  File "/b/c/b/mac_air_perf_bisect/src/tools/perf/page_sets/system_health/system_health_story.py", line 121, in RunPageInteractions
    self._DidLoadDocument(action_runner)
  File "/b/c/b/mac_air_perf_bisect/src/tools/perf/page_sets/system_health/browsing_stories.py", line 82, in _DidLoadDocument
    self._ScrollMainPage(action_runner)
  File "/b/c/b/mac_air_perf_bisect/src/tools/perf/page_sets/system_health/browsing_stories.py", line 92, in _ScrollMainPage
    action_runner.tab.WaitForDocumentReadyStateToBeComplete()
  File "/b/c/b/mac_air_perf_bisect/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 75, in traced_function
    return func(*args, **kwargs)
  File "/b/c/b/mac_air_perf_bisect/src/third_party/catapult/telemetry/telemetry/internal/browser/web_contents.py", line 74, in WaitForDocumentReadyStateToBeComplete
    'document.readyState == "complete"', timeout=timeout)
  File "/b/c/b/mac_air_perf_bisect/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 75, in traced_function
    return func(*args, **kwargs)
  File "/b/c/b/mac_air_perf_bisect/src/third_party/catapult/telemetry/telemetry/internal/browser/web_contents.py", line 191, in WaitForJavaScriptCondition
    return self._inspector_backend.WaitForJavaScriptCondition(*args, **kwargs)
  File "/b/c/b/mac_air_perf_bisect/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 75, in traced_function
    return func(*args, **kwargs)
  File "/b/c/b/mac_air_perf_bisect/src/third_party/catapult/telemetry/telemetry/internal/backends/chrome_inspector/inspector_backend.py", line 294, in WaitForJavaScriptCondition
    e.message + '\n' + debug_message)
TimeoutException: Timed out while waiting 90s for IsJavaScriptExpressionTrue.
Console output:
(log) http://edition.i.cdn.cnn.com/.a/1.281.2/js/cnn-header-second.min.js:14: [AdFuel - WARNING]
(log) http://edition.i.cdn.cnn.com/.a/1.281.2/js/cnn-header-second.min.js:14: [AdFuel - WARNING]
(log) http://edition.i.cdn.cnn.com/.a/1.281.2/js/cnn-header-second.min.js:14: [AdFuel - WARNING]
(log) http://edition.i.cdn.cnn.com/.a/1.281.2/js/cnn-header-second.min.js:14: [AdFuel - WARNING]
(log) http://edition.i.cdn.cnn.com/.a/1.281.2/js/cnn-header-second.min.js:14: [AdFuel - WARNING]
(log) http://edition.i.cdn.cnn.com/.a/1.281.2/js/cnn-header-second.min.js:14: [AdFuel - WARNING]


INFO:root:Chrome version: 3070
[  FAILED  ] browse:news:cnn@{'case': 'browse', 'group': 'news'} (248346 ms)
WARNING:root:Failed to gracefully shutdown.
WARNING:root:Proceed to kill the browser.
INFO:py_utils.cloud_storage:Uploading /var/folders/9x/6c6sv3cj4j53wzpzthbp4ksm0000gm/T/tmp9a3g3k.png to gs://chrome-telemetry-output/profiler-file-id_0-2017-04-17_16-16-1169140.png
View generated profiler files online at https://console.developers.google.com/m/cloudstorage/b/chrome-telemetry-output/o/profiler-file-id_0-2017-04-17_16-16-1169140.png for page browse:news:cnn
[  PASSED  ] 0 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ]  browse:news:cnn@{'case': 'browse', 'group': 'news'}

1 FAILED TEST
Project Member

Comment 37 by 42576172...@developer.gserviceaccount.com, Apr 20 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : API:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      663.321 +- 40.5775      4      good
chromium@464050      671.88 +- 6.68782       2      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981785656026225040

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5258055601618944


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 41 by 42576172...@developer.gserviceaccount.com, Apr 21 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : API:duration_avg/browse_news/browse_news_cnn

Revision             Result                    N
chromium@463966      674.954 +- 54.8038        5      good
chromium@464050      720.318 +- 0.0120208      2      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981735892173631296

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5782721491632128


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 43 by 42576172...@developer.gserviceaccount.com, Apr 21 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : API:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      675.996 +- 0.0          1      good
chromium@464050      683.579 +- 47.2307      7      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981731983941405056

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6061864099774464


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 45 by 42576172...@developer.gserviceaccount.com, Apr 21 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : API:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      679.038 +- 2.69337      2      good
chromium@464050      692.992 +- 38.2048      3      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981724380020987504

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5237660345434112


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 46 by 42576172...@developer.gserviceaccount.com, Apr 21 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : API:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      663.621 +- 41.259       3      good
chromium@464050      698.392 +- 27.5955      2      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981720543347457088

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5343082465198080


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 47 by sheriffbot@chromium.org, Apr 21 2017

This issue is marked as a release blocker with no OS labels associated. Please add an appropriate OS label.

All release blocking issues should have OS labels associated to it, so that the issue can tracked and promptly verified, once it gets fixed.

Thanks for your time! To disable nags, add the Disable-Nags label.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Project Member

Comment 48 by 42576172...@developer.gserviceaccount.com, Apr 21 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : API:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      670.476 +- 8.12254      2      good
chromium@464050      673.686 +- 0.0          1      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981708963812207840

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5312377743998976


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 49 by sheriffbot@chromium.org, Apr 24 2017

This issue is marked as a release blocker with no OS labels associated. Please add an appropriate OS label.

All release blocking issues should have OS labels associated to it, so that the issue can tracked and promptly verified, once it gets fixed.

Thanks for your time! To disable nags, add the Disable-Nags label.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Labels: OS-Mac
Owner: simonhatch@chromium.org
Status: Assigned (was: Untriaged)
I am not sure what to make out of this alert. Simon, is this for real or the bots running wild?
Original alert seems legit, although there's no reference to compare against. No device change from what I can see, same builder before/after regression. Bisect is having trouble running and getting enough samples though, as mentioned in #c35 the bisect bot runs are failing in the vast majority of cases.

Tried widening the range + no story filter which will take a while to run.
This could be another case of  issue 714497 
re: #c53

Maybe, although these are mac desktop. Is there a way to see temperature on those?
No we don't have temperature reading on Mac.
Project Member

Comment 57 by 42576172...@developer.gserviceaccount.com, Apr 26 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : IC:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      1210.5 +- 14.7941       2      good
chromium@464050      1213.55 +- 16.7419      6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981281851934461776

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5860523549130752


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 58 by 42576172...@developer.gserviceaccount.com, Apr 26 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_retina_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : Compile:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463259      1936.23 +- 59.0279      2      good
chromium@464184      1970.66 +- 53.6546      2      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981329584607341824

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6453324766773248


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 60 by 42576172...@developer.gserviceaccount.com, Apr 27 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_retina_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : Compile:duration_avg/browse_news/browse_news_cnn

Revision             Result                 N
chromium@463259      1933.73 +- 0.0         1      good
chromium@464184      1965.38 +- 78.209      5      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981261188735174416

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6453324766773248


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 62 by 42576172...@developer.gserviceaccount.com, Apr 27 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : IC:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      1213.05 +- 17.7645      4      good
chromium@464050      1203.94 +- 17.3064      2      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981134220385648592

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5258055601618944


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 64 by 42576172...@developer.gserviceaccount.com, Apr 28 2017


=== BISECT JOB RESULTS ===
NO Perf regression found, tests failed to produce values

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : API:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      672.798 +- 11.9993      4      good

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981103841193154944

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6453324766773248


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 66 by 42576172...@developer.gserviceaccount.com, Apr 28 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : IC:duration_avg/browse_news/browse_news_cnn

Revision             Result                    N
chromium@463966      674.954 +- 54.8038        5      good
chromium@464050      720.318 +- 0.0120208      2      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981086595233462096

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5782721491632128


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 68 by 42576172...@developer.gserviceaccount.com, Apr 28 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : IC:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      675.996 +- 0.0          1      good
chromium@464050      683.579 +- 47.2307      7      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981078229738257824

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6061864099774464


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 71 by 42576172...@developer.gserviceaccount.com, Apr 28 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : IC:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      679.038 +- 2.69337      2      good
chromium@464050      692.992 +- 38.2048      3      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981065470236367264

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5237660345434112


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 72 by 42576172...@developer.gserviceaccount.com, Apr 28 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : IC:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      663.621 +- 41.259       3      good
chromium@464050      698.392 +- 27.5955      2      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981065265006161392

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5343082465198080


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 74 by 42576172...@developer.gserviceaccount.com, Apr 28 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_air_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : IC:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463966      670.476 +- 8.12254      2      good
chromium@464050      673.686 +- 0.0          1      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981052301171832928

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5312377743998976


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Comment 75 by ajha@chromium.org, May 8 2017

Friendly ping to get an update on this issue marked as Beta blocker for M-60.

Comment 76 by ajha@chromium.org, May 23 2017

Just to update, M-60 will be branched in 2 days time(05/25) and since this is marked as Beta blocker, would be good to have this resolved before branch point.

Thank you!

Comment 77 by ajha@chromium.org, May 29 2017

Cc: bmeu...@chromium.org
Cc'ing this week V8 Performance Sheriff for help in further action and as this is marked as Beta blocker for M-60. M-60 will probably be promoted to Beta in first week of June. 
We are close to promoting M60 to Beta, please have the latest update on this issue.
Labels: -ReleaseBlock-Beta ReleaseBlock-Stable
There is active investigation for this issue since the past 1 month, moving 
as RBS.
So I'm not clear why this isn't reproducing, but the original regression actually went away a few days after filing this, from the graph link in the original post. Is this still a blocker?

=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_pro_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : Compile:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463506      1865.37 +- 214.319      21      good
chromium@464066      1877.83 +- 260.794      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8977343525503240288

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5320125470736384


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_pro_perf_bisect
  Benchmark    : v8.runtimestats.browsing_desktop_classic
  Metric       : Compile:duration_avg/browse_news/browse_news_cnn

Revision             Result                  N
chromium@463506      1900.62 +- 181.567      21      good
chromium@464066      1873.34 +- 293.879      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests v8.runtimestats.browsing_desktop_classic

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8977279909478202736

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5320125470736384


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
simonhatch@ - Could you please provide any update on the issue.

Thanks...!!
Labels: -ReleaseBlock-Stable
From me in #c81

"So I'm not clear why this isn't reproducing, but the original regression actually went away a few days after filing this, from the graph link in the original post. Is this still a blocker?"

Doesn't seem like this is a blocker, so removing the label.
Status: Archived (was: Assigned)

Sign in to add a comment