New issue
Advanced search Search tips
Note: Color blocks (like █ or █) mean that a user may not be available. Tooltip shows the reason.

Issue 675535 link

Starred by 1 user
Status: WontFix
Owner: ----
Closed: Jul 2017
Cc:
kouhei@chromium.org
█ jasontiller@chromium.org
ksakamoto@chromium.org
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

16.2%-25.9% regression in loading.mobile at 438962:439069

Project Member Reported by jasontiller@chromium.org, Dec 19 2016 
See the link to graphs below.
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Dec 19 2016 


===== BISECT JOB RESULTS =====
Status: failed


=== Bisection aborted ===
The bisect was aborted because Bisect cannot identify a culprit: Bisect failed to reproduce the regression with enough confidence.
Please contact the the team (see below) if you believe this is in error.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N   Good?
chromium@438961  4214.96  969.874  21  good
chromium@439069  4238.86  1459.1   21  bad

Bisect job ran on: android_one_perf_bisect
Bug ID: 675535

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http...noticias.bol.uol.com.br.ultimas.noticias.brasil.2016.08.03.tufao.nida.nao.deixa.vitimas.mas.prejuizos.de.us.43.milhoes.htm loading.mobile
Test Metric: timeToFirstContentfulPaint_avg/Regular-3G/http___noticias.bol.uol.com.br_ultimas-noticias_brasil_2016_08_03_tufao-nida-nao-deixa-vitimas-mas-prejuizos-de-us-43-milhoes.htm
Relative Change: 0.57%

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_one_perf_bisect/builds/1885
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8992861582711185136


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5743432297873408

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 6 by 42576172...@developer.gserviceaccount.com, Dec 19 2016 


===== BISECT JOB RESULTS =====
Status: failed


=== Bisection aborted ===
The bisect was aborted because Bisect cannot identify a culprit: Bisect failed to reproduce the regression with enough confidence.
Please contact the the team (see below) if you believe this is in error.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N   Good?
chromium@438961  6366.82  318.998  21  good
chromium@439069  6368.76  332.572  21  bad

Bisect job ran on: android_one_perf_bisect
Bug ID: 675535

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=https...www.flipkart.com.big.wing.casuals.p.itmemeageyfn6m9z.lid.LSTSHOEMEAGURG2PHPW18FTBN.pid.SHOEMEAGURG2PHPW loading.mobile
Test Metric: timeToFirstContentfulPaint_avg/Regular-3G/https___www.flipkart.com_big-wing-casuals_p_itmemeageyfn6m9z?lid_LSTSHOEMEAGURG2PHPW18FTBN_pid_SHOEMEAGURG2PHPW
Relative Change: 0.03%

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_one_perf_bisect/builds/1888
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8992818353118195536


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5280815129296896

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 7 by 42576172...@developer.gserviceaccount.com, Dec 19 2016 


===== BISECT JOB RESULTS =====
Status: failed


=== Bisection aborted ===
The bisect was aborted because Bisect cannot identify a culprit: Bisect failed to reproduce the regression with enough confidence.
Please contact the the team (see below) if you believe this is in error.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N   Good?
chromium@438961  7409.89  345.681  21  good
chromium@439069  7403.34  304.933  21  bad

Bisect job ran on: android_one_perf_bisect
Bug ID: 675535

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http...noticias.bol.uol.com.br.ultimas.noticias.brasil.2016.08.03.tufao.nida.nao.deixa.vitimas.mas.prejuizos.de.us.43.milhoes.htm loading.mobile
Test Metric: timeToFirstMeaningfulPaint_avg/Regular-3G/http___noticias.bol.uol.com.br_ultimas-noticias_brasil_2016_08_03_tufao-nida-nao-deixa-vitimas-mas-prejuizos-de-us-43-milhoes.htm
Relative Change: 0.09%

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_one_perf_bisect/builds/1889
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8992818344013459616


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5846301260906496

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 9 by 42576172...@developer.gserviceaccount.com, Dec 20 2016 


===== BISECT JOB RESULTS =====
Status: failed


=== Bisection aborted ===
The bisect was aborted because Bisect cannot identify a culprit: Bisect failed to reproduce the regression with enough confidence.
Please contact the the team (see below) if you believe this is in error.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N   Good?
chromium@438961  12194.6  308.134  21  good
chromium@439069  12182.6  267.06   21  bad

Bisect job ran on: android_one_perf_bisect
Bug ID: 675535

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http...www.amazon.com.gp.aw.s.ref.is.s.189.8585431.1246432.k.shoes loading.mobile
Test Metric: timeToFirstContentfulPaint_avg/Regular-3G/http___www.amazon.com_gp_aw_s_ref_is_s_189-8585431-1246432?k_shoes
Relative Change: 0.10%

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_one_perf_bisect/builds/1891
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8992798726872613856


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5888189942726656

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

Comment 11 by jasontiller@chromium.org, Dec 20 2016

Cc: ksakamoto@chromium.org kouhei@chromium.org
+benchmark owners as FYI.
Project Member

Comment 12 by 42576172...@developer.gserviceaccount.com, Dec 20 2016 


===== BISECT JOB RESULTS =====
Status: failed


=== Bisection aborted ===
The bisect was aborted because Bisect cannot identify a culprit: Bisect failed to reproduce the regression with enough confidence.
Please contact the the team (see below) if you believe this is in error.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N   Good?
chromium@438845  4199.94  1144.59  21  good
chromium@439069  4332.91  2931.77  21  bad

Bisect job ran on: android_one_perf_bisect
Bug ID: 675535

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http...noticias.bol.uol.com.br.ultimas.noticias.brasil.2016.08.03.tufao.nida.nao.deixa.vitimas.mas.prejuizos.de.us.43.milhoes.htm loading.mobile
Test Metric: timeToFirstMeaningfulPaint_avg/Regular-3G/http___noticias.bol.uol.com.br_ultimas-noticias_brasil_2016_08_03_tufao-nida-nao-deixa-vitimas-mas-prejuizos-de-us-43-milhoes.htm
Relative Change: 3.17%

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_one_perf_bisect/builds/1892
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8992728112916342192


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5820226514452480

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

Comment 15 by benhenry@chromium.org, Jul 27 2017

Status: WontFix (was: Untriaged)
This alert was found before M-60 branched. Closing as WontFix as this is believed to either be invalid or non-reproducible.
►

Sign in to add a comment