New issue
Advanced search Search tips

Issue 605485 link

Starred by 0 users

Issue metadata

Status: Archived
Owner:
Closed: Aug 2017
EstimatedDays: ----
NextAction: ----
OS: Mac
Pri: 2
Type: Bug-Regression



Sign in to add a comment

Fix and re-enable startup.large_profile.{cold, warm}.blank_page failure on chromium.perf on Mac 10.10

Project Member Reported by petrcermak@chromium.org, Apr 21 2016

Issue description

Revision range first seen: 388514:388527
Bot:
https://build.chromium.org/p/chromium.perf/builders/Mac%2010.10%20Perf%20(4)
Build:
https://build.chromium.org/p/chromium.perf/builders/Mac%2010.10%20Perf%20%284%29/builds/3968
Link to failing step log:
https://build.chromium.org/p/chromium.perf/builders/Mac%2010.10%20Perf%20%284%29/builds/3968/steps/startup.large_profile.cold.blank_page/logs/stdio

Error:

(INFO) 2016-04-20 12:50:11,589 desktop_browser_backend._SetupProfile:164  Using profile directory:'/tmp/tmptVTTQH'.
Traceback (most recent call last):
  File "/b/build/slave/Mac_10_10_Perf__4_/build/src/third_party/catapult/telemetry/telemetry/internal/story_runner.py", line 77, in _RunStoryAndProcessErrorIfNeeded
    state.WillRunStory(story)
  File "/b/build/slave/Mac_10_10_Perf__4_/build/src/tools/perf/page_sets/pregenerated_profile_shared_state.py", line 30, in WillRunStory
    super(PregeneratedProfileSharedState, self).WillRunStory(page)
  File "/b/build/slave/Mac_10_10_Perf__4_/build/src/third_party/catapult/telemetry/telemetry/page/shared_page_state.py", line 250, in WillRunStory
    self._StartBrowser(page)
  File "/b/build/slave/Mac_10_10_Perf__4_/build/src/third_party/catapult/telemetry/telemetry/page/shared_page_state.py", line 184, in _StartBrowser
    self._browser = self._possible_browser.Create(self._finder_options)
  File "/b/build/slave/Mac_10_10_Perf__4_/build/src/third_party/catapult/telemetry/telemetry/internal/backends/chrome/desktop_browser_finder.py", line 66, in Create
    self._flash_path, self._is_content_shell, self._browser_directory)
  File "/b/build/slave/Mac_10_10_Perf__4_/build/src/third_party/catapult/telemetry/telemetry/internal/backends/chrome/desktop_browser_backend.py", line 140, in __init__
    self._SetupProfile()
  File "/b/build/slave/Mac_10_10_Perf__4_/build/src/third_party/catapult/telemetry/telemetry/internal/backends/chrome/desktop_browser_backend.py", line 166, in _SetupProfile
    shutil.copytree(profile_dir, self._tmp_profile_dir)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 208, in copytree
    raise Error, errors
Error: [('/tmp/tmptVTTQH/App Shim Socket', '/tmp/tmpaqVkM3/App Shim Socket', "[Errno 102] Operation not supported on socket: '/tmp/tmptVTTQH/App Shim Socket'"), ('/tmp/tmptVTTQH/RunningChromeVersion', '/tmp/tmpaqVkM3/RunningChromeVersion', "[Errno 2] No such file or directory: '/tmp/tmptVTTQH/RunningChromeVersion'"), ('/tmp/tmptVTTQH/SingletonCookie', '/tmp/tmpaqVkM3/SingletonCookie', "[Errno 2] No such file or directory: '/tmp/tmptVTTQH/SingletonCookie'"), ('/tmp/tmptVTTQH/SingletonLock', '/tmp/tmpaqVkM3/SingletonLock', "[Errno 2] No such file or directory: '/tmp/tmptVTTQH/SingletonLock'"), ('/tmp/tmptVTTQH/SingletonSocket', '/tmp/tmpaqVkM3/SingletonSocket', "[Errno 102] Operation not supported on socket: '/tmp/tmptVTTQH/SingletonSocket'")]

If the test is disabled, please downgrade to Pri-2.

 
I accidentally tried to bisect startup.warm.blank_page, which of course failed. Here's hopefully a correct one: https://chromeperf.appspot.com/buildbucket_job_status/9014776278657333808
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Apr 21 2016


===== BISECT JOB RESULTS =====
Status: completed


===== TESTED REVISIONS =====
Revision                Exit Code   Std. Dev.   Num Values  Good?
chromium@388513         0           N/A         3           good
chromium@388527         0           N/A         3           bad

Bisect job ran on: mac_10_10_perf_bisect
Bug ID: 605485

Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests startup.warm.blank_page
Test Metric: first_main_frame_load_time/first_main_frame_load_time
Relative Change: 0.00%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_10_10_perf_bisect/builds/2087
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9014777190002011232


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=605485

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 4 by 42576172...@developer.gserviceaccount.com, Apr 21 2016


===== BISECT JOB RESULTS =====
Status: completed


===== TESTED REVISIONS =====
Revision                Exit Code   Std. Dev.   Num Values  Good?
chromium@388514         0           N/A         3           good
chromium@388527         0           N/A         3           bad

Bisect job ran on: mac_10_10_perf_bisect
Bug ID: 605485

Test Command: src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --also-run-disabled-tests startup.large_profile.cold.blank_page
Test Metric: first_main_frame_load_time/first_main_frame_load_time
Relative Change: 0.00%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/mac_10_10_perf_bisect/builds/2088
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9014776278657333808


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=605485

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Cc: erikc...@chromium.org
It seems a bot specific issue and not a CL related issue. There might be an issue with the profiles.

+erikchen
Project Member

Comment 6 by bugdroid1@chromium.org, Apr 22 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/4cb0d12a9ac64e9ad01c97c74272127e5dc48987

commit 4cb0d12a9ac64e9ad01c97c74272127e5dc48987
Author: fmeawad <fmeawad@chromium.org>
Date: Fri Apr 22 22:35:28 2016

[Perf Sheriffing] Disable startup.large_profile.{cold|warm}.blank_page on Mac 10.10

BUG= 605485 
CQ_EXTRA_TRYBOTS=tryserver.chromium.perf:mac_retina_perf_cq;tryserver.chromium.perf:linux_perf_cq

(Removed tryserver.chromium.perf:android_s5_perf_cq and tryserver.chromium.perf:winx64_10_perf_cq; from perf try bots)

Review URL: https://codereview.chromium.org/1914543003

Cr-Commit-Position: refs/heads/master@{#389275}

[modify] https://crrev.com/4cb0d12a9ac64e9ad01c97c74272127e5dc48987/tools/perf/benchmarks/startup.py

Cc: -erikc...@chromium.org petrcermak@chromium.org
Labels: -Pri-1 Pri-2
Owner: erikc...@chromium.org
Project Member

Comment 8 by bugdroid1@chromium.org, Apr 25 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/0735876b2703bd85e023d84193a69c0a64ae5c7d

commit 0735876b2703bd85e023d84193a69c0a64ae5c7d
Author: fmeawad <fmeawad@chromium.org>
Date: Mon Apr 25 18:48:52 2016

[PerfBotSherrif] Rename OS name for disabled startup benchmark

I got the OS name wrong the first time in http://codereview.chromium.org/1914543003

BUG= 605485 

TBR=nednguyen@google.com,aiolos@chromium.org

Disabling the extra trybots:
tryserver.chromium.perf:android_s5_perf_cq;tryserver.chromium.perf:winx64_10_perf_cq;tryserver.chromium.perf:mac_retina_perf_cq;tryserver.chromium.perf:linux_perf_cq

Review URL: https://codereview.chromium.org/1913903002

Cr-Commit-Position: refs/heads/master@{#389526}

[modify] https://crrev.com/0735876b2703bd85e023d84193a69c0a64ae5c7d/tools/perf/benchmarks/startup.py

Status: Available (was: Untriaged)
Summary: Fix and re-enable startup.large_profile.{cold, warm}.blank_page failure on chromium.perf on Mac 10.10 (was: startup.large_profile.{cold, warm}.blank_page failure on chromium.perf at )
Project Member

Comment 10 by bugdroid1@chromium.org, Apr 25 2016

Labels: merge-merged-2716
The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/0735876b2703bd85e023d84193a69c0a64ae5c7d

commit 0735876b2703bd85e023d84193a69c0a64ae5c7d
Author: fmeawad <fmeawad@chromium.org>
Date: Mon Apr 25 18:48:52 2016

[PerfBotSherrif] Rename OS name for disabled startup benchmark

I got the OS name wrong the first time in http://codereview.chromium.org/1914543003

BUG= 605485 

TBR=nednguyen@google.com,aiolos@chromium.org

Disabling the extra trybots:
tryserver.chromium.perf:android_s5_perf_cq;tryserver.chromium.perf:winx64_10_perf_cq;tryserver.chromium.perf:mac_retina_perf_cq;tryserver.chromium.perf:linux_perf_cq

Review URL: https://codereview.chromium.org/1913903002

Cr-Commit-Position: refs/heads/master@{#389526}

[modify] https://crrev.com/0735876b2703bd85e023d84193a69c0a64ae5c7d/tools/perf/benchmarks/startup.py

Bot health sheriff ping
Labels: Performance-Sheriff-BotHealth
Status: Assigned (was: Available)
Cc: -petrcermak@chromium.org
Cc: -petrcermak@chromium.org
Labels: -Performance-BotHealth
Status: Archived (was: Assigned)

Sign in to add a comment