New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 646971 link

Starred by 1 user

Issue metadata

Status: Duplicate
Owner:
Closed: Sep 2016
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug-Regression



Sign in to add a comment

memory.long_running_idle_gmail_background_tbmv2 failure on all Android bots at 414705:414730

Project Member Reported by oysteine@chromium.org, Sep 14 2016

Issue description

Revision range first seen:
Link to failing step log:


If the test is disabled, please downgrade to Pri-2.

https://luci-logdog.appspot.com/v/?s=chromium%2Fbb%2Fchromium.perf%2FAndroid_Nexus7v2_Perf__2_%2F2714%2F%2B%2Frecipes%2Fsteps%2Fmemory.long_running_idle_gmail_background_tbmv2%2F0%2Fstdout


Traceback (most recent call last):
  File "/b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/internal/story_runner.py", line 86, in _RunStoryAndProcessErrorIfNeeded
    state.RunStory(results)
  File "/b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/page/shared_page_state.py", line 295, in RunStory
    self._current_page.Run(self)
  File "/b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/page/__init__.py", line 99, in Run
    self.RunPageInteractions(action_runner)
  File "/b/rr/tmpMnVnGc/w/src/tools/perf/page_sets/long_running_idle_google_cases.py", line 29, in RunPageInteractions
    action_runner.tab.browser.tabs.New()
  File "/b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/internal/browser/tab_list.py", line 9, in New
    return self._tab_list_backend.New(timeout)
  File "/b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/internal/backends/chrome/tab_list_backend.py", line 42, in New
    return self.GetBackendFromContextId(context_id)
  File "/b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/internal/backends/chrome_inspector/inspector_backend_list.py", line 71, in GetBackendFromContextId
    self._Update()
  File "/b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/internal/backends/chrome_inspector/inspector_backend_list.py", line 99, in _Update
    backends_map = self._devtools_client.GetUpdatedInspectableContexts()
  File "/b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/internal/backends/chrome_inspector/devtools_client_backend.py", line 298, in GetUpdatedInspectableContexts
    contexts = self._ListInspectableContexts()
  File "/b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/internal/backends/chrome_inspector/devtools_client_backend.py", line 223, in _ListInspectableContexts
    return self._devtools_http.RequestJson('')
  File "/b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/internal/backends/chrome_inspector/devtools_http.py", line 107, in RequestJson
    return json.loads(self.Request(path, timeout))
  File "/b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/internal/backends/chrome_inspector/devtools_http.py", line 88, in Request
    response = self._conn.getresponse()
  File "/usr/lib/python2.7/httplib.py", line 1051, in getresponse
    response.begin()
  File "/usr/lib/python2.7/httplib.py", line 415, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python2.7/httplib.py", line 379, in _read_status
    raise BadStatusLine(line)
DevToolsClientConnectionError: ''
(INFO) 2016-08-26 10:13:01,948 exception_formatter.PrintFormattedException:19  Try printing formatted exception: None None None
Exception raised when cleaning story run: 
Traceback (most recent call last):
  _RunStoryAndProcessErrorIfNeeded at /b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/internal/story_runner.py:108
    test.DidRunStory(state.platform)
  DidRunStory at /b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/web_perf/timeline_based_measurement.py:301
    platform.tracing_controller.StopTracing()
  StopTracing at /b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/core/tracing_controller.py:47
    return self._tracing_controller_backend.StopTracing()
  StopTracing at /b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/internal/platform/tracing_controller_backend.py:108
    self._IssueClockSyncMarker()
  _IssueClockSyncMarker at /b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/internal/platform/tracing_controller_backend.py:199
    self._RecordIssuerClockSyncMarker)
  RecordClockSyncMarker at /b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/internal/platform/tracing_agent/chrome_tracing_agent.py:185
    sync_id, record_controller_clock_sync_marker_callback)
  _RecordClockSyncMarkerAsyncEvent at /b/rr/tmpMnVnGc/w/src/third_party/catapult/telemetry/telemetry/internal/platform/tracing_agent/chrome_tracing_agent.py:168
    raise ChromeClockSyncError()
ChromeClockSyncError
Locals:
  has_clock_synced                             : False
  record_controller_clock_sync_marker_callback : <bound method TracingControllerBackend._RecordIssuerClockSyncMarker of <telemetry.internal.platform.tracing_controller_backend.TracingControllerBackend object at 0x7fbb4204e4d0>>
  sync_id                                      : '06ee283d-ecab-4622-925c-c6782e763ee9'
(INFO) 2016-08-26 10:13:01,949 cmd_helper._ValidateAndLogCommand:153  [host]> /b/rr/tmpMnVnGc/w/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 06d8a77c shell '( ps | grep -F org.chromium.chrome; echo "PIPESTATUS: ${PIPESTATUS[@]}" );echo %$?'
(INFO) 2016-08-26 10:13:02,066 cmd_helper._ValidateAndLogCommand:153  [host]> /b/rr/tmpMnVnGc/w/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 06d8a77c shell '( p=org.chromium.chrome;if [[ "$(ps)" = *$p* ]]; then am force-stop $p; fi );echo %$?'
(INFO) 2016-08-26 10:13:02,198 cmd_helper._ValidateAndLogCommand:153  [host]> /b/rr/tmpMnVnGc/w/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 06d8a77c forward --list
(INFO) 2016-08-26 10:13:02,263 cmd_helper._ValidateAndLogCommand:153  [host]> /b/rr/tmpMnVnGc/w/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 06d8a77c forward --remove tcp:46913
(INFO) 2016-08-26 10:13:02,333 forwarder._UnmapDevicePortLocked:233  Undo forwarding using command: [u'--adb=/b/rr/tmpMnVnGc/w/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb', '--serial-id=06d8a77c', '--unmap', '57197']
(INFO) 2016-08-26 10:13:02,333 cmd_helper._ValidateAndLogCommand:153  [host]> /b/rr/tmpMnVnGc/w/src/third_party/catapult/devil/bin/deps/linux2/x86_64/forwarder_host --adb=/b/rr/tmpMnVnGc/w/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb --serial-id=06d8a77c --unmap 57197
(INFO) 2016-08-26 10:13:02,385 forwarder._UnmapDevicePortLocked:233  Undo forwarding using command: [u'--adb=/b/rr/tmpMnVnGc/w/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb', '--serial-id=06d8a77c', '--unmap', '45385']
(INFO) 2016-08-26 10:13:02,385 cmd_helper._ValidateAndLogCommand:153  [host]> /b/rr/tmpMnVnGc/w/src/third_party/catapult/devil/bin/deps/linux2/x86_64/forwarder_host --adb=/b/rr/tmpMnVnGc/w/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb --serial-id=06d8a77c --unmap 45385
[  FAILED  ] https://mail.google.com/mail/ (51264 ms)
 
Cc: nednguyen@chromium.org
+nednguyen: Is this related to https://bugs.chromium.org/p/chromium/issues/detail?id=646925#c14 you think? It's been broken for longer, but it's also clocksync related from what I can tell by the above stack.
Owner: pfeldman@chromium.org
No, it's not. This is probably devtool bug that Pavel introduced recently
Project Member

Comment 6 by 42576172...@developer.gserviceaccount.com, Sep 17 2016

Mergedinto: 641390
Status: Duplicate (was: Untriaged)

===== BISECT JOB RESULTS =====
Status: completed


===== SUSPECTED CL(s) =====
Subject : DevTools: merge devtools target with devtools host, part 1
Author  : pfeldman
Commit description:
  
BUG= 627517 
TBR=

CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.linux:closure_compilation

Review-Url: https://codereview.chromium.org/2263843002
Cr-Commit-Position: refs/heads/master@{#414707}
Commit  : a9e7ddae8f1174e71c2e999eec4813ee24c1f41a
Date    : Fri Aug 26 14:37:20 2016


===== TESTED REVISIONS =====
Revision         Exit Code  Std Dev  N  Good?
chromium@414704  0          N/A      1  good
chromium@414706  0          N/A      1  good
chromium@414707  1          N/A      1  bad    <--
chromium@414710  1          N/A      1  bad
chromium@414717  1          N/A      1  bad
chromium@414730  1          N/A      1  bad

Bisect job ran on: android_nexus7_perf_bisect
Bug ID: 646971

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests memory.long_running_idle_gmail_background_tbmv2
Test Metric: memory:chrome:renderer_processes:reported_by_chrome:v8:heap:code_space:effective_size_min/memory:chrome:renderer_processes:reported_by_chrome:v8:heap:code_space:effective_size_min
Relative Change: Zero to non-zero
Score: 0.0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus7_perf_bisect/builds/3315
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9001326313772272432


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5834240745275392

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 7 by 42576172...@developer.gserviceaccount.com, Sep 17 2016


===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Exit Code  Std Dev  N   Good?
chromium@403687  0          N/A      20  good
chromium@410561  0          N/A      20  good
chromium@414495  0          N/A      20  good
chromium@414687  0          N/A      20  good
chromium@414702  0          N/A      20  good
chromium@414710  1          N/A      20  bad
chromium@414717  1          N/A      20  bad
chromium@414745  1          N/A      20  bad
chromium@414803  1          N/A      20  bad
chromium@414881  1          N/A      20  bad
chromium@415247  1          N/A      20  bad
chromium@415965  1          N/A      20  bad
chromium@417435  1          N/A      20  bad

Bisect job ran on: android_s5_perf_bisect
Bug ID: 646971

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests memory.long_running_idle_gmail_background_tbmv2
Test Metric: Idle-v8-gc-total_std/Idle-v8-gc-total_std
Relative Change: Zero to non-zero
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_s5_perf_bisect/builds/1004
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9001332593075864912


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5694485932015616

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Project Member

Comment 9 by 42576172...@developer.gserviceaccount.com, Apr 11 2017


=== BISECT JOB RESULTS ===
Test failure found but unable to narrow commit range

Build failures prevented the bisect from narrowing the range further.


Bisect Details
  Configuration: android_s5_perf_bisect
  Benchmark    : memory.long_running_idle_gmail_background_tbmv2
  Metric       : Idle-v8-gc-total_std/Idle-v8-gc-total_std

Suspected Commit Range
  1 commits in range
  https://chromium.googlesource.com/chromium/src/+log/2a83230d22978adfb14d897638ac37070e1f2d5b..5ea85f775041eb6ccb4813bdf91e1672f829c577


Revision             Exit Code      N
chromium@403687      0 +- N/A       20      good
chromium@410561      0 +- N/A       20      good
chromium@414495      0 +- N/A       20      good
chromium@414687      0 +- N/A       20      good
chromium@414702      0 +- N/A       20      good
chromium@414710      1 +- N/A       20      bad
chromium@414717      1 +- N/A       20      bad
chromium@414745      1 +- N/A       20      bad
chromium@414803      1 +- N/A       20      bad
chromium@414881      1 +- N/A       20      bad
chromium@415247      1 +- N/A       20      bad
chromium@415965      1 +- N/A       20      bad
chromium@417435      1 +- N/A       20      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests memory.long_running_idle_gmail_background_tbmv2

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8982611674059462752

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5694485932015616


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Sign in to add a comment