New issue
Advanced search Search tips

Issue 752313 link

Starred by 1 user

Issue metadata

Status: Assigned
Owner:
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: ----



Sign in to add a comment

v8.browsing_mobile flaky on chromium.perf/Android One Perf

Project Member Reported by martiniss@chromium.org, Aug 3 2017

Issue description

v8.browsing_mobile failing on chromium.perf/Android One Perf

Builders failed on: 
- Android One Perf: 
  https://build.chromium.org/p/chromium.perf/builders/Android%20One%20Perf


This benchmark seems to flake every once and a while. It seems to give black screens every few runs, on somewhat random tests. Here are some examples:

https://chromium-swarm.appspot.com/task?id=37c0b97f869fb610&refresh=10&show_raw=1 -- cnn gives https://console.developers.google.com/m/cloudstorage/b/chrome-telemetry-output/o/profiler-file-id_4-2017-08-03_12-35-3420157.png

https://chromium-swarm.appspot.com/task?id=37bd3d1aadc9a010&refresh=10&show_raw=1 -- two failures. One has a crash, one has a black screen.

https://chromium-swarm.appspot.com/task?id=37c0b97f869fb610&refresh=10&show_raw=1 -- cnn failure, black screen again.

Not sure what the cause of this is. Someone should look into this though. I'd rather not disable the test, or stories in it, since it seems flaky, but if it keeps failing we probably should. ulan@ can you look into this, if possible?
 

=== BISECT JOB RESULTS ===
NO Test failure found

Bisect Details
  Configuration: android_one_perf_bisect
  Benchmark    : system_health.memory_mobile
  Metric       : memory:chrome:renderer_processes:reported_by_chrome:v8:heap:effective_size_avg/browse_news/browse_news_washingtonpost

Revision             Exit Code      N
chromium@489862      0 +- N/A       20      good
chromium@490186      0 +- N/A       20      bad

Please refer to the following doc on diagnosing memory regressions:
  https://chromium.googlesource.com/chromium/src/+/master/docs/memory-infra/memory_benchmarks.md

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.washingtonpost system_health.memory_mobile

More information on addressing performance regressions:
  http://g.co/ChromePerformanceRegressions

Debug information about this bisect:
  https://chromeperf.appspot.com/buildbucket_job_status/8971732341652318560


For feedback, file a bug with component Speed>Bisection

Comment 3 by u...@chromium.org, Aug 9 2017

The logs says that tracing is failing on cnn. This story has high memory usage. I suspect that Android OOM killer might be killing the browser.

To confirm that I need the logcat output from the device, which I cannot find on the bot page.

martiniss@, nednguyen@, was logcat output logging removed from the bots? I remember that before I could inspect logcat.


Traceback (most recent call last):
  File "/b/swarming/w/ir/third_party/catapult/telemetry/telemetry/internal/story_runner.py", line 107, in _RunStoryAndProcessErrorIfNeeded
    test.Measure(state.platform, results)
  File "/b/swarming/w/ir/third_party/catapult/telemetry/telemetry/web_perf/timeline_based_measurement.py", line 285, in Measure
    trace_result = platform.tracing_controller.StopTracing()
  File "/b/swarming/w/ir/third_party/catapult/telemetry/telemetry/core/tracing_controller.py", line 47, in StopTracing
    return self._tracing_controller_backend.StopTracing()
  File "/b/swarming/w/ir/third_party/catapult/telemetry/telemetry/internal/platform/tracing_controller_backend.py", line 140, in StopTracing
    '\n'.join(raised_exception_messages))
TracingException: Exceptions raised when trying to stop tracing:
Traceback (most recent call last):
  File "/b/swarming/w/ir/third_party/catapult/telemetry/telemetry/internal/platform/tracing_controller_backend.py", line 128, in StopTracing
    agent.CollectAgentTraceData(builder)
  File "/b/swarming/w/ir/third_party/catapult/telemetry/telemetry/internal/platform/tracing_agent/chrome_tracing_agent.py", line 250, in CollectAgentTraceData
    '\n'.join(raised_exception_messages))
ChromeTracingStoppedError: Exceptions raised when trying to collect Chrome devtool tracing:
Error when collecting Chrome tracing on devtools at port localabstract:chrome_devtools_remote:
Traceback (most recent call last):

Comment 4 by u...@chromium.org, Aug 17 2017

The latest build shows a different failure:
https://luci-logdog.appspot.com/v/?s=chrome%2Fbb%2Fchromium.perf%2FAndroid_One_Perf%2F404%2F%2B%2Frecipes%2Fsteps%2Fv8.browsing_mobile_on_Android%2F0%2Fstdout

Exception: At most one instance of process org.chromium.chrome expected but found pids: defaultdict(<type 'list'>, {'org.chromium.chrome:sandboxed_process0': ['11866'], 'org.chromium.chrome': ['11834', '11929']})
Locals:
  pids : defaultdict(<type 'list'>, {'org.chromium.chrome:sandboxed_process0': ['11866'], 'org.chromium.chrome': ['11834', '11929']})


Comment 5 by zh...@chromium.org, Oct 16 2017

Still failing.
Components: Speed>Metrics>SystemHealthRegressions
Components: -Speed>Metrics>SystemHealthRegressions

Sign in to add a comment