The test is timing out on debug build.

I suspect this is caused by slowness of debug Chrome. I am going to disable the test.


Traceback (most recent call last):
    File "/b/c/b/Android_Tests__dbg_/src/third_party/catapult/telemetry/telemetry/internal/story_runner.py", line 85, in _RunStoryAndProcessErrorIfNeeded
      state.RunStory(results)
    File "/b/c/b/Android_Tests__dbg_/src/third_party/catapult/telemetry/telemetry/page/shared_page_state.py", line 319, in RunStory
      self._current_page.Run(self)
    File "/b/c/b/Android_Tests__dbg_/src/third_party/catapult/telemetry/telemetry/page/__init__.py", line 99, in Run
      self.RunPageInteractions(action_runner)
    File "/b/c/b/Android_Tests__dbg_/src/tools/perf/page_sets/system_health/system_health_story.py", line 60, in RunPageInteractions
      self._DidLoadDocument(action_runner)
    File "/b/c/b/Android_Tests__dbg_/src/tools/perf/page_sets/system_health/browsing_stories.py", line 66, in _DidLoadDocument
      self._NavigateToItem(action_runner, i)
    File "/b/c/b/Android_Tests__dbg_/src/tools/perf/page_sets/system_health/browsing_stories.py", line 36, in _NavigateToItem
      self._ClickLink(action_runner, item_selector)
    File "/b/c/b/Android_Tests__dbg_/src/tools/perf/page_sets/system_health/browsing_stories.py", line 39, in _ClickLink
      action_runner.WaitForElement(element_function=element_function)
    File "/b/c/b/Android_Tests__dbg_/src/third_party/catapult/telemetry/telemetry/internal/actions/action_runner.py", line 206, in WaitForElement
      timeout_in_seconds=timeout_in_seconds))
    File "/b/c/b/Android_Tests__dbg_/src/third_party/catapult/telemetry/telemetry/internal/actions/action_runner.py", line 45, in _RunAction
      action.RunAction(self._tab)
    File "/b/c/b/Android_Tests__dbg_/src/third_party/catapult/telemetry/telemetry/internal/actions/wait.py", line 22, in RunAction
      wait=True, timeout_in_seconds=self.timeout_in_seconds)
    File "/b/c/b/Android_Tests__dbg_/src/third_party/catapult/telemetry/telemetry/internal/actions/page_action.py", line 113, in EvaluateCallbackWithElement
      tab.WaitForJavaScriptExpression(code, timeout_in_seconds)
    File "/b/c/b/Android_Tests__dbg_/src/third_party/catapult/telemetry/telemetry/internal/browser/web_contents.py", line 136, in WaitForJavaScriptExpression
      e.message + '\n' + debug_message)
  TimeoutException: Timed out while waiting 60s for IsJavaScriptExpressionTrue.
  Console output:
  (error) https://m.facebook.com/sem_campaigns/sem_pixel_test/?google_pixel_category=4&google_pixel_src=https%3A%2F%2Fgoogleads.g.doubleclick.net%2Fpagead%2Fviewthroughconversion%2F995153884%2F%3Fvalue%3D1.00%26currency_code%3DUSD%26label%3DszBrCMnWkWAQ3K_D2gM%26guid%3DON%26script%3D0:0: Refused to display 'https://m.facebook.com/sem_campaigns/sem_pixel_test/?google_pixel_category=4&google_pixel_src=https%3A%2F%2Fgoogleads.g.doubleclick.net%2Fpagead%2Fviewthroughconversion%2F995153884%2F%3Fvalue%3D1.00%26currency_code%3DUSD%26label%3DszBrCMnWkWAQ3K_D2gM%26guid%3DON%26script%3D0' in a frame because it set 'X-Frame-Options' to 'DENY'.
  
  
  [  FAILED  ] browse:social:facebook (154471 ms)
  [  PASSED  ] 0 tests.
  [  FAILED  ] 1 test, listed below:
  [  FAILED  ]  browse:social:facebook
  
  1 FAILED TEST

Hmm, looks like I cannot disable just browse:social:facebook story, I have to disable the whole v8.browsing_mobile benchmark.

Ned, I see that it is possible to disable individual stories in system health benchmark. What should I change to be able to do the same for v8.browsing?

benchmark_smoke_unittest.py only run the first page from the benchmark. You can disable the failing benchmark by putting it in the _BLACK_LIST.

Did you mean _DISABLE_TEST list? https://codereview.chromium.org/2150273002/

 Issue 628641  has been merged into this issue.

In  issue 628641  it's failing in release, so this is not due to slowness of Debug build.

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/defbb39e453be7d10061e094a718d85598291cda

commit defbb39e453be7d10061e094a718d85598291cda
Author: ulan <ulan@chromium.org>
Date: Fri Jul 15 15:18:37 2016

Disable smoke test for v8.browsing benchmark.

BUG= 628368 
CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.perf:android_s5_perf_cq;master.tryserver.chromium.perf:mac_retina_perf_cq

Review-Url: https://codereview.chromium.org/2150273002
Cr-Commit-Position: refs/heads/master@{#405758}

[modify] https://crrev.com/defbb39e453be7d10061e094a718d85598291cda/tools/perf/benchmarks/benchmark_smoke_unittest.py

Debug builders are no longer running benchmark smoke tests.