Disabling instructions can be found here:
https://chromium.googlesource.com/chromium/src/+/master/docs/speed/bot_health_sheriffing/how_to_disable_a_story.md

Rerouting to Ned, as I no longer work on chromium.

Apologies, I had meant to send to Ned in the first place. Thanks for the instructions and for re-routing!

P1 as this failed a number of times today,.

https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Win10%20Tests%20x64%20%28dbg%29/1031
https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Win10%20Tests%20x64%20%28dbg%29/1032

This has been problematic for more than the last 200 builds.

Capturing debug output here:
Running ['C:\\b\\s\\w\\ir\\.swarming_module_cache\\vpython\\383165\\Scripts\\python.exe', '../../tools/perf/run_benchmark', u'dummy_benchmark.stable_benchmark_1', '--smoke-test-mode', '--browser=debug_x64', '--output-format=histograms', '--output-dir', 'c:\\b\\s\\w\\itki39mn\\tmp9ijfbftelemetry', '--output-format=json-test-results'] in None (env: {'TMP': 'C:\\Users\\CHROME~1\\AppData\\Local\\Temp', 'LC_NUMERIC': 'English_United States.UTF-8', 'COMPUTERNAME': 'WIN10-0AF2FD95-', 'USERDOMAIN': 'WIN10-0AF2FD95-', 'LC_CTYPE': 'English_United States.UTF-8', 'PSMODULEPATH': 'C:\\Program Files\\WindowsPowerShell\\Modules;C:\\Windows\\system32\\WindowsPowerShell\\v1.0\\Modules', 'COMMONPROGRAMFILES': 'C:\\Program Files\\Common Files', 'GTEST_TOTAL_SHARDS': '2', 'PROGRAMFILES': 'C:\\Program Files', 'PROCESSOR_REVISION': '4f00', 'PATH': 'C:\\b\\s\\w\\ir\\.swarming_module_cache\\vpython\\383165\\Scripts;C:\\b\\s\\w\\ir\\.swarming_module;C:\\b\\s\\w\\ir\\.swarming_module\\bin;C:\\b\\s\\cipd_cache\\bin;C:\\Windows\\system32;C:\\Windows;C:\\Windows\\System32\\Wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\;C:\\Program Files\\Puppet Labs\\Puppet\\bin;c:\\setup\\depot_tools;C:\\b\\s\\w\\ir\\.swarming_module_cache\\vpython\\383165\\lib\\site-packages\\pywin32_system32;C:\\b\\s\\w\\ir\\.swarming_module_cache\\vpython\\383165\\lib\\site-packages\\pywin32_system32', 'SYSTEMROOT': 'C:\\Windows', 'SWARMING_BOT_ID': 'win10-0af2fd95-us-west1-b-0hgq', 'PROGRAMFILES(X86)': 'C:\\Program Files (x86)', 'LANG': 'en_US.UTF-8', 'VIRTUAL_ENV': 'C:\\b\\s\\w\\ir\\.swarming_module_cache\\vpython\\383165', 'SWARMING_SERVER': 'https://chromium-swarm.appspot.com', 'TEMP': 'C:\\b\\s\\w\\itki39mn', 'LC_MONETARY': 'English_United States.UTF-8', 'CHROME_DEVEL_SANDBOX': '/opt/chromium/chrome_sandbox', 'COMMONPROGRAMFILES(X86)': 'C:\\Program Files (x86)\\Common Files', 'PUBLIC': 'C:\\Users\\Public', 'PROCESSOR_ARCHITECTURE': 'AMD64', 'SWARMING_HEADLESS': '1', 'ALLUSERSPROFILE': 'C:\\ProgramData', 'USERPROFILE': 'C:\\Users\\chrome-bot', 'LOCALAPPDATA': 'C:\\Users\\chrome-bot\\AppData\\Local', 'FPS_BROWSER_USER_PROFILE_STRING': 'Default', 'HOMEPATH': '\\Users\\chrome-bot', 'LUCI_CONTEXT': 'C:\\b\\s\\w\\itki39mn\\luci_ctx.csivjy.json', 'CIPD_CACHE_DIR': 'C:\\b\\s\\cipd_cache\\cache', 'PROGRAMW6432': 'C:\\Program Files', 'USERNAME': 'chrome-bot', 'LC_ALL': 'English_United States.UTF-8', 'LOGONSERVER': '\\\\WIN10-0AF2FD95-', 'PROMPT': '$P$G', 'COMSPEC': 'C:\\Windows\\system32\\cmd.exe', 'PROGRAMDATA': 'C:\\ProgramData', 'SWARMING_EXTERNAL_BOT_SETUP': '1', 'PYTHONNOUSERSITE': '1', 'ONEDRIVE': 'C:\\Users\\chrome-bot\\OneDrive', 'GTEST_SHARD_INDEX': '0', 'VPYTHON_VIRTUALENV_ROOT': 'C:\\b\\s\\w\\ir\\.swarming_module_cache\\vpython', 'FPS_BROWSER_APP_PROFILE_STRING': 'Internet Explorer', 'NO_GCE_CHECK': 'False', 'CHROME_HEADLESS': '1', 'PATHEXT': '.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC', 'SESSIONNAME': 'Console', 'SWARMING_TASK_ID': '3de2905444cd1b11', 'GIT_USER_AGENT': 'git/2.16.2.windows.1 win32 win10-0af2fd95-us-west1-b-0hgq.c.chromecompute.google.com.internal', 'HOMEDRIVE': 'C:', 'APPDATA': 'C:\\Users\\chrome-bot\\AppData\\Roaming', 'SYSTEMDRIVE': 'C:', 'USERDOMAIN_ROAMINGPROFILE': 'WIN10-0AF2FD95-', 'PROCESSOR_IDENTIFIER': 'Intel64 Family 6 Model 79 Stepping 0, GenuineIntel', 'NUMBER_OF_PROCESSORS': '8', 'PROCESSOR_LEVEL': '6', 'LC_TIME': 'English_United States.UTF-8', 'COMMONPROGRAMW6432': 'C:\\Program Files\\Common Files', 'OS': 'Windows_NT', 'LC_COLLATE': 'English_United States.UTF-8', 'WINDIR': 'C:\\Windows'})
WARNING:root:Failed to import devil.android.forwarder: No module named fcntl
(WARNING) 2018-06-04 00:44:42,642 desktop_browser_finder.FindAllAvailableBrowsers:278  Chrome build location for win_AMD64 not found. Browser will be run without Flash.
(WARNING) 2018-06-04 00:44:42,658 desktop_browser_finder.FindAllAvailableBrowsers:278  Chrome build location for win_AMD64 not found. Browser will be run without Flash.
(WARNING) 2018-06-04 00:44:42,674 desktop_browser_finder.FindAllAvailableBrowsers:278  Chrome build location for win_AMD64 not found. Browser will be run without Flash.
[ RUN      ] dummy_benchmark.stable_benchmark_1/dummy_page.html
(ERROR) 2018-06-04 00:46:45,549 story_runner.ProcessError:101  Handleable error
Traceback (most recent call last):
  File "C:\b\s\w\ir\third_party\catapult\telemetry\telemetry\internal\story_runner.py", line 119, in _RunStoryAndProcessErrorIfNeeded
    state.WillRunStory(story)
  File "C:\b\s\w\ir\third_party\catapult\common\py_trace_event\py_trace_event\trace_event_impl\decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "C:\b\s\w\ir\third_party\catapult\telemetry\telemetry\page\shared_page_state.py", line 240, in WillRunStory
    self.browser.tabs.New()
  File "C:\b\s\w\ir\third_party\catapult\telemetry\telemetry\internal\browser\tab_list.py", line 9, in New
    return self._tab_list_backend.New(timeout)
  File "C:\b\s\w\ir\third_party\catapult\telemetry\telemetry\internal\backends\chrome\tab_list_backend.py", line 43, in New
    return self.GetBackendFromContextId(context_id)
  File "C:\b\s\w\ir\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_backend_list.py", line 78, in GetBackendFromContextId
    raise e
TimeoutException: 
********************************************************************************
(C:\b\s\w\ir\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_backend.py:487 _ConvertExceptionFromInspectorWebsocket) The app is probably crashed:

Found Minidump: False
Stack Trace:
********************************************************************************
	No crash dump found.
********************************************************************************
Standard output:
********************************************************************************
********************************************************************************
System log:
(Not implemented)
********************************************************************************
(C:\b\s\w\ir\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_backend.py:492 _ConvertExceptionFromInspectorWebsocket) Original exception:
timed out
********************************************************************************
(C:\b\s\w\ir\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_backend.py:513 _AddDebuggingInformation) Received a socket error in the browser connection and the tab no longer exists. The tab probably crashed.
********************************************************************************
(C:\b\s\w\ir\third_party\catapult\telemetry\telemetry\internal\backends\chrome_inspector\inspector_backend.py:514 _AddDebuggingInformation) Debugger url: ws://127.0.0.1:59616/devtools/page/C5414D5B20A2DD8C30AB3A6454771BE2
********************************************************************************
(C:\b\s\w\ir\third_party\catapult\telemetry\telemetry\internal\backends\chrome\tab_list_backend.py:111 _HandleDevToolsConnectionError) The browser exists and can be reached. The devtools target probably crashed.
(WARNING) 2018-06-04 00:46:45,549 screenshot.TryCaptureScreenShot:45  Either tab has crashed or browser does not support taking tab screenshot. Skip taking screenshot on failure.
[  FAILED  ] dummy_benchmark.stable_benchmark_1/dummy_page.html (123168 ms)
[  PASSED  ] 0 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ]  dummy_benchmark.stable_benchmark_1/dummy_page.html

1 FAILED TEST


And disabling the test.

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/a309931ee129091ba240475a86029371f2502f75

commit a309931ee129091ba240475a86029371f2502f75
Author: Dominic Battre <battre@chromium.org>
Date: Mon Jun 04 15:12:29 2018

Disable dummy_benchmark.histogram_benchmark_1/dummy_page.html perf test

NOTRY=true
TBR=pmeenan@chromium.org, nednguyen@chromium.org
CC=​eakuefner@chromium.org, simonhatch@chromium.org

Bug: 848900
Change-Id: If9875b81659d3a44366518058f83d7e4be2bf1ae
Reviewed-on: https://chromium-review.googlesource.com/1085296
Commit-Queue: Dominic Battré <battre@chromium.org>
Reviewed-by: Dominic Battré <battre@chromium.org>
Cr-Commit-Position: refs/heads/master@{#564097}
[modify] https://crrev.com/a309931ee129091ba240475a86029371f2502f75/tools/perf/expectations.config

The test is disabled, reduce the priority

Looks like we are seeing the same issue with dummy_benchmark.stable_benchmark_1/dummy_page.html: 

https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Win10%20Tests%20x64%20%28dbg%29

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/e2cc8270b2e32f604380334cc4bc99364553f5cb

commit e2cc8270b2e32f604380334cc4bc99364553f5cb
Author: Emily Hanley <eyaich@google.com>
Date: Thu Jun 14 14:02:12 2018

Disabling dummy_benchmark.stable_benchmark_1/dummy_page.html on win

TBR=charliea@chromium.org
NOTRY=true

Bug: 848900
Change-Id: I8fa3a3cad3515ec16ba19f558875be13910c902b
Reviewed-on: https://chromium-review.googlesource.com/1100960
Reviewed-by: Emily Hanley <eyaich@chromium.org>
Commit-Queue: Emily Hanley <eyaich@chromium.org>
Cr-Commit-Position: refs/heads/master@{#567251}
[modify] https://crrev.com/e2cc8270b2e32f604380334cc4bc99364553f5cb/tools/perf/expectations.config