New issue
Advanced search Search tips
Note: Color blocks (like █ or █) mean that a user may not be available. Tooltip shows the reason.

Issue 676200 link

Starred by 1 user
Status: Fixed
Owner:
█ pschmidt@chromium.org
Last visit > 30 days ago
Closed: Dec 2016
Cc:
█ kbr@chromium.org
mac-bugs-priority@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: Mac
Pri: 0
Type: Bug

Blocking:
issue 676343



Sign in to add a comment

GPU.FYI Mac builders (release and debug) are stuck

Project Member Reported by ynovikov@chromium.org, Dec 21 2016 
https://build.chromium.org/p/chromium.gpu.fyi/builders/GPU%20Mac%20Builder
building
start:
09:43
< 1 min
1105 pending

https://build.chromium.org/p/chromium.gpu.fyi/builders/GPU%20Mac%20Builder%20%28dbg%29
building
start:
16:10
< 1 min
1760 pending

All other Mac GPU.FYI bots are idle.

Comment 1 by ynovikov@chromium.org, Dec 21 2016 

Took a while for bot pages to load. Looks like they are stuck in bot_update.

Comment 2 by ynovikov@chromium.org, Dec 21 2016 

Here is the beginning of log:
@@@STEP_CURSOR@bot_update@@@
@@@STEP_STARTED@@@
python -u /b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/depot_tools/recipe_modules/bot_update/resources/bot_update.py --spec $'cache_dir = \'/b/c/git_cache\'\nsolutions = [{\'deps_file\': \'.DEPS.git\', \'managed\': True, \'name\': \'src\', \'url\': \'https://chromium.googlesource.com/chromium/src.git\'}, {\'custom_deps\': {\'src/chrome/test/data/firefox2_profile/searchplugins\': None, \'src/chrome/test/data/firefox2_searchplugins\': None, \'src/chrome/test/data/firefox3_profile/searchplugins\': None, \'src/chrome/test/data/firefox3_searchplugins\': None, \'src/chrome/test/data/osdd\': None, \'src/chrome/test/data/perf/frame_rate/private\': None, \'src/chrome/test/data/plugin\': None, \'src/chrome/test/data/ssl/certs\': None, \'src/data/autodiscovery\': None, \'src/data/esctf\': None, \'src/data/mach_ports\': None, \'src/data/memory_test\': None, \'src/data/mozilla_js_tests\': None, \'src/data/page_cycler\': None, \'src/data/selenium_core\': None, \'src/data/tab_switching\': None, \'src/tools/grit/grit/test/data\': None, \'src/webkit/data/bmp_decoder\': None, \'src/webkit/data/ico_decoder\': None, \'src/webkit/data/test_shell/plugins\': None, \'src/webkit/data/xbm_decoder\': None}, \'deps_file\': \'.DEPS.git\', \'managed\': True, \'name\': \'src-internal\', \'url\': \'https://chrome-internal.googlesource.com/chrome/src-internal.git\'}]' --patch_root src --revision_mapping_file /tmp/tmp5NFRmh.json --git-cache-dir /b/c/git_cache --output_json /tmp/tmpHwcVc2.json --revision src@HEAD --revision src/third_party/angle@HEAD --output_manifest
in dir /b/c/b/mac:
 allow_subannotations: False
 base_name: bot_update
 cmd: ['python', '-u', '/b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/depot_tools/recipe_modules/bot_update/resources/bot_update.py', '--spec', "cache_dir = '/b/c/git_cache'\nsolutions = [{'deps_file': '.DEPS.git', 'managed': True, 'name': 'src', 'url': 'https://chromium.googlesource.com/chromium/src.git'}, {'custom_deps': {'src/chrome/test/data/firefox2_profile/searchplugins': None, 'src/chrome/test/data/firefox2_searchplugins': None, 'src/chrome/test/data/firefox3_profile/searchplugins': None, 'src/chrome/test/data/firefox3_searchplugins': None, 'src/chrome/test/data/osdd': None, 'src/chrome/test/data/perf/frame_rate/private': None, 'src/chrome/test/data/plugin': None, 'src/chrome/test/data/ssl/certs': None, 'src/data/autodiscovery': None, 'src/data/esctf': None, 'src/data/mach_ports': None, 'src/data/memory_test': None, 'src/data/mozilla_js_tests': None, 'src/data/page_cycler': None, 'src/data/selenium_core': None, 'src/data/tab_switching': None, 'src/tools/grit/grit/test/data': None, 'src/webkit/data/bmp_decoder': None, 'src/webkit/data/ico_decoder': None, 'src/webkit/data/test_shell/plugins': None, 'src/webkit/data/xbm_decoder': None}, 'deps_file': '.DEPS.git', 'managed': True, 'name': 'src-internal', 'url': 'https://chrome-internal.googlesource.com/chrome/src-internal.git'}]", '--patch_root', 'src', '--revision_mapping_file', '/tmp/tmp5NFRmh.json', '--git-cache-dir', '/b/c/git_cache', '--output_json', '/tmp/tmpHwcVc2.json', '--revision', 'src@HEAD', '--revision', 'src/third_party/angle@HEAD', '--output_manifest']
 cwd: /b/c/b/mac
 env: {'PATH': '%(PATH)s:/b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/depot_tools/'}
 infra_step: True
 name: bot_update
 nest_level: 0
 ok_ret: frozenset([0, 88, 87])
 step_test_data: <lambda>(...)
 trigger_specs: []
full environment:
 AWS_CREDENTIAL_FILE: /b/build/site_config/.boto
 BOTO_CONFIG: /b/build/site_config/.boto
 BUILDBOT_BLAMELIST: [u'tommycli@chromium.org']
 BUILDBOT_BRANCH: master
 BUILDBOT_BUILDBOTURL: http://build.chromium.org/p/chromium.gpu.fyi/
 BUILDBOT_BUILDERNAME: GPU Mac Builder
 BUILDBOT_BUILDNUMBER: 78696
 BUILDBOT_CLOBBER: 
 BUILDBOT_GOT_REVISION: None
 BUILDBOT_MASTERNAME: chromium.gpu.fyi
 BUILDBOT_REVISION: 81892544ca67cc6ff463c7a5d58bcfadd499594d
 BUILDBOT_SCHEDULER: gpu
 BUILDBOT_SLAVENAME: vm696-m1
 CHROME_HEADLESS: 1
 GIT_USER_AGENT: darwin git/2.7.4 vm696-m1.golo.chromium.org
 HOME: /Users/chrome-bot
 LOGNAME: chrome-bot
 PAGER: cat
 PATH: /Users/chrome-bot/slavebin:/b/depot_tools:/usr/local/git/bin:/usr/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/depot_tools/
 PWD: /b/build/slave/GPU_Mac_Builder/build
 PYTHONPATH: /b/rr/tmpWlEhsm/rw/checkout/scripts:/b/rr/tmpWlEhsm/rw/checkout/site_config:/b/rr/tmpWlEhsm/rw/checkout/third_party:/b/rr/tmpWlEhsm/rw/checkout/third_party/buildbot_8_4p1:/b/rr/tmpWlEhsm/rw/checkout/third_party/buildbot_slave_8_4:/b/rr/tmpWlEhsm/rw/checkout/third_party/coverage-3.7.1:/b/rr/tmpWlEhsm/rw/checkout/third_party/decorator_3_3_1:/b/rr/tmpWlEhsm/rw/checkout/third_party/google_api_python_client:/b/rr/tmpWlEhsm/rw/checkout/third_party/httplib2/python2:/b/rr/tmpWlEhsm/rw/checkout/third_party/infra_libs:/b/rr/tmpWlEhsm/rw/checkout/third_party/jinja2:/b/rr/tmpWlEhsm/rw/checkout/third_party/markupsafe:/b/rr/tmpWlEhsm/rw/checkout/third_party/mock-1.0.1:/b/rr/tmpWlEhsm/rw/checkout/third_party/oauth2client:/b/rr/tmpWlEhsm/rw/checkout/third_party/pyasn1:/b/rr/tmpWlEhsm/rw/checkout/third_party/pyasn1-modules:/b/rr/tmpWlEhsm/rw/checkout/third_party/python-rsa:/b/rr/tmpWlEhsm/rw/checkout/third_party/requests_2_10_0:/b/rr/tmpWlEhsm/rw/checkout/third_party/setuptools-0.6c11:/b/rr/tmpWlEhsm/rw/checkout/third_party/sqlalchemy_0_7_1:/b/rr/tmpWlEhsm/rw/checkout/third_party/sqlalchemy_migrate_0_7_1:/b/rr/tmpWlEhsm/rw/checkout/third_party/tempita_0_5:/b/rr/tmpWlEhsm/rw/checkout/third_party/twisted_10_2:/b/rr/tmpWlEhsm/rw/checkout/third_party/uritemplate:/b/rr/tmpWlEhsm/rw/checkout/third_party/site-packages:/b/rr/tmpWlEhsm/rw/checkout/scripts/slave/recipe_modules/test_results/resources:/b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/third_party:/b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/third_party/requests:/b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/third_party/six:/b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/third_party/client-py:/b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/third_party/mock-1.0.1:/b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/third_party/astunparse:/b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/recipe_engine:/b/build/site_config:/b/build/scripts:/b/build/scripts/release:/b/build/third_party:/b/build/third_party/requests_2_10_0:/b/build_internal/site_config:/b/build_internal/symsrc:/b/build/slave:/b/build/third_party/buildbot_slave_8_4:/b/build/third_party/twisted_10_2:/b/build/slave/GPU_Mac_Builder/build:/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python27.zip:/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7:/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/plat-darwin:/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/plat-mac:/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/plat-mac/lib-scriptpackages:/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python:/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/lib-tk:/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/lib-old:/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/lib-dynload:/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/PyObjC
 PYTHONUNBUFFERED: 1
 SHELL: /bin/bash
 SSH_AUTH_SOCK: /tmp/launch-SzGV3M/Listeners
 USER: chrome-bot

Debugging info:
BUILDER_DIR: '/b/c/b'
CURRENT_DIR: '/b/c/b/mac'
DEPOT_TOOLS_DIR: '/b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/depot_tools'
THIS_DIR: '/b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/depot_tools/recipe_modules/bot_update/resources'
Gclient Solutions
=================
src (https://chromium.googlesource.com/chromium/src.git)
  Dependencies file is .DEPS.git
  Managed mode is OFF

src-internal (https://chrome-internal.googlesource.com/chrome/src-internal.git)
  Dependencies file is .DEPS.git
  Managed mode is OFF
  Custom Dependencies:
    src/chrome/test/data/firefox2_profile/searchplugins: Ignore
    src/chrome/test/data/firefox2_searchplugins: Ignore
    src/chrome/test/data/firefox3_profile/searchplugins: Ignore
    src/chrome/test/data/firefox3_searchplugins: Ignore
    src/chrome/test/data/osdd: Ignore
    src/chrome/test/data/perf/frame_rate/private: Ignore
    src/chrome/test/data/plugin: Ignore
    src/chrome/test/data/ssl/certs: Ignore
    src/data/autodiscovery: Ignore
    src/data/esctf: Ignore
    src/data/mach_ports: Ignore
    src/data/memory_test: Ignore
    src/data/mozilla_js_tests: Ignore
    src/data/page_cycler: Ignore
    src/data/selenium_core: Ignore
    src/data/tab_switching: Ignore
    src/tools/grit/grit/test/data: Ignore
    src/webkit/data/bmp_decoder: Ignore
    src/webkit/data/ico_decoder: Ignore
    src/webkit/data/test_shell/plugins: Ignore
    src/webkit/data/xbm_decoder: Ignore

Revisions: ['src@HEAD', 'src/third_party/angle@HEAD']
Fetching Git checkout at src@HEAD
Checking git version...
===Running git version (attempt #1)===
In directory: /b/c/b/mac
git version 2.7.4
===Succeeded in 0.0 mins===

Using git version 2.7.4
Fetching Git checkout
===Running /usr/bin/python -u /b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py unlock -vv --force --all --cache-dir /b/c/git_cache (attempt #1)===
In directory: /b/c/b/mac
===Succeeded in 0.0 mins===

===Running /usr/bin/python -u /b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py populate --ignore_locks -v --cache-dir /b/c/git_cache https://chromium.googlesource.com/chromium/src.git (attempt #1)===
In directory: /b/c/b/mac
running "git config gc.autodetach 0" in "/b/c/git_cache/chromium.googlesource.com-chromium-src"
running "git config gc.autopacklimit 0" in "/b/c/git_cache/chromium.googlesource.com-chromium-src"
running "git config core.deltaBaseCacheLimit 2g" in "/b/c/git_cache/chromium.googlesource.com-chromium-src"
running "git config remote.origin.url https://chromium.googlesource.com/chromium/src.git" in "/b/c/git_cache/chromium.googlesource.com-chromium-src"
running "git config --replace-all remote.origin.fetch +refs/heads/*:refs/heads/* \+refs/heads/\*:.*" in "/b/c/git_cache/chromium.googlesource.com-chromium-src"
Fetching +refs/heads/*:refs/heads/*
running "git fetch -v --progress origin +refs/heads/*:refs/heads/*" in "/b/c/git_cache/chromium.googlesource.com-chromium-src"
POST git-upload-pack (gzip 1031 to 594 bytes)
remote: Counting objects: 1           
remote: Counting objects: 255317           
remote: Counting objects: 304048, done        
remote: Finding sources:  25% (1/4)           
remote: Finding sources:  50% (2/4)           
remote: Finding sources:  75% (3/4)           
remote: Finding sources: 100% (4/4)           
remote: Finding sources: 100% (4/4)        
remote: Total 4 (delta 3), reused 4 (delta 3)        
From https://chromium.googlesource.com/a/chromium/src
 = [up to date]      ignore/bar -> ignore/bar
 = [up to date]      ignore/foo -> ignore/foo
 = [up to date]      infra/config -> infra/config
   674e112..6cfe928  lkcr       -> lkcr
   9431efd..5406d40  lkgr       -> lkgr
   503a829..8189254  master     -> master
===Succeeded in 0.1 mins===

===Running /usr/bin/python -u /b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py exists --quiet --cache-dir /b/c/git_cache https://chromium.googlesource.com/chromium/src.git (attempt #1)===
In directory: /b/c/b/mac
/b/c/git_cache/chromium.googlesource.com-chromium-src
===Succeeded in 0.0 mins===

===Running git remote set-url origin /b/c/git_cache/chromium.googlesource.com-chromium-src (attempt #1)===
In directory: /b/c/b/mac/src
===Succeeded in 0.0 mins===

===Running git fetch origin (attempt #1)===
In directory: /b/c/b/mac/src
From /b/c/git_cache/chromium.googlesource.com-chromium-src
   674e112..6cfe928  lkcr       -> origin/lkcr
   9431efd..5406d40  lkgr       -> origin/lkgr
   503a829..8189254  master     -> origin/master
===Succeeded in 0.0 mins===

===Running git checkout --force origin/master (attempt #1)===
In directory: /b/c/b/mac/src
Previous HEAD position was 503a829... Revert of Set overflow: auto in StyleResolver::styleForDocument. (patchset #1 id:1 of https://codereview.chromium.org/2571893003/ )
HEAD is now at 8189254... Revert of [DevTools] Migrate storage domain to new generator. (patchset #1 id:1 of https://codereview.chromium.org/2572933002/ )
===Succeeded in 0.1 mins===

===Running git clean -dff (attempt #1)===
In directory: /b/c/b/mac/src
Removing remoting/webapp/app_remoting/
===Succeeded in 0.0 mins===

===Running git log --format=%H --max-count=1 (attempt #1)===
In directory: /b/c/b/mac/src
81892544ca67cc6ff463c7a5d58bcfadd499594d
===Succeeded in 0.0 mins===

===Running /usr/bin/python -u /b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py populate --ignore_locks -v --cache-dir /b/c/git_cache https://chrome-internal.googlesource.com/chrome/src-internal.git (attempt #1)===
In directory: /b/c/b/mac
running "git config gc.autodetach 0" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
running "git config gc.autopacklimit 0" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
running "git config core.deltaBaseCacheLimit 2g" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
running "git config remote.origin.url https://chrome-internal.googlesource.com/chrome/src-internal.git" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
running "git config --replace-all remote.origin.fetch +refs/heads/*:refs/heads/* \+refs/heads/\*:.*" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
Fetching +refs/heads/*:refs/heads/*
running "git fetch -v --progress origin +refs/heads/*:refs/heads/*" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
From https://chrome-internal.googlesource.com/chrome/src-internal
 = [up to date]      infra/config -> infra/config
 = [up to date]      master     -> master
===Succeeded in 0.0 mins===

===Running /usr/bin/python -u /b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py exists --quiet --cache-dir /b/c/git_cache https://chrome-internal.googlesource.com/chrome/src-internal.git (attempt #1)===
In directory: /b/c/b/mac
/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal
===Succeeded in 0.0 mins===

===Running git remote set-url origin /b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal (attempt #1)===
In directory: /b/c/b/mac/src-internal
===Succeeded in 0.0 mins===

===Running git fetch origin (attempt #1)===
In directory: /b/c/b/mac/src-internal
===Succeeded in 0.0 mins===

===Running git checkout --force origin/master (attempt #1)===
In directory: /b/c/b/mac/src-internal
HEAD is now at cd10fec... Roll Flash 24.0.0.178(VanNess)
===Succeeded in 0.0 mins===

===Running git clean -dff (attempt #1)===
In directory: /b/c/b/mac/src-internal
===Succeeded in 0.0 mins===

===Processing patch solutions===
Patch root is 'src'
Processing solution 'src'
  relative root is '', target is 'DEPS'
Processing solution 'src-internal'
===Running /usr/bin/python -u /b/rr/tmpWlEhsm/rw/checkout/scripts/slave/.recipe_deps/depot_tools/gclient.py sync --verbose --reset --force --ignore_locks --output-json /tmp/tmpq31bOP.json --nohooks --noprehooks --delete_unversioned_trees (attempt #1)===
In directory: /b/c/b/mac
Looking for .gclient starting from /b/c/b/mac

Loaded .gclient config in /b/c/b/mac:
solutions = [   {   'deps_file': '.DEPS.git',
        'managed': False,
        'name': 'src',
        'url': 'https://chromium.googlesource.com/chromium/src.git'},
    {   'custom_deps': {   'src/chrome/test/data/firefox2_profile/searchplugins': None,
                           'src/chrome/test/data/firefox2_searchplugins': None,
                           'src/chrome/test/data/firefox3_profile/searchplugins': None,
                           'src/chrome/test/data/firefox3_searchplugins': None,
                           'src/chrome/test/data/osdd': None,
                           'src/chrome/test/data/perf/frame_rate/private': None,
                           'src/chrome/test/data/plugin': None,
                           'src/chrome/test/data/ssl/certs': None,
                           'src/data/autodiscovery': None,
                           'src/data/esctf': None,
                           'src/data/mach_ports': None,
                           'src/data/memory_test': None,
                           'src/data/mozilla_js_tests': None,
                           'src/data/page_cycler': None,
                           'src/data/selenium_core': None,
                           'src/data/tab_switching': None,
                           'src/tools/grit/grit/test/data': None,
                           'src/webkit/data/bmp_decoder': None,
                           'src/webkit/data/ico_decoder': None,
                           'src/webkit/data/test_shell/plugins': None,
                           'src/webkit/data/xbm_decoder': None},
        'deps_file': '.DEPS.git',
        'managed': False,
        'name': 'src-internal',
        'url': 'https://chrome-internal.googlesource.com/chrome/src-internal.git'}]

cache_dir = r"/b/c/git_cache"


target_os_only=False

gclient(629) ParseDepsFile:Found recursedeps "{'src/third_party/android_tools': {'deps_file': '.DEPS.git'}, 'src/third_party/angle': {'deps_file': 'DEPS.chromium'}, 'src/buildtools': {'deps_file': '.DEPS.git'}}".

src-internal (Elapsed: 0:00:00)
----------------------------------------
[0:00:00] Started.
_____ src-internal at refs/remotes/origin/master
[0:00:00] ________ unmanaged solution; skipping src-internal
[0:00:00] Finished.
----------------------------------------

src (Elapsed: 0:00:00)
----------------------------------------
[0:00:00] Started.
_____ src at refs/remotes/origin/master
[0:00:00] ________ unmanaged solution; skipping src
[0:00:00] Finished.
----------------------------------------
[0:01:00] Still working on:
[0:01:00]   src/chrome/app/theme/default_100_percent/google_chrome
[0:01:00]   src/chrome/app/theme/default_200_percent/google_chrome
[0:01:00]   src/chrome/app/theme/google_chrome
[0:01:00]   src/chrome/browser/autofill/internal
[0:01:00]   src/chrome/browser/google/linkdoctor_internal
[0:01:00]   src/chrome/browser/internal
[0:01:00]   src/chrome/browser/resources/media_router_internal
[0:01:00]   src/chrome/browser/resources/settings_internal

"Still working on" is then repeated forever.

Comment 3 by ynovikov@chromium.org, Dec 21 2016

Labels: -Pri-1 Pri-0
Just realized that release bot is stuck for 6 days and debug bot for 11 days.
Increasing priority.

78696 ETA: 17:22:20 [0 secs] [Running for 151 hrs, 38 mins, 35 secs] bot_update
80424 ETA: 17:22:21 [0 secs] [Running for 265 hrs, 11 mins, 51 secs] bot_update

Comment 4 by ynovikov@chromium.org, Dec 21 2016

Components: -Infra>Labs>HWOps Infra>Labs

Comment 5 by pschm...@google.com, Dec 21 2016 

Looks like wedged git.   I'll pop them first to see if they self recover.

Comment 7 by ynovikov@chromium.org, Dec 21 2016 

Thanks.
I see that it happened recently - issue 663464.
Can we have some automatic alert for build taking longer than, say, a day?

Comment 8 by pschm...@google.com, Dec 21 2016 

Looks like monitoring exists for the main waterfall masters (e.g master.chromium.gpu) but not for the fyi ones.

I would go ahead and file a separate bug for that.

Comment 9 by kbr@chromium.org, Dec 21 2016

Blocking: 676343

Comment 10 by kbr@chromium.org, Dec 21 2016

Owner: pschmidt@chromium.org
Status: Fixed (was: Untriaged)
Thanks Peter for your help. I filed  Issue 676343  about adding alerting for the chromium.gpu.fyi waterfall.

Comment 12 by pschm...@google.com, Dec 21 2016 

Done.  Also this time I clobbered it.
►

Sign in to add a comment