Issue metadata
Sign in to add a comment
|
Multiple GPU bots failing gclient runhooks with missing gyp_angle |
||||||||||||||||||||||
Issue descriptionExamples: https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Mac%20FYI%20dEQP%20Release%20AMD/19344 https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Mac%20FYI%20dEQP%20Release%20Intel/19466 https://ci.chromium.org/p/chromium/builders/luci.chromium.try/mac_optional_gpu_tests_rel/6519 https://ci.chromium.org/p/chromium/builders/luci.chromium.try/linux_optional_gpu_tests_rel/5899 Log excerpt: ________ running '/b/s/w/ir/cache/vpython/09242d/bin/python tools/clang/scripts/update.py --if-needed' in '/b/s/w/ir/cache/builder' Updating Clang to 317263-4... Creating directory /b/s/w/ir/cache/builder/third_party/llvm-build Downloading prebuilt clang Downloading https://commondatastorage.googleapis.com/chromium-browser-clang/Mac/clang-317263-4.tgz .......... Done. Creating directory /b/s/w/ir/cache/builder/third_party/llvm-build/Release+Asserts clang 317263-4 unpacked ________ running '/b/s/w/ir/cache/vpython/09242d/bin/python gyp/gyp_angle' in '/b/s/w/ir/cache/builder' /b/s/w/ir/cache/vpython/09242d/bin/python: can't open file 'gyp/gyp_angle': [Errno 2] No such file or directory Error: Command '/b/s/w/ir/cache/vpython/09242d/bin/python gyp/gyp_angle' returned non-zero exit status 2 in /b/s/w/ir/cache/builder step returned non-zero exit code: 2
,
Jul 12
Here's the last good build on one bot: https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Mac%20FYI%20dEQP%20Release%20AMD/19343 and the first failing build: https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Mac%20FYI%20dEQP%20Release%20AMD/19344 It looks like ANGLE was unchanged and there weren't any relevant CLs in Chrome. Could depot_tools have changed?
,
Jul 12
Something's going wrong during bot_update: https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Mac%20FYI%20dEQP%20Release%20AMD/19344 https://logs.chromium.org/logs/chromium/buildbucket/cr-buildbucket.appspot.com/8941170344519296496/+/steps/bot_update/0/stdout ________ running 'git -c core.deltaBaseCacheLimit=2g fetch origin --prune --verbose' in '/b/s/w/ir/cache/builder/src/third_party/angle' [0:00:14] From /b/s/w/ir/cache/git/chromium.googlesource.com-angle-angle [0:00:14] = [up to date] chrome_m27 -> origin/chrome_m27 ... ________ running 'git reset --hard HEAD' in '/b/s/w/ir/cache/builder/src/third_party/angle' [0:00:18] HEAD is now at 523c5e312 Vulkan: Suppress PointCoord test on Android. Checked out revision 447bfac19acfb9a6a0f212375df88792c847bb8d [0:00:21] _____ removing unversioned directory third_party/vulkan-headers/ [0:00:21] _____ removing unversioned directory third_party/vulkan-loader/ [0:00:21] _____ removing unversioned directory third_party/vulkan-tools/ [0:00:22] Finished. "Checked out revision 447bfac19acfb9a6a0f212375df88792c847bb8d" is highly suspicious. This is an ancient revision: https://chromium.googlesource.com/angle/angle/+/447bfac19acfb9a6a0f212375df88792c847bb8d 523c5e3 is the current revision: https://chromium.googlesource.com/angle/angle/+log What could have changed in bot_update?
,
Jul 12
Not sure if https://chromium-review.googlesource.com/1119235 caused this; it was reverted in https://chromium-review.googlesource.com/1135893 , but the problem still seems to be happening on some bots.
,
Jul 12
Looking at a current failure: https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Mac%20FYI%20dEQP%20Release%20Intel/19478 https://logs.chromium.org/logs/chromium/buildbucket/cr-buildbucket.appspot.com/8941166844718504096/+/steps/bot_update/0/stdout It's difficult to understand from the logs which version of depot_tools the bot actually used in kitchen.
,
Jul 12
It looks like the bots are recovering. https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Mac%20FYI%20dEQP%20Release%20Intel https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Mac%20FYI%20dEQP%20Release%20AMD both are green. https://ci.chromium.org/p/chromium/builders/luci.chromium.try/mac_optional_gpu_tests_rel https://ci.chromium.org/p/chromium/builders/luci.chromium.try/linux_optional_gpu_tests_rel have builds which have gotten past gclient runhooks. Probably was the same issue as Issue 863211. Duplicating. |
|||||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||||
Comment 1 by kbr@chromium.org
, Jul 12