New issue
Advanced search Search tips

Issue 912917 link

Starred by 2 users

Issue metadata

Status: Verified
Owner:
Closed: Dec 16
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug

Blocking:
issue 894217



Sign in to add a comment

goma client sometimes fails to find generated files

Project Member Reported by most...@vewd.com, Dec 7

Issue description

When stress-testing another goma backend with GOMA_FALLBACK=false, I sometimes see jobs that fail due to the goma client not finding generated files.  torque-generated/builtin-definitions-from-dsl.h and include/inspector/Runtime.h being the most common.  When these compile jobs fail, I confirm that the files actually exist in the correct location, but rebuilds fail with the same error.  The jobs succeed once I restart the goma client.  The ninja dependencies appear to be correct, so I suspect that this is a bug in one of the goma client's caches.

If I modify IncludeFileFinder::Lookup() so that it doesn't use the include_dir_index_lowerbound_ map or files_in_include_dirs_ set, then I have not been able to reproduce the issue.

Alternatively, I noticed that if I increase the (suspicious) 1 second constant in FileStat::CanBeNewerThan() to 5 seconds then I cannot reproduce the failure either (I was still able to reproduce the failures with a value of 2 seconds).  This is a small change at least, but feels like it's sacrificing cache efficiently to mask a bug.
 
(that should read "sacrificing cache efficiency" ^)
b/120741399
Blocking: 894217
Owner: tikuta@chromium.org
Status: Started (was: Untriaged)
Thank you for report! I'm fixing this issue.
Your investigation helped a lot.
Project Member

Comment 5 by bugdroid1@chromium.org, Dec 12

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/goma/client/+/4f4a81fefffa9d02611dfe2076abd424f1fc2d6e

commit 4f4a81fefffa9d02611dfe2076abd424f1fc2d6e
Author: Takuto Ikuta <tikuta@google.com>
Date: Wed Dec 12 09:03:42 2018

Great- I'm looking forward to seeing the fix (I'm still trying to understand the design of this part of the goma client).
Project Member

Comment 7 by bugdroid1@chromium.org, Dec 13

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/goma/client/+/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0

commit f4c90513afd6e8b186b2295dfc6c1adf1efb50b0
Author: Goma Authors <goma-dev@google.com>
Date: Thu Dec 13 06:05:59 2018

Import changes for goma client

  - 4f4a81fefffa9d02611dfe2076abd424f1fc2d6e Use filestat taking time to know whether filestat is stal...
  - 611102dcbecf62dc1d504d596d2eb4c9228a0143 Try to use sub-second resolution for file stat
  - 45f9c7be7ae5b8e08642faabd69f1c2dd3b5d883 Roll client/third_party/boringssl/src 0f5ecd3a8..bf5021a6b
  - 42d66d9a1857da2034ba5c02573a9bd836092736 goma_fetch --noauth by default.
  - 8c6e396f9afbdbb2b14e2860499c9744f91eeafa oepnssl_engine: clarify which OpenSSLContext was used.
  - 83fd9472fcf3b3c3fcd2c93afddf250c85f10410 Enable subprocess killing on windows
  - 3f81a2d603830c8ecd1c7028305e174ca4c17ed4 Allow empty hash_key if not using remote.
  - 21e611e515aaa3e1c2872cf9050b55f24afef02b http: mark "error:" only if GOMA_FAIL_FAST is enabled.
  - 91afaf1efd549353efefd80253e3e4967b78f8f0 Omit elapsed time from goma_ctl.py stat error field.
  - e62af20e2093a5f84152e29908f3780785290b44 http: clean up code to use proxy.
  - fdf906b599a96517d3fcc0a3d4e3fcc39938c1b7 DepsCache doesn't support link
  - f4cb027ffb8586c3678da68ef07efc9b082707fa Simplify condition
  - 46c87e22ec1f69e44ae40b40aee1f6a2a5feb3ce http: Also pass the destination host in the Host field fo...
  - 75b0b5a0b5ec2d6df197877117ef0403b407a1d9 CompilerInfoBuilder should work correctly with clang modu...
  - 2dc4f6fc403ba59f8cd8b6e0adce1f74e0744f7a roll_boringssl.py: suggest how boringssl was rolled.
  - 40a6d9fb206b0f732fc08dc04ce72772feb04115 Support pnacl-clang, nacl-gcc, and nacl-clang for arbitra...
  - 9ef6060150a60bc441af6219717cb29c56ffa09d Introduce ToolchainSpec
  - fdc4e10a60147b8057e9fc864c68077e572b3823 gcc_flags: clean up important environments.
  - f32535c85dad986645e4418d0c1fc52ca82ef591 goma_ctl.py: Not to use proxy to connect to compiler_proxy.
  - b83eb729a0d3c799b69212d6339e29ca0c2ed1ce Extract nacl-gcc code from clang_compiler_info_builder
  - ab089abda5a74339d42b9559bf47b16b0c1e7f9f Add GCCFlags::IsNaClClangCommand
  - 57c05f37771abbdcea2173f2d236aa474260b376 Roll client/third_party/boringssl/src 46e12b03f..0f5ecd3a8
  - 2586d90c993b5bf54b89ec6addc471abdfcf833d roll_boringssl.py: remove removed asm files.
  - 14c5d46723647b9ccba83c6871304ba491e9f874 Show dump request message on web browser
  - 8414ba462d435d6634a63a312e1fa4134258760f .gitignore architectures Goma client do not use.
  - e0b510cc4301c7452c7837c1fadcd58d2a60a3a4 Import roll_boringssl.py and modified for Goma client.
  - bbf67b466f5c675e72434dfd14661d9f29b29084 Update PRESUBMIT.py for buildtools.
  - fec6c326835d374477ed5e90448d08ea6872bf18 Use subprocess32 to set timeout in test execution
  - fdde074b6a36305311989b805afd1d244c11385c goma_ctl: crash dump code visibility change.
  - 82280082c6100eac5f58b5ac00a2f27ac11c9da6 update early-access-guide.md
  - 3a17e8ef44b7b444f1448c55148818a3ccee7459 Remove HttpClient::Options::http_host_name
  - ff1e43cc6dd24f7ee943bb7f2cc82bf892d210da goma_ctl: Remove unused proxy parsing code
  - 49041e914dc2d98c99ca77fb85563a832d47fb46 Cleanup build config
  - c3be787218de4b727c15ec88d637bb5f93e3c061 Remove libc++/libc++abi from DEPS
  - 08135f74a24a9fb4537de0b7a2547eecad927e97 Use libc++/libc++abi in buildtools
  - 3e2743863ba03e2756a1ae679a6913516bfb5072 Send subprograms as input
  - 4b5f7d266b30e7cf7522d7da7f1a39365c05cf7c Replace buildtools directory to chromium's buildtools

Bug:  912917 
GitOrigin-RevId: 4f4a81fefffa9d02611dfe2076abd424f1fc2d6e
Change-Id: I8ff3b5eb7c74f91d9877fbaeb530d8fdeb014e13

[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/fipsmodule/md5-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/sha256_hash_cache_unittest.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/fipsmodule/rsaz-avx2.S
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/boringssl/linux-x86/crypto/fipsmodule/bn-586.S
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/boringssl/linux-ppc64le/crypto/fipsmodule/aesp8-ppc.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/fipsmodule/rsaz-avx2.asm
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/boringssl/linux-x86/crypto/chacha/chacha-x86.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/fipsmodule/rdrand-x86_64.asm
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/fipsmodule/p256_beeu-x86_64-asm.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/fipsmodule/sha1-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/fipsmodule/sha1-x86_64.asm
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/cipher_extra/aes128gcmsiv-x86_64.asm
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/build/config/BUILD.gn
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/.gitignore
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/fipsmodule/aesni-gcm-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/compile_task_unittest.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/DEPS
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/cxx/gcc_compiler_type_specific.h
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/lib/gcc_flags.h
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/http.h
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/fipsmodule/sha256-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/goma_auth.py
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/boringssl/linux-x86/crypto/fipsmodule/sha256-586.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/fipsmodule/bsaes-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/cxx/BUILD.gn
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/buildtools/linux64/gn.sha1
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/cipher_extra/aes128gcmsiv-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/http_rpc_unittest.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/BUILD.gn
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/boringssl/linux-ppc64le/crypto/fipsmodule/ghashp8-ppc.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/fipsmodule/bsaes-x86_64.asm
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/clang_modules/modulemap/cache_unittest.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/clang_modules/modulemap/processor.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/.gitignore
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/fipsmodule/aesni-gcm-x86_64.asm
[add] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/build/config/sanitizers/sanitizers.gni
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/cxx/clang_compiler_info_builder_helper.h
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/http.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/goma_flags.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/cipher_extra/aes128gcmsiv-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/fake/fake_compiler_type_specific.h
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/build/run_unittest.py
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/fipsmodule/aesni-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/fipsmodule/rdrand-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/compile_task.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/build/config/compiler/BUILD.gn
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/.gitignore
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/fipsmodule/p256_beeu-x86_64-asm.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/fipsmodule/ghash-x86_64.asm
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/cxx/gcc_compiler_info_builder_unittest.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/fipsmodule/vpaes-x86_64.asm
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/fipsmodule/md5-x86_64.asm
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/cxx/cxx_compiler_type_specific.h
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/boringssl/linux-x86/crypto/fipsmodule/co-586.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/compile_task.h
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/boringssl/linux-x86/crypto/fipsmodule/aes-586.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/clang_modules/modulemap/cache.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/fipsmodule/x86_64-mont.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/fipsmodule/rdrand-x86_64.S
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/buildtools/win/clang-format.exe.sha1
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/buildtools/win/toolchain_vs2013.hash
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/compiler_proxy_http_handler.cc
[add] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/cxx/nacl_compiler_info_builder_helper.h
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/buildtools/linux64/clang-format.sha1
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/fipsmodule/p256-x86_64-asm.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/fipsmodule/sha1-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/fipsmodule/x86_64-mont5.asm
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/fipsmodule/sha512-x86_64.S
[add] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/cxx/nacl_compiler_info_builder_helper.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/lib/gcc_flags_unittest.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/fipsmodule/ghash-x86_64.S
[add] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/roll_boringssl.py
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/fipsmodule/sha512-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/compiler_info.h
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/boringssl/linux-x86/crypto/fipsmodule/aesni-x86.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/fipsmodule/sha512-x86_64.asm
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/buildtools/.gitignore
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/fipsmodule/x86_64-mont5.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/fipsmodule/x86_64-mont.asm
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/sha256_hash_cache.h
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/libc++abi/LICENSE
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/doc/early-access-guide.md
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/fipsmodule/aesni-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/compile_service.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/compiler_info.cc
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/boringssl/linux-x86/crypto/fipsmodule/sha1-586.S
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/buildtools/mac/clang-format.sha1
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/lib/gcc_flags.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/openssl_engine.cc
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/libc++/BUILD.gn
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/cipher_extra/chacha20_poly1305_x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/fipsmodule/sha256-x86_64.asm
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/buildtools/win/gn.exe.sha1
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/compiler_info_data.proto
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/file_stat.h
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/boringssl/linux-x86/crypto/fipsmodule/x86-mont.S
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/boringssl/linux-x86/crypto/fipsmodule/sha512-586.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/lib/goma_data.proto
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/java/java_compiler_type_specific.h
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/fipsmodule/aes-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/cipher_extra/chacha20_poly1305_x86_64.asm
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/chacha/chacha-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/fipsmodule/vpaes-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/goma_fetch.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/PRESUBMIT.py
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/fipsmodule/p256_beeu-x86_64-asm.asm
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/cxx/vc_compiler_type_specific.h
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/boringssl/linux-x86/crypto/fipsmodule/md5-586.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/compiler_info_builder.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/fipsmodule/x86_64-mont5.S
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/libc++/LICENSE
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/build/config/sanitizers/BUILD.gn
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/fipsmodule/aesni-x86_64.asm
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/unittest_util.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/fipsmodule/ghash-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/fipsmodule/vpaes-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/chacha/chacha-x86_64.asm
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/compiler_type_specific.h
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/boringssl/linux-x86/crypto/fipsmodule/vpaes-x86.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/build/config/BUILDCONFIG.gn
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/fipsmodule/sha256-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/fipsmodule/aes-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/fipsmodule/bsaes-x86_64.S
[add] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/build/config/c++/c++.gni
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/file_stat.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/cxx/gcc_compiler_type_specific.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/cxx/include_processor/cpp_include_processor.cc
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/boringssl/linux-x86/crypto/fipsmodule/ghash-x86.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/fipsmodule/p256-x86_64-asm.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/unittest_util.h
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/test/goma_ctl_test.py
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/compile_service.h
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/cxx/clang_compiler_info_builder_helper.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/fipsmodule/aes-x86_64.asm
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/fipsmodule/x86_64-mont.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/clang_modules/modulemap/BUILD.gn
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/win-x86_64/crypto/fipsmodule/p256-x86_64-asm.asm
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/chacha/chacha-x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/clang_modules/modulemap/processor.h
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/third_party/libc++abi/BUILD.gn
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/BUILD.generated.gni
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/clang_tidy/clang_tidy_compiler_type_specific.h
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/list_dir_cache.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/fipsmodule/aesni-gcm-x86_64.S
[delete] https://crrev.com/b1361956547569b650063d5155ef957c8d1c3660/buildtools/mac/gn.sha1
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/cipher_extra/chacha20_poly1305_x86_64.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/cxx/gcc_compiler_info_builder.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/goma_ctl.py
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/mac-x86_64/crypto/fipsmodule/md5-x86_64.S
[add] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/compiler_type_specific_unittest.cc
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/third_party/boringssl/linux-x86_64/crypto/fipsmodule/rsaz-avx2.S
[modify] https://crrev.com/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0/client/sha256_hash_cache.cc

Owner: most...@vewd.com
Status: Assigned (was: Started)
I update external client include fix for this.
Can I ask you to verify the behavior?
Sure, I will run some stress tests during the weekend.
Status: Verified (was: Assigned)
I haven't encountered these errors in my stress tests since upgrading the goma client.  This was my last blocker before an important internal milestone- thanks for the fix!

Just curious- was the comparison between filesystem mtimes and absl::Now() in ListDirCache::GetDirEntries the root cause?
Thank you for verifying.

There were several bug around filestat. https://chromium.googlesource.com/infra/goma/client/+/f4c90513afd6e8b186b2295dfc6c1adf1efb50b0%5E%21/#F50
* we used one second resolution timestamp in filestat.
* we can not rely on filestat in some cases if filestat's mtime is very close to the time when the timestat is taken. But we did compare mtime with current timestamp, that is the root cause.

Sign in to add a comment