New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 611217 link

Starred by 1 user

Issue metadata

Status: Archived
Owner:
Closed: Mar 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 3
Type: Bug



Sign in to add a comment

BuildPackages: No such file or directory errors

Project Member Reported by steve...@chromium.org, May 11 2016

Issue description

In the BuildPackages stage (using GYP) in a normal PFQ run, e.g.:

https://uberchromegw.corp.google.com/i/chromeos/builders/amd64-generic-chromium-pfq/builds/8611

We get the following errors:

chromeos-chrome-52.0.2730.0_rc-r1: Copying Chrome tests into /build/amd64-generic/tmp/portage/chromeos-base/chromeos-chrome-52.0.2730.0_rc-r1/work/test_src
chromeos-chrome-52.0.2730.0_rc-r1:  * Installing test targets: media_unittests sandbox_linux_unittests video_decode_accelerator_unittest video_encode_accelerator_unittest ppapi_example_video_decode libppapi_tests.so chrome_sandbox
chromeos-chrome-52.0.2730.0_rc-r1: x86_64-cros-linux-gnu-strip: '/var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release/ppapi_example_video_decode': No such file
chromeos-chrome-52.0.2730.0_rc-r1: x86_64-cros-linux-gnu-strip: '/var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release/libppapi_tests.so': No such file
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release/lib32': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release/lib64': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release/mock_nacl_gdb': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release/ppapi_nacl_tests_newlib.nmf': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release/ppapi_nacl_tests_glibc.nmf': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release/ppapi_nacl_tests_newlib_x32.nexe': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release/ppapi_nacl_tests_newlib_x64.nexe': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release/ppapi_nacl_tests_newlib_arm.nexe': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release/ppapi_nacl_tests_glibc_x32.nexe': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release/ppapi_nacl_tests_glibc_x64.nexe': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release/ppapi_nacl_tests_glibc_arm.nexe': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release/test_case.html': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release/test_case.html.mock-http-headers': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release/test_page.css': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release/test_url_loader_data': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: rsync: link_stat "/home/chrome-bot/chrome_root/src/chrome/test/functional" failed: No such file or directory (2)
chromeos-chrome-52.0.2730.0_rc-r1: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1165) [sender=3.1.1]
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/chrome/test/functional': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: rsync: link_stat "/home/chrome-bot/chrome_root/src/content/common/gpu/testdata" failed: No such file or directory (2)
chromeos-chrome-52.0.2730.0_rc-r1: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1165) [sender=3.1.1]
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/content/common/gpu/testdata': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: rsync: change_dir "/home/chrome-bot/chrome_root/src/third_party/accessibility-developer-tools/gen" failed: No such file or directory (2)
chromeos-chrome-52.0.2730.0_rc-r1: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1165) [sender=3.1.1]
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/third_party/accessibility-developer-tools/gen/axs_testing.js': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: Copying Telemetry Framework into /build/amd64-generic/tmp/portage/chromeos-base/chromeos-chrome-52.0.2730.0_rc-r1/work/telemetry_src
chromeos-chrome-52.0.2730.0_rc-r1: rsync: link_stat "/home/chrome-bot/chrome_root/src/third_party/catapult/third_party/Paste/tests/urlparser_data/find_file/dir" failed: No such file or directory (2)
chromeos-chrome-52.0.2730.0_rc-r1: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1165) [sender=3.1.1]
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/third_party/catapult/third_party/Paste/tests/urlparser_data/find_file/dir': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: rsync: link_stat "/home/chrome-bot/chrome_root/src/with" failed: No such file or directory (2)
chromeos-chrome-52.0.2730.0_rc-r1: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1165) [sender=3.1.1]
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/with': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: rsync: change_dir "/home/chrome-bot/chrome_root/src/spaces" failed: No such file or directory (2)
chromeos-chrome-52.0.2730.0_rc-r1: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1165) [sender=3.1.1]
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/spaces/test': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: rsync: link_stat "/home/chrome-bot/chrome_root/src/4.html" failed: No such file or directory (2)
chromeos-chrome-52.0.2730.0_rc-r1: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1165) [sender=3.1.1]
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/4.html': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: rsync: link_stat "/home/chrome-bot/chrome_root/src/third_party/catapult/third_party/Paste/tests/urlparser_data/find_file/test" failed: No such file or directory (2)
chromeos-chrome-52.0.2730.0_rc-r1: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1165) [sender=3.1.1]
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/third_party/catapult/third_party/Paste/tests/urlparser_data/find_file/test': No such file or directory
chromeos-chrome-52.0.2730.0_rc-r1: rsync: link_stat "/home/chrome-bot/chrome_root/src/3.html" failed: No such file or directory (2)
chromeos-chrome-52.0.2730.0_rc-r1: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1165) [sender=3.1.1]
chromeos-chrome-52.0.2730.0_rc-r1: cp: cannot stat '/var/cache/chromeos-chrome/chrome-src/src/3.html': No such file or directory


We need to fix these before we can isolate new failures due to files moved during the GN migration.

 
Unsing find in /var/cache/chromeos-chrome/chrome-src/src/out_amd64-generic/Release:

Not found:

ppapi_example_video_decode
libppapi_tests.so
mock_nacl_gdb
ppapi_nacl_tests*
test_case.html.mock-http-headers
test_page.css
test_url_loader_data
functional
gpu/testdata
accessibility-developer-tools/gen
axs_testing.js
find_file/dir
with
spaces/test
4.html
3.html

Found elsewhere:

lib32: gen/tc_{irt|glibc|newlib|nonsfi_helper}/lib32
lib64: gen/tc_{irt|glibc|newlib}/lib64
test_case.html: var/cache/chromeos-chrome/chrome-src-internal/src/ppapi/tests/test_case.html
test_url_loader_data: var/cache/chromeos-chrome/chrome-src-internal/src/ppapi/tests/test_url_loader_data
var/cache/chromeos-chrome/chrome-src-internal/src/third_party/catapult/third_party/Paste/tests/urlparser_data/find_file


ppapi_example_video_decode is actually now obj/ppapi/examples/video_decode

I don't really have any ideas about the others. I will try to identify owners.

Cc: fischman@chromium.org jorgelo@chromium.org davidjames@chromium.org achuith@chromium.org posciak@chromium.org spang@chromium.org
+posciak@ for:
libppapi_tests.so

+spang@ for:
mock_nacl_gdb
ppapi_nacl_tests*
test_case.html*
test_page.css
test_url_loader_data

+davidjames@ for:
chrome/test/functional 

+fischman@ for:
content/common/gpu/testdata

+jorgelo@ for:
accessibility-developer-tools/gen/axs_testing.js

+achuith@ for failures related to "Copying Telemetry Framework"


If I don't hear otherwise I will ruthlessly remove these. I recognize that some may only exist when certain USE flags are enabled, in which case we need to update the ebuild to reflect that so that we can identify really errors from bogus ones when we migrate.




chrome/test/functional was added here: http://codereview.chromium.org/3327014

I'm no expert for this, but based on the commit message, I believe it's for pyauto so you can remove it.
Cc: -fischman@chromium.org
Sorry, I have no idea what any of this is about :)  (I've been out of chrome media for years).  Defer to posciak@ for c/c/g/t.
I have no idea what accessibility-developer-tools/gen/axs_testing.js is, I don't think I ever touched it.
Cc: fdeng@chromium.org
jorgelo@ - sorry, looks like that was actually added here:
https://chromium.git.corp.google.com/chromiumos/overlays/chromiumos-overlay/+/0f99d6d23c73fa60c5e572c95e12abf1d26552da%5E%21/#F0

+fdeng@ for:
accessibility-developer-tools/gen/axs_testing.js

Comment 8 by ihf@chromium.org, May 11 2016

I was working on this here. Many of the files have moved/disappeared over time failing silently, 
https://chromium-review.googlesource.com/#/c/330127/1/chromeos-base/chromeos-chrome/chromeos-chrome-9999.ebuild

Then there is this path in chromium
src/third_party/catapult/third_party/Paste/tests/urlparser_data/find_file/dir with spaces

which leads to the garbage below as it escaping that is hard:

find_file/dir
with
spaces/test
4.html
3.html

Cc: -jorgelo@chromium.org
Status: Fixed (was: Started)
I think this is probably fixed now?
Labels: -Proj-GN-Migration Hotlist-CrOS-Gardener
Status: Available (was: Fixed)
No, this is nowhere near fixed, but I've managed to parse through all of the bogus failures so far...

Removing Proj-GN-Migration.

Labels: -Pri-1 Pri-2
Lowering priority.

Cc: -davidjames@chromium.org
Labels: Pri-3
Status: Archived (was: Available)

Sign in to add a comment