New issue
Advanced search Search tips
Starred by 2 users
Status: Duplicate
Owner:
Closed: Nov 6
Cc:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 2
Type: ----



Sign in to add a comment
daisy_skate-release:1910 failed
Project Member Reported by teravest@chromium.org, Nov 1 Back to list
daisy_skate-release:1910 failed

Builders failed on: 
- daisy_skate-release: 
  https://luci-milo.appspot.com/buildbot/chromeos/daisy_skate-release/1910


It looks like maybe this failed due to verify/repair failing?
https://logs.chromium.org/v/?s=chromeos%2Fbb%2Fchromeos%2Fdaisy_skate-release%2F1910%2F%2B%2Frecipes%2Fsteps%2FPaygenTestDev%2F0%2Fstdout

ayatane,
Do we have logs from the verify/repair attempts failing? It feels like something is broken here since daisy_skate-release has been broken for 14 builds in a row.

The paygen suites themselves passed.
https://00e9e64bac19d092f0fc2a00907fe2cd52d2af471c9ac8bb77-apidata.googleusercontent.com/download/storage/v1/b/chromeos-autotest-results/o/152990959-chromeos-test%2Fhostless%2Fdebug%2Fautoserv.DEBUG?qk=AD5uMEvvK79c3YeydGDdhjZoJ53YI3S56LAZyh3ajHJV4BuKoirGFZaeGuR6NT7zbFEr3bqTCDtmp0Oraj4hjbvLdhQ8lYFEUFloqwTVwYYfHhxAyACXJOTl_9ukpHZibyOKpdArv350Gm6qS-74L9srTQ1_z1YgOa8EAFxMqsX_gafd83YUwUivMPhG4SC2uRydJ_F5AY_cEDiZrQhd1nrH-5dOnD59-APKbhM7c9iRPVM7cIrA_4mCeYPPNsAYSyCT53Q5hAcSrXqQA4h_ZEfb92Q7m9tZo30B6xhxZvALkn7LfvDTSqglhqgqCs_H3VjzVItdBa0dAXh9ITGhJKLvXLnV6Z8xdDtUWS-pJllxC49dkeNxUBXQNzhOc-AmKJC6ohQwdeHg5SG9L5Wl1CAe6ZUQfy1yDUIhCb5kRhEi82bm3WEVnQg9ec2dWX5vMf2iAyQEq4iRhBbg5bFwOwBK63qZsM8ND2D3enrhDfSensDiveVAOHU57w0l-Rak50-TXDXxoRISe3Juw1tXOkdAJoiDZlk4qnw6GqU1UKLRkVf7ZnrYGK8cQqxVMeSYwPmB_vC3g8coQ0MD4-yGZQsufjACa89cX8eGxVqpvMn2-sBOOeKAIOc8PCVyDCBvkuQKRjCtlA49BsQ0um081G1pMv7FRogHQenX4nqqXIxFKss91qzQ6qryxy4EzKfKqV1tscbntHH_QgC8-rO_e1iIRFpNcwcOkkNfw4SVsKpGf9W92peOEqbny9M2VQD56BiKBJp8yOQBAIVBJ1_snbOayVRxpoOrPF_cC59U7668LiLzVmmeQovvkNH0KfRQH7BGniV4G1pd
 
I'm only really familiar with run_suite.py, the Autotest part.

This line in the log is printing at the very end of run_suite.py:

   Will return from run_suite with status: OK

Thus, the result is correct at the moment it is leaving run_suite.py (Autotest)

If you check the Report stdout:

   ** PASS PaygenTestDev (1:44:00)

So it looks good there.  I don't know why it shows up as red in Luci

I think the actual failure is this:

Failed in stage Paygen:
<class 'chromite.lib.parallel.ProcessSilentTimeout'>: No output from <_BackgroundTask(_BackgroundTask-7:6:6:3, started)> for 8610 seconds
01:39:14: INFO: RunCommand: python /b/c/goma_client/goma_ctl.py stop
using /b/c/cbuild/repository/chroot/tmp/goma_tmp_dir.oep3Ug as tmpdir
Killing compiler proxy.
compiler proxy status:  goma is not running.
01:39:14: INFO: Goma log directory is: /b/c/cbuild/repository/chroot/tmp/goma_tmp_dir.oep3Ug/log_dir
01:39:14: INFO: Goma log upload destination: gs://chrome-goma-log/2017/11/01/cros-beefy26-c2
01:39:14: INFO: BuilderInfo: {"builder": "daisy_skate-release", "master": "chromeos", "slave": "cros-beefy26-c2", "clobber": false, "os": "chromeos"}
01:39:14: INFO: Uploading /b/c/cbuild/repository/chroot/tmp/goma_tmp_dir.oep3Ug/log_dir/compiler_proxy-subproc.cros-beefy26-c2.chrome-bot.log.INFO.20171031-200218.1104
01:39:14: INFO: RunCommand: /b/c/cbuild/repository/.cache/common/gsutil_4.27.tar.gz/gsutil/gsutil -o 'Boto:num_retries=10' -h 'x-goog-meta-builderinfo:{"builder": "daisy_skate-release", "master": "chromeos", "slave": "cros-beefy26-c2", "clobber": false, "os": "chromeos"}' cp -v -Z -- /b/c/cbuild/repository/chroot/tmp/goma_tmp_dir.oep3Ug/log_dir/compiler_proxy-subproc.cros-beefy26-c2.chrome-bot.log.INFO.20171031-200218.1104 gs://chrome-goma-log/2017/11/01/cros-beefy26-c2/compiler_proxy-subproc.cros-beefy26-c2.chrome-bot.log.INFO.20171031-200218.1104.gz
01:39:16: INFO: Uploading /b/c/cbuild/repository/chroot/tmp/goma_tmp_dir.oep3Ug/log_dir/compiler_proxy.cros-beefy26-c2.chrome-bot.log.INFO.20171031-200217.1103
01:39:16: INFO: RunCommand: /b/c/cbuild/repository/.cache/common/gsutil_4.27.tar.gz/gsutil/gsutil -o 'Boto:num_retries=10' -h 'x-goog-meta-builderinfo:{"builder": "daisy_skate-release", "master": "chromeos", "slave": "cros-beefy26-c2", "clobber": false, "os": "chromeos"}' cp -v -Z -- /b/c/cbuild/repository/chroot/tmp/goma_tmp_dir.oep3Ug/log_dir/compiler_proxy.cros-beefy26-c2.chrome-bot.log.INFO.20171031-200217.1103 gs://chrome-goma-log/2017/11/01/cros-beefy26-c2/compiler_proxy.cros-beefy26-c2.chrome-bot.log.INFO.20171031-200217.1103.gz
01:39:34: INFO: No gomacc logs found

To clarify, PaygenTestCanary failed, failing Paygen
Cc: ayatane@chromium.org
 Issue 780639  has been merged into this issue.
Cc: shuqianz@chromium.org
Owner: akes...@chromium.org
Mergedinto: 781682
Status: Duplicate
Sign in to add a comment