New issue
Advanced search Search tips

Issue 858910 link

Starred by 4 users
Status: Closed
Owner:
haddowk@chromium.org
Closed: Aug 28
Cc:
yllin@google.com
namyoon@chromium.org
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: ----


Show other hotlists

Hotlists containing this issue:
Hotlist-1
Hotlist-2


Sign in to add a comment

many builders fails to build_packages

Project Member Reported by sheriff-...@appspot.gserviceaccount.com, Jun 29 2018 
Filed by sheriff-o-matic@appspot.gserviceaccount.com on behalf of yllin@google.com

amd64-generic-paladin:33235 failed

Builders failed on: 
- amd64-generic-paladin: 
  https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?buildbucketId=8942430056982703552

error message:
Found new deps: 'sys-apps/mosys-1.2.3-r780
 chromeos-base/tast-remote-tests-cros-0.0.1-r95
 chromeos-base/cros-devutils-0.0.3-r1093
 chromeos-base/tast-cmd-0.0.1-r120
 chromeos-base/ec-devutils-0.0.2-r2938
 chromeos-base/shill-client-0.0.1-r1455
 virtual/mysql-5.5
 chromeos-base/system_api-0.0.1-r3361
 chromeos-base/session_manager-client-0.0.1-r1554
 chromeos-base/metrics-0.0.1-r2825
 dev-util/cmake-3.7.2
 sys-apps/coreboot-utils-0.0.1-r3415
 chromeos-base/ec-utils-0.0.1-r4865
 chromeos-base/devserver-0.0.3-r340
'. Converting deps to package names.
ERROR   : Thu Jun 28 17:41:11 PDT 2018
ERROR   :  PGID  PPID   PID     ELAPSED     TIME %CPU COMMAND
ERROR   : Arguments of 10: ./build_packages '--board=amd64-generic' '--accept_licenses=@CHROMEOS' '--withdebugsymbols' '--skip_chroot_upgrade' '--withevents' '--eventfile=/mnt/host/source/buildbot_archive/amd64-generic-paladin/R69-10827.0.0-rc1/build-events.json' '--save_install_plan=/tmp/amd64-generic_install_plan.2705941' 'virtual/target-os' 'virtual/target-os-dev' 'virtual/target-os-test' 'virtual/target-os-factory' 'virtual/target-os-factory-shim' 'chromeos-base/autotest-all'
ERROR   : Backtrace:  (most recent call is last)
ERROR   :  build_packages:320:main(), called: die_err_trap  
ERROR   : 
ERROR   : Command failed:
ERROR   :   Command 'MOD_PKGS+=($(      equery-${FLAGS_board} list -p -o --format='$category/$name'           ${NEW_DEPS[*]}))' exited with nonzero code: 3
17:41:11: ERROR:

Comment 1 by yllin@chromium.org, Jun 29 2018 

Many builders failed to do equery list

Comment 3 by yllin@chromium.org, Jun 29 2018

Cc: jrbarnette@chromium.org namyoon@chromium.org

Comment 4 by yllin@chromium.org, Jun 29 2018

Summary: many builders fails to build_packages (was: amd64-generic-paladin:33235 failed)

Comment 5 by yllin@chromium.org, Jun 29 2018

Description: Show this description

Comment 6 Deleted

Comment 7 by yllin@chromium.org, Jun 29 2018

Owner: haddowk@chromium.org
cherry-pick this CL in my local build, and it fails: https://chromium-review.googlesource.com/c/chromiumos/overlays/portage-stable/+/1115907

error message:
Total: 6 packages (6 reinstalls), Size of downloads: 0 KiB
Skipping merge because of --pretend mode.
Found new deps: 'dev-util/cmake-3.7.2
'. Converting deps to package names.
ERROR   : Fri Jun 29 11:50:33 CST 2018
ERROR   :   PGID   PPID    PID     ELAPSED     TIME %CPU COMMAND
ERROR   :      4      4      8       01:55 00:00:00  0.1 /bin/bash ./build_packages --board=chell
ERROR   :      4      8   2691       00:00 00:00:00  0.0  \_ /bin/bash ./build_packages --board=chell
ERROR   :      4   2691   2692       00:00 00:00:00  0.0      \_ ps f -o pgid,ppid,pid,etime,cputime,%cpu,command
ERROR   : Arguments of 8: ./build_packages '--board=chell'
ERROR   : Backtrace:  (most recent call is last)
ERROR   :  build_packages:320:main(), called: die_err_trap  
ERROR   : 
ERROR   : Command failed:
ERROR   :   Command 'MOD_PKGS+=($(      equery-${FLAGS_board} list -p -o --format='$category/$name'           ${NEW_DEPS[*]}))' exited with nonzero code: 3

Comment 8 by yllin@chromium.org, Jun 29 2018

Labels: Hotlist-CrOS-Sheriffing

Comment 9 by haddowk@chromium.org, Jun 29 2018

Status: Assigned (was: Available)
So I believe the mistake was actually in another CL https://crrev.com/c/1118708 that needs to be submitted with https://crrev.com/c/1118708 but had its CQ depend wrong.

I ran another tryjob https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/buildDetails?buildbucketId=8942410167006071264 and the build packages stage has passed, I believe this confirms my theory.

Comment 11 by jrbarnette@chromium.org, Jun 29 2018

Cc: -jrbarnette@chromium.org

Comment 12 by haddowk@chromium.org, Jun 29 2018

Labels: -Pri-0 Pri-2
I am not going to try again to submit this until after I come back from vacation, I will reduce the priority for now and work with the sheriff at that time to test, I really do not understand why it works on tryjobs but fails in the CQ.

Comment 13 by haddowk@chromium.org, Aug 28

Status: Closed (was: Assigned)
The CL was submitted by vapier at a later date.
►

Sign in to add a comment