New issue
Advanced search Search tips
Note: Color blocks (like █ or █) mean that a user may not be available. Tooltip shows the reason.

Issue 832384 link

Starred by 1 user
Status: Verified
Owner:
marcochen@chromium.org
Closed: Apr 2018
Cc:
█ dianwa@chromium.org
xixuan@chromium.org
dgarr...@chromium.org
█ pbe...@chromium.org
█ jrbarnette@chromium.org
█ gu...@chromium.org
sheckylin@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

[Waterfall] soraka-pre-flight-branch Builds Failed due to chrome-src-internal not existed

Project Member Reported by marcochen@chromium.org, Apr 13 2018 
soraka pre-flight factory-soraka-10323.39.B continues to build failed and please refer to [1]. The error msg is like 

  chromeos-chrome-65.0.3325.89_rc-r1:  * set the chrome source root to /var/cache/chromeos-cache/distfiles/target/chrome-src-internal
  chromeos-chrome-65.0.3325.89_rc-r1:  * From this point onwards there is no difference 
  between 			SERVER_SOURCE and LOCAL_SOURCE, since the fetch is done
  chromeos-chrome-65.0.3325.89_rc-r1:  * /var/cache/chromeos-cache/distfiles/target/chrome-src-internal should be set here properly
  chromeos-chrome-65.0.3325.89_rc-r1:  * ERROR: chromeos-base/chromeos-chrome- 
  65.0.3325.89_rc-r1::chromiumos failed (prepare phase):
  chromeos-chrome-65.0.3325.89_rc-r1:  *   Cannot chdir to /var/cache/chromeos- 
  cache/distfiles/target/chrome-src-internal

On the other hand, soraka factory factory-soraka-10323.39.B can build successful so it should not be the problem on repos themselves. Compare the logs in build_packages stage, it seems like the different is that msg below is in factory-soraka but not in preflight.

  01:26:45: INFO: RunCommand: /b/c/cbuild/repository/chromite/bin/cros_sdk --goma_dir /b/c/goma_client --goma_client_json /creds/service_accounts/service-account-goma-client.json '--chrome_root=/b/c/cbuild/repository/.cache/distfiles/target-factory-soraka-10323.39.B/chrome-src-internal' 

[1] https://uberchromegw.corp.google.com/i/chromeos.branch/builders/soraka%20pre-flight%20factory-soraka-10323.39.B

Comment 1 by marcochen@chromium.org, Apr 13 2018

Cc: sheckylin@chromium.org pbe...@chromium.org jrbarnette@chromium.org jkop@chromium.org dianwa@chromium.org
cc Sheriff and infra deputy.

Since factory-soraka-10323.39.B can build ok, it might not be the issue of code base themselves so also cc infra deputy.

Comment 2 by jrbarnette@chromium.org, Apr 13 2018

Cc: dgarr...@chromium.org

Comment 3 by dgarr...@chromium.org, Apr 13 2018

Owner: pprabhu@chromium.org

Comment 4 by pbe...@chromium.org, Apr 16 2018

Labels: Hotlist-CrOS-Sheriffing

Comment 5 by marcochen@chromium.org, Apr 19 2018 

ping

Comment 6 by jkop@chromium.org, Apr 19 2018

Cc: -jkop@chromium.org gu...@chromium.org xixuan@chromium.org
Owner: gu...@chromium.org

Comment 7 by gu...@chromium.org, Apr 19 2018 

So far what I can tell is:
According to the build log, it says:
hromeos-chrome-65.0.3325.89_rc-r1: >>> Unpacking source...
...
chromeos-chrome-65.0.3325.89_rc-r1:  * Skipping syncing as cbuildbot ran SyncChrome for us.

But the SyncChrome was also skipped. 

************************************************************
** Start Stage SyncChrome - Thu, 19 Apr 2018 03:24:11 -0700 (PDT)
** 
** Stage that syncs Chrome sources if needed.
************************************************************
03:24:11: INFO: Running cidb query on pid 40988, repr(query) starts with <sqlalchemy.sql.expression.Update object at 0x7f4551c2bb90>
************************************************************
** Not running Stage SyncChrome
************************************************************
03:24:14: INFO: Writing metadata to /b/c/cbuild/repository/buildbot_archive/soraka-pre-flight-branch/R65-10323.39.4-rc1/partial-metadata.json.
03:24:14: INFO: Uploading metadata file /b/c/cbuild/repository/buildbot_archive/soraka-pre-flight-branch/R65-10323.39.4-rc1/partial-metadata.json now.
03:24:14: INFO: RunCommand: /b/c/cbuild/repository/.cache/common/gsutil_4.27.tar.gz/gsutil/gsutil -o 'Boto:num_retries=10' -m cp -v -- /b/c/cbuild/repository/buildbot_archive/soraka-pre-flight-branch/R65-10323.39.4-rc1/partial-metadata.json gs://chromeos-image-archive/soraka-pre-flight-branch/R65-10323.39.4-rc1/partial-metadata.json
03:24:14: INFO: RunCommand: /b/c/cbuild/repository/.cache/common/gsutil_4.27.tar.gz/gsutil/gsutil -o 'Boto:num_retries=10' -m cp -v -- /b/c/cbuild/repository/buildbot_archive/soraka-pre-flight-branch/R65-10323.39.4-rc1/UPLOADED gs://chromeos-image-archive/soraka-pre-flight-branch/R65-10323.39.4-rc1/UPLOADED
03:24:15: INFO: Writing updated metadata to database for build_id 2493109.
03:24:15: INFO: Running cidb query on pid 40988, repr(query) starts with <sqlalchemy.sql.expression.Update object at 0x7f4551c4ce50>
03:24:15: INFO: Running cidb query on pid 40988, repr(query) starts with <sqlalchemy.sql.expression.Update object at 0x7f4551c33c10>
03:24:16: INFO: Writing metadata to /b/c/cbuild/repository/buildbot_archive/soraka-pre-flight-branch/R65-10323.39.4-rc1/partial-metadata.json.
03:24:16: INFO: Uploading metadata file /b/c/cbuild/repository/buildbot_archive/soraka-pre-flight-branch/R65-10323.39.4-rc1/partial-metadata.json now.
03:24:16: INFO: RunCommand: /b/c/cbuild/repository/.cache/common/gsutil_4.27.tar.gz/gsutil/gsutil -o 'Boto:num_retries=10' -m cp -v -- /b/c/cbuild/repository/buildbot_archive/soraka-pre-flight-branch/R65-10323.39.4-rc1/partial-metadata.json gs://chromeos-image-archive/soraka-pre-flight-branch/R65-10323.39.4-rc1/partial-metadata.json
03:24:17: INFO: RunCommand: /b/c/cbuild/repository/.cache/common/gsutil_4.27.tar.gz/gsutil/gsutil -o 'Boto:num_retries=10' -m cp -v -- /b/c/cbuild/repository/buildbot_archive/soraka-pre-flight-branch/R65-10323.39.4-rc1/UPLOADED gs://chromeos-image-archive/soraka-pre-flight-branch/R65-10323.39.4-rc1/UPLOADED
03:24:17: INFO: Writing updated metadata to database for build_id 2493109.
03:24:17: INFO: Running cidb query on pid 40988, repr(query) starts with <sqlalchemy.sql.expression.Update object at 0x7f4551c4c690>
************************************************************
** Finished Stage SyncChrome - Thu, 19 Apr 2018 03:24:18 -0700 (PDT)
************************************************************
03:24:18: INFO: Running cidb query on pid 40988, repr(query) starts with <sqlalchemy.sql.expression.Insert object at 0x7f4551c4cf90>

Comment 8 by gu...@chromium.org, Apr 19 2018

Owner: marcochen@chromium.org
It should be the cause. Please check the config and don't skip SyncChrome.

Comment 9 by marcochen@chromium.org, Apr 20 2018 

re#8

I refer to [1] poppy factory branch and [2] fizz one which are all disable sync_chrome. Try to enable it first to see the result.

[1] https://chromium.googlesource.com/chromiumos/chromite/+/factory-poppy-10504.B/cbuildbot/chromeos_config.py#3945
[2] https://chromium.googlesource.com/chromiumos/chromite/+/factory-fizz-10167.B/cbuildbot/chromeos_config.py#3799
Project Member

Comment 10 by bugdroid1@chromium.org, Apr 20 2018

Labels: merge-merged-factory-soraka-10323.39.B
The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/chromite/+/73627035ad718e11c77c952e985ff5c1fd7f2902

commit 73627035ad718e11c77c952e985ff5c1fd7f2902
Author: Marco Chen <marcochen@chromium.org>
Date: Fri Apr 20 01:34:05 2018

Soraka: enable sync_chrome for pre-flight build.

BUG= chromium:832384 
TEST=None

Change-Id: Idc714767c7b2b94632a5a99b50c9dc442d5d559c
Reviewed-on: https://chromium-review.googlesource.com/1020683
Reviewed-by: Marco Chen <marcochen@chromium.org>
Commit-Queue: Marco Chen <marcochen@chromium.org>
Tested-by: Marco Chen <marcochen@chromium.org>

[modify] https://crrev.com/73627035ad718e11c77c952e985ff5c1fd7f2902/cbuildbot/config_dump.json
[modify] https://crrev.com/73627035ad718e11c77c952e985ff5c1fd7f2902/cbuildbot/chromeos_config.py

Comment 11 by marcochen@chromium.org, Apr 20 2018

Status: Verified (was: Untriaged)
It works and thanks.
►

Sign in to add a comment