New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 842279 link

Starred by 3 users

Issue metadata

Status: Verified
Owner:
Closed: May 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug



Sign in to add a comment

ci_results_archiver failed to find Table google.com:chromeos-lab:ci_results.tko_jobs20180511

Project Member Reported by nxia@chromium.org, May 11 2018

Issue description


INFO 2018-05-11 12:23:25 tko_jobs [transport.py:151] Attempting refresh to obtain initial access_token
INFO 2018-05-11 12:23:26 tko_jobs [client.py:795] Refreshing access_token
Traceback (most recent call last):
  File "/usr/local/google/home/chromeos-test/chromiumos/infra/ci_results_archiver/ci_results_archiver/main.py", line 215, in <module>
    main()
  File "/usr/local/google/home/chromeos-test/chromiumos/infra/ci_results_archiver/ci_results_archiver/main.py", line 209, in main
    _BuilderMain(table_type=options.table_type, configs=configs)
  File "/usr/local/google/home/chromeos-test/chromiumos/infra/ci_results_archiver/ci_results_archiver/main.py", line 114, in _BuilderMain
    builder.Run()
  File "/usr/local/google/home/chromeos-test/chromiumos/infra/ci_results_archiver/venv/ci_results_archiver/archive_builder.py", line 154, in Run
    table_suffixes, unexported = self._exporter.ExportNewEntries(entries)
  File "/usr/local/google/home/chromeos-test/chromiumos/infra/ci_results_archiver/venv/ci_results_archiver/bigquery_exporter.py", line 54, in ExportNewEntries
    self._ExportNewEntriesToTable(table_suffix, entries_in_date)
  File "/usr/local/google/home/chromeos-test/chromiumos/infra/ci_results_archiver/venv/ci_results_archiver/bigquery_exporter.py", line 75, in _ExportNewEntriesToTable
    new_entries)
  File "/usr/local/google/home/chromeos-test/chromiumos/infra/ci_results_archiver/venv/ci_results_archiver/utils/bigquery_tables.py", line 83, in LoadEntries
    self._bigquery_wrapper.LoadEntries(table_name, schema, entries)
  File "/usr/local/google/home/chromeos-test/chromiumos/infra/ci_results_archiver/venv/ci_results_archiver/utils/bigquery_wrapper.py", line 141, in LoadEntries
    self._MaybePatchSchema(table_name, schema)
  File "/usr/local/google/home/chromeos-test/chromiumos/infra/ci_results_archiver/venv/ci_results_archiver/utils/bigquery_wrapper.py", line 213, in _MaybePatchSchema
    table.patch(self._bigquery_client, schema=schema)
  File "/usr/local/google/home/chromeos-test/.cache/cros_venv/venv-2.7.6-9b73359f13f2cf7b6ed8f86d2c7d6ff7/local/lib/python2.7/site-packages/google/cloud/bigquery/table.py", line 612, in patch
    method='PATCH', path=self.path, data=partial)
  File "/usr/local/google/home/chromeos-test/.cache/cros_venv/venv-2.7.6-9b73359f13f2cf7b6ed8f86d2c7d6ff7/local/lib/python2.7/site-packages/google/cloud/_http.py", line 303, in api_request
    error_info=method + ' ' + url)
google.cloud.exceptions.NotFound: 404 Not found: Table google.com:chromeos-lab:ci_results.tko_jobs20180511 (PATCH https://www.googleapis.com/bigquery/v2/projects/google.com:chromeos-lab/datasets/ci_results/tables/tko_jobs20180511)
ERROR 2018-05-11 12:23:27 scheduler [base.py:131] Job "tko_jobs (trigger: interval[0:20:00], next run at: 2018-05-11 19:40:00 UTC)" raised an exception
Traceback (most recent call last):
  File "/usr/local/google/home/chromeos-test/.cache/cros_venv/venv-2.7.6-9b73359f13f2cf7b6ed8f86d2c7d6ff7/local/lib/python2.7/site-packages/apscheduler/executors/base.py", line 125, in run_job
    retval = job.func(*job.args, **job.kwargs)
  File "/usr/local/google/home/chromeos-test/chromiumos/infra/ci_results_archiver/ci_results_archiver/main.py", line 100, in _RunBuilder
    subprocess32.check_call(builder_argv, timeout=timeout.total_seconds())
  File "/usr/local/google/home/chromeos-test/.cache/cros_venv/venv-2.7.6-9b73359f13f2cf7b6ed8f86d2c7d6ff7/local/lib/python2.7/site-packages/subprocess32.py", line 602, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['/usr/local/google/home/chromeos-test/.cache/cros_venv/venv-2.7.6-9b73359f13f2cf7b6ed8f86d2c7d6ff7/bin/python', '/usr/local/google/home/chromeos-test/chromiumos/infra/ci_results_archiver/ci_results_archiver/main.py', '--config=/etc/ci_results_archiver/config.yaml', '--one-shot', '--table-type=tko_jobs']' returned non-zero exit status 1


I couldn't find the table (google.com:chromeos-lab:ci_results.tko_jobs20180511) in big query. 
 
Cc: nxia@chromium.org
Owner: nya@chromium.org
Status: Assigned (was: Untriaged)
nya, any ideas?  Is it recommended to upload to partitioned tables like this?  e.g. uploading to google.com:chromeos-lab:ci_results.tko_jobs20180511 instead of google.com:chromeos-lab:ci_results.tko_jobs
Owner: pprabhu@chromium.org
Status: Started (was: Assigned)
I'm touching ci_results_archiver. Will take a look.
Fix uploaded: https://chromium-review.googlesource.com/c/chromiumos/infra/ci_results_archiver/+/1056047

Will require a push-to-prod to take effect though :(
Project Member

Comment 4 by bugdroid1@chromium.org, May 14 2018

Status: Verified (was: Started)
#4 pushed to prod, ci_results_archiver is all caught up. stailness is also caught up.

Sign in to add a comment