New issue
Advanced search Search tips

Issue 824386 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Mar 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug-Regression



Sign in to add a comment

Tricium service configs are not available

Project Member Reported by qyears...@chromium.org, Mar 21 2018

Issue description

Both tricium-dev and tricium-prod are not able to access the tricium service configs, which is now causing tricium to fail to start any analysis requests.

On luci-config, it shows "No config files found" for both:

 - https://luci-config.appspot.com/#/services/tricium-prod
 - https://luci-config.appspot.com/#/services/tricium-dev

According to the tricium-dev logs, this started at about 13:27:00 March 20 (yesterday) PDT. There were no changes to the tricium services or configs at that time.

Reimport yields "Reimport successful" but stil no configs.

luci-config still seems to be fetching other configs, e.g. https://luci-config.appspot.com/#/services/luci-config.

Some questions:
 - Is there a way I can validate the config locally?
 - Are other services storing service configs in datastore or elsewhere in case fetching config fails?
 
Note, around 13:06 yesterday the following were in the logs of luci-config;

path: /internal/task/luci-config/gitiles_import/services/tricium-prod
GET https://chrome-internal.googlesource.com/a/infradata/config/+log/refs/heads/master/configs/tricium-prod?n=1 failed with HTTP 404

path: /internal/task/luci-config/gitiles_import/services/tricium-dev
GET https://chrome-internal.googlesource.com/a/infradata/config/+log/refs/heads/master/configs/tricium-dev?n=1 failed with HTTP 404

But, there have been lots of successful requests to that same endpoint later on:

2018-03-21 10:45:03.979 PDT
GET https://chrome-internal.googlesource.com/a/infradata/config/+log/refs/heads/master/configs/tricium-dev?n=1 ...
2018-03-21 10:45:04.254 PDT
Rolling None => 68a5bb7cc7a9c268eaa39b5754b80a1aeeabbe9d (/base/data/home/apps/s~luci-config/backend:3399-8f40014.408446908344010897/gitiles_import.py:278) ...

Comment 2 by no...@chromium.org, Mar 21 2018

this is bug 819453. The root cause is gitiles bug. We've deployed a workaround yesterday. Please land whitespace CLs.
Status: Started (was: Assigned)
Thanks -- landing any change to the service configs will cause luci-config to fetch a new version, right? It just so happens that I had uploaded a change, so if that one looks OK, then landing that may also work.
Project Member

Comment 4 by bugdroid1@chromium.org, Mar 21 2018

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infradata/config/+/646d9e05766dce0b68da02e031cc66c5b1f9488a

commit 646d9e05766dce0b68da02e031cc66c5b1f9488a
Author: Quinten Yearsley <qyearsley@chromium.org>
Date: Wed Mar 21 21:48:06 2018

Status: Fixed (was: Started)

Sign in to add a comment