New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 798425 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner: ----
Closed: Mar 2018
Cc:
Components:
EstimatedDays: 8
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

Automate bqschemaupdater

Project Member Reported by katthomas@chromium.org, Jan 2 2018

Issue description

Currently, bqschemaupdater is run manually. Because of this, there are a few problems:
* The schema that is saved in version control might not necessarily match the schema of the actual table. 
* There is no requirement that a schema is code reviewed before a table is created from it.
* bqschemaupdater must be run manually.

If we wrote a tool to automate bqschemaupdater, we should consider the following:
* The tool needs to know the path to the proto file and the ids of the associated project, dataset, and table. We could add configuration with that information for each table definition.
* The tool needs to authenticate itself for the given project. Maybe we’d use a single service account, and projects would need to give that service account permission to insert and update tables.
* Disabling running the tool manually.  
* Monitoring for table inserts/updates, with alerting as we approach or exceed limits. 


 

Comment 1 by no...@chromium.org, Jan 2 2018

> * The schema that is saved in version control might not necessarily match the schema of the actual table. 
* There is no requirement that a schema is code reviewed before a table is created from it.
* bqschemaupdater must be run manually.

these problems are ~p3 to me because we have all of them for all deployments in chrome-infra, e.g. deployments for appengine apps.
Cc: katthomas@chromium.org
Labels: -Pri-2 Pri-3
Owner: ----
Status: Available (was: Assigned)

Comment 3 by no...@chromium.org, Mar 19 2018

Status: WontFix (was: Available)
what we have is good enough

Sign in to add a comment