New issue
Advanced search Search tips

Issue 818020 link

Starred by 1 user

Issue metadata

Status: Started
Owner:
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 2
Type: ----
OKR



Sign in to add a comment

New a service to estimate flakiness of tests.

Project Member Reported by xixuan@chromium.org, Mar 1 2018

Issue description

Create a GAE service to estimate flakiness of tests.
 
Project Member

Comment 1 by bugdroid1@chromium.org, Mar 14 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/infra/test_analyzer/+/08a56c4174caca3f43e3fdbd5262e5b6a25be6b1

commit 08a56c4174caca3f43e3fdbd5262e5b6a25be6b1
Author: Xixuan Wu <xixuan@chromium.org>
Date: Wed Mar 14 21:24:33 2018

test_analyzer: Add initial setups & bigquery connections.

BUG=chromium:818020
TEST=Ran 'pipenv run pytest test_analyzer/integration_test'.
Ran 'bin/run_tests'.

Change-Id: I7665a5db69be4ac6a930ce0eb5648be8ff0f6a39
Reviewed-on: https://chromium-review.googlesource.com/944621
Tested-by: Xixuan Wu <xixuan@chromium.org>
Reviewed-by: Shuhei Takahashi <nya@chromium.org>
Reviewed-by: Paul Hobbs <phobbs@google.com>
Commit-Queue: Xixuan Wu <xixuan@chromium.org>

[add] https://crrev.com/08a56c4174caca3f43e3fdbd5262e5b6a25be6b1/Pipfile.lock
[add] https://crrev.com/08a56c4174caca3f43e3fdbd5262e5b6a25be6b1/pytest.ini
[add] https://crrev.com/08a56c4174caca3f43e3fdbd5262e5b6a25be6b1/test_analyzer/__init__.py
[add] https://crrev.com/08a56c4174caca3f43e3fdbd5262e5b6a25be6b1/test_analyzer/bigquery_client.py
[add] https://crrev.com/08a56c4174caca3f43e3fdbd5262e5b6a25be6b1/test_analyzer/configs.py
[add] https://crrev.com/08a56c4174caca3f43e3fdbd5262e5b6a25be6b1/.gitignore
[add] https://crrev.com/08a56c4174caca3f43e3fdbd5262e5b6a25be6b1/bin/run_tests
[add] https://crrev.com/08a56c4174caca3f43e3fdbd5262e5b6a25be6b1/test_analyzer/integration_test/bigquery_client_test.py
[add] https://crrev.com/08a56c4174caca3f43e3fdbd5262e5b6a25be6b1/test_analyzer/integration_test/__init__.py
[add] https://crrev.com/08a56c4174caca3f43e3fdbd5262e5b6a25be6b1/PRESUBMIT.cfg
[add] https://crrev.com/08a56c4174caca3f43e3fdbd5262e5b6a25be6b1/Pipfile
[add] https://crrev.com/08a56c4174caca3f43e3fdbd5262e5b6a25be6b1/chromite
[add] https://crrev.com/08a56c4174caca3f43e3fdbd5262e5b6a25be6b1/README.md

Project Member

Comment 2 by bugdroid1@chromium.org, Mar 15 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/infra/test_analyzer/+/fc7cae5ca68cc6db6a45a673ac1d74a082877a40

commit fc7cae5ca68cc6db6a45a673ac1d74a082877a40
Author: Xixuan Wu <xixuan@chromium.org>
Date: Thu Mar 15 18:13:50 2018

test_analyzer: separate running_unittests & integration tests.

BUG=chromium:818020
TEST=Ran bin/run_unittests, bin/run_integration_tests.

Change-Id: Ief4fba5692362fb3aa93747f8bd070e61c8fe439
Reviewed-on: https://chromium-review.googlesource.com/963547
Tested-by: Xixuan Wu <xixuan@chromium.org>
Trybot-Ready: Xixuan Wu <xixuan@chromium.org>
Reviewed-by: Shuhei Takahashi <nya@chromium.org>
Reviewed-by: Paul Hobbs <phobbs@google.com>
Commit-Queue: Xixuan Wu <xixuan@chromium.org>

[rename] https://crrev.com/fc7cae5ca68cc6db6a45a673ac1d74a082877a40/bin/run_unittests
[modify] https://crrev.com/fc7cae5ca68cc6db6a45a673ac1d74a082877a40/test_analyzer/integration_test/bigquery_client_test.py
[add] https://crrev.com/fc7cae5ca68cc6db6a45a673ac1d74a082877a40/bin/run_integration_tests
[modify] https://crrev.com/fc7cae5ca68cc6db6a45a673ac1d74a082877a40/README.md

Cc: akes...@chromium.org
Is there a design doc about this?
Project Member

Comment 5 by bugdroid1@chromium.org, Mar 28 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/infra_virtualenv/+/c112c3ec15f5f761ad67d412fcc2b99c59e24d20

commit c112c3ec15f5f761ad67d412fcc2b99c59e24d20
Author: Xixuan Wu <xixuan@chromium.org>
Date: Tue Mar 27 19:08:14 2018

venv: add jinja2.

BUG=chromium:818020
TEST=None

Change-Id: I1b8bc8daa3358e55e91b2169265cd8198c66c579

[add] https://crrev.com/c112c3ec15f5f761ad67d412fcc2b99c59e24d20/pip_packages/Jinja2-2.10-py2.py3-none-any.whl

Project Member

Comment 7 by bugdroid1@chromium.org, Mar 29 2018

Project Member

Comment 8 by bugdroid1@chromium.org, Apr 20 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/chromite/+/63c1da634ab2111fd37624c006beb81490a14ea9

commit 63c1da634ab2111fd37624c006beb81490a14ea9
Author: Xixuan Wu <xixuan@chromium.org>
Date: Fri Apr 20 07:33:04 2018

chromite: Add deploy_appengine scripts for common use.

BUG=chromium:818020
TEST=Ran ./appengine/deploy_appengine.

Change-Id: I5b499af6551aa06658ab4bcebec058ed48d0685b
Reviewed-on: https://chromium-review.googlesource.com/982517
Commit-Ready: Xixuan Wu <xixuan@chromium.org>
Tested-by: Xixuan Wu <xixuan@chromium.org>
Reviewed-by: Xixuan Wu <xixuan@chromium.org>

[add] https://crrev.com/63c1da634ab2111fd37624c006beb81490a14ea9/appengine/deploy_appengine.py
[add] https://crrev.com/63c1da634ab2111fd37624c006beb81490a14ea9/appengine/deploy_appengine
[modify] https://crrev.com/63c1da634ab2111fd37624c006beb81490a14ea9/venv/requirements.txt

Project Member

Comment 9 by bugdroid1@chromium.org, Apr 20 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/infra/test_analyzer/+/7b0a71303075b11ce506fe6c34477a139c02236e

commit 7b0a71303075b11ce506fe6c34477a139c02236e
Author: Xixuan Wu <xixuan@chromium.org>
Date: Fri Apr 20 07:32:53 2018

flakiness analyzer: Add apis.

BUG=chromium:818020
TEST=Ran integration tests.
Ran "./bin/run_demo" for demo.
Ran "./bin/deploy_staging", "./bin/deploy_prod" to deploy.

Change-Id: If9a7fd8ffc9f84c8d0e521c1ba31f3c1e71a7d60
Reviewed-on: https://chromium-review.googlesource.com/982516
Commit-Ready: Xixuan Wu <xixuan@chromium.org>
Tested-by: Xixuan Wu <xixuan@chromium.org>
Reviewed-by: Paul Hobbs <phobbs@google.com>

[modify] https://crrev.com/7b0a71303075b11ce506fe6c34477a139c02236e/Pipfile.lock
[add] https://crrev.com/7b0a71303075b11ce506fe6c34477a139c02236e/test_analyzer/integration_test/demo_api_test.py
[add] https://crrev.com/7b0a71303075b11ce506fe6c34477a139c02236e/bin/run_demo
[add] https://crrev.com/7b0a71303075b11ce506fe6c34477a139c02236e/openapi-appengine_template.yaml
[modify] https://crrev.com/7b0a71303075b11ce506fe6c34477a139c02236e/test_analyzer/configs.py
[add] https://crrev.com/7b0a71303075b11ce506fe6c34477a139c02236e/bin/deploy_prod
[modify] https://crrev.com/7b0a71303075b11ce506fe6c34477a139c02236e/PRESUBMIT.cfg
[add] https://crrev.com/7b0a71303075b11ce506fe6c34477a139c02236e/test_analyzer/main.py
[modify] https://crrev.com/7b0a71303075b11ce506fe6c34477a139c02236e/test_analyzer/kms.py
[modify] https://crrev.com/7b0a71303075b11ce506fe6c34477a139c02236e/Pipfile
[add] https://crrev.com/7b0a71303075b11ce506fe6c34477a139c02236e/app_template.yaml
[add] https://crrev.com/7b0a71303075b11ce506fe6c34477a139c02236e/bin/deploy_staging

Project Member

Comment 10 by bugdroid1@chromium.org, Apr 20 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/babdbf381d6462fb8be2b0fafeca6e586bc68a2e

commit babdbf381d6462fb8be2b0fafeca6e586bc68a2e
Author: chromite-chromium-autoroll@skia-buildbots.google.com.iam.gserviceaccount.com <chromite-chromium-autoroll@skia-buildbots.google.com.iam.gserviceaccount.com>
Date: Fri Apr 20 09:00:16 2018

Roll src/third_party/chromite/ 328ec4e13..a46a52500 (2 commits)

https://chromium.googlesource.com/chromiumos/chromite.git/+log/328ec4e1303a..a46a525000ae

$ git log 328ec4e13..a46a52500 --date=short --no-merges --format='%ad %ae %s'
2018-04-19 bpastene chrome_committer: Add the WATCHLISTS file to the sparse checkout.
2018-03-27 xixuan chromite: Add deploy_appengine scripts for common use.

Created with:
  roll-dep src/third_party/chromite
BUG=chromium:None,chromium:818020


The AutoRoll server is located here: https://chromite-chromium-roll.skia.org

Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+/master/autoroll/README.md

If the roll is causing failures, please contact the current sheriff, who should
be CC'd on the roll, and stop the roller if necessary.


TBR=chrome-os-gardeners@chromium.org

Change-Id: I1ab7ae1e6d841cb506e72285541d2df062ad9a66
Reviewed-on: https://chromium-review.googlesource.com/1021180
Commit-Queue: Chromite Chromium Autoroll <chromite-chromium-autoroll@skia-buildbots.google.com.iam.gserviceaccount.com>
Reviewed-by: Chromite Chromium Autoroll <chromite-chromium-autoroll@skia-buildbots.google.com.iam.gserviceaccount.com>
Cr-Commit-Position: refs/heads/master@{#552288}
[modify] https://crrev.com/babdbf381d6462fb8be2b0fafeca6e586bc68a2e/DEPS

Components: -Infra>Client>ChromeOS Infra>Client>ChromeOS>Test
Labels: -okr OKR

Sign in to add a comment