Issue 605369 link

Starred by 1 user

Issue metadata

Status:	Fixed
Owner:	█ kateso...@chromium.org Last visit > 30 days ago
Closed:	Nov 2016
Cc:	mbarbe...@chromium.org infe...@chromium.org
Components:	Tools>Test>Predator
EstimatedDays:	----
NextAction:	----
OS:	----
Pri:	2
Type:	Bug

crash: build the infra to compare analysis results of two different Findit versions for experimental purposes

Project Member Reported by st...@chromium.org, Apr 21 2016

Issue description

To experiment on small improvement to Findit, we want to have some infra to make it possible to run experiment on a selected set of crashes and compare analysis results of two different Findit versions.

We should at least compare detection rate, correctness.

Comment 1 by st...@chromium.org, May 27 2016

Blocking: 615262
Cc: -kateso...@chromium.org
Owner: kateso...@chromium.org
Status: Assigned (was: Available)

Comment 2 by st...@chromium.org, May 27 2016

Blockedon: 615252

615252 is for ClusterFuzz

Comment 3 by st...@chromium.org, May 27 2016

Later we want this to work for both ClusterFuzz and Fracas/Cracas once Findit is ported to App Engine entirely.

Comment 4 by kateso...@chromium.org, Sep 27 2016

Blockedon: 650764

Comment 5 by kateso...@chromium.org, Oct 20 2016

Blockedon: -650764 -615252

Comment 6 by kateso...@chromium.org, Oct 20 2016

Blockedon: 658027

Project Member

Comment 7 by bugdroid1@chromium.org, Oct 21 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/infra.git/+/78a5e1474f30feafe0488ed6e3b0d7791edca139

commit 78a5e1474f30feafe0488ed6e3b0d7791edca139
Author: katesonia <katesonia@chromium.org>
Date: Fri Oct 21 18:55:35 2016

[Findit] Add iterator and crash_iterator for delta test.

BUG= 605369 

Review-Url: https://chromiumcodereview.appspot.com/2391823006

[modify] https://crrev.com/78a5e1474f30feafe0488ed6e3b0d7791edca139/appengine/findit/model/crash/chrome_crash_analysis.py
[modify] https://crrev.com/78a5e1474f30feafe0488ed6e3b0d7791edca139/appengine/findit/model/crash/test/chrome_crash_analysis_test.py
[add] https://crrev.com/78a5e1474f30feafe0488ed6e3b0d7791edca139/appengine/findit/util_scripts/crash_queries/__init__.py
[add] https://crrev.com/78a5e1474f30feafe0488ed6e3b0d7791edca139/appengine/findit/util_scripts/crash_queries/crash_iterator.py
[add] https://crrev.com/78a5e1474f30feafe0488ed6e3b0d7791edca139/appengine/findit/util_scripts/crash_queries/crash_printer/__init__.py
[add] https://crrev.com/78a5e1474f30feafe0488ed6e3b0d7791edca139/appengine/findit/util_scripts/crash_queries/crash_printer/crash_printer.py
[add] https://crrev.com/78a5e1474f30feafe0488ed6e3b0d7791edca139/appengine/findit/util_scripts/crash_queries/crash_printer/print_crash.py
[add] https://crrev.com/78a5e1474f30feafe0488ed6e3b0d7791edca139/appengine/findit/util_scripts/iterator.py
[modify] https://crrev.com/78a5e1474f30feafe0488ed6e3b0d7791edca139/appengine/findit/util_scripts/remote_api.py
[add] https://crrev.com/78a5e1474f30feafe0488ed6e3b0d7791edca139/appengine/findit/util_scripts/script_util.py

Project Member

Comment 8 by bugdroid1@chromium.org, Oct 24 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/infra.git/+/6cb32efbba33bf0bd0fe76a14f80a7d5172a3bb5

commit 6cb32efbba33bf0bd0fe76a14f80a7d5172a3bb5
Author: katesonia <katesonia@chromium.org>
Date: Mon Oct 24 18:10:39 2016

[Findit] Add skeleton code for delta test script.

Skeleton code for delta test, the logic is the same as delta test in clusterfuzz.

BUG= 605369 

Review-Url: https://codereview.chromium.org/2400283003

[modify] https://crrev.com/6cb32efbba33bf0bd0fe76a14f80a7d5172a3bb5/appengine/findit/crash/findit_for_chromecrash.py
[modify] https://crrev.com/6cb32efbba33bf0bd0fe76a14f80a7d5172a3bb5/appengine/findit/crash/test/findit_for_chromecrash_test.py
[add] https://crrev.com/6cb32efbba33bf0bd0fe76a14f80a7d5172a3bb5/appengine/findit/util_scripts/crash_queries/delta_test/__init__.py
[add] https://crrev.com/6cb32efbba33bf0bd0fe76a14f80a7d5172a3bb5/appengine/findit/util_scripts/crash_queries/delta_test/delta_test.py
[add] https://crrev.com/6cb32efbba33bf0bd0fe76a14f80a7d5172a3bb5/appengine/findit/util_scripts/crash_queries/delta_test/delta_util.py
[add] https://crrev.com/6cb32efbba33bf0bd0fe76a14f80a7d5172a3bb5/appengine/findit/util_scripts/crash_queries/delta_test/run-delta-test.py
[add] https://crrev.com/6cb32efbba33bf0bd0fe76a14f80a7d5172a3bb5/appengine/findit/util_scripts/crash_queries/delta_test/run-predator.py

Project Member

Comment 9 by bugdroid1@chromium.org, Nov 11 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/infra.git/+/b8b4590396043079125412a7e3715c7867eef05f

commit b8b4590396043079125412a7e3715c7867eef05f
Author: katesonia <katesonia@chromium.org>
Date: Fri Nov 11 22:41:43 2016

[Findit] Add local git parsers.

BUG= 605369 

Review-Url: https://codereview.chromium.org/2435863003

[add] https://crrev.com/b8b4590396043079125412a7e3715c7867eef05f/appengine/findit/util_scripts/__init__.py
[modify] https://crrev.com/b8b4590396043079125412a7e3715c7867eef05f/appengine/findit/util_scripts/crash_queries/crash_iterator.py
[modify] https://crrev.com/b8b4590396043079125412a7e3715c7867eef05f/appengine/findit/util_scripts/crash_queries/delta_test/delta_test.py
[modify] https://crrev.com/b8b4590396043079125412a7e3715c7867eef05f/appengine/findit/util_scripts/crash_queries/delta_test/delta_util.py
[add] https://crrev.com/b8b4590396043079125412a7e3715c7867eef05f/appengine/findit/util_scripts/git_checkout/__init__.py
[add] https://crrev.com/b8b4590396043079125412a7e3715c7867eef05f/appengine/findit/util_scripts/git_checkout/local_git_parsers.py
[add] https://crrev.com/b8b4590396043079125412a7e3715c7867eef05f/appengine/findit/util_scripts/git_checkout/test/__init__.py
[add] https://crrev.com/b8b4590396043079125412a7e3715c7867eef05f/appengine/findit/util_scripts/git_checkout/test/local_git_parsers_test.py
[modify] https://crrev.com/b8b4590396043079125412a7e3715c7867eef05f/appengine/findit/util_scripts/iterator.py
[modify] https://crrev.com/b8b4590396043079125412a7e3715c7867eef05f/appengine/findit/util_scripts/remote_api.py
[modify] https://crrev.com/b8b4590396043079125412a7e3715c7867eef05f/appengine/findit/util_scripts/sample_remote_api_query.py

Comment 10 by st...@chromium.org, Nov 11 2016

Components: -Tools>Test>FindIt Tools>Test>FindIt>Crash

Project Member

Comment 11 by bugdroid1@chromium.org, Nov 12 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/infra.git/+/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a

commit bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a
Author: katesonia <katesonia@chromium.org>
Date: Sat Nov 12 00:23:09 2016

[Findit] Add local_git_parsers, local_git_repository

BUG= 605369 

Review-Url: https://codereview.chromium.org/2432113002

[modify] https://crrev.com/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a/appengine/findit/lib/gitiles/test/gitiles_repository_test.py
[modify] https://crrev.com/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a/appengine/findit/util_scripts/__init__.py
[add] https://crrev.com/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a/appengine/findit/util_scripts/git_checkout/local_git_repository.py
[modify] https://crrev.com/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a/appengine/findit/util_scripts/git_checkout/test/local_git_parsers_test.py
[add] https://crrev.com/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a/appengine/findit/util_scripts/git_checkout/test/local_git_repository_test.py
[modify] https://crrev.com/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a/appengine/findit/util_scripts/script_util.py
[add] https://crrev.com/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a/appengine/findit/util_scripts/test/__init__.py
[add] https://crrev.com/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a/appengine/findit/util_scripts/test/script_util_test.py

Project Member

Comment 12 by bugdroid1@chromium.org, Nov 12 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/infra.git/+/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a

commit bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a
Author: katesonia <katesonia@chromium.org>
Date: Sat Nov 12 00:23:09 2016

[Findit] Add local_git_parsers, local_git_repository

BUG= 605369 

Review-Url: https://codereview.chromium.org/2432113002

[modify] https://crrev.com/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a/appengine/findit/lib/gitiles/test/gitiles_repository_test.py
[modify] https://crrev.com/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a/appengine/findit/util_scripts/__init__.py
[add] https://crrev.com/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a/appengine/findit/util_scripts/git_checkout/local_git_repository.py
[modify] https://crrev.com/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a/appengine/findit/util_scripts/git_checkout/test/local_git_parsers_test.py
[add] https://crrev.com/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a/appengine/findit/util_scripts/git_checkout/test/local_git_repository_test.py
[modify] https://crrev.com/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a/appengine/findit/util_scripts/script_util.py
[add] https://crrev.com/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a/appengine/findit/util_scripts/test/__init__.py
[add] https://crrev.com/bc02c3473ee6c1a08f4ef97ef66f0486f870ec2a/appengine/findit/util_scripts/test/script_util_test.py

Project Member

Comment 13 by bugdroid1@chromium.org, Nov 14 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/infra.git/+/6261f070027929832dd22a109a575733e0db0aee

commit 6261f070027929832dd22a109a575733e0db0aee
Author: katesonia <katesonia@chromium.org>
Date: Mon Nov 14 21:16:25 2016

[Predator] Add local cache for get command output.

BUG= 605369 

Review-Url: https://codereview.chromium.org/2456603003

[modify] https://crrev.com/6261f070027929832dd22a109a575733e0db0aee/appengine/findit/lib/cache_decorator.py
[add] https://crrev.com/6261f070027929832dd22a109a575733e0db0aee/appengine/findit/util_scripts/local_cache.py
[modify] https://crrev.com/6261f070027929832dd22a109a575733e0db0aee/appengine/findit/util_scripts/script_util.py
[add] https://crrev.com/6261f070027929832dd22a109a575733e0db0aee/appengine/findit/util_scripts/test/local_cache_test.py
[modify] https://crrev.com/6261f070027929832dd22a109a575733e0db0aee/appengine/findit/util_scripts/test/script_util_test.py

Comment 14 by kateso...@chromium.org, Nov 17 2016

Components: Tools>Test>Predator

Project Member

Comment 15 by bugdroid1@chromium.org, Nov 17 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/infra.git/+/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309

commit ced5e9b61c62f348d5e880d1cec54f0ba1fe6309
Author: katesonia <katesonia@chromium.org>
Date: Thu Nov 17 20:36:55 2016

[Predator] Run predator.

Implement run-predator.py and make delta test script run.

BUG= 605369 

Review-Url: https://codereview.chromium.org/2432203003

[modify] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/crash/changelist_classifier.py
[modify] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/crash/crash_pipeline.py
[modify] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/crash/culprit.py
[modify] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/crash/findit.py
[modify] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/crash/test/crash_testcase.py
[modify] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/handlers/crash/crash_handler.py
[modify] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/handlers/crash/test/crash_handler_test.py
[modify] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/util_scripts/crash_queries/crash_iterator.py
[modify] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/util_scripts/crash_queries/delta_test/delta_test.py
[modify] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/util_scripts/crash_queries/delta_test/delta_util.py
[modify] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/util_scripts/crash_queries/delta_test/run-delta-test.py
[add] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/util_scripts/crash_queries/delta_test/run-predator.py
[modify] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/util_scripts/git_checkout/local_git_repository.py
[modify] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/util_scripts/git_checkout/test/local_git_repository_test.py
[modify] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/util_scripts/iterator.py
[modify] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/util_scripts/local_cache.py
[modify] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/util_scripts/script_util.py
[modify] https://crrev.com/ced5e9b61c62f348d5e880d1cec54f0ba1fe6309/appengine/findit/util_scripts/test/script_util_test.py

Comment 16 by kateso...@chromium.org, Nov 17 2016

Components: -Tools>Test>FindIt>Crash

Comment 17 by kateso...@chromium.org, Nov 22 2016

Blockedon: 658051

Comment 18 by kateso...@chromium.org, Nov 29 2016

Blockedon: -658051 -658027

Comment 19 by kateso...@chromium.org, Nov 29 2016

Status: Fixed (was: Assigned)

Comment 20 by kateso...@chromium.org, Nov 30 2016

Blocking: -615262

►

Issue 605369 link

Issue metadata

crash: build the infra to compare analysis results of two different Findit versions for experimental purposes

Issue description

Comment 1 by st...@chromium.org, May 27 2016

Comment 1 Deleted

Comment 2 by st...@chromium.org, May 27 2016

Comment 2 Deleted

Comment 3 by st...@chromium.org, May 27 2016

Comment 3 Deleted

Comment 4 by kateso...@chromium.org, Sep 27 2016

Comment 4 Deleted

Comment 5 by kateso...@chromium.org, Oct 20 2016

Comment 5 Deleted

Comment 6 by kateso...@chromium.org, Oct 20 2016

Comment 6 Deleted

Comment 7 by bugdroid1@chromium.org, Oct 21 2016

Comment 7 Deleted

Comment 8 by bugdroid1@chromium.org, Oct 24 2016

Comment 8 Deleted

Comment 9 by bugdroid1@chromium.org, Nov 11 2016

Comment 9 Deleted

Comment 10 by st...@chromium.org, Nov 11 2016

Comment 10 Deleted

Comment 11 by bugdroid1@chromium.org, Nov 12 2016

Comment 11 Deleted

Comment 12 by bugdroid1@chromium.org, Nov 12 2016

Comment 12 Deleted

Comment 13 by bugdroid1@chromium.org, Nov 14 2016

Comment 13 Deleted

Comment 14 by kateso...@chromium.org, Nov 17 2016

Comment 14 Deleted

Comment 15 by bugdroid1@chromium.org, Nov 17 2016

Comment 15 Deleted

Comment 16 by kateso...@chromium.org, Nov 17 2016

Comment 16 Deleted

Comment 17 by kateso...@chromium.org, Nov 22 2016

Comment 17 Deleted

Comment 18 by kateso...@chromium.org, Nov 29 2016

Comment 18 Deleted

Comment 19 by kateso...@chromium.org, Nov 29 2016

Comment 19 Deleted

Comment 20 by kateso...@chromium.org, Nov 30 2016

Comment 20 Deleted

Sign in to add a comment