New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 632121 link

Starred by 2 users

Issue metadata

Status: Verified
Owner:
Closed: Aug 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Feature



Sign in to add a comment

[Findit] Refactor Findit pipelines

Project Member Reported by chanli@chromium.org, Jul 27 2016

Issue description

Refactor Findit pipelines to make it easier to debug and extend.
 
Project Member

Comment 1 by bugdroid1@chromium.org, Aug 12 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/infra.git/+/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1

commit 41875d7adbe20d8c9adeaaa7b47000cc8804d5d1
Author: chanli <chanli@chromium.org>
Date: Fri Aug 12 23:23:34 2016

[Findit] Refactor Findit pipeline.

1. Merge pipelines under the same root pipeline and remove some unused pipelines
2. For test try jobs, trigger swarming tasks earlier

Example try jobs after this refactor:
Compile:
https://chanli-dot-findit-for-me.appspot.com/waterfall/build-failure?url=https://build.chromium.org/p/chromium.memory/builders/Linux%20Chromium%20OS%20ASan%20LSan%20Builder/builds/26425

Test:
https://chanli-dot-findit-for-me.appspot.com/waterfall/build-failure?url=https://build.chromium.org/p/chromium.win/builders/Win7%20Tests%20(1)/builds/54707

Design doc (Under development):
https://docs.google.com/a/google.com/document/d/1QzkpoJT_XrN0cwMXPYjDMXpJfNNYH7-rFFhSaCV7RjY/edit?usp=sharing

BUG= 632121 ,  627298 

Review-Url: https://codereview.chromium.org/2187763004

[modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/model/test/wf_swarming_task_test.py
[modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/model/wf_swarming_task.py
[modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/analyze_build_failure_pipeline.py
[modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/identify_try_job_culprit_pipeline.py
[modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/monitor_try_job_pipeline.py
[modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/process_swarming_task_result_pipeline.py
[delete] https://crrev.com/004cf1209f4147996ef78cc3249ed58ba6ea7d54/appengine/findit/waterfall/run_try_job_for_reliable_failure_pipeline.py
[add] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/schedule_compile_try_job_pipeline.py
[add] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/schedule_test_try_job_pipeline.py
[modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/schedule_try_job_pipeline.py
[modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/start_try_job_on_demand_pipeline.py
[delete] https://crrev.com/004cf1209f4147996ef78cc3249ed58ba6ea7d54/appengine/findit/waterfall/swarming_tasks_to_try_job_pipeline.py
[modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/analyze_build_failure_pipeline_test.py
[modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/identify_try_job_culprit_pipeline_test.py
[modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/monitor_try_job_pipeline_test.py
[modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/process_swarming_task_result_pipeline_test.py
[delete] https://crrev.com/004cf1209f4147996ef78cc3249ed58ba6ea7d54/appengine/findit/waterfall/test/run_try_job_for_reliable_failure_pipeline_test.py
[add] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/schedule_compile_try_job_pipeline_test.py
[add] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/schedule_test_try_job_pipeline_test.py
[modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/schedule_try_job_pipeline_test.py
[modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/start_try_job_on_demand_pipeline_test.py
[delete] https://crrev.com/004cf1209f4147996ef78cc3249ed58ba6ea7d54/appengine/findit/waterfall/test/swarming_tasks_to_try_job_pipeline_test.py
[delete] https://crrev.com/004cf1209f4147996ef78cc3249ed58ba6ea7d54/appengine/findit/waterfall/test/try_job_pipeline_test.py
[modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/try_job_util_test.py
[delete] https://crrev.com/004cf1209f4147996ef78cc3249ed58ba6ea7d54/appengine/findit/waterfall/try_job_pipeline.py
[delete] https://crrev.com/004cf1209f4147996ef78cc3249ed58ba6ea7d54/appengine/findit/waterfall/try_job_type.py
[modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/try_job_util.py

Comment 2 by chanli@chromium.org, Aug 19 2016

Status: Verified (was: Assigned)

Sign in to add a comment