To speed up test try jobs, trigger swarming tasks earlier and monitor tasks when ready to run test.
The following revision refers to this bug: https://chromium.googlesource.com/infra/infra.git/+/668b1e3f1018f5e9493a36dc12686dfe67e1d4c0 commit 668b1e3f1018f5e9493a36dc12686dfe67e1d4c0 Author: chanli <chanli@chromium.org> Date: Wed Jul 13 00:53:56 2016 [Findit] Trigger swarming tasks after detech_first_faliure_pipeline BUG= 627298 Review-Url: https://codereview.chromium.org/2139093002 [modify] https://crrev.com/668b1e3f1018f5e9493a36dc12686dfe67e1d4c0/appengine/findit/model/wf_analysis.py [modify] https://crrev.com/668b1e3f1018f5e9493a36dc12686dfe67e1d4c0/appengine/findit/waterfall/analyze_build_failure_pipeline.py [modify] https://crrev.com/668b1e3f1018f5e9493a36dc12686dfe67e1d4c0/appengine/findit/waterfall/detect_first_failure_pipeline.py [modify] https://crrev.com/668b1e3f1018f5e9493a36dc12686dfe67e1d4c0/appengine/findit/waterfall/process_swarming_task_result_pipeline.py [modify] https://crrev.com/668b1e3f1018f5e9493a36dc12686dfe67e1d4c0/appengine/findit/waterfall/swarming_tasks_to_try_job_pipeline.py [modify] https://crrev.com/668b1e3f1018f5e9493a36dc12686dfe67e1d4c0/appengine/findit/waterfall/test/detect_first_failure_pipeline_test.py [modify] https://crrev.com/668b1e3f1018f5e9493a36dc12686dfe67e1d4c0/appengine/findit/waterfall/test/process_swarming_task_result_pipeline_test.py [modify] https://crrev.com/668b1e3f1018f5e9493a36dc12686dfe67e1d4c0/appengine/findit/waterfall/test/swarming_tasks_to_try_job_pipeline_test.py [add] https://crrev.com/668b1e3f1018f5e9493a36dc12686dfe67e1d4c0/appengine/findit/waterfall/test/trigger_swarming_tasks_pipeline_test.py [modify] https://crrev.com/668b1e3f1018f5e9493a36dc12686dfe67e1d4c0/appengine/findit/waterfall/test/try_job_util_test.py [add] https://crrev.com/668b1e3f1018f5e9493a36dc12686dfe67e1d4c0/appengine/findit/waterfall/trigger_swarming_tasks_pipeline.py [modify] https://crrev.com/668b1e3f1018f5e9493a36dc12686dfe67e1d4c0/appengine/findit/waterfall/try_job_util.py
The following revision refers to this bug: https://chromium.googlesource.com/infra/infra.git/+/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1 commit 41875d7adbe20d8c9adeaaa7b47000cc8804d5d1 Author: chanli <chanli@chromium.org> Date: Fri Aug 12 23:23:34 2016 [Findit] Refactor Findit pipeline. 1. Merge pipelines under the same root pipeline and remove some unused pipelines 2. For test try jobs, trigger swarming tasks earlier Example try jobs after this refactor: Compile: https://chanli-dot-findit-for-me.appspot.com/waterfall/build-failure?url=https://build.chromium.org/p/chromium.memory/builders/Linux%20Chromium%20OS%20ASan%20LSan%20Builder/builds/26425 Test: https://chanli-dot-findit-for-me.appspot.com/waterfall/build-failure?url=https://build.chromium.org/p/chromium.win/builders/Win7%20Tests%20(1)/builds/54707 Design doc (Under development): https://docs.google.com/a/google.com/document/d/1QzkpoJT_XrN0cwMXPYjDMXpJfNNYH7-rFFhSaCV7RjY/edit?usp=sharing BUG= 632121 , 627298 Review-Url: https://codereview.chromium.org/2187763004 [modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/model/test/wf_swarming_task_test.py [modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/model/wf_swarming_task.py [modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/analyze_build_failure_pipeline.py [modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/identify_try_job_culprit_pipeline.py [modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/monitor_try_job_pipeline.py [modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/process_swarming_task_result_pipeline.py [delete] https://crrev.com/004cf1209f4147996ef78cc3249ed58ba6ea7d54/appengine/findit/waterfall/run_try_job_for_reliable_failure_pipeline.py [add] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/schedule_compile_try_job_pipeline.py [add] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/schedule_test_try_job_pipeline.py [modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/schedule_try_job_pipeline.py [modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/start_try_job_on_demand_pipeline.py [delete] https://crrev.com/004cf1209f4147996ef78cc3249ed58ba6ea7d54/appengine/findit/waterfall/swarming_tasks_to_try_job_pipeline.py [modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/analyze_build_failure_pipeline_test.py [modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/identify_try_job_culprit_pipeline_test.py [modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/monitor_try_job_pipeline_test.py [modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/process_swarming_task_result_pipeline_test.py [delete] https://crrev.com/004cf1209f4147996ef78cc3249ed58ba6ea7d54/appengine/findit/waterfall/test/run_try_job_for_reliable_failure_pipeline_test.py [add] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/schedule_compile_try_job_pipeline_test.py [add] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/schedule_test_try_job_pipeline_test.py [modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/schedule_try_job_pipeline_test.py [modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/start_try_job_on_demand_pipeline_test.py [delete] https://crrev.com/004cf1209f4147996ef78cc3249ed58ba6ea7d54/appengine/findit/waterfall/test/swarming_tasks_to_try_job_pipeline_test.py [delete] https://crrev.com/004cf1209f4147996ef78cc3249ed58ba6ea7d54/appengine/findit/waterfall/test/try_job_pipeline_test.py [modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/test/try_job_util_test.py [delete] https://crrev.com/004cf1209f4147996ef78cc3249ed58ba6ea7d54/appengine/findit/waterfall/try_job_pipeline.py [delete] https://crrev.com/004cf1209f4147996ef78cc3249ed58ba6ea7d54/appengine/findit/waterfall/try_job_type.py [modify] https://crrev.com/41875d7adbe20d8c9adeaaa7b47000cc8804d5d1/appengine/findit/waterfall/try_job_util.py
Comment 1 by bugdroid1@chromium.org
, Jul 13 2016