New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 751272 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Feb 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Feature

Blocked on:
issue 646067



Sign in to add a comment

Move to buildbucket scheduling for as many ChromeOS builds as possible.

Project Member Reported by dgarr...@chromium.org, Aug 1 2017

Issue description

We currently use buildbot scheduling for many of our builders, which makes them invisible to new UI efforts that are based on buildbucket.

Further, before we can move to swarming, we need to replace all buildbot scheduling logic. Since we can use buildbucket to schedule both buildbot and swarming builds, we should start the scheduling change now.
 
Project Member

Comment 1 by bugdroid1@chromium.org, Aug 2 2017

Labels: merge-merged-config
The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/chromite/+/ce2282a35880ed6b61ddeaf7859cca4d2da0bad0

commit ce2282a35880ed6b61ddeaf7859cca4d2da0bad0
Author: Don Garrett <dgarrett@google.com>
Date: Wed Aug 02 17:01:27 2017

infra/config: Create luci-scheduler task for som-dispatcher.

This is intended to use the luci-scheduler to start the som-dispatcher
builder on the chromeos waterfall 5 minutes after the previous build
finishes via buildbucket.

If this works correctly, we will extend this further to use
luci-scheduler as a replacement for most (all?) builds currently
scheduled via buildbot's scheduler. This is an important step towards
fully moving away from buildbot.

BUG= chromium:751272 
TEST=None

Change-Id: Idd4586b6fde847f17468aec1c0e5f4adc68813e2
Reviewed-on: https://chromium-review.googlesource.com/597068
Reviewed-by: Vadim Shtayura <vadimsh@chromium.org>
Reviewed-by: Daniel Jacques <dnj@chromium.org>
Reviewed-by: Don Garrett <dgarrett@chromium.org>
Tested-by: Don Garrett <dgarrett@chromium.org>

[add] https://crrev.com/ce2282a35880ed6b61ddeaf7859cca4d2da0bad0/luci-scheduler.cfg

ChromeOS waterfall:

# Continuous
master-paladin
pre-cq-launcher

# 5 minute intervals
chell-incremental
lakitu-incremental
link-depthcharge-full-firmware

# Fixed schedule
master-release         # 2 AM, 10 AM, 6 PM
master-toolchain       # 7 AM
master-android-pfq     # Every 3 hours
master-nyc-android-pfq # Every 3 hours

# Triggered by new Chrome versions, currently git-triggered
master-chromium-pfq

ChromiumOS waterfall:

All of these builders are currently being triggered any ChromeOS submission. This is effectively a continuous build.

# 5 minute intervals
amd64-generic-incremental
daisy-incremenal

amd64-generic-full
arm-generic-full
daisy-full
lakitu-full
oak-full

amd64-generic-asan

chromiumos-sdk

ChromeOS Release waterfall:

Based on code inspection, I have no idea how these work.


reef-android-nyc-pre-flight-branch release-R61-9765.B
samus-chrome-pre-flight-branch release-R61-9765.B
veyron_tiger-android-mnc-pre-flight-branch release-R61-9765.B
master-release release-R61-9765.B

cyan-android-mnc-pre-flight-branch release-R60-9592.B
reef-android-nyc-pre-flight-branch release-R60-9592.B
samus-chrome-pre-flight-branch release-R60-9592.B
master-release release-R60-9592.B

samus-pre-flight-branch release-R59-9460.B
master-release release-R59-9460.B
Project Member

Comment 5 by bugdroid1@chromium.org, Sep 1 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/chromite/+/3e896acecd50171aa637a8d7e08f2ffe80db6a0c

commit 3e896acecd50171aa637a8d7e08f2ffe80db6a0c
Author: Don Garrett <dgarrett@google.com>
Date: Fri Sep 01 18:35:49 2017

infra/config: All most chromeos builders.

Add schedulers for all chromeos waterfall builders that need them,
other than master-chromium-pfq, which requires git triggering.

BUG= chromium:751272 
TEST=None

Change-Id: Ib13876f369e6a058989ec71b67b84a4fbc78a569
Reviewed-on: https://chromium-review.googlesource.com/620067
Reviewed-by: Ningning Xia <nxia@chromium.org>
Tested-by: Don Garrett <dgarrett@chromium.org>

[modify] https://crrev.com/3e896acecd50171aa637a8d7e08f2ffe80db6a0c/luci-scheduler.cfg

The new schedulers for the chromeos waterfall are in-place and paused. I'll start turning off the buildbot schedulers now.
Project Member

Comment 7 by bugdroid1@chromium.org, Sep 1 2017

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/chrome/tools/build/+/42c61b26a3c84c10b7736b083ec71be3753111b5

commit 42c61b26a3c84c10b7736b083ec71be3753111b5
Author: Don Garrett <dgarrett@google.com>
Date: Fri Sep 01 23:10:10 2017

Blockedon: 646067
Labels: CrOS-Swarming
Labels: Legoland
Status: Fixed (was: Started)
This is in place for every master/slave group, and for enough other builders to prove out the scheduling mechanism.

Other builders will be converted as they move to swarming. Declaring success.

Sign in to add a comment