New issue
Advanced search Search tips

Master: Migrate chromium.clang builders to luci

Project Member Reported by efoo@chromium.org, Jul 27

Issue description

This is the master bug to migrate chromium.clang builders to LUCI

Scheduled for week 2018-09-03
Client owner contact: thakis@chromium.org
Obtain approvals from thakis
 
Determined that this migration will likely need 15 32-core Linux GCE bots, 17 32-core Windows GCE bots and 4 Mac Mini (4 core bots). We have enough Mac resources but will need to file for the 32-core GCE Linux/Win bots. 

Filed the following to Infra>Labs
871631 - 15 32-core Linux GCE bots
871632 - 17 32-core Windows GCE bots

Refer to bugs for new bot IDs to use. Thanks!
The NextAction date has arrived: 2018-09-03
Project Member

Comment 3 by bugdroid1@chromium.org, Sep 7

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/ead1c24e5b0e6b883f7d7e816b15c81777fef6bb

commit ead1c24e5b0e6b883f7d7e816b15c81777fef6bb
Author: Ryan Tseng <hinoka@google.com>
Date: Fri Sep 07 20:57:41 2018

Mirror chromium.clang to LUCI

Bug: 868213
Change-Id: I1d5b577d46789cbcfd375423031b428362935320
Reviewed-on: https://chromium-review.googlesource.com/1214158
Reviewed-by: Andrii Shyshkalov <tandrii@chromium.org>
Commit-Queue: Ryan Tseng <hinoka@chromium.org>
Cr-Commit-Position: refs/heads/master@{#589624}
[modify] https://crrev.com/ead1c24e5b0e6b883f7d7e816b15c81777fef6bb/infra/config/global/cr-buildbucket.cfg
[modify] https://crrev.com/ead1c24e5b0e6b883f7d7e816b15c81777fef6bb/infra/config/global/luci-milo.cfg
[modify] https://crrev.com/ead1c24e5b0e6b883f7d7e816b15c81777fef6bb/infra/config/global/luci-scheduler.cfg

Project Member

Comment 4 by bugdroid1@chromium.org, Sep 7

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infradata/config/+/71d843ea58cc76a6b4422ca80f2115179bb30d7f

commit 71d843ea58cc76a6b4422ca80f2115179bb30d7f
Author: Ryan Tseng <hinoka@google.com>
Date: Fri Sep 07 21:41:06 2018

Project Member

Comment 5 by bugdroid1@chromium.org, Sep 7

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/8a8c0cad77038dacece05c393b4d1a232cf012e5

commit 8a8c0cad77038dacece05c393b4d1a232cf012e5
Author: Ryan Tseng <hinoka@google.com>
Date: Fri Sep 07 22:13:15 2018

Remove cores dimensions for clang

They need large core machines.
This is fine since auto_builder_dimensions is on.

Bug: 868213
TBR: tandrii
Change-Id: I3aa153e09afbd7e9ddc885441a09183f73727232
Reviewed-on: https://chromium-review.googlesource.com/1214220
Reviewed-by: Ryan Tseng <hinoka@chromium.org>
Commit-Queue: Ryan Tseng <hinoka@chromium.org>
Cr-Commit-Position: refs/heads/master@{#589683}
[modify] https://crrev.com/8a8c0cad77038dacece05c393b4d1a232cf012e5/infra/config/global/cr-buildbucket.cfg

Project Member

Comment 6 by bugdroid1@chromium.org, Sep 8

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/39542c96b769b27b3d5d92ba9dd02f0274807161

commit 39542c96b769b27b3d5d92ba9dd02f0274807161
Author: Ryan Tseng <hinoka@google.com>
Date: Sat Sep 08 00:33:45 2018

[luci-milo] include experimental for luci.chromium.clang

Bug: 868213
Change-Id: Ic990e6dd681159e7c214bfbba54a460c56bb0588
Reviewed-on: https://chromium-review.googlesource.com/1214563
Reviewed-by: Andrii Shyshkalov <tandrii@chromium.org>
Commit-Queue: Ryan Tseng <hinoka@chromium.org>
Cr-Commit-Position: refs/heads/master@{#589735}
[modify] https://crrev.com/39542c96b769b27b3d5d92ba9dd02f0274807161/infra/config/global/luci-milo.cfg

Project Member

Comment 7 by bugdroid1@chromium.org, Sep 10

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/a5b28c8d76bd3f27fd33da2814f5ea0336066b97

commit a5b28c8d76bd3f27fd33da2814f5ea0336066b97
Author: Ryan Tseng <hinoka@google.com>
Date: Mon Sep 10 18:11:50 2018

Set chromium.clang builder timeouts to 6h (from 3h)

These builders take a long time to finish.

Bug: 868213
Change-Id: I532603b76a6a724bbdf36f5d27e93223d6f5d2de
Reviewed-on: https://chromium-review.googlesource.com/1217223
Reviewed-by: Andrii Shyshkalov <tandrii@chromium.org>
Commit-Queue: Ryan Tseng <hinoka@chromium.org>
Cr-Commit-Position: refs/heads/master@{#589982}
[modify] https://crrev.com/a5b28c8d76bd3f27fd33da2814f5ea0336066b97/infra/config/global/cr-buildbucket.cfg

Project Member

Comment 8 by bugdroid1@chromium.org, Sep 11

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/36c72696810a5db2bb24913a1572c647f2bcc680

commit 36c72696810a5db2bb24913a1572c647f2bcc680
Author: Ryan Tseng <hinoka@google.com>
Date: Tue Sep 11 18:05:15 2018

Add perf_dashboard_machine_group:ChromiumClang property to clang builds

Bug: 868213
Change-Id: I94bfee9ed4840a88473a8bb055ceac34e64e6bb9
Reviewed-on: https://chromium-review.googlesource.com/1219895
Reviewed-by: Andrii Shyshkalov <tandrii@chromium.org>
Reviewed-by: Jao-ke Chin-Lee <jchinlee@chromium.org>
Commit-Queue: Ryan Tseng <hinoka@chromium.org>
Cr-Commit-Position: refs/heads/master@{#590398}
[modify] https://crrev.com/36c72696810a5db2bb24913a1572c647f2bcc680/infra/config/global/cr-buildbucket.cfg

Project Member

Comment 9 by bugdroid1@chromium.org, Sep 11

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infradata/config/+/a70a05b0112cb5727df8a4d9cde1cde270de4aa7

commit a70a05b0112cb5727df8a4d9cde1cde270de4aa7
Author: Ryan Tseng <hinoka@google.com>
Date: Tue Sep 11 23:45:16 2018

Project Member

Comment 10 by bugdroid1@chromium.org, Sep 12

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/80fb1e1aa60aa4cdc3d17a8c41225911fa068352

commit 80fb1e1aa60aa4cdc3d17a8c41225911fa068352
Author: Ryan Tseng <hinoka@google.com>
Date: Wed Sep 12 22:38:02 2018

chromium.clang: Fix coverage recipe name, increase timeout to 12h

Bug: 868213
Change-Id: I6717000d74accdd6c42ed8cc2a88d3c1f04e9bd8
Reviewed-on: https://chromium-review.googlesource.com/1222701
Commit-Queue: Ryan Tseng <hinoka@chromium.org>
Reviewed-by: Andrii Shyshkalov <tandrii@chromium.org>
Cr-Commit-Position: refs/heads/master@{#590843}
[modify] https://crrev.com/80fb1e1aa60aa4cdc3d17a8c41225911fa068352/infra/config/global/cr-buildbucket.cfg

Project Member

Comment 11 by bugdroid1@chromium.org, Sep 13

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infradata/config/+/4ef3b40f45520298ce9a29bb2bb014792177afc3

commit 4ef3b40f45520298ce9a29bb2bb014792177afc3
Author: Ryan Tseng <hinoka@google.com>
Date: Thu Sep 13 17:40:05 2018

Project Member

Comment 12 by bugdroid1@chromium.org, Sep 13

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/luci/luci-py.git/+/8d3c9e4feb6145924df78fc90f0bdbbdba8fdd3d

commit 8d3c9e4feb6145924df78fc90f0bdbbdba8fdd3d
Author: Ryan Tseng <hinoka@google.com>
Date: Thu Sep 13 22:38:45 2018

Increase max lease duration to 7d

For https://chrome-internal-review.googlesource.com/c/infradata/config/+/678692

Bug: 868213
Change-Id: I86f7f5ba6ee49be2205ea2f5fe225fb676a8df47
Reviewed-on: https://chromium-review.googlesource.com/1226030
Reviewed-by: smut <smut@google.com>
Commit-Queue: Ryan Tseng <hinoka@chromium.org>

[modify] https://crrev.com/8d3c9e4feb6145924df78fc90f0bdbbdba8fdd3d/appengine/machine_provider/handlers_endpoints.py

Project Member

Comment 13 by bugdroid1@chromium.org, Sep 14

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/luci/luci-py.git/+/0f78f2588e8f1119eb34542edc4521406d84ce49

commit 0f78f2588e8f1119eb34542edc4521406d84ce49
Author: Marc-Antoine Ruel <maruel@chromium.org>
Date: Fri Sep 14 20:19:58 2018

[machine_provider] increase max lease to 3 weeks

This is mainly to allow for tasks that have a 12 hours execution
timeout, which means that a 24h/48h lease would make the machine mostly
unusable.

There's potentially use cases for higher lease time, so let's allow more
latitude there.

R=smut@google.com

Bug: 868213
Change-Id: Ic17698092749cb3804e503e6df6015f2849667ea
Reviewed-on: https://chromium-review.googlesource.com/1227030
Commit-Queue: Marc-Antoine Ruel <maruel@chromium.org>
Reviewed-by: Ryan Tseng <hinoka@chromium.org>

[modify] https://crrev.com/0f78f2588e8f1119eb34542edc4521406d84ce49/appengine/machine_provider/handlers_endpoints.py

Project Member

Comment 14 by bugdroid1@chromium.org, Sep 14

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infradata/config/+/f8d5e35ba6ff162608711a88d2d2c71322f5dece

commit f8d5e35ba6ff162608711a88d2d2c71322f5dece
Author: Ryan Tseng <hinoka@google.com>
Date: Fri Sep 14 21:33:02 2018

Project Member

Comment 15 by bugdroid1@chromium.org, Sep 14

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/630ab6596e3620e984fe6a45e82a23b07600b5c4

commit 630ab6596e3620e984fe6a45e82a23b07600b5c4
Author: Ryan Tseng <hinoka@google.com>
Date: Fri Sep 14 21:37:33 2018

chromium.clang: Specify OS dimensions

So that builder pools can be merged in bots.cfg

Bug: 868213
Change-Id: Iea69b964ad411c15ee5c79fb67af7dff61792449
Reviewed-on: https://chromium-review.googlesource.com/1227146
Reviewed-by: Jao-ke Chin-Lee <jchinlee@chromium.org>
Reviewed-by: Andrii Shyshkalov <tandrii@chromium.org>
Commit-Queue: Ryan Tseng <hinoka@chromium.org>
Cr-Commit-Position: refs/heads/master@{#591482}
[modify] https://crrev.com/630ab6596e3620e984fe6a45e82a23b07600b5c4/infra/config/global/cr-buildbucket.cfg

Project Member

Comment 16 by bugdroid1@chromium.org, Sep 14

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infradata/config/+/1d8af44f519263ce7de84fa0f57423c16e032862

commit 1d8af44f519263ce7de84fa0f57423c16e032862
Author: Ryan Tseng <hinoka@google.com>
Date: Fri Sep 14 21:41:02 2018

Project Member

Comment 17 by bugdroid1@chromium.org, Sep 14

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infradata/config/+/1ac7d09cc4a2ea082595b18a4d4396092aef4e9e

commit 1ac7d09cc4a2ea082595b18a4d4396092aef4e9e
Author: Ryan Tseng <hinoka@google.com>
Date: Fri Sep 14 22:18:11 2018

Project Member

Comment 18 by bugdroid1@chromium.org, Sep 25

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/chrome/src-internal.git/+/89ae8c86b8c8f5b00e6a2ae18b02d768f33fdce0

commit 89ae8c86b8c8f5b00e6a2ae18b02d768f33fdce0
Author: Ryan Tseng <hinoka@google.com>
Date: Tue Sep 25 21:07:43 2018

Project Member

Comment 19 by bugdroid1@chromium.org, Sep 25

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/0111ebc7f38b3993d2c6f30902912b56abf305aa

commit 0111ebc7f38b3993d2c6f30902912b56abf305aa
Author: chromium-internal-autoroll <chromium-internal-autoroll@skia-corp.google.com.iam.gserviceaccount.com>
Date: Tue Sep 25 22:38:24 2018

Roll src-internal 29788f1ac1da..89ae8c86b8c8 (2 commits)

https://chrome-internal.googlesource.com/chrome/src-internal.git/+log/29788f1ac1da..89ae8c86b8c8


Created with:
  gclient setdep -r src-internal@89ae8c86b8c8

The AutoRoll server is located here: https://autoroll-internal.skia.org/r/src-internal-chromium-autoroll

Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+/master/autoroll/README.md

If the roll is causing failures, please contact the current sheriff, who should
be CC'd on the roll, and stop the roller if necessary.



BUG=chromium:868213
TBR=mmoss@chromium.org

Change-Id: Ib90caca078f76ca4972dbefc844348541a2ae32b
Reviewed-on: https://chromium-review.googlesource.com/1244717
Reviewed-by: chromium-internal-autoroll <chromium-internal-autoroll@skia-corp.google.com.iam.gserviceaccount.com>
Commit-Queue: chromium-internal-autoroll <chromium-internal-autoroll@skia-corp.google.com.iam.gserviceaccount.com>
Cr-Commit-Position: refs/heads/master@{#594131}
[modify] https://crrev.com/0111ebc7f38b3993d2c6f30902912b56abf305aa/DEPS

Project Member

Comment 20 by bugdroid1@chromium.org, Sep 25

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infradata/config/+/50953edf48f255dd15949362b1d5a5299f2a09c1

commit 50953edf48f255dd15949362b1d5a5299f2a09c1
Author: Ryan Tseng <hinoka@google.com>
Date: Tue Sep 25 22:43:25 2018

Project Member

Comment 21 by bugdroid1@chromium.org, Sep 26

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infradata/config/+/d7bd67fe55f8a49e0a354ab32dadd503510ee1f4

commit d7bd67fe55f8a49e0a354ab32dadd503510ee1f4
Author: Ryan Tseng <hinoka@google.com>
Date: Wed Sep 26 22:39:30 2018

Project Member

Comment 22 by bugdroid1@chromium.org, Jan 3

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/5643699462e024934d7ba14c0697488bb0c305c5

commit 5643699462e024934d7ba14c0697488bb0c305c5
Author: Eric Foo <efoo@chromium.org>
Date: Thu Jan 03 22:57:28 2019

Remove chromium.clang builders migrated to LUCI

Bug:868213
Change-Id: I26c29ffff8c07dc37d3e0a104be11406a633f7d7
Reviewed-on: https://chromium-review.googlesource.com/c/1345433
Commit-Queue: Eric Foo <efoo@chromium.org>
Reviewed-by: Nico Weber <thakis@chromium.org>

[modify] https://crrev.com/5643699462e024934d7ba14c0697488bb0c305c5/masters/master.chromium.clang/builders.pyl

Project Member

Comment 23 by bugdroid1@chromium.org, Jan 3

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infradata/master-manager/+/a46e4d7cb9a32732a19469596e43d96ca7216209

commit a46e4d7cb9a32732a19469596e43d96ca7216209
Author: Eric Foo <efoo@google.com>
Date: Thu Jan 03 23:41:09 2019

Sign in to add a comment