New issue
Advanced search Search tips

Issue 888810 link

Starred by 3 users

Issue metadata

Status: Assigned
Owner:
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Linux
Pri: 2
Type: Bug



Sign in to add a comment

rename mac-rel, mac_chromium_rel_ng et al.

Project Member Reported by martiniss@chromium.org, Sep 25

Issue description

https://pantheon.corp.google.com/storage/browser/chromium-layout-test-archives/linux_chromium_rel_ng/194147/?project=chromium-archive is an example

It looks like, at some point in 2016, some layout tests were uploaded which have build numbers we're re-using now, or something?

At the time of this issue being created, that build hadn't run. https://ci.chromium.org/p/chromium/builders/luci.chromium.try/linux_chromium_rel_ng/194147 would 404. But, there are still files in that directory.

I don't know if this will throw things off, but it's at least surprising for me.
 
I suppose it's possible, though I don't know why we would've done that.

This is "easily" fixed by changing the builder name :)
linux-rel??
I'm more worried if this is something widespread or just isolated to this builder. I can change the name, and maybe we should. 
We should change the name (yes, to linux-rel) regardless of this issue, but the fear of us having colliding build numbers is legit.

It might be worth poking around a bit to see if we can figure out how widespread that is.
Owner: martiniss@chromium.org
Status: Assigned (was: Unconfirmed)
Stephen, do you mind handling both the investigation & the rename?
I did some digging, and it looks like this mainly affects the builders we've had for a long time:

mac_chromium_rel_ng has bad value at 148244
linux_chromium_rel_ng has bad value at 194884
win7_chromium_rel_ng has bad value at 92922

These are builds which I verified using gsutil to have very old results json files (did this with a small script).

So I guess we rename those to....

mac-rel
linux-rel
win7-rel

? Are those descriptive enough names? Do we need to add anything else?

I'm worried the rename will break all sorts of little scripts. Will send out PSAs and dig around in code search.
Are there a lot of collisions with "old" values, or just a few?

If you were to follow the bit.ly/chromium-build-naming doc, that is the names you'd get. Given the *very* high visibility of these three builders in particular, it's probably worth doing another pass over that doc to make sure we don't want to change anything again. I know there are a few open items that I've wanted to address.

So, maybe give me this afternoon to do that, and then we can double-check and move forward?
Owner: dpranke@chromium.org
SGTM

I'll assign to you for now. When you're done thinking about the names, re-assign to me.
Okay, I'm not going to get to this today.

If I don't get to this tomorrow, let's just go ahead with those names.
Hm, yes, good catch. More evidence for the theory that we might want to change things in the naming doc :).
These names would be in luci.chromium.try; there's already some precedent for duplicated names across buckets. I've done it for the jumbo builders: https://ci.chromium.org/search?q=linux-jumbo-rel


In retrospect, the builders on the "chromium" waterfall should've been named with either "clobber" or "archive" in them, e.g., linux-archive-rel, since that's the main distinction between them and linux_chromium_rel_ng.

"archive" is probably better, since the existing mirrored tryjobs have "archive" in the  name.
Cc: -dpranke@google.com dpranke@chromium.org
Owner: martiniss@chromium.org
Summary: rename mac-rel, mac_chromium_rel_ng et al. (was: Stale layout test results in cloud storage)
@martiniss - bouncing back to you to rename the chromium waterfall bots, if that's okay?

Updating the title to "rename mac-rel, mac_chromium_rel_ng et al"
Ok, I'll rename the builders. Here's the changes I'm going to make:

* mac-rel -> mac-archive-rel
* mac_chromium_rel_ng -> mac-rel
* win{,32}-rel -> win{,32}-archive-rel
* win7_chromium_rel_ng -> win7-rel
* linux-rel -> linux-archive-rel
* linux_chromium_rel_ng -> linux-rel

win7-rel seems a bit weird to me, maybe just cause we don't have numbers in the OS name anywhere else. 
Any objections to this plan?
I think win7-rel is fine, because I think we'll end up with win10-rel, mac10.14-rel, etc at some point.
Labels: -Pri-3 Pri-2
Ok. Plan is as follows:

1. Send out PSA to chromium-dev (or infra-dev? both?) announcing change
2. Land CL in tools/build to add duplicate configs for the new builder names
3. Land internal CL to make bots powering the builders advertise both builder names.
4. Land CL in chromium/src to rename builders. Will probably do this off peak MTV time, since I think there will be some breakage, as different LUCI services pick up configs at different speeds.
5. Cleanup tools/build configs

I'm going to also rename the android bots, and also make sure to rename the debug versions of these bots. So, revised list:

* android-{rel,dbg} -> android-archive-{rel,dbg}
* mac-{rel,dbg} -> mac-archive-{rel,dbg}
* mac_chromium_rel_ng -> mac-rel
* win{,32}-{rel,dbg} -> win{,32}-archive-{rel,dbg}
* win7_chromium_rel_ng -> win7-rel
* linux-{rel,dbg} -> linux-archive-{rel,dbg}
* linux_chromium_rel_ng -> linux-rel
Should I include the other windows trybots, like win_chromium_x64_rel_ng, win10_chromium_x64_rel_ng, win10_chromium_x64_dbg_ng?
I would probably not try to do everything all at once, if that's what you're asking.

However, the more builders you want to rename overall, the better by me :).
I would agree that builders should be renamed gradually, though announced all at once. I would definitely announce to chromium-dev. I'm not sure the folks who are on infra-dev and not chromium-dev would care.

Names all SGTM, and agree that the more, the merrier
Project Member

Comment 22 by bugdroid1@chromium.org, Nov 15

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/infradata/config/+/59197dcd9b5605d60d2c48a90a09dfdcc5c98756

commit 59197dcd9b5605d60d2c48a90a09dfdcc5c98756
Author: Stephen Martinis <martiniss@google.com>
Date: Thu Nov 15 18:15:37 2018

I'm going to go with the list in #18. That's what landed in #22. Can rename more later.

I'll draft up an email and send to chromium-dev.
The flakiness dashboard currently stores data by builder name, will that data be migrated so we won't lose this historical information?
Cc: seanmccullough@chromium.org
cc-ing sean; is it possible to migrate it? I don't think so....

How much of an impact would this have? Would it matter after a day or two?
Cc: e...@chromium.org
I guess it wouldn't be too bad after a day or two... just unfortunate
(cc'd eae because he may also have opinions on the flakiness dashboard)
> I guess it wouldn't be too bad after a day or two... just unfortunate

Yeah, this is a long-standing limitation of the way the current flakiness dashboard works. It's something I'd expect us to fix when we replace it (hopefully next year), but not before then. In the meantime, I don't think this limitation should keep us from renaming builders.
I'm working on renaming these. I'm going to keep the old builders around in buildbucket, so that existing links to builds on these builders don't break. I'll delete them in Q2 2019 (or maybe earlier, depending on how much usage they see).
I'm thinking of adding something to milo to note that builders have been renamed. I'll discuss this more with the team in our team meeting on Thursday.
Project Member

Comment 31 by bugdroid1@chromium.org, Dec 4

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/f11883f1961a13fa97ef3a27c0d121e5a266001c

commit f11883f1961a13fa97ef3a27c0d121e5a266001c
Author: Stephen Martinis <martiniss@chromium.org>
Date: Tue Dec 04 19:47:52 2018

Add renamed CQ builders

This CL adds new builders with the new names of 3 CQ bots. The old
builders will be kept around for a bit, so that old links don't break.

This CL shouldn't change anything. The real change will happen when
cq.cfg changes to point at these builders.

Bug: 888810
Change-Id: I57cd40ddb6bac1fb9b0d2b2cc24ea7f16e68aa67
Reviewed-on: https://chromium-review.googlesource.com/c/1357657
Commit-Queue: Stephen Martinis <martiniss@chromium.org>
Reviewed-by: Andrii Shyshkalov <tandrii@chromium.org>
Reviewed-by: John Budorick <jbudorick@chromium.org>
Cr-Commit-Position: refs/heads/master@{#613656}
[modify] https://crrev.com/f11883f1961a13fa97ef3a27c0d121e5a266001c/infra/config/global/cr-buildbucket.cfg
[modify] https://crrev.com/f11883f1961a13fa97ef3a27c0d121e5a266001c/infra/config/global/luci-milo.cfg

Project Member

Comment 32 by bugdroid1@chromium.org, Jan 18 (5 days ago)

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build/+/90407f75042051417f2c2220e922a118be47d5e7

commit 90407f75042051417f2c2220e922a118be47d5e7
Author: Stephen Martinis <martiniss@chromium.org>
Date: Fri Jan 18 00:34:04 2019

Add renamed CQ bot configuration

Also updates existing references to point to these.

Bug: 888810
Change-Id: I55991d91eeb3f0f235028cbb73da79063334bd0b
Reviewed-on: https://chromium-review.googlesource.com/c/1404106
Commit-Queue: Stephen Martinis <martiniss@chromium.org>
Reviewed-by: John Budorick <jbudorick@chromium.org>

[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/invalid_results.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/tests/api/run_tests_on_tryserver.expected/enable_retry_with_patch_succeed_after_deapply.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/tests/api/compile_specific_targets.py
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/tests/api/run_tests_on_tryserver.expected/enable_retry_with_patch_invalid_test_results.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/compile_because_of_analyze_with_filtered_compile_targets_exclude_all.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/tests/api/compile_specific_targets.expected/failure_tryserver.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/chromium_gpu.py
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/swarming_test_with_priority_expiration_and_timeout.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/dynamic_isolated_script_test_on_trybot_passing.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/tests/api/wrap_chromium_tests.py
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/tests/api/run_tests_on_tryserver.expected/enable_retry_with_patch_recipes.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/compile_because_of_analyze_with_filtered_compile_targets.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/swarming_trigger_failure.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.py
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/tests/api/run_tests_on_tryserver.expected/nonzero_exit_code_no_gtest_output.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/swarmed_layout_tests_too_many_failures_for_retcode.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/compile_because_of_analyze_with_filtered_tests.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/tests/api/trybot_steps.expected/no_compile.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/swarming_missing_isolated.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/swarming_basic_try_job.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/script_test_with_overridden_compile_targets.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/led_recipes_tester.py
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/compile_failure_without_patch_deapply_fn.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/swarmed_webkit_tests_unexpected_error.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/swarming_test_failure_no_patch_deapplication.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/swarming_basic_cq.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/no_compile_because_of_analyze.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/use_webrtc_patch_on_chromium_trybot_compile_failure.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/tests/api/trybot_steps.expected/no_compile_no_source.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/dynamic_isolated_script_test_on_trybot_failing.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/compile_because_of_analyze.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/tests/api/run_tests_on_tryserver.py
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/compile_failure_without_patch_ng.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/led_recipes_tester.expected/basic.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/trybots.py
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/tests/api/trybot_steps.expected/basic.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/tests/api/runhooks.py
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/compile_failure_ng.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/chromium_recipe.md
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/dynamic_swarmed_isolated_script_test_failure_no_result_json.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/chromium_linux.py
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/swarmed_webkit_tests_interrupted.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/tests/api/run_tests_on_tryserver.expected/basic.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/tests/api/deapply_patch.py
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/tests/api/deapply_patch.expected/basic.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/use_v8_patch_on_chromium_trybot.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/tests/masters_recipes_test.py
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/dynamic_isolated_script_test_with_args_on_trybot.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/process_dumps_failure.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/compile_failure_infra.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/tests/api/trybot_steps.py
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/use_webrtc_patch_on_chromium_trybot.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipe_modules/chromium_tests/tests/api/run_tests_on_tryserver.expected/disable_deapply_patch_affected_files.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/swarming_test_failure.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/compile_because_of_analyze_matching_exclusion.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/led_recipes_tester.expected/recipe_roller.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/led_recipes_tester.expected/manual_roll_with_changes.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/unittests/remote_run_test_disabled.py
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/analyze_finds_invalid_target.json
[modify] https://crrev.com/90407f75042051417f2c2220e922a118be47d5e7/scripts/slave/recipes/chromium_trybot.expected/use_skia_patch_on_chromium_trybot.json

Project Member

Comment 33 by bugdroid1@chromium.org, Jan 18 (4 days ago)

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/9b93ba905cb5953410b7391831f595346a403aad

commit 9b93ba905cb5953410b7391831f595346a403aad
Author: Stephen Martinis <martiniss@chromium.org>
Date: Fri Jan 18 23:50:44 2019

Add new CQ bot configs to mb_config.pyl

Bug: 888810
Change-Id: Iaf4fb6cbf6823ef540eadf71c531ef3304ee7a07
Reviewed-on: https://chromium-review.googlesource.com/c/1423345
Commit-Queue: Stephen Martinis <martiniss@chromium.org>
Commit-Queue: Ben Pastene <bpastene@chromium.org>
Auto-Submit: Stephen Martinis <martiniss@chromium.org>
Reviewed-by: Ben Pastene <bpastene@chromium.org>
Cr-Commit-Position: refs/heads/master@{#624361}
[modify] https://crrev.com/9b93ba905cb5953410b7391831f595346a403aad/tools/mb/mb_config.pyl

Sign in to add a comment