triage for branch builders failures |
||||
Issue descriptionSince Chrome OS requires branches to be long lived and continuously working, in order to: * support deploying security fixes in firmware quickly * support new RO for updated AVL components. * support RMA shim updates throughout the life of the project * support follower devices based on the SoC family's validated factory branch. Branches have been breaking frequently, which is becoming a problem for follower devices and firmware builds. We should continuously (1/week ?) build these branches, even if no changes have been submitted, to ensure they continue functioning or have a record when the relevant infra broke. I think the easy fix here would just be to add a scheduler to kick all builders once a week or so.
,
Jun 11 2018
I don't think it makes sense for sheriffs to investigate the failures, since failures found by these runs would be by definition infra issues. Is there an equivalent infra-deputy page?
,
Jun 11 2018
There's no current capability to do pages: we're building that as a part of CI 2020 with a current anticipated delivery date of Q4.
,
Jun 11 2018
No, like a web page document =) I don't think anyone needs to be paged for weekly background branch builder failures. It's great that these builders are running already though.
,
Jun 11 2018
,
Jun 11 2018
Biggest issue we face with that is that we have no way of knowing which branches are no longer relevant to the business. If we had a way of recording that or finding an owner of the branch when it fails, that would make this more possible.
,
Jun 11 2018
That's a good point. Would be worthwhile to purge extra branches at some point. However, most firmware or factory branches that match shipped, non-EOL products are still needed. They don't have owners, or maintainers that could cover for infra issues, other than the infra team. Of course anyone checking things into the branch in situations where it's generating releases is responsible for not breaking it, but otherwise it's expected to continue working for the life of the product so long as no changes have been checked in.
,
Oct 8
This was escalated as an SIE Infra request. However, I don't see an action item here.
,
Oct 12
Removing Infra labels, this is not an infra request. Please re-categorize as appropriate. |
||||
►
Sign in to add a comment |
||||
Comment 1 by jclinton@chromium.org
, Jun 11 2018