New issue
Advanced search Search tips

Issue 851987 link

Starred by 5 users

Issue metadata

Status: Untriaged
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 2
Type: Bug



Sign in to add a comment

Consider testing rootFS size in the sanity suite

Reported by jrbarnette@chromium.org, Jun 12 2018

Issue description

Recently, the root FS size for reef builders went over the threshold
enforced by build_RootFilesystemSize.  The nominal culprit change
came from the Chrome sources, but reef-chrome-pfq passed.  Details
are in bug 851897.

When the image size grew in the PFQ, it wasn't detected because
reef-chrome-pfq runs only "sanity" and "bvt-arc", but not "bvt-inline".
We'd like to have earlier detection of image problems like this.
One cheap way would be just to move "build_RootFilesystemSize" to the
sanity suite to replace "dummy_Pass".

For extra credit, we could also rename "build_RootFilesystemSize" to
just "build_Sanity", and allow the test to include any static check
that's as cheap and reliable as the current FS size check.

 

Comment 1 by la...@chromium.org, Jun 12 2018

Cc: la...@chromium.org
Cc: steve...@chromium.org
Labels: Hotlist-CrOS-Gardener
Ideally we should test this in both the PFQ and on the chromium builders (i.e. chromeos-amd64-generic-rel and the arm/daisy equivalent).

> Ideally we should test this in both the PFQ and on the
> chromium builders (i.e. chromeos-amd64-generic-rel and the
> arm/daisy equivalent).

That's the idea.  The sanity suite runs just about anywhere
that we run HWTest.

An alternative (possibly better) solution would be some sort of
build/unit test that runs on every builder everywhere.  The tricky
part is that I don't know whether our current build system has the
hooks that make it easy to add such a test.

Well, I guess there are two problems we should solve:

1. Test for file size increases due to chrome changes, including changes to GN args (i.e in chromeos-amd64-generic-rel).

2. Test for board specific file size increases (pfq-informational and pfq).

One challenge, as always, is leaving some breathing room for small increases, while adding instructions in the test expectations for significant size increases (i.e. how to propose increasing the partition size to support the size increase).

Comment 5 by derat@chromium.org, Jun 12 2018

Could this be an image test (i.e. src/scripts/build_library/test_image_content.sh)?
> Could this be an image test (i.e. src/scripts/build_library/test_image_content.sh)?

Aha!  That might be just the ticket.  It looks like failing there would
actually force build_packages to fail, which would mean developers testing
changes would have a good chance to discover the problem before it hits
the CQ.  And failing to produce an image seems useful.

The one drawback is that it means that the buffer between "100% full" and
"too full to ignore" becomes less useful.  Once we get close to the limit,
any change that pushes the size over will suddenly be impossible (or at
least, hard) to build, let alone test.

Comment 7 by lannm@google.com, Jun 16 2018

Components: -OS>Systems Infra>Client>ChromeOS>CI

Sign in to add a comment