New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 725096 link

Starred by 1 user

Issue metadata

Status: Assigned
Owner:
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug



Sign in to add a comment

jpeg_decode_accelerator_unittest build target not covered by trybots

Project Member Reported by glevin@chromium.org, May 22 2017

Issue description

Chrome Version: 60.0.3101.0

What steps will reproduce the problem?
(1) Make a non-compiling change to a file in the jpeg_decode_accelerator_unittest build target (e.g. media/gpu/jpeg_decode_accelerator_unittest.cc;
see https://cs.chromium.org/chromium/src/media/gpu/BUILD.gn?type=cs&q=jpeg_decode_accelerator_unittest.cc)
(2) Create a CL with this change
(3) Run trybots (CQ dry run)

What is the expected result?
Some trybot should fail

What happens instead?
All trybots pass

As an example:
https://codereview.chromium.org/2891683002 passed all trybots and was committed to repository.  However, the change to jpeg_decode_accelerator_unittest.cc didn't actually compile, and so broke the informational builders:

https://bugs.chromium.org/p/chromium/issues/detail?id=588249#c10
https://uberchromegw.corp.google.com/i/chromeos.chrome/builders/peach_pit-tot-chrome-pfq-informational/builds/6166


afakhry@, stevenjb@, ihf@ - How do we get this build target added to the appropriate trybots?
 
Cc: w...@chromium.org henryhsu@chromium.org
Labels: Hotlist-CrOS-Gardener
Owner: ihf@chromium.org
Assigning to the gardner so this doesn't get lost.

The test is part of the 'android_video_decode_accelerator_unittests' target in media/gpu, which is included in video_decode_accelerator_unittest, which has this comment:

# TODO(watk): Run this on bots. http://crbug.com/461437

+watk@

It is also included in media/media_unittests, and is part of "gn_all" (which probably isn't built anywhere), "chrome_official_builder" (if is_win), and "chromiumos_preflight" (if is_chromeos). 

You may need to dig in to which gn targets are run on which builders and update a target.

Comment 2 by w...@chromium.org, May 22 2017

I'm confused re #1. jpeg_decode_accelerator_unittest is a chromeos only test target. Did you confuse it with video_decode_accelerator_unittest perhaps? 
Cc: jcliang@chromium.org
Hmm, apologies, ignore comment #1, my I must have miss copy/pasted my search.

jpeg_decode_accelerator_unittest does not appear to be referenced elsewhere in the chromium code.

It is however referenced directly in the chromeos-chrome ebuild, which is unusual:

https://cs.corp.google.com/chromeos_public/src/third_party/chromiumos-overlay/chromeos-base/chromeos-chrome/chromeos-chrome-9999.ebuild?q=jpeg_decode_accelerator_unittest&l=693

It appears to be run by video_JpegDecodeAccelerator.py.

This is kind of unfortunate since the first time this will break is in the PFQ informational builders.

+jcliang@

I'm not sure what the right solution is here, but ihf@ has been involved in the recent discussions about trying to minimize PFQ breakage, so maybe has some thoughts on this.

Can we add jpeg_decode_accelerator_unittest.cc as a target of the following two trybots?

- chromeos_daisy_chromium_compile_only_ng
- chromeos_amd64-generic_chromium_compile_only_ng
We could. It's weird and confusing because we do not usually run Chrome unit tests in a Chrome OS environment (including Simple Chrome).

Ideally I think we should have a special target, something like "autotest_unittests", for tests that get run on a device in an autotest (even if it is just this one, but we should also check to see if there are others).

Then, adding that target, with a comment, to the simple chrome builders mentioned in comment #4 would make sense to me.

Since the original problem was that the JDA did not compile and the cq did not catch it, adding JDA as a build target would fix the issue.

We're working on adding fully functional chromeos bots to the chrome cq. Currently the chromeos bots are compile-only and do not run any chrome tests. Once the chromeos bots are set up we will have both compile and test coverage.

The "autotest_unittests" bot sounds like a good plan, but it'll probably require more effort to replicate the autotest environment in chrome lab. It can be a stretch goal once we have the chromeos bots set up.
Sure, we can fix things for just this particular instance that broke, however, here is the list of additional targets we build in the ebuild:

https://cs.corp.google.com/chromeos_public/src/third_party/chromiumos-overlay/chromeos-base/chromeos-chrome/chromeos-chrome-9999.ebuild?l=692

I was not suggesting that we attempt to run them, just add an extra GN target and build them in the simple chrome builders.

(While we do plan to run a few VMTests in the Simple Chrome builders on the Chromium waterfall, those will be kept to a minimum and we are unlikely to actually run these tests, but it definitely makes sense to build them.)

Ah, I see. Sorry I misread you in #5. Having a autotest_unittests GN target makes sense. We're actually suggesting the same approach which is to get compile coverage in the builders first.

Ultimately we'd want to run Chrome unit tests on the simple chrome builders as well with the tests running on real chromeos devices. Lacking Chrome CQ coverage has caused lots of regressions in the VDA and VEA unit tests on Chrome OS and today we usually learn the regression on the chromeos-chrome PFQ which is too late.
Project Member

Comment 9 by sheriffbot@chromium.org, May 25 2018

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Status: Assigned (was: Untriaged)
This bug has an owner, thus, it's been triaged. Changing status to "assigned".

Sign in to add a comment