Code coverage: extend the test suite |
||||
Issue descriptionIt looks like there might be some other tests that we're missing in https://cs.chromium.org/chromium/src/tools/code_coverage/test_suite.txt. It would be nice to add those.
,
Aug 31
CC'ing more people who might have ideas where we can find more tests. Please share if you think we're missing anything in: https://cs.chromium.org/chromium/src/tools/code_coverage/test_suite.txt Also, does anyone think we should try running everything produced by: "gn refs out/coverage //base/test:test_support -t executable" ?
,
Sep 4
maintaining a separate text file seems like not the best way to manage this. Ideally either you'd get something like your `gn refs` call to work, or define a single "//:all_tests" target and maintain that list instead.
,
Sep 5
Thanks, Dirk! I've also talked to jbudorick@ today and we agreed that some of those targets might be broken / useless / etc. It doesn't look like any of the existing testbots is running all those things, but it might be interesting to run all of them. At least, without code coverage first, just to see how bad or good thing are.
,
Sep 6
Wondering whether it's feasible now to align this with the CQ trybot test spec. That's the direction I'd like to move to with the redesign to using Luci infra.
,
Sep 6
stgao@, that sounds good too. Could you please share (if you know) which tests the existing CQ bots are running? I think the existing test_suite was based on some of the bots, but I wonder if things have changed or we are missing anything. It still a good question though, why do we have ~400 test targets if we run only ~100 of them? Should we run more or delete some...
,
Sep 7
I don't know the details, but the test spec are in https://cs.chromium.org/chromium/src/testing/buildbot/
,
Sep 7
It might not doable if the current setup is not on Recipes.
,
Jan 3
Handing this over to Shuotao, as per c#7-c#8. It would be awesome to extend the test suite by using more or less unified set of tests instead of the existing https://cs.chromium.org/chromium/src/tools/code_coverage/test_suite.txt that was compiled mostly manually based on some testbot and inquiries from developers. |
||||
►
Sign in to add a comment |
||||
Comment 1 by bugdroid1@chromium.org
, Aug 30