MessageLoopTypedTest.MetricsOnlyFromUILoops/UI_NoTaskScheduler flaked on Fuchsia/x64 |
|||
Issue descriptionIn waterfall run https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Fuchsia%20x64/14374 base_unittests failed with output including: [ RUN ] MessageLoopTypedTest.MetricsOnlyFromUILoops/UI_NoTaskScheduler ../../base/test/metrics/histogram_tester.cc:69: Failure Expected equality of these values: count Which is: 1 0 Histogram "MessageLoop.DelayedTaskQueueForUI.PendingTasksCountOnIdle" does not exist. Stack trace: #00: testing::internal::UnitTestImpl::CurrentOsStackTraceExceptTop(int) at gtest.cc:? #01: testing::internal::AssertHelper::operator=(testing::Message const&) const at gtest.cc:? #02: base::HistogramTester::ExpectTotalCount(std::__2::basic_string<char, std::__2::char_traits<char>, std::__2::allocator<char> > const&, int) const at histogram_tester.cc:? #03: base::MessageLoopTypedTest_MetricsOnlyFromUILoops_Test::TestBody() at message_loop_unittest.cc:? [ FAILED ] MessageLoopTypedTest.MetricsOnlyFromUILoops/UI_NoTaskScheduler, where GetParam() = 8-byte object <01-00 00-00 00-00 00-00> (13 ms) We had another flake with what looks like code lingering from some earlier test firing histograms unexpectedly firing in the middle of later tests ( issue 863262 ), so adding asvitkine@.
,
Jul 22
FYI: Opted to revert the CL rather than just disable the test, to leave things in a known-stable state & de-flake the CQ. If we're confident that the flake is just the test itself then we can re-land with that addressed.
,
Jul 23
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/c512937e6b6f6ec01384fbb210401aac0c7f1467 commit c512937e6b6f6ec01384fbb210401aac0c7f1467 Author: Wez <wez@chromium.org> Date: Mon Jul 23 09:56:44 2018 Revert "[MessageLoop] Remove heavy diagnosis metrics and leave others only on UI thread" This reverts commit 81626592441ad8517fb6acc8c85e4df4544222e4. Reason for revert: MetricsOnlyFromUILoops test appears to be flaky (see https://crbug.com/866299 ). Original change's description: > [MessageLoop] Remove heavy diagnosis metrics and leave others only on UI thread > > Addresses crbug.com/860801 in time for the M69 branch while keeping the > diagnosis signals which will be used to assess future improvements > (MessageLoop.DelayedTaskQueueForUI.PendingTasksCountOnIdle that is). > > Removed MessageLoop.DelayedTaskQueue.PostedDelay as we've > learnt everything we needed from this one, that is : > We now know that while 99% of tasks are posted with a delay under 30s, > 95% of users post at least one task in every portion of the 0ms-3hours > range at least once per day: > https://uma.googleplex.com/histograms?endDate=20180717&dayCount=1&histograms=MessageLoop.DelayedTaskQueue.PostedDelay&fixupData=true&uniqueUsers=true&showMax=true&filters=platform%2Ceq%2CW%2Cchannel%2Ceq%2C1%2Cisofficial%2Ceq%2CTrue&implicitFilters=isofficial > > Removed MessageLoop.ScheduledSleep.* metrics as we've also > learnt what we wanted from it, that is : > The maximum sleep a MessageLoop ever completes is 1 hour (and > even then 99% of completed sleeps are under 1 second), all > longer delays are reliably always interrupted. > Win : https://uma.googleplex.com/histograms?endDate=20180717&dayCount=1&histograms=MessageLoop.ScheduledSleep.Completed%2CMessageLoop.ScheduledSleep.Interrupted&fixupData=true&showMax=true&filters=platform%2Ceq%2CM%2Cchannel%2Ceq%2C1%2Cisofficial%2Ceq%2CTrue&implicitFilters=isofficial > Mac : https://uma.googleplex.com/histograms?endDate=20180717&dayCount=1&histograms=MessageLoop.ScheduledSleep.Completed%2CMessageLoop.ScheduledSleep.Interrupted&fixupData=true&showMax=true&filters=platform%2Ceq%2CM%2Cchannel%2Ceq%2C1%2Cisofficial%2Ceq%2CTrue&implicitFilters=isofficial > Android : https://uma.googleplex.com/histograms?endDate=20180717&dayCount=1&histograms=MessageLoop.ScheduledSleep.Completed%2CMessageLoop.ScheduledSleep.Interrupted&fixupData=true&showMax=true&filters=platform%2Ceq%2CA%2Cchannel%2Ceq%2C1%2Cisofficial%2Ceq%2CTrue&implicitFilters=isofficial > > Added a test for MessageLoop.DelayedTaskQueueForUI.PendingTasksCountOnIdle > but it appears to be broken on MacOSX (prior to this CL). Added a note > to investigate on the metric but it shouldn't block this CL which > doesn't make it worse. > > R=kylechar@chromium.org, rkaplow@chromium.org > > Bug: 860801 , 850450 , 786597 > Change-Id: I7a693886ab4e1b9c8e9fbe8a64d906a95019a609 > Reviewed-on: https://chromium-review.googlesource.com/1142589 > Commit-Queue: Gabriel Charette <gab@chromium.org> > Reviewed-by: kylechar <kylechar@chromium.org> > Reviewed-by: Robert Kaplow (OOO until 0730) <rkaplow@chromium.org> > Cr-Commit-Position: refs/heads/master@{#576686} TBR=gab@chromium.org,rkaplow@chromium.org,erikchen@chromium.org,kylechar@chromium.org Bug: 860801 , 850450 , 786597, 866299 Change-Id: I848621acf9ddbec69d72649d16a459910ffa937e Reviewed-on: https://chromium-review.googlesource.com/1146300 Commit-Queue: Wez <wez@chromium.org> Reviewed-by: Wez <wez@chromium.org> Cr-Commit-Position: refs/heads/master@{#577133} [modify] https://crrev.com/c512937e6b6f6ec01384fbb210401aac0c7f1467/base/message_loop/incoming_task_queue.cc [modify] https://crrev.com/c512937e6b6f6ec01384fbb210401aac0c7f1467/base/message_loop/message_loop.cc [modify] https://crrev.com/c512937e6b6f6ec01384fbb210401aac0c7f1467/base/message_loop/message_loop.h [modify] https://crrev.com/c512937e6b6f6ec01384fbb210401aac0c7f1467/base/message_loop/message_loop_unittest.cc [modify] https://crrev.com/c512937e6b6f6ec01384fbb210401aac0c7f1467/tools/metrics/histograms/histograms.xml
,
Jul 23
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/5c7b464ca5393510823ad2c2a0262a4eb1460c05 commit 5c7b464ca5393510823ad2c2a0262a4eb1460c05 Author: Gabriel Charette <gab@chromium.org> Date: Mon Jul 23 20:05:18 2018 Reland "[MessageLoop] Remove heavy diagnosis metrics and leave others only on UI thread" This reverts commit c512937e6b6f6ec01384fbb210401aac0c7f1467. Reason for revert: change is correct, fixed test flakiness Original change's description: > Revert "[MessageLoop] Remove heavy diagnosis metrics and leave others only on UI thread" > > This reverts commit 81626592441ad8517fb6acc8c85e4df4544222e4. > > Reason for revert: MetricsOnlyFromUILoops test appears to be flaky (see https://crbug.com/866299 ). > > Original change's description: > > [MessageLoop] Remove heavy diagnosis metrics and leave others only on UI thread > > > > Addresses crbug.com/860801 in time for the M69 branch while keeping the > > diagnosis signals which will be used to assess future improvements > > (MessageLoop.DelayedTaskQueueForUI.PendingTasksCountOnIdle that is). > > > > Removed MessageLoop.DelayedTaskQueue.PostedDelay as we've > > learnt everything we needed from this one, that is : > > We now know that while 99% of tasks are posted with a delay under 30s, > > 95% of users post at least one task in every portion of the 0ms-3hours > > range at least once per day: > > https://uma.googleplex.com/histograms?endDate=20180717&dayCount=1&histograms=MessageLoop.DelayedTaskQueue.PostedDelay&fixupData=true&uniqueUsers=true&showMax=true&filters=platform%2Ceq%2CW%2Cchannel%2Ceq%2C1%2Cisofficial%2Ceq%2CTrue&implicitFilters=isofficial > > > > Removed MessageLoop.ScheduledSleep.* metrics as we've also > > learnt what we wanted from it, that is : > > The maximum sleep a MessageLoop ever completes is 1 hour (and > > even then 99% of completed sleeps are under 1 second), all > > longer delays are reliably always interrupted. > > Win : https://uma.googleplex.com/histograms?endDate=20180717&dayCount=1&histograms=MessageLoop.ScheduledSleep.Completed%2CMessageLoop.ScheduledSleep.Interrupted&fixupData=true&showMax=true&filters=platform%2Ceq%2CM%2Cchannel%2Ceq%2C1%2Cisofficial%2Ceq%2CTrue&implicitFilters=isofficial > > Mac : https://uma.googleplex.com/histograms?endDate=20180717&dayCount=1&histograms=MessageLoop.ScheduledSleep.Completed%2CMessageLoop.ScheduledSleep.Interrupted&fixupData=true&showMax=true&filters=platform%2Ceq%2CM%2Cchannel%2Ceq%2C1%2Cisofficial%2Ceq%2CTrue&implicitFilters=isofficial > > Android : https://uma.googleplex.com/histograms?endDate=20180717&dayCount=1&histograms=MessageLoop.ScheduledSleep.Completed%2CMessageLoop.ScheduledSleep.Interrupted&fixupData=true&showMax=true&filters=platform%2Ceq%2CA%2Cchannel%2Ceq%2C1%2Cisofficial%2Ceq%2CTrue&implicitFilters=isofficial > > > > Added a test for MessageLoop.DelayedTaskQueueForUI.PendingTasksCountOnIdle > > but it appears to be broken on MacOSX (prior to this CL). Added a note > > to investigate on the metric but it shouldn't block this CL which > > doesn't make it worse. > > > > R=kylechar@chromium.org, rkaplow@chromium.org > > > > Bug: 860801 , 850450 , 786597 > > Change-Id: I7a693886ab4e1b9c8e9fbe8a64d906a95019a609 > > Reviewed-on: https://chromium-review.googlesource.com/1142589 > > Commit-Queue: Gabriel Charette <gab@chromium.org> > > Reviewed-by: kylechar <kylechar@chromium.org> > > Reviewed-by: Robert Kaplow (OOO until 0730) <rkaplow@chromium.org> > > Cr-Commit-Position: refs/heads/master@{#576686} > > TBR=gab@chromium.org,rkaplow@chromium.org,erikchen@chromium.org,kylechar@chromium.org > > Bug: 860801 , 850450 , 786597, 866299 > Change-Id: I848621acf9ddbec69d72649d16a459910ffa937e > Reviewed-on: https://chromium-review.googlesource.com/1146300 > Commit-Queue: Wez <wez@chromium.org> > Reviewed-by: Wez <wez@chromium.org> > Cr-Commit-Position: refs/heads/master@{#577133} TBR=wez@chromium.org,gab@chromium.org,rkaplow@chromium.org,erikchen@chromium.org,kylechar@chromium.org Change-Id: Idb53da9b8b40b407ece6cf6c81b95bcb7072d76c No-Presubmit: true No-Tree-Checks: true No-Try: true Bug: 860801 , 850450 , 786597, 866299 Reviewed-on: https://chromium-review.googlesource.com/1147360 Reviewed-by: Gabriel Charette <gab@chromium.org> Commit-Queue: Gabriel Charette <gab@chromium.org> Cr-Commit-Position: refs/heads/master@{#577228} [modify] https://crrev.com/5c7b464ca5393510823ad2c2a0262a4eb1460c05/base/message_loop/incoming_task_queue.cc [modify] https://crrev.com/5c7b464ca5393510823ad2c2a0262a4eb1460c05/base/message_loop/message_loop.cc [modify] https://crrev.com/5c7b464ca5393510823ad2c2a0262a4eb1460c05/base/message_loop/message_loop.h [modify] https://crrev.com/5c7b464ca5393510823ad2c2a0262a4eb1460c05/base/message_loop/message_loop_unittest.cc [modify] https://crrev.com/5c7b464ca5393510823ad2c2a0262a4eb1460c05/tools/metrics/histograms/histograms.xml
,
Jul 23
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/771b50f56cd66df43f6fa26bc113147432748255 commit 771b50f56cd66df43f6fa26bc113147432748255 Author: Gabriel Charette <gab@chromium.org> Date: Mon Jul 23 20:15:56 2018 Revert "Reland "[MessageLoop] Remove heavy diagnosis metrics and leave others only on UI thread"" This reverts commit 5c7b464ca5393510823ad2c2a0262a4eb1460c05. Reason for revert: oops, didn't mean to auto-CQ PS1. Original change's description: > Reland "[MessageLoop] Remove heavy diagnosis metrics and leave others only on UI thread" > > This reverts commit c512937e6b6f6ec01384fbb210401aac0c7f1467. > > Reason for revert: change is correct, fixed test flakiness > > Original change's description: > > Revert "[MessageLoop] Remove heavy diagnosis metrics and leave others only on UI thread" > > > > This reverts commit 81626592441ad8517fb6acc8c85e4df4544222e4. > > > > Reason for revert: MetricsOnlyFromUILoops test appears to be flaky (see https://crbug.com/866299 ). > > > > Original change's description: > > > [MessageLoop] Remove heavy diagnosis metrics and leave others only on UI thread > > > > > > Addresses crbug.com/860801 in time for the M69 branch while keeping the > > > diagnosis signals which will be used to assess future improvements > > > (MessageLoop.DelayedTaskQueueForUI.PendingTasksCountOnIdle that is). > > > > > > Removed MessageLoop.DelayedTaskQueue.PostedDelay as we've > > > learnt everything we needed from this one, that is : > > > We now know that while 99% of tasks are posted with a delay under 30s, > > > 95% of users post at least one task in every portion of the 0ms-3hours > > > range at least once per day: > > > https://uma.googleplex.com/histograms?endDate=20180717&dayCount=1&histograms=MessageLoop.DelayedTaskQueue.PostedDelay&fixupData=true&uniqueUsers=true&showMax=true&filters=platform%2Ceq%2CW%2Cchannel%2Ceq%2C1%2Cisofficial%2Ceq%2CTrue&implicitFilters=isofficial > > > > > > Removed MessageLoop.ScheduledSleep.* metrics as we've also > > > learnt what we wanted from it, that is : > > > The maximum sleep a MessageLoop ever completes is 1 hour (and > > > even then 99% of completed sleeps are under 1 second), all > > > longer delays are reliably always interrupted. > > > Win : https://uma.googleplex.com/histograms?endDate=20180717&dayCount=1&histograms=MessageLoop.ScheduledSleep.Completed%2CMessageLoop.ScheduledSleep.Interrupted&fixupData=true&showMax=true&filters=platform%2Ceq%2CM%2Cchannel%2Ceq%2C1%2Cisofficial%2Ceq%2CTrue&implicitFilters=isofficial > > > Mac : https://uma.googleplex.com/histograms?endDate=20180717&dayCount=1&histograms=MessageLoop.ScheduledSleep.Completed%2CMessageLoop.ScheduledSleep.Interrupted&fixupData=true&showMax=true&filters=platform%2Ceq%2CM%2Cchannel%2Ceq%2C1%2Cisofficial%2Ceq%2CTrue&implicitFilters=isofficial > > > Android : https://uma.googleplex.com/histograms?endDate=20180717&dayCount=1&histograms=MessageLoop.ScheduledSleep.Completed%2CMessageLoop.ScheduledSleep.Interrupted&fixupData=true&showMax=true&filters=platform%2Ceq%2CA%2Cchannel%2Ceq%2C1%2Cisofficial%2Ceq%2CTrue&implicitFilters=isofficial > > > > > > Added a test for MessageLoop.DelayedTaskQueueForUI.PendingTasksCountOnIdle > > > but it appears to be broken on MacOSX (prior to this CL). Added a note > > > to investigate on the metric but it shouldn't block this CL which > > > doesn't make it worse. > > > > > > R=kylechar@chromium.org, rkaplow@chromium.org > > > > > > Bug: 860801 , 850450 , 786597 > > > Change-Id: I7a693886ab4e1b9c8e9fbe8a64d906a95019a609 > > > Reviewed-on: https://chromium-review.googlesource.com/1142589 > > > Commit-Queue: Gabriel Charette <gab@chromium.org> > > > Reviewed-by: kylechar <kylechar@chromium.org> > > > Reviewed-by: Robert Kaplow (OOO until 0730) <rkaplow@chromium.org> > > > Cr-Commit-Position: refs/heads/master@{#576686} > > > > TBR=gab@chromium.org,rkaplow@chromium.org,erikchen@chromium.org,kylechar@chromium.org > > > > Bug: 860801 , 850450 , 786597, 866299 > > Change-Id: I848621acf9ddbec69d72649d16a459910ffa937e > > Reviewed-on: https://chromium-review.googlesource.com/1146300 > > Commit-Queue: Wez <wez@chromium.org> > > Reviewed-by: Wez <wez@chromium.org> > > Cr-Commit-Position: refs/heads/master@{#577133} > > TBR=wez@chromium.org,gab@chromium.org,rkaplow@chromium.org,erikchen@chromium.org,kylechar@chromium.org > > Change-Id: Idb53da9b8b40b407ece6cf6c81b95bcb7072d76c > No-Presubmit: true > No-Tree-Checks: true > No-Try: true > Bug: 860801 , 850450 , 786597, 866299 > Reviewed-on: https://chromium-review.googlesource.com/1147360 > Reviewed-by: Gabriel Charette <gab@chromium.org> > Commit-Queue: Gabriel Charette <gab@chromium.org> > Cr-Commit-Position: refs/heads/master@{#577228} TBR=wez@chromium.org,gab@chromium.org,rkaplow@chromium.org,erikchen@chromium.org,kylechar@chromium.org Change-Id: I29dec465bd2a29c3aa16940664ba5e1d3d005c0e No-Presubmit: true No-Tree-Checks: true No-Try: true Bug: 860801 , 850450 , 786597, 866299 Reviewed-on: https://chromium-review.googlesource.com/1147380 Reviewed-by: Gabriel Charette <gab@chromium.org> Commit-Queue: Gabriel Charette <gab@chromium.org> Cr-Commit-Position: refs/heads/master@{#577234} [modify] https://crrev.com/771b50f56cd66df43f6fa26bc113147432748255/base/message_loop/incoming_task_queue.cc [modify] https://crrev.com/771b50f56cd66df43f6fa26bc113147432748255/base/message_loop/message_loop.cc [modify] https://crrev.com/771b50f56cd66df43f6fa26bc113147432748255/base/message_loop/message_loop.h [modify] https://crrev.com/771b50f56cd66df43f6fa26bc113147432748255/base/message_loop/message_loop_unittest.cc [modify] https://crrev.com/771b50f56cd66df43f6fa26bc113147432748255/tools/metrics/histograms/histograms.xml
,
Jul 24
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/5a4495a48fb32b1faa38b4a0a21b47eddce44ef5 commit 5a4495a48fb32b1faa38b4a0a21b47eddce44ef5 Author: Gabriel Charette <gab@chromium.org> Date: Tue Jul 24 15:34:01 2018 Reland "[MessageLoop] Remove heavy diagnosis metrics and leave others only on UI thread" Original CL: https://chromium-review.googlesource.com/c/chromium/src/+/1142589 Reverted for test flakiness on Fuchsia. Implementation is fine (this is a diagnostic metric -- this change definitely doesn't make it worse). The test was only added to ensure proper logging on UI thread only. Made the test more robust in this reland (see diff vs PS1). If it flakes again, please disable it on flaky platforms instead of reverting. Original change's description: Addresses crbug.com/860801 in time for the M69 branch while keeping the diagnosis signals which will be used to assess future improvements (MessageLoop.DelayedTaskQueueForUI.PendingTasksCountOnIdle that is). Removed MessageLoop.DelayedTaskQueue.PostedDelay as we've learnt everything we needed from this one, that is : We now know that while 99% of tasks are posted with a delay under 30s, 95% of users post at least one task in every portion of the 0ms-3hours range at least once per day: https://uma.googleplex.com/histograms?endDate=20180717&dayCount=1&histograms=MessageLoop.DelayedTaskQueue.PostedDelay&fixupData=true&uniqueUsers=true&showMax=true&filters=platform%2Ceq%2CW%2Cchannel%2Ceq%2C1%2Cisofficial%2Ceq%2CTrue&implicitFilters=isofficial Removed MessageLoop.ScheduledSleep.* metrics as we've also learnt what we wanted from it, that is : The maximum sleep a MessageLoop ever completes is 1 hour (and even then 99% of completed sleeps are under 1 second), all longer delays are reliably always interrupted. Win : https://uma.googleplex.com/histograms?endDate=20180717&dayCount=1&histograms=MessageLoop.ScheduledSleep.Completed%2CMessageLoop.ScheduledSleep.Interrupted&fixupData=true&showMax=true&filters=platform%2Ceq%2CM%2Cchannel%2Ceq%2C1%2Cisofficial%2Ceq%2CTrue&implicitFilters=isofficial Mac : https://uma.googleplex.com/histograms?endDate=20180717&dayCount=1&histograms=MessageLoop.ScheduledSleep.Completed%2CMessageLoop.ScheduledSleep.Interrupted&fixupData=true&showMax=true&filters=platform%2Ceq%2CM%2Cchannel%2Ceq%2C1%2Cisofficial%2Ceq%2CTrue&implicitFilters=isofficial Android : https://uma.googleplex.com/histograms?endDate=20180717&dayCount=1&histograms=MessageLoop.ScheduledSleep.Completed%2CMessageLoop.ScheduledSleep.Interrupted&fixupData=true&showMax=true&filters=platform%2Ceq%2CA%2Cchannel%2Ceq%2C1%2Cisofficial%2Ceq%2CTrue&implicitFilters=isofficial Added a test for MessageLoop.DelayedTaskQueueForUI.PendingTasksCountOnIdle but it appears to be broken on MacOSX (prior to this CL). Added a note to investigate on the metric but it shouldn't block this CL which doesn't make it worse. TBR=wez@chromium.org Bug: 860801 , 850450 , 786597, 866299 Change-Id: Ic0fb2b58780cd595e47b36f97a9ae440bb988225 Reviewed-on: https://chromium-review.googlesource.com/1147400 Commit-Queue: Gabriel Charette <gab@chromium.org> Reviewed-by: Wez <wez@chromium.org> Reviewed-by: Gabriel Charette <gab@chromium.org> Cr-Commit-Position: refs/heads/master@{#577553} [modify] https://crrev.com/5a4495a48fb32b1faa38b4a0a21b47eddce44ef5/base/message_loop/incoming_task_queue.cc [modify] https://crrev.com/5a4495a48fb32b1faa38b4a0a21b47eddce44ef5/base/message_loop/message_loop.cc [modify] https://crrev.com/5a4495a48fb32b1faa38b4a0a21b47eddce44ef5/base/message_loop/message_loop.h [modify] https://crrev.com/5a4495a48fb32b1faa38b4a0a21b47eddce44ef5/base/message_loop/message_loop_unittest.cc [modify] https://crrev.com/5a4495a48fb32b1faa38b4a0a21b47eddce44ef5/tools/metrics/histograms/histograms.xml
,
Jul 24
Fixed, I think |
|||
►
Sign in to add a comment |
|||
Comment 1 by w...@chromium.org
, Jul 22Status: Assigned (was: Untriaged)