Issue metadata
Sign in to add a comment
|
rendering.mobile/youtube, youtube_desktop, and techcrunch flaky on chromium.perf/Android Nexus5X Perf |
||||||||||||||||||||||
Issue descriptionFiled by sheriff-o-matic@appspot.gserviceaccount.com on behalf of charliea@chromium.org rendering.mobile/youtube in rendering.mobile failing on chromium.perf/Android Nexus5X Perf Builders failed on: - Android Nexus5X Perf: https://ci.chromium.org/buildbot/chromium.perf/Android%20Nexus5X%20Perf It looks like both of these stories are failing >15% of the time, which is our typical threshold for whether a test gets disabled.
,
Jul 2
Woops - I didn't notice the distinction between youtube and youtube desktop. youtube_desktop has been failing for a really long time. youtube appears to have been passing around 561968 but appears to have started failing by 562744 (around 5/25). techcrunch appears to have been passing around 563959 and started failing by r566933. I'll kick off bisects on youtube (non-desktop) and techcrunch and disable all 3.
,
Jul 2
📍 Pinpoint job started. https://pinpoint-dot-chromeperf.appspot.com/job/11ede6a4a40000
,
Jul 2
📍 Pinpoint job started. https://pinpoint-dot-chromeperf.appspot.com/job/1394351b240000
,
Jul 2
,
Jul 2
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/7b99bbe2d20898a5a9a415aba20cae0b743f8a40 commit 7b99bbe2d20898a5a9a415aba20cae0b743f8a40 Author: Charlie Andrews <charliea@chromium.org> Date: Mon Jul 02 17:22:18 2018 Disable rendering.mobile stories failing on Nexus 5X NOTRY=true TBR=nednguyen@chromium.org Bug: 859575 Change-Id: I81e1c060bf93f8d30c56a4cc8563c6f828b524fb Reviewed-on: https://chromium-review.googlesource.com/1122970 Commit-Queue: Charlie Andrews <charliea@chromium.org> Reviewed-by: Charlie Andrews <charliea@chromium.org> Cr-Commit-Position: refs/heads/master@{#571930} [modify] https://crrev.com/7b99bbe2d20898a5a9a415aba20cae0b743f8a40/tools/perf/expectations.config
,
Jul 2
📍 Couldn't reproduce a difference. https://pinpoint-dot-chromeperf.appspot.com/job/1394351b240000
,
Jul 3
📍 Found a significant difference after 1 commit. https://pinpoint-dot-chromeperf.appspot.com/job/11ede6a4a40000 Finch: Add configs for waterfall testing. by farahcharab@google.com https://chromium.googlesource.com/chromium/src/+/a60f7661bc3b3b2a9d8656e6b38d634c209538f1 0 → 0.12 (+0.12) Understanding performance regressions: http://g.co/ChromePerformanceRegressions
,
Jul 3
Farah, it looks like your config push to the waterfall significant increased the flakiness of a couple of our rendering tests (specifically, youtube and techcrunch). https://paste.googleplex.com/6537938573721600 is a link to the full failure callstack for a techcrunch failure. Could you please figure out why this led to an increase in flakiness, or route this bug to someone who can?
,
Jul 3
,
Jul 6
The NextAction date has arrived: 2018-07-06
,
Jul 9
It seems that it's started crashing. Is there a way to get a stacktrace out of this?
,
Jul 9
See comment 9 above: I think https://paste.googleplex.com/6537938573721600 should work
,
Jul 10
Re #13: Unfortunately, that doesn't seem to be a full failure callstack -- it has python one and it shows that the renderer has crashed, but it doesn't have the renderer stacktrace for the crash.
,
Jul 10
I'm not really sure what next step might help debug the problem, especially given that I talked to altimin@ offline and he already tried unsuccessfully to reproduce the problem. nednguyen@, any ideas?
,
Jul 10
altimin@ can you reproduce the crash locally?
,
Jul 10
I talked with him earlier and he said he was unable to :/
,
Jul 10
Did he tried to reproduce using the isolate? The local build maybe different from the bot build. go/reproduce-telemetry
,
Jul 16
+Juan in case he has some thoughts about how to reproduce this problem
,
Jul 31
It looks that it's crashing. We need to look into this. farahcharab@, you mentioned that you were able to get a stacktrace for the crash?
,
Aug 2
,
Aug 14
rendering.mobile/youtube has been re-recorded as rendering.mobile/youtube_2018 and is now re-enabled. |
|||||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||||
Comment 1 by charliea@chromium.org
, Jul 2Owner: charliea@chromium.org
Status: Assigned (was: Available)
Summary: rendering.mobile/youtube and techcrunch flaky on chromium.perf/Android Nexus5X Perf (was: rendering.mobile/youtube and techcrunch failing on chromium.perf/Android Nexus5X Perf)