Issue metadata
Sign in to add a comment
|
loading.mobile failing on chromium.perf/Android One Perf |
||||||||||||||||||||
Issue descriptionFiled by sheriff-o-matic@appspot.gserviceaccount.com on behalf of charliea@chromium.org loading.mobile failing on chromium.perf/Android One Perf Builders failed on: - Android One Perf: https://ci.chromium.org/buildbot/chromium.perf/Android%20One%20Perf Looks like loading.mobile has been hitting its hard timeout of 4.5h every run since we corrected the traffic settings and the catapult roll hit. This CL was new in the first failed run: https://chromium.googlesource.com/catapult.git/+log/f989b62823cb..484f9f764dc5 nednguyen@, do you have any idea why this may have made things slower and not faster? It looks to have been taking about 2h50m before the change.
,
Jul 2
,
Jul 2
,
Jul 3
The NextAction date has arrived: 2018-07-03
,
Jul 3
Ned suggested offline to assign this to benchmark owners directly.
,
Jul 3
Kouhei: you would need to reduce the number of 3g tests. The timing of tests now can be found in https://chromium-review.googlesource.com/c/chromium/src/+/1124662/2/tools/perf/core/shard_maps/timing_data/android_nexus5_story_timing.json (durations are in seconds)
,
Jul 4
Which the sharding launch, we no longer have the problem with the suite timed out. However, almost all the 3g tests failed because they are timed out after 166s (after the traffic settings change, each network throttling is now 128 times slower :-(). I will disable all of them. If you still want to add network throttling tests to loading suite, I suggest using REGULAR_4G or Wifi
,
Jul 4
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/8b0cc8b035ac9d6aa6b1e9d3ae14ae1909bf2489 commit 8b0cc8b035ac9d6aa6b1e9d3ae14ae1909bf2489 Author: Ned Nguyen <nednguyen@google.com> Date: Wed Jul 04 12:50:21 2018 Disable all the failing 3g tests of loading.mobile benchmark After https://chromium.googlesource.com/catapult.git/+/484f9f764dc58973a0466e4bdf1bfd50c75165e2 fix to set the correct value of traffic settings (and makes each of them 1024X slower), many 3g tests are timed out after 166s. For now disabling all those tests. Future fix would probably replace these with better traffic settings like REGULAR_4G or Wifi. NOTRY=true TBR=kouhei@chromium.org, ksakamoto@chromium.org Bug: 859597 Change-Id: I311d598c5e7e83475a5558c5f53d4a9953559a9d Reviewed-on: https://chromium-review.googlesource.com/1126079 Reviewed-by: Ned Nguyen <nednguyen@google.com> Commit-Queue: Ned Nguyen <nednguyen@google.com> Cr-Commit-Position: refs/heads/master@{#572545} [modify] https://crrev.com/8b0cc8b035ac9d6aa6b1e9d3ae14ae1909bf2489/tools/perf/expectations.config
,
Jul 7
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/b33b5a492c9cee2fa5cf8458778686e89c696790 commit b33b5a492c9cee2fa5cf8458778686e89c696790 Author: Ned Nguyen <nednguyen@google.com> Date: Sat Jul 07 00:02:58 2018 Disable more flaky loading 3g pages TBR=kouhei@chromium.org NOTRY=true Bug: 859597 Change-Id: Ib3cf1d840e5b32514b45085ffffbb48230fce3ee Reviewed-on: https://chromium-review.googlesource.com/1128400 Reviewed-by: Ned Nguyen <nednguyen@google.com> Commit-Queue: Ned Nguyen <nednguyen@google.com> Cr-Commit-Position: refs/heads/master@{#573122} [modify] https://crrev.com/b33b5a492c9cee2fa5cf8458778686e89c696790/tools/perf/expectations.config
,
Jul 7
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/1b0681beabf02971dcc8fe7f4fac5ad890c905e6 commit 1b0681beabf02971dcc8fe7f4fac5ad890c905e6 Author: Ned Nguyen <nednguyen@google.com> Date: Sat Jul 07 12:09:46 2018 Disable more flaky 3g loading mobile tests NOTRY=true TBR=kouhei@chromium.org Bug: 859597 Change-Id: I8e91b7c6ac6f1b3bd3a74af4715b3af0608b5928 Reviewed-on: https://chromium-review.googlesource.com/1128411 Reviewed-by: Ned Nguyen <nednguyen@google.com> Commit-Queue: Ned Nguyen <nednguyen@google.com> Cr-Commit-Position: refs/heads/master@{#573163} [modify] https://crrev.com/1b0681beabf02971dcc8fe7f4fac5ad890c905e6/tools/perf/expectations.config |
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by charliea@chromium.org
, Jul 2Components: Speed>Benchmarks>Waterfall