New issue
Advanced search Search tips

Issue 791800 link

Starred by 1 user

Issue metadata

Status: Untriaged
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Windows
Pri: 2
Type: Bug



Sign in to add a comment

telemetry_perf_unittests flake on linux_android_rel_ng

Project Member Reported by jam@chromium.org, Dec 4 2017

Issue description

I see this often, so filing a bug

https://chromium-swarm.appspot.com/task?id=3a3c82424b53ad10&refresh=10&show_raw=1

 [host]> /b/swarming/w/ir/third_party/catapult/devil/bin/deps/linux2/x86_64/forwarder_host --adb=/b/swarming/w/ir/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb --serial-id=06b04bccf0e68af0 --unmap 38768
  Story load:media:soundcloud is not in the story set.
  Story browse:chrome:newtab is not in the story set.
  Story browse:news:globo is not in the story set.
  Story browse:chrome:omnibox is not in the story set.
  Story load:tools:gmail is not in the story set.
  Story browse:news:toi is not in the story set.
  Story long_running:tools:gmail-background is not in the story set.
  Story browse:shopping:flipkart is not in the story set.
  Story background:tools:gmail is not in the story set.
  Story browse:social:facebook is not in the story set.
  Story load:tools:drive is not in the story set.
  Used 23.4 GiB out of 31.4 GiB memory available.
  Top 10 memory consumers:
  - 77.6 MiB (pid=739) python
  - 66.1 MiB (pid=729) python
  - 55.8 MiB (pid=46) python
  - 25.7 MiB (pid=724) python
  - 8.7 MiB (pid=738) python
  - 8.6 MiB (pid=737) python
  - 4.8 MiB (pid=736) python
  - 3.3 MiB (pid=1391) adb
  - 1.8 MiB (pid=5248) forwarder_host
  - 1.6 MiB (pid=45) su
  Current process:
  - 77.6 MiB (pid=739) python
  Traceback (most recent call last):
    File "/b/swarming/w/ir/tools/perf/benchmarks/system_health_smoke_test.py", line 118, in RunTest
      msg='Failed: %s' % benchmark_class)
  AssertionError: Failed: <class 'benchmarks.system_health.MobileMemorySystemHealth'>



Another weird thing is that swarming job is purple (link above) but try run page https://ci.chromium.org/buildbot/tryserver.chromium.android/linux_android_rel_ng/445262 is red.
 
Cc: perezju@chromium.org
Owner: nedngu...@google.com
In the log above, the 3 failed tests are:

browse:news:qq
load:tools:weather
browse:tools:maps

Comment 2 by jam@chromium.org, Dec 6 2017

ping, any update?
Cc: nedngu...@google.com
 Issue 792485  has been merged into this issue.
Summary: telemetry_perf_unittests flake on linux_android_rel_ng (was: telemetry_perf_unittests flake on android bot)
How do I move telemetry_perf_unittests from N5 CQ to N5 config on the main waterfall?
#5: I'm not sure what you're asking. The configs are shared between the two. t_p_u runs on the matching waterfall bot: https://ci.chromium.org/buildbot/chromium.android/KitKat%20Phone%20Tester%20%28rel%29/
#5: so there is no way to schedule a test on N5 chromium waterfall and not on CQ?
Project Member

Comment 8 by bugdroid1@chromium.org, Dec 7 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/feb0738bf09e041b5a69f748ce0f6d6c92ca8da5

commit feb0738bf09e041b5a69f748ce0f6d6c92ca8da5
Author: Ned Nguyen <nednguyen@google.com>
Date: Thu Dec 07 17:56:15 2017

Migrate telemetry_perf_unittests from KitKat Phone Tester (rel) to KitKat Phone Tester (dbg)

This suite is a bit flaky on CQ, so we are moving it to the main waterfall.
The fact that this is a dbg build also give us some clue to cause of the flakes.

Bug: 791800
Change-Id: I0aa36d80e1de4683a6b6765363654eb7c282b4bc
Reviewed-on: https://chromium-review.googlesource.com/812166
Reviewed-by: John Budorick <jbudorick@chromium.org>
Commit-Queue: Ned Nguyen <nednguyen@google.com>
Cr-Commit-Position: refs/heads/master@{#522468}
[modify] https://crrev.com/feb0738bf09e041b5a69f748ce0f6d6c92ca8da5/testing/buildbot/chromium.android.json
[modify] https://crrev.com/feb0738bf09e041b5a69f748ce0f6d6c92ca8da5/testing/buildbot/waterfalls.pyl

Labels: -Pri-1 Pri-2
Components: Speed>Telemetry
Owner: ----
Status: Available (was: Assigned)
Leave this bug available for someone else to later reenable telemetry_perf_unittests on linux_android_rel_ng 
Project Member

Comment 11 by bugdroid1@chromium.org, Dec 8 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/1823a372b10f274f2bf82f8981194b8734f3cb18

commit 1823a372b10f274f2bf82f8981194b8734f3cb18
Author: John Budorick <jbudorick@chromium.org>
Date: Fri Dec 08 04:03:42 2017

Remove telemetry_perf_unittests from KitKat Phone Tester (dbg).

As of this writing, this suite has run six times on the bot. It has failed
all six. This is untenable.

TBR=nednguyen@google.com

Bug: 791800
Change-Id: Ie834b1b3c1d076fc9f6502d381413cd4d9a5b617
Reviewed-on: https://chromium-review.googlesource.com/815950
Reviewed-by: John Budorick <jbudorick@chromium.org>
Commit-Queue: John Budorick <jbudorick@chromium.org>
Cr-Commit-Position: refs/heads/master@{#522705}
[modify] https://crrev.com/1823a372b10f274f2bf82f8981194b8734f3cb18/testing/buildbot/chromium.android.json
[modify] https://crrev.com/1823a372b10f274f2bf82f8981194b8734f3cb18/testing/buildbot/waterfalls.pyl

Project Member

Comment 12 by sheriffbot@chromium.org, Dec 10

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot

Comment 13 by benhenry@google.com, Jan 16 (6 days ago)

Components: Test>Telemetry

Comment 14 by benhenry@google.com, Jan 16 (6 days ago)

Components: -Speed>Telemetry

Sign in to add a comment