New issue
Advanced search Search tips

Issue 909627 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner: ----
Closed: Nov 30
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Bug

Blocked on:
issue 909584



Sign in to add a comment

All telemetry_Benchmarks tests failed on ChromeOS since 11289.0.0

Project Member Reported by vovoy@chromium.org, Nov 28

Issue description

Blockedon: 909584
Cc: chromeos-toolchain@google.com
Components: Tests>Telemetry
Cc: cmt...@chromium.org zhizhouy@chromium.org
This problem maybe related to: Issue 905834.

The timeline matches roughly. Caroline reported this bug on the 15 and there were no chrome uprevs from the 15 to the 22. 

The log for one of the first failures is below. I can see the warning about cv2 in there but I don't see an import error. 

vovoy, can you try the workaround suggested by cmtice to see if the problem goes away?

https://00e9e64bac0a8eb6df84b5932161036bfd15b22d5d01ffdafc-apidata.googleusercontent.com/download/storage/v1/b/chromeos-autotest-results/o/260397399-chromeos-test%2Fchromeos2-row7-rack11-host9%2Ftelemetry_Benchmarks.speedometer2%2Fdebug%2Ftelemetry_Benchmarks.speedometer2.DEBUG?qk=AD5uMEtm-01F8jo4WGEhxePA4iiEIbc7rx_K_mVCoGObI-bU157deR6AizqSqhFe5bUqlWTbPDGopLc6J75HYpiqdoPHZe4e6R4OOZLRjLmFVng4oNXxLSjSJY8HwYLY-WZCTx-duLtAcUgyeXq_AOoQDyPROCCeYGyCHqTTg4ojJaaQjsG0IS-KGcZqpqK6Rxpl3OpvxhkuwP1QSTbIhOsgi9s_FCXkozVQ919pkkSkqJkuZc-5PWALn2sNr5QEKwHg7REpOAYgQ3ghGHji9gOWnBnctXY2u2YiFv6PFe_q5kXK8ye_Ifbrc_SMSYqFEm4aVNIahK8bARcWx3vXQtr9PbwWoMGh7fDkkUNU9XHtWyxROmY-JijhD233nvB44SJtgIl_wOU3dtulmZL1-OHLgr5bUBz4cT8GSVszXuxy-wMd6otJ9n5j7PGWJ9ieUixlJe5eLuRCPn9owmuBHOy2tsLfs4itlqC9SxeDO8B1Cte6x0PjSK_jrLuCrCZoYCiiG29mNr599P9LIvhwPwr-baAWVJp0gsnWLmwHmf-rLHjmZ5BED9g_vWCHQRUXLOTak7iJsuPOJL4UmOlHDj_wBeW4ufgiP4F9BvPLwh77ViHm_GDnDkwyOhn1dbwsBd2549SSHBswghj8rRMrh0arGm_KlJDgwnd9bDRSe51A52KN_rQkWRokFi_EaP8Z37RiLbOVCcwVe7OmLTfmPQa-lEGoZFi3NI_JiT0ert85NcqSeH4H2S2VOOpFDJLJC-cO1b4ns7S1SiiHuZAbpKUVN14PjoNjYhJ-NpTUkOhvMsrlihdG64FF9y224WNvXvgESNCroD_OqdieEF7DIO9vGXDB7BNIG0Q8Jm5M0cxy9ok5g4Z5EIulPdV1op0W6LwRQS-Ty4c3rKcp9QYoOdvVjWLP94qdmdkgUPymT-GlUsJ-hokDqm9Qe6TxNkdhtCsyFwBmm8Ho
Cc: lakshm...@chromium.org
Cc: sky@chromium.org
Via bisect, I found the culprit is 
https://chromium-review.googlesource.com/c/chromium/src/+/1346690
"chromeos: copy command line switches to ash services"

I also found there is a fixup CL
https://chromium-review.googlesource.com/c/chromium/src/+/1351573
maybe it will fix the issue?

More detail about he bisections if you are interested.

Due to issue 909584 and issue 910077, we need two patches to bisect
 1. https://chromium-review.googlesource.com/c/chromiumos/platform/bisect-kit/+/1354842
 2. and local hack
--- a/build_and_deploy_chrome_helper.sh
+++ b/build_and_deploy_chrome_helper.sh
@@ -13,6 +13,8 @@ fi

 out_dir=out_${SDK_BOARD}/Release

+rm -rf $out_dir
+
 # This step is redundant and harmless for recent chrome. Keep it for older
 # versions.
 ./buildtools/linux64/gn gen $out_dir --args="$GN_ARGS"


------------
Bisect command line
$ ./setup_cros_bisect.py new --session=909627
$ ./diagnose_cros_autotest.py --session=909627 init --test_name telemetry_Benchmarks.speedometer2 --old 11288.0.0 --new 11289.0.0 --board quawks --model quawks --dut :lab:
$ ./diagnose_cros_autotest.py --session=909627 run

Result:
bisector: bisect_cros_version
change_list: https://crosland.corp.google.com/log/11288.0.0..11289.0.0
Range: (R72-11288.0.0, R72-11289.0.0], 1 revs left
(roughly 0 steps)
[0] R72-11288.0.0       {u'old': 1}
[1] R72-11289.0.0       {u'new': 1}
        https://crosland.corp.google.com/log/11288.0.0..11289.0.0
============================================================
bisector: bisect_cr_localbuild_internal
The link of change list only lists chrome src/ commits. For example, commits inside v8 and third party repos are not listed.
change_list: https://chromium.googlesource.com/chromium/src/+log/72.0.3617.0..72.0.3618.0?n=10000
fuller: https://chromium.googlesource.com/chromium/src/+log/72.0.3617.0..72.0.3618.0?n=10000&pretty=fuller
Range: (72.0.3617.0~72.0.3618.0/292, 72.0.3617.0~72.0.3618.0/293], 1 revs left
(roughly 0 steps)
[0] 72.0.3612.0 {u'skip': 3, u'old': 1}
[1020] 72.0.3615.0~72.0.3616.0/360      {u'old': 1}
[1531] 72.0.3616.0~72.0.3617.0/364      {u'old': 1}
[1786] 72.0.3617.0~72.0.3618.0/236      {u'old': 1}
[1818] 72.0.3617.0~72.0.3618.0/268      {u'old': 1}
[1833] 72.0.3617.0~72.0.3618.0/283      {u'old': 1}
[1841] 72.0.3617.0~72.0.3618.0/291      {u'old': 1}
[1842] 72.0.3617.0~72.0.3618.0/292      {u'old': 1}
        commit 79f096f4da src 'Android: Specify monochrome unwind asset in public repo'
        https://chromium.googlesource.com/chromium/src.git/+/79f096f4da062377bb5acf052f5d67eec9ddaac3
[1843] 72.0.3617.0~72.0.3618.0/293      {u'new': 1}
        commit 3a4b161705 src 'chromeos: copy command line switches to ash services'
        https://chromium.googlesource.com/chromium/src.git/+/3a4b161705cb3fb4cb55e521bb650dd109db4b01
[1845] 72.0.3617.0~72.0.3618.0/295      {u'new': 1}
[1849] 72.0.3617.0~72.0.3618.0/299      {u'new': 1}
[1913] 72.0.3617.0~72.0.3618.0/363      {u'new': 1}
[2041] 72.0.3618.0      {u'new': 1}


kcwu, is this still failing after https://chromium-review.googlesource.com/c/chromium/src/+/1351573 ?
Status: Fixed (was: Untriaged)
https://chromium-review.googlesource.com/c/chromium/src/+/1351573
landed in 11312.0.0 and the test become green for most boards
https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/testDetails?testName=telemetry_Benchmarks.speedometer2

so this should be already resolved.
Thanks for your help.

Sign in to add a comment