All telemetry_Benchmarks tests failed on ChromeOS since 11289.0.0 |
|||||||
Issue description
,
Nov 29
,
Nov 29
,
Nov 29
This problem maybe related to: Issue 905834. The timeline matches roughly. Caroline reported this bug on the 15 and there were no chrome uprevs from the 15 to the 22. The log for one of the first failures is below. I can see the warning about cv2 in there but I don't see an import error. vovoy, can you try the workaround suggested by cmtice to see if the problem goes away? https://00e9e64bac0a8eb6df84b5932161036bfd15b22d5d01ffdafc-apidata.googleusercontent.com/download/storage/v1/b/chromeos-autotest-results/o/260397399-chromeos-test%2Fchromeos2-row7-rack11-host9%2Ftelemetry_Benchmarks.speedometer2%2Fdebug%2Ftelemetry_Benchmarks.speedometer2.DEBUG?qk=AD5uMEtm-01F8jo4WGEhxePA4iiEIbc7rx_K_mVCoGObI-bU157deR6AizqSqhFe5bUqlWTbPDGopLc6J75HYpiqdoPHZe4e6R4OOZLRjLmFVng4oNXxLSjSJY8HwYLY-WZCTx-duLtAcUgyeXq_AOoQDyPROCCeYGyCHqTTg4ojJaaQjsG0IS-KGcZqpqK6Rxpl3OpvxhkuwP1QSTbIhOsgi9s_FCXkozVQ919pkkSkqJkuZc-5PWALn2sNr5QEKwHg7REpOAYgQ3ghGHji9gOWnBnctXY2u2YiFv6PFe_q5kXK8ye_Ifbrc_SMSYqFEm4aVNIahK8bARcWx3vXQtr9PbwWoMGh7fDkkUNU9XHtWyxROmY-JijhD233nvB44SJtgIl_wOU3dtulmZL1-OHLgr5bUBz4cT8GSVszXuxy-wMd6otJ9n5j7PGWJ9ieUixlJe5eLuRCPn9owmuBHOy2tsLfs4itlqC9SxeDO8B1Cte6x0PjSK_jrLuCrCZoYCiiG29mNr599P9LIvhwPwr-baAWVJp0gsnWLmwHmf-rLHjmZ5BED9g_vWCHQRUXLOTak7iJsuPOJL4UmOlHDj_wBeW4ufgiP4F9BvPLwh77ViHm_GDnDkwyOhn1dbwsBd2549SSHBswghj8rRMrh0arGm_KlJDgwnd9bDRSe51A52KN_rQkWRokFi_EaP8Z37RiLbOVCcwVe7OmLTfmPQa-lEGoZFi3NI_JiT0ert85NcqSeH4H2S2VOOpFDJLJC-cO1b4ns7S1SiiHuZAbpKUVN14PjoNjYhJ-NpTUkOhvMsrlihdG64FF9y224WNvXvgESNCroD_OqdieEF7DIO9vGXDB7BNIG0Q8Jm5M0cxy9ok5g4Z5EIulPdV1op0W6LwRQS-Ty4c3rKcp9QYoOdvVjWLP94qdmdkgUPymT-GlUsJ-hokDqm9Qe6TxNkdhtCsyFwBmm8Ho
,
Nov 29
,
Nov 29
Via bisect, I found the culprit is https://chromium-review.googlesource.com/c/chromium/src/+/1346690 "chromeos: copy command line switches to ash services" I also found there is a fixup CL https://chromium-review.googlesource.com/c/chromium/src/+/1351573 maybe it will fix the issue?
,
Nov 29
More detail about he bisections if you are interested. Due to issue 909584 and issue 910077, we need two patches to bisect 1. https://chromium-review.googlesource.com/c/chromiumos/platform/bisect-kit/+/1354842 2. and local hack --- a/build_and_deploy_chrome_helper.sh +++ b/build_and_deploy_chrome_helper.sh @@ -13,6 +13,8 @@ fi out_dir=out_${SDK_BOARD}/Release +rm -rf $out_dir + # This step is redundant and harmless for recent chrome. Keep it for older # versions. ./buildtools/linux64/gn gen $out_dir --args="$GN_ARGS" ------------ Bisect command line $ ./setup_cros_bisect.py new --session=909627 $ ./diagnose_cros_autotest.py --session=909627 init --test_name telemetry_Benchmarks.speedometer2 --old 11288.0.0 --new 11289.0.0 --board quawks --model quawks --dut :lab: $ ./diagnose_cros_autotest.py --session=909627 run Result: bisector: bisect_cros_version change_list: https://crosland.corp.google.com/log/11288.0.0..11289.0.0 Range: (R72-11288.0.0, R72-11289.0.0], 1 revs left (roughly 0 steps) [0] R72-11288.0.0 {u'old': 1} [1] R72-11289.0.0 {u'new': 1} https://crosland.corp.google.com/log/11288.0.0..11289.0.0 ============================================================ bisector: bisect_cr_localbuild_internal The link of change list only lists chrome src/ commits. For example, commits inside v8 and third party repos are not listed. change_list: https://chromium.googlesource.com/chromium/src/+log/72.0.3617.0..72.0.3618.0?n=10000 fuller: https://chromium.googlesource.com/chromium/src/+log/72.0.3617.0..72.0.3618.0?n=10000&pretty=fuller Range: (72.0.3617.0~72.0.3618.0/292, 72.0.3617.0~72.0.3618.0/293], 1 revs left (roughly 0 steps) [0] 72.0.3612.0 {u'skip': 3, u'old': 1} [1020] 72.0.3615.0~72.0.3616.0/360 {u'old': 1} [1531] 72.0.3616.0~72.0.3617.0/364 {u'old': 1} [1786] 72.0.3617.0~72.0.3618.0/236 {u'old': 1} [1818] 72.0.3617.0~72.0.3618.0/268 {u'old': 1} [1833] 72.0.3617.0~72.0.3618.0/283 {u'old': 1} [1841] 72.0.3617.0~72.0.3618.0/291 {u'old': 1} [1842] 72.0.3617.0~72.0.3618.0/292 {u'old': 1} commit 79f096f4da src 'Android: Specify monochrome unwind asset in public repo' https://chromium.googlesource.com/chromium/src.git/+/79f096f4da062377bb5acf052f5d67eec9ddaac3 [1843] 72.0.3617.0~72.0.3618.0/293 {u'new': 1} commit 3a4b161705 src 'chromeos: copy command line switches to ash services' https://chromium.googlesource.com/chromium/src.git/+/3a4b161705cb3fb4cb55e521bb650dd109db4b01 [1845] 72.0.3617.0~72.0.3618.0/295 {u'new': 1} [1849] 72.0.3617.0~72.0.3618.0/299 {u'new': 1} [1913] 72.0.3617.0~72.0.3618.0/363 {u'new': 1} [2041] 72.0.3618.0 {u'new': 1}
,
Nov 29
kcwu, is this still failing after https://chromium-review.googlesource.com/c/chromium/src/+/1351573 ?
,
Nov 30
https://chromium-review.googlesource.com/c/chromium/src/+/1351573 landed in 11312.0.0 and the test become green for most boards https://cros-goldeneye.corp.google.com/chromeos/healthmonitoring/testDetails?testName=telemetry_Benchmarks.speedometer2 so this should be already resolved.
,
Nov 30
Thanks for your help.
,
Dec 3
FYI, link to bisect detail http://bisect.tpe.corp.google.com:8080/b/ce9a93e7-95aa-4741-b564-49fd85afec5a |
|||||||
►
Sign in to add a comment |
|||||||
Comment 1 by vovoy@chromium.org
, Nov 28