New issue
Advanced search Search tips

Issue 775260 link

Starred by 0 users
Status: Duplicate
Merged: issue 792995
Owner:
vmp...@chromium.org
Closed: Dec 2017
Components:
EstimatedDays: ----
NextAction: ----
OS: Android
Pri: 1
Type: Bug-Regression



Sign in to add a comment

cc_perftests very flaky on chromium.perf/Android Nexus5 Perf

Project Member Reported by zh...@chromium.org, Oct 16 2017 
cc_perftests is very falky on chromium.perf/Android Nexus5 Perf. Almost only 1 pass in 10 runs.

Builders failed on: 
- Android Nexus5 Perf: 
  https://build.chromium.org/p/chromium.perf/builders/Android%20Nexus5%20Perf

Comment 1 by zh...@chromium.org, Oct 16 2017 

https://uberchromegw.corp.google.com/i/chromium.perf/builders/Android%20Nexus5%20Perf/builds/493

I  522.117s Main  STARTING TRY #3/3
I  522.117s Main  Will run 1 tests on 1 devices: 0acc13b443e4b104
I  522.117s TimeoutThread-1-for-run_tests_on_device(0acc13b443e4b104)  [host]> /b/swarming/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 0acc13b443e4b104 shell '( pm dump org.chromium.native_test | grep dataDir=; echo "PIPESTATUS: ${PIPESTATUS[@]}" );echo %$?'
I  523.026s TimeoutThread-1-for-run_tests_on_device(0acc13b443e4b104)  [host]> /b/swarming/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 0acc13b443e4b104 shell '( mkdir -p /sdcard/tmp-5ce6e90fc33a7 );echo %$?'
I  523.041s run_tests_on_device(0acc13b443e4b104)  flags:
I  523.041s run_tests_on_device(0acc13b443e4b104)    --test-launcher-print-test-stdio=always
I  523.042s TimeoutThread-1-for-run_tests_on_device(0acc13b443e4b104)  [host]> /b/swarming/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 0acc13b443e4b104 push /b/swarming/w/itgs5fp7/tmp2Joocz /data/local/tmp/temp_file-a582fa4bf4b84.sh
I  523.046s TimeoutThread-1-for-run_tests_on_device(0acc13b443e4b104)  Large shell command will be run from file: ( p=org.chromium.native_test;am instrument -w -e "$p".NativeTestInstrumentationTestRunner.ShardNanoTimeout 120000000000 -e "$p".NativeTestInstrumentationTestRunner.NativeTestActivity "$p".NativeUnitTestActivity -e "$p".NativeTestInstrumentationTestRunner.StdoutFile /storage/emulated/legacy/temp_file-1f7fbada7839c.gtest_out -e "$p".NativeTestInstrumentationTestRunner.Test TileManagerPerfTest.PrepareTiles -e "$p".NativeTest.CommandLineFlags --test-launcher-print-test-stdio=always "$p"/"$p".NativeTestInstrumen ...
I  523.046s TimeoutThread-1-for-run_tests_on_device(0acc13b443e4b104)  [host]> /b/swarming/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 0acc13b443e4b104 shell '( sh /data/local/tmp/temp_file-a582fa4bf4b84.sh );echo %$?'
I  568.925s TimeoutThread-1-for-delete_temporary_file(0acc13b443e4b104)  [host]> /b/swarming/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 0acc13b443e4b104 shell 'rm -f /data/local/tmp/temp_file-a582fa4bf4b84.sh'
I  568.926s TimeoutThread-1-for-run_tests_on_device(0acc13b443e4b104)  [host]> /b/swarming/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 0acc13b443e4b104 pull /data/local/tmp/temp_file-ed7b33e4c94b4 /b/swarming/w/itgs5fp7/tmpcN3hK6/tmp_ReadFileWithPull
I  568.970s TimeoutThread-1-for-delete_temporary_file(0acc13b443e4b104)  [host]> /b/swarming/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 0acc13b443e4b104 shell 'rm -f /data/local/tmp/temp_file-ed7b33e4c94b4'
I  568.978s TimeoutThread-1-for-run_tests_on_device(0acc13b443e4b104)  [host]> /b/swarming/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 0acc13b443e4b104 shell '( TZ=utc ls -a -l /storage/emulated/legacy/ );echo %$?'
I  569.010s run_tests_on_device(0acc13b443e4b104)  /storage/emulated/legacy/temp_file-1f7fbada7839c.gtest_out size on device: 713
I  569.011s TimeoutThread-1-for-run_tests_on_device(0acc13b443e4b104)  [host]> /b/swarming/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 0acc13b443e4b104 shell '( TZ=utc ls -a -l /storage/emulated/legacy/ );echo %$?'
I  569.027s TimeoutThread-1-for-run_tests_on_device(0acc13b443e4b104)  [host]> /b/swarming/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 0acc13b443e4b104 shell '( cat /storage/emulated/legacy/temp_file-1f7fbada7839c.gtest_out );echo %$?'
I  569.042s TimeoutThread-1-for-delete_temporary_file(0acc13b443e4b104)  [host]> /b/swarming/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 0acc13b443e4b104 shell 'rm -f /storage/emulated/legacy/temp_file-1f7fbada7839c.gtest_out'
I  569.043s TimeoutThread-1-for-delete_temporary_file(0acc13b443e4b104)  [host]> /b/swarming/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 0acc13b443e4b104 shell 'rm -f /data/data/org.chromium.native_test/temp_file-1b63f2b326079.xml'
I  569.043s TimeoutThread-1-for-run_tests_on_device(0acc13b443e4b104)  [host]> /b/swarming/w/ir/third_party/android_tools/sdk/platform-tools/adb -s 0acc13b443e4b104 shell '( pm clear org.chromium.native_test );echo %$?'
I  569.808s run_tests_on_device(0acc13b443e4b104)  >>ScopedMainEntryLogger
I  569.808s run_tests_on_device(0acc13b443e4b104)  Note: Google Test filter = TileManagerPerfTest.PrepareTiles
I  569.808s run_tests_on_device(0acc13b443e4b104)  [==========] Running 1 test from 1 test case.
I  569.808s run_tests_on_device(0acc13b443e4b104)  [----------] Global test environment set-up.
I  569.808s run_tests_on_device(0acc13b443e4b104)  [----------] 1 test from TileManagerPerfTest
I  569.808s run_tests_on_device(0acc13b443e4b104)  [ RUN      ] TileManagerPerfTest.PrepareTiles
I  569.808s run_tests_on_device(0acc13b443e4b104)  *RESULT prepare_tiles: 2_100= 31.238828659057617 runs/s
I  569.808s run_tests_on_device(0acc13b443e4b104)  *RESULT prepare_tiles: 2_500= 277.73590087890625 runs/s
I  569.808s run_tests_on_device(0acc13b443e4b104)  *RESULT prepare_tiles: 2_1000= 262.5540466308594 runs/s
I  569.808s run_tests_on_device(0acc13b443e4b104)  *RESULT prepare_tiles: 10_100= 321.4953918457031 runs/s
I  569.808s run_tests_on_device(0acc13b443e4b104)  *RESULT prepare_tiles: 10_500= 280.0615234375 runs/s
I  569.808s run_tests_on_device(0acc13b443e4b104)  *RESULT prepare_tiles: 10_1000= 259.2953796386719 runs/s
I  569.808s run_tests_on_device(0acc13b443e4b104)  *RESULT prepare_tiles: 50_100= 272.2672424316406 runs/s
I  569.808s run_tests_on_device(0acc13b443e4b104)  *RESULT prepare_tiles: 50_500= 236.12460327148438 runs/s
I  569.809s run_tests_on_device(0acc13b443e4b104)  Finished running tests on this device.
I  569.818s Main  FINISHED TRY #3/3
I  569.818s Main  1 failed tests remain.
C  569.819s Main  ********************************************************************************
C  569.819s Main  Detailed Logs
C  569.819s Main  ********************************************************************************
C  569.819s Main  [UNKNOWN] TileManagerPerfTest.PrepareTiles:
C  569.819s Main  [ RUN      ] TileManagerPerfTest.PrepareTiles
C  569.819s Main  *RESULT prepare_tiles: 2_100= 31.238828659057617 runs/s
C  569.819s Main  *RESULT prepare_tiles: 2_500= 277.73590087890625 runs/s
C  569.819s Main  *RESULT prepare_tiles: 2_1000= 262.5540466308594 runs/s
C  569.819s Main  *RESULT prepare_tiles: 10_100= 321.4953918457031 runs/s
C  569.819s Main  *RESULT prepare_tiles: 10_500= 280.0615234375 runs/s
C  569.819s Main  *RESULT prepare_tiles: 10_1000= 259.2953796386719 runs/s
C  569.819s Main  *RESULT prepare_tiles: 50_100= 272.2672424316406 runs/s
C  569.819s Main  *RESULT prepare_tiles: 50_500= 236.12460327148438 runs/s
C  569.819s Main  ********************************************************************************
C  569.819s Main  Summary
C  569.819s Main  ********************************************************************************

Comment 2 by dtapu...@chromium.org, Nov 1 2017

Components: Internals>Compositing

Comment 3 by ericrk@chromium.org, Dec 7 2017

Owner: vmp...@chromium.org
TileManagerPerfTest.PrepareTiles appears to be timing out in the cases seen. It seems like running these native tests within the timeout is challenging. For the CC tests we appear to be running a fair number of tests (6-50) with a 120s time out. Given that many of these tests run for 2s each, 120s seems low as we approach 50 tests. We might need to break up these runs further, or increase the timeout. It's also unclear whether the test is running much longer than expected.

Comment 4 by vmp...@chromium.org, Dec 8 2017

Mergedinto: 792995
Status: Duplicate (was: Available)
►

Sign in to add a comment