New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 815220 link

Starred by 3 users

Issue metadata

Status: Fixed
Owner:
Closed: May 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Bug



Sign in to add a comment

autotest: stop relying on cpufreq in autotests for newer platforms that don't have it

Project Member Reported by kirtika@google.com, Feb 23 2018

Issue description

My understanding is that cpufreq has been phased out in favor of intel_pstate or similar in newer platforms (eve, <redacted>). 
Some of our autotest plumbing uses it implicitly or explicitly.
e.g. audio_Microphone test fails on my <redacted> P1 board with this stack-trace. Is cpufreq ever going to be present on this platform?

21:38:42 INFO | autoserv| Finished processing control file
21:38:42 INFO | autoserv| Skipping crash dump/info collection as requested.
21:38:43 INFO | autoserv| get_network_stats: at-end RXbytes 3811602 TXbytes 1200980
21:38:44 INFO | autoserv| record_state_duration failed: job_or_task_id=None, hostname=100.127.30.211, status=Running
-------------------------------------------------------------------------------------
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone                  [  FAILED  ]
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone                    FAIL: Fail to get selected input device.
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone [  FAILED  ]
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   FAIL: Fail to get selected input device.
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.476 ERROR|               log:0027| pre-test siteration sysinfo error:
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.481 ERROR|         traceback:0013| Traceback (most recent call last):
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.485 ERROR|         traceback:0013|   File "/usr/local/autotest/common_lib/log.py", line 25, in decorated_func
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.490 ERROR|         traceback:0013|     fn(*args, **dargs)
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.494 ERROR|         traceback:0013|   File "/usr/local/autotest/bin/base_sysinfo.py", line 394, in log_before_each_iteration
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.498 ERROR|         traceback:0013|     board = utils.get_board_with_frequency_and_memory()
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.503 ERROR|         traceback:0013|   File "/usr/local/autotest/bin/utils.py", line 1980, in get_board_with_frequency_and_memory
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.508 ERROR|         traceback:0013|     frequency = int(round(get_cpu_max_frequency() * 1e-8)) * 0.1
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.513 ERROR|         traceback:0013|   File "/usr/local/autotest/bin/utils.py", line 1852, in get_cpu_max_frequency
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.517 ERROR|         traceback:0013|     paths = _get_cpufreq_paths('cpuinfo_max_freq')
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.521 ERROR|         traceback:0013|   File "/usr/local/autotest/bin/utils.py", line 2057, in _get_cpufreq_paths
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.525 ERROR|         traceback:0013|     paths = utils.run(cmd, verbose=False).stdout.splitlines()
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.529 ERROR|         traceback:0013|   File "/usr/local/autotest/common_lib/utils.py", line 748, in run
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.534 ERROR|         traceback:0013|     "Command returned non-zero exit status")
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.540 ERROR|         traceback:0013| CmdError: Command <ls /sys/devices/system/cpu/cpu*/cpufreq/cpuinfo_max_freq> failed, rc=2, Command returned non-zero exit status
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.545 ERROR|         traceback:0013| * Command:
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.549 ERROR|         traceback:0013|     ls /sys/devices/system/cpu/cpu*/cpufreq/cpuinfo_max_freq
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.553 ERROR|         traceback:0013| Exit status: 2
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.558 ERROR|         traceback:0013| Duration: 0.00382399559021
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.562 ERROR|         traceback:0013|
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.566 ERROR|         traceback:0013| stderr:
/tmp/test_that_results_P7a_n0/results-1-audio_Microphone/audio_Microphone   02/22 19:38:37.570 ERROR|         traceback:0013| ls: cannot access '/sys/devices/system/cpu/cpu*/cpufreq/cpuinfo_max_freq': No such file or directory
-------------------------------------------------------------------------------------
Total PASS: 0/2 (0%)

 

Comment 1 by kirtika@google.com, Feb 23 2018

Cc: rajatja@chromium.org
+ Rajat for experience on Poppy.

Ok, I dug some more on my Eve, and this bug is a mistake - cpufreq is present on Eve (as a state-keeping entity?) and intel_pstate is the "scaling_driver" (one of the available ones) that it uses. 

Only question then is why does my <redacted> board not have cpufreq entries populated? 
Leaving this open in case Todd/Duncan have thoughts on needed cpufreq changes.

Comment 2 by tbroch@chromium.org, Feb 23 2018

my guess is kernel is being built w/o CONFIG_CPU_FREQ ... at least that appears to be where the sysfs path originates.

drivers/cpufreq/cpufreq.c:
show_one(cpuinfo_max_freq, cpuinfo.max_freq);

Comment 3 by za...@chromium.org, Mar 14 2018

Cc: wzang@chromium.org glevin@chromium.org za...@chromium.org
 Issue 822007  has been merged into this issue.

Comment 4 by glevin@chromium.org, Mar 15 2018

Components: Infra>Client>ChromeOS
Labels: -Pri-2 Build-PFQ-Failures Pri-1
Status: Assigned (was: Untriaged)
Please take a look at this ASAP.  The failures reported in  Issue 822007  are (along with other issues) keeping the pfq red.

Comment 5 by glevin@chromium.org, Mar 18 2018

Labels: -Pri-1 OS-iOS Pri-2
RE: Comment 4-
After 3 days of solid red, amd64-generic-chromium-pfq turned green again with build #11759, and has been green since:
  https://uberchromegw.corp.google.com/i/chromeos/builders/amd64-generic-chromium-pfq?numbuilds=200
I guess this is no longer urgent...?

Comment 6 by glevin@chromium.org, Mar 18 2018

Labels: -OS-iOS

Comment 7 by za...@chromium.org, Mar 19 2018

Cc: -za...@chromium.org

Comment 8 by jen...@chromium.org, Mar 24 2018

Cc: kbleicher@chromium.org sammiequon@chromium.org
 Issue 825395  has been merged into this issue.
Cc: minch@chromium.org shuqianz@chromium.org afakhry@chromium.org akes...@chromium.org
Labels: -Pri-2 Pri-1
This is still seen on various builders. Example: https://logs.chromium.org/v/?s=chromiumos%2Fbb%2Fchromiumos.chromium%2Famd64-generic-telemetry%2F14420%2F%2B%2Frecipes%2Fsteps%2FVMTest__attempt_2_%2F0%2Fstdout on the https://build.chromium.org/p/chromiumos.chromium/builders/amd64-generic-telemetry/builds/14420 build.




/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user                            [  FAILED  ]
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user                              FAIL: The unit tests of /usr/local/telemetry/src/third_party/catapult/telemetry failed.
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests        [  FAILED  ]
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          FAIL: The unit tests of /usr/local/telemetry/src/third_party/catapult/telemetry failed.
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:50.943 ERROR|               log:0027| pre-test siteration sysinfo error:
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:50.951 ERROR|         traceback:0013| Traceback (most recent call last):
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:50.960 ERROR|         traceback:0013|   File "/usr/local/autotest/common_lib/log.py", line 25, in decorated_func
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:50.968 ERROR|         traceback:0013|     fn(*args, **dargs)
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:50.976 ERROR|         traceback:0013|   File "/usr/local/autotest/bin/base_sysinfo.py", line 394, in log_before_each_iteration
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:50.984 ERROR|         traceback:0013|     board = utils.get_board_with_frequency_and_memory()
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:50.992 ERROR|         traceback:0013|   File "/usr/local/autotest/bin/utils.py", line 2052, in get_board_with_frequency_and_memory
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:51.001 ERROR|         traceback:0013|     frequency = int(round(get_cpu_max_frequency() * 1e-8)) * 0.1
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:51.009 ERROR|         traceback:0013|   File "/usr/local/autotest/bin/utils.py", line 1879, in get_cpu_max_frequency
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:51.016 ERROR|         traceback:0013|     paths = _get_cpufreq_paths('cpuinfo_max_freq')
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:51.024 ERROR|         traceback:0013|   File "/usr/local/autotest/bin/utils.py", line 2136, in _get_cpufreq_paths
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:51.032 ERROR|         traceback:0013|     paths = utils.run(cmd, verbose=False).stdout.splitlines()
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:51.040 ERROR|         traceback:0013|   File "/usr/local/autotest/common_lib/utils.py", line 748, in run
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:51.049 ERROR|         traceback:0013|     "Command returned non-zero exit status")
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:51.060 ERROR|         traceback:0013| CmdError: Command <ls /sys/devices/system/cpu/cpu*/cpufreq/cpuinfo_max_freq> failed, rc=2, Command returned non-zero exit status
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:51.068 ERROR|         traceback:0013| * Command:
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:51.076 ERROR|         traceback:0013|     ls /sys/devices/system/cpu/cpu*/cpufreq/cpuinfo_max_freq
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:51.084 ERROR|         traceback:0013| Exit status: 2
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:51.091 ERROR|         traceback:0013| Duration: 0.0041971206665
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:51.099 ERROR|         traceback:0013|
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:51.106 ERROR|         traceback:0013| stderr:
/tmp/cbuildbotsdNOFP/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/telemetry_UnitTests          03/27 09:31:51.113 ERROR|         traceback:0013| ls: cannot access '/sys/devices/system/cpu/cpu*/cpufreq/cpuinfo_max_freq': No such file or directory

Cc: nednguyen@chromium.org achuith@chromium.org
Better formatted traceback:

      log:0027| pre-test siteration sysinfo error:
traceback:0013| Traceback (most recent call last):
traceback:0013|   File "/usr/local/autotest/common_lib/log.py", line 25, in decorated_func
traceback:0013|     fn(*args, **dargs)
traceback:0013|   File "/usr/local/autotest/bin/base_sysinfo.py", line 394, in log_before_each_iteration
traceback:0013|     board = utils.get_board_with_frequency_and_memory()
traceback:0013|   File "/usr/local/autotest/bin/utils.py", line 2052, in get_board_with_frequency_and_memory
traceback:0013|     frequency = int(round(get_cpu_max_frequency() * 1e-8)) * 0.1
traceback:0013|   File "/usr/local/autotest/bin/utils.py", line 1879, in get_cpu_max_frequency
traceback:0013|     paths = _get_cpufreq_paths('cpuinfo_max_freq')
traceback:0013|   File "/usr/local/autotest/bin/utils.py", line 2136, in _get_cpufreq_paths
traceback:0013|     paths = utils.run(cmd, verbose=False).stdout.splitlines()
traceback:0013|   File "/usr/local/autotest/common_lib/utils.py", line 748, in run
traceback:0013|     "Command returned non-zero exit status")
traceback:0013| CmdError: Command <ls /sys/devices/system/cpu/cpu*/cpufreq/cpuinfo_max_freq> failed, rc=2, Command returned non-zero exit status
traceback:0013| * Command:
traceback:0013|     ls /sys/devices/system/cpu/cpu*/cpufreq/cpuinfo_max_freq
traceback:0013| Exit status: 2
traceback:0013| Duration: 0.0041971206665
traceback:0013|
traceback:0013| stderr:
traceback:0013| ls: cannot access '/sys/devices/system/cpu/cpu*/cpufreq/cpuinfo_max_freq': No such file or directory

Sign in to add a comment