We are seeing many telemetry processes still running after run_benchmark has finished.
$ ps -eo pid,lstart,cmd|grep run_benchmark
nothing shows up
$ ps -eo pid,lstart,cmd|grep telemetry
79428 Tue Dec 18 17:49:02 2018 /usr/local/google/home/mobiletc-prebuild/.vpython-root/6768b1/bin/python -m telemetry.core.local_server run_backend telemetry.core.memory_cache_http_server MemoryCacheHTTPServerBackend {"paths": ["/usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/blink/perf_tests"], "host": "127.0.0.1", "port": 0, "base_dir": "/usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/blink/perf_tests"}
84640 Tue Dec 18 18:11:04 2018 /usr/local/google/home/mobiletc-prebuild/.vpython-root/6768b1/bin/python -m telemetry.core.local_server run_backend telemetry.core.memory_cache_http_server MemoryCacheHTTPServerBackend {"paths": ["/usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/blink/perf_tests"], "host": "127.0.0.1", "port": 0, "base_dir": "/usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/blink/perf_tests"}
127188 Wed Dec 19 06:53:49 2018 /usr/local/google/home/mobiletc-prebuild/.vpython-root/6768b1/bin/python /usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/telemetry/third_party/tsproxy/tsproxy.py --port=0 --desthost=127.0.0.1
127429 Wed Dec 19 06:54:38 2018 /usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/telemetry/telemetry/internal/bin/linux/x86_64/wpr replay --http_port=0 --https_port=0 --https_key_file=/usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/web_page_replay_go/wpr_key.pem --https_cert_file=/usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/web_page_replay_go/wpr_cert.pem --inject_scripts=/usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/web_page_replay_go/deterministic.js /usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/tools/perf/page_sets/data/system_health_desktop_018.wprgo
142708 Thu Dec 20 10:17:55 2018 grep --color=auto profiling
184679 Wed Dec 19 18:26:39 2018 ssh -o ForwardX11=no -o ForwardX11Trusted=no -n -o ConnectTimeout=5 -S /tmp/telemetry@chromeos6-row2-rack12-host8.cros -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=publickey -o UserKnownHostsFile=/dev/null -o ControlMaster=no -i /usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/telemetry/third_party/chromite/ssh_keys/testing_rsa -L43767:127.0.0.1:45722 root@chromeos6-row2-rack12-host8.cros -p22 -NT
184690 Wed Dec 19 18:26:47 2018 ssh -o ForwardX11=no -o ForwardX11Trusted=no -n -o ConnectTimeout=5 -S /tmp/telemetry@chromeos6-row2-rack12-host8.cros -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=publickey -o UserKnownHostsFile=/dev/null -o ControlMaster=no -i /usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/telemetry/third_party/chromite/ssh_keys/testing_rsa -L41987:127.0.0.1:45722 root@chromeos6-row2-rack12-host8.cros -p22 -NT
188678 Wed Dec 19 18:36:26 2018 ssh -o ForwardX11=no -o ForwardX11Trusted=no -n -o ConnectTimeout=5 -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=publickey -o UserKnownHostsFile=/dev/null -o ControlMaster=no -i /usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/telemetry/third_party/chromite/ssh_keys/testing_rsa -R0:127.0.0.1:45583 root@chromeos6-row2-rack12-host8.cros -p22 -NT
230749 Wed Dec 19 20:24:25 2018 ssh -o ForwardX11=no -o ForwardX11Trusted=no -n -o ConnectTimeout=5 -S /tmp/telemetry@chromeos6-row2-rack12-host8.cros -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=publickey -o UserKnownHostsFile=/dev/null -o ControlMaster=no -i /usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/telemetry/third_party/chromite/ssh_keys/testing_rsa -L33699:127.0.0.1:38741 root@chromeos6-row2-rack12-host8.cros -p22 -NT
230758 Wed Dec 19 20:24:32 2018 ssh -o ForwardX11=no -o ForwardX11Trusted=no -n -o ConnectTimeout=5 -S /tmp/telemetry@chromeos6-row2-rack12-host8.cros -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=publickey -o UserKnownHostsFile=/dev/null -o ControlMaster=no -i /usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/telemetry/third_party/chromite/ssh_keys/testing_rsa -L45739:127.0.0.1:38741 root@chromeos6-row2-rack12-host8.cros -p22 -NT
231386 Wed Dec 19 20:26:24 2018 ssh -o ForwardX11=no -o ForwardX11Trusted=no -n -o ConnectTimeout=5 -S /tmp/telemetry@chromeos6-row2-rack12-host8.cros -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=publickey -o UserKnownHostsFile=/dev/null -o ControlMaster=no -i /usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/telemetry/third_party/chromite/ssh_keys/testing_rsa -L43067:127.0.0.1:33182 root@chromeos6-row2-rack12-host8.cros -p22 -NT
231408 Wed Dec 19 20:26:30 2018 ssh -o ForwardX11=no -o ForwardX11Trusted=no -n -o ConnectTimeout=5 -S /tmp/telemetry@chromeos6-row2-rack12-host8.cros -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=publickey -o UserKnownHostsFile=/dev/null -o ControlMaster=no -i /usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/telemetry/third_party/chromite/ssh_keys/testing_rsa -L41069:127.0.0.1:33182 root@chromeos6-row2-rack12-host8.cros -p22 -NT
231976 Wed Dec 19 20:28:10 2018 ssh -o ForwardX11=no -o ForwardX11Trusted=no -n -o ConnectTimeout=5 -S /tmp/telemetry@chromeos6-row2-rack12-host8.cros -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=publickey -o UserKnownHostsFile=/dev/null -o ControlMaster=no -i /usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/telemetry/third_party/chromite/ssh_keys/testing_rsa -L34643:127.0.0.1:36083 root@chromeos6-row2-rack12-host8.cros -p22 -NT
231999 Wed Dec 19 20:28:17 2018 ssh -o ForwardX11=no -o ForwardX11Trusted=no -n -o ConnectTimeout=5 -S /tmp/telemetry@chromeos6-row2-rack12-host8.cros -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=publickey -o UserKnownHostsFile=/dev/null -o ControlMaster=no -i /usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/telemetry/third_party/chromite/ssh_keys/testing_rsa -L46249:127.0.0.1:36083 root@chromeos6-row2-rack12-host8.cros -p22 -NT
232554 Wed Dec 19 20:29:58 2018 ssh -o ForwardX11=no -o ForwardX11Trusted=no -n -o ConnectTimeout=5 -S /tmp/telemetry@chromeos6-row2-rack12-host8.cros -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=publickey -o UserKnownHostsFile=/dev/null -o ControlMaster=no -i /usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/telemetry/third_party/chromite/ssh_keys/testing_rsa -L43029:127.0.0.1:41763 root@chromeos6-row2-rack12-host8.cros -p22 -NT
232625 Wed Dec 19 20:30:04 2018 ssh -o ForwardX11=no -o ForwardX11Trusted=no -n -o ConnectTimeout=5 -S /tmp/telemetry@chromeos6-row2-rack12-host8.cros -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=publickey -o UserKnownHostsFile=/dev/null -o ControlMaster=no -i /usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/telemetry/third_party/chromite/ssh_keys/testing_rsa -L36019:127.0.0.1:41763 root@chromeos6-row2-rack12-host8.cros -p22 -NT
233142 Wed Dec 19 20:31:46 2018 ssh -o ForwardX11=no -o ForwardX11Trusted=no -n -o ConnectTimeout=5 -S /tmp/telemetry@chromeos6-row2-rack12-host8.cros -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=publickey -o UserKnownHostsFile=/dev/null -o ControlMaster=no -i /usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/telemetry/third_party/chromite/ssh_keys/testing_rsa -L46385:127.0.0.1:44768 root@chromeos6-row2-rack12-host8.cros -p22 -NT
233162 Wed Dec 19 20:31:53 2018 ssh -o ForwardX11=no -o ForwardX11Trusted=no -n -o ConnectTimeout=5 -S /tmp/telemetry@chromeos6-row2-rack12-host8.cros -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=publickey -o UserKnownHostsFile=/dev/null -o ControlMaster=no -i /usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/telemetry/third_party/chromite/ssh_keys/testing_rsa -L36621:127.0.0.1:44768 root@chromeos6-row2-rack12-host8.cros -p22 -NT
260615 Wed Dec 19 02:53:49 2018 /usr/local/google/home/mobiletc-prebuild/.vpython-root/6768b1/bin/python /usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/catapult/telemetry/third_party/tsproxy/tsproxy.py --port=0 --desthost=127.0.0.1
260693 Wed Dec 19 02:54:07 2018 /usr/local/google/home/mobiletc-prebuild/.vpython-root/6768b1/bin/python -m telemetry.core.local_server run_backend telemetry.core.memory_cache_http_server MemoryCacheHTTPServerBackend {"paths": ["/usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/blink/perf_tests"], "host": "127.0.0.1", "port": 0, "base_dir": "/usr/local/google/home/mobiletc-prebuild/chromeos_benchmarks_profiling/chromium/src/third_party/blink/perf_tests"}
we do not see this problem when running the tests using crosperf. So I suspect this is related to running the tests through similize.
Comment 1 by lakshm...@chromium.org
, Dec 28