New issue
Advanced search Search tips

Issue 894455 link

Starred by 1 user

Issue metadata

Status: Untriaged
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

Python segfault while computing trace metrics

Project Member Reported by skyos...@chromium.org, Oct 11

Issue description

Full log: https://chrome-swarming.appspot.com/task?id=407ba8192e6e6b10&refresh=10&show_raw=1

(INFO) 2018-10-11 11:30:33,963 timeline_based_measurement._ComputeTimelineBasedMetrics:317  Starting to compute metrics on trace
*** Error in `/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python': free(): invalid pointer: 0x00007f1a48157630 ***
======= Backtrace: =========
/lib/x86_64-linux-gnu/libc.so.6(+0x777e5)[0x7f1a6d2077e5]
/lib/x86_64-linux-gnu/libc.so.6(+0x8037a)[0x7f1a6d21037a]
/lib/x86_64-linux-gnu/libc.so.6(cfree+0x4c)[0x7f1a6d21453c]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyThread_ReInitTLS+0x81)[0x50b0c1]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyOS_AfterFork+0x37)[0x511757]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python[0x5fce86]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalFrameEx+0x6efa)[0x4c449a]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalCodeEx+0x7f8)[0x4c6a88]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalFrameEx+0x6cd1)[0x4c4271]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalCodeEx+0x7f8)[0x4c6a88]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python[0x6278ff]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyObject_Call+0x3a)[0x42e56a]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python[0x432a55]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyObject_Call+0x3a)[0x42e56a]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python[0x48ff3f]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python[0x48ae1a]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyObject_Call+0x3a)[0x42e56a]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalFrameEx+0x1805)[0x4beda5]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalFrameEx+0x71f6)[0x4c4796]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalCodeEx+0x7f8)[0x4c6a88]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalFrameEx+0x6cd1)[0x4c4271]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalCodeEx+0x7f8)[0x4c6a88]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalFrameEx+0x6cd1)[0x4c4271]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalCodeEx+0x7f8)[0x4c6a88]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python[0x6278ff]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyObject_Call+0x3a)[0x42e56a]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalFrameEx+0x213b)[0x4bf6db]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalCodeEx+0x7f8)[0x4c6a88]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalFrameEx+0x6cd1)[0x4c4271]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalCodeEx+0x7f8)[0x4c6a88]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalFrameEx+0x6cd1)[0x4c4271]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalCodeEx+0x7f8)[0x4c6a88]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python[0x6278ff]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyObject_Call+0x3a)[0x42e56a]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalFrameEx+0x213b)[0x4bf6db]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalFrameEx+0x71f6)[0x4c4796]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalFrameEx+0x71f6)[0x4c4796]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_EvalCodeEx+0x7f8)[0x4c6a88]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python[0x627830]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyObject_Call+0x3a)[0x42e56a]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python[0x432a55]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyObject_Call+0x3a)[0x42e56a]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python(PyEval_CallObjectWithKeywords+0x47)[0x4bd4f7]
/b/swarming/w/ir/.swarming_module_cache/vpython/f22999/bin/python[0x50f602]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba)[0x7f1a6dea96ba]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f1a6d29741d]
 
Cc: nednguyen@chromium.org
Components: -Speed>Metrics Speed>Telemetry
Swapping Speed > Metrics out for Speed > Telemetry: looks like this is a Telemetry problem.
Cc: iannucci@chromium.org crouleau@chromium.org
Wow, any idea what's going on or how to debug this further?
Cc: dpranke@chromium.org
Is this failure case intermittent or consistent?

I hit something similar for Chrome Remote Desktop tests. We had no idea how to fix it and ended up doing a hacky workaround.

If we can get a small repro then hopefully we can get someone from python development team to help us.

The other thing we could do is migrate to python3. +Dirk
Cc: mar...@chromium.org
unfortunately, switching to python3 isn't a short-term option.
#3: I saw this on a couple of different log files when I filed the bug, but it seems to be fairly random. I wonder if we're running out of memory while processing the trace?
Via a simple Google search:

PyOS_AfterFork -> https://docs.python.org/2/c-api/sys.html#c.PyOS_AfterFork
Looks like it's immediately called at the very start of the process.

PyThread_ReInitTLS tells me this looks similar to https://bugs.python.org/issue30967
Cc: -nednguyen@chromium.org nedngu...@google.com
Cc: iannu...@google.com
Cc: -iannucci@chromium.org

Comment 10 by benhenry@google.com, Jan 16 (6 days ago)

Components: Test>Telemetry

Comment 11 by benhenry@google.com, Jan 16 (6 days ago)

Components: -Speed>Telemetry

Sign in to add a comment