New issue
Advanced search Search tips
Note: Color blocks (like █ or █) mean that a user may not be available. Tooltip shows the reason.

Issue 800104 link

Starred by 1 user
Status: Duplicate
Merged: issue 800132
Owner:
█ jrbarnette@chromium.org
Last visit > 30 days ago
Closed: Jan 2018
Cc:
xixuan@chromium.org
jdufault@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug



Sign in to add a comment

veyron_minnie-tot-chrome-pfq-informational failing with Lost connection to MySQL server at 'reading initial communication packet'

Project Member Reported by jdufault@chromium.org, Jan 8 2018 
May just be a flake. The actual error:

  <class 'autotest_lib.frontend.afe.json_rpc.proxy.JSONRPCException'>(OperationalError: (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 0")


Error logs:

chromeos-golo-server2-194: 3aeffefb9640de10 1
  Autotest instance created: cautotest-prod
  01-08-2018 [11:09:26] Created suite job: http://cautotest-prod.corp.google.com/afe/#tab_id=view_job&object_id=168596909
  @@@STEP_LINK@Link to suite@http://cautotest-prod.corp.google.com/afe/#tab_id=view_job&object_id=168596909@@@
  The suite job has another 2:29:50.389567 till timeout.
  01-08-2018 [12:03:23] Suite job is finished.
  01-08-2018 [12:03:23] Start collecting test results and dump them to json.
  <class 'autotest_lib.frontend.afe.json_rpc.proxy.JSONRPCException'>(OperationalError: (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 0")
  Traceback (most recent call last):
    File "/usr/local/autotest/frontend/afe/json_rpc/serviceHandler.py", line 109, in dispatchRequest
      results['result'] = self.invokeServiceEndpoint(meth, args)
    File "/usr/local/autotest/frontend/afe/json_rpc/serviceHandler.py", line 147, in invokeServiceEndpoint
      return meth(*args)
    File "/usr/local/autotest/frontend/afe/rpc_handler.py", line 270, in new_fn
      return f(*args, **keyword_args)
    File "/usr/local/autotest/frontend/tko/rpc_interface.py", line 184, in get_detailed_test_views
      test_views = models.TestView.list_objects(filter_data)
    File "/usr/local/autotest/frontend/afe/model_logic.py", line 817, in list_objects
      for model_object in query]
    File "/usr/local/autotest/site-packages/django/db/models/query.py", line 123, in _result_iter
      self._fill_cache()
    File "/usr/local/autotest/site-packages/django/db/models/query.py", line 927, in _fill_cache
      self._result_cache.append(next(self._iter))
    File "/usr/local/autotest/site-packages/django/db/models/query.py", line 301, in iterator
      for row in compiler.results_iter():
    File "/usr/local/autotest/site-packages/django/db/models/sql/compiler.py", line 775, in results_iter
      for rows in self.execute_sql(MULTI):
    File "/usr/local/autotest/site-packages/django/db/models/sql/compiler.py", line 839, in execute_sql
      cursor = self.connection.cursor()
    File "/usr/local/autotest/site-packages/django/db/backends/__init__.py", line 326, in cursor
      cursor = util.CursorWrapper(self._cursor(), self)
    File "/usr/local/autotest/site-packages/django/db/backends/mysql/base.py", line 405, in _cursor
      self.connection = Database.connect(**kwargs)
    File "/usr/local/autotest/site-packages/MySQLdb/__init__.py", line 81, in Connect
      return Connection(*args, **kwargs)
    File "/usr/local/autotest/site-packages/MySQLdb/connections.py", line 187, in __init__
      super(Connection, self).__init__(*args, **kwargs2)
  OperationalError: (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 0")
  )
  Retrying in 7.332335 seconds...
  <class 'autotest_lib.frontend.afe.json_rpc.proxy.JSONRPCException'>(OperationalError: (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 0")
  Traceback (most recent call last):
    File "/usr/local/autotest/frontend/afe/json_rpc/serviceHandler.py", line 109, in dispatchRequest
      results['result'] = self.invokeServiceEndpoint(meth, args)
    File "/usr/local/autotest/frontend/afe/json_rpc/serviceHandler.py", line 147, in invokeServiceEndpoint
      return meth(*args)
    File "/usr/local/autotest/frontend/afe/rpc_handler.py", line 270, in new_fn
      return f(*args, **keyword_args)
    File "/usr/local/autotest/frontend/tko/rpc_interface.py", line 184, in get_detailed_test_views
      test_views = models.TestView.list_objects(filter_data)
    File "/usr/local/autotest/frontend/afe/model_logic.py", line 817, in list_objects
      for model_object in query]
    File "/usr/local/autotest/site-packages/django/db/models/query.py", line 123, in _result_iter
      self._fill_cache()
    File "/usr/local/autotest/site-packages/django/db/models/query.py", line 927, in _fill_cache
      self._result_cache.append(next(self._iter))
    File "/usr/local/autotest/site-packages/django/db/models/query.py", line 301, in iterator
      for row in compiler.results_iter():
    File "/usr/local/autotest/site-packages/django/db/models/sql/compiler.py", line 775, in results_iter
      for rows in self.execute_sql(MULTI):
    File "/usr/local/autotest/site-packages/django/db/models/sql/compiler.py", line 839, in execute_sql
      cursor = self.connection.cursor()
    File "/usr/local/autotest/site-packages/django/db/backends/__init__.py", line 326, in cursor
      cursor = util.CursorWrapper(self._cursor(), self)
    File "/usr/local/autotest/site-packages/django/db/backends/mysql/base.py", line 405, in _cursor
      self.connection = Database.connect(**kwargs)
    File "/usr/local/autotest/site-packages/MySQLdb/__init__.py", line 81, in Connect
      return Connection(*args, **kwargs)
    File "/usr/local/autotest/site-packages/MySQLdb/connections.py", line 187, in __init__
      super(Connection, self).__init__(*args, **kwargs2)
  OperationalError: (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 0")
  )
  Retrying in 14.912238 seconds...
  <class 'autotest_lib.frontend.afe.json_rpc.proxy.JSONRPCException'>(OperationalError: (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 0")
  Traceback (most recent call last):
    File "/usr/local/autotest/frontend/afe/json_rpc/serviceHandler.py", line 109, in dispatchRequest
      results['result'] = self.invokeServiceEndpoint(meth, args)
    File "/usr/local/autotest/frontend/afe/json_rpc/serviceHandler.py", line 147, in invokeServiceEndpoint
      return meth(*args)
    File "/usr/local/autotest/frontend/afe/rpc_handler.py", line 270, in new_fn
      return f(*args, **keyword_args)
    File "/usr/local/autotest/frontend/tko/rpc_interface.py", line 184, in get_detailed_test_views
      test_views = models.TestView.list_objects(filter_data)
    File "/usr/local/autotest/frontend/afe/model_logic.py", line 817, in list_objects
      for model_object in query]
    File "/usr/local/autotest/site-packages/django/db/models/query.py", line 123, in _result_iter
      self._fill_cache()
    File "/usr/local/autotest/site-packages/django/db/models/query.py", line 927, in _fill_cache
      self._result_cache.append(next(self._iter))
    File "/usr/local/autotest/site-packages/django/db/models/query.py", line 301, in iterator
      for row in compiler.results_iter():
    File "/usr/local/autotest/site-packages/django/db/models/sql/compiler.py", line 775, in results_iter
      for rows in self.execute_sql(MULTI):
    File "/usr/local/autotest/site-packages/django/db/models/sql/compiler.py", line 839, in execute_sql
      cursor = self.connection.cursor()
    File "/usr/local/autotest/site-packages/django/db/backends/__init__.py", line 326, in cursor
      cursor = util.CursorWrapper(self._cursor(), self)
    File "/usr/local/autotest/site-packages/django/db/backends/mysql/base.py", line 405, in _cursor
      self.connection = Database.connect(**kwargs)
    File "/usr/local/autotest/site-packages/MySQLdb/__init__.py", line 81, in Connect
      return Connection(*args, **kwargs)
    File "/usr/local/autotest/site-packages/MySQLdb/connections.py", line 187, in __init__
      super(Connection, self).__init__(*args, **kwargs2)
  OperationalError: (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 0")
  )
  Retrying in 14.741500 seconds...
  <class 'autotest_lib.frontend.afe.json_rpc.proxy.JSONRPCException'>(OperationalError: (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 0")
  Traceback (most recent call last):
    File "/usr/local/autotest/frontend/afe/json_rpc/serviceHandler.py", line 109, in dispatchRequest
      results['result'] = self.invokeServiceEndpoint(meth, args)
    File "/usr/local/autotest/frontend/afe/json_rpc/serviceHandler.py", line 147, in invokeServiceEndpoint
      return meth(*args)
    File "/usr/local/autotest/frontend/afe/rpc_handler.py", line 270, in new_fn
      return f(*args, **keyword_args)
    File "/usr/local/autotest/frontend/tko/rpc_interface.py", line 184, in get_detailed_test_views
      test_views = models.TestView.list_objects(filter_data)
    File "/usr/local/autotest/frontend/afe/model_logic.py", line 817, in list_objects
      for model_object in query]
    File "/usr/local/autotest/site-packages/django/db/models/query.py", line 123, in _result_iter
      self._fill_cache()
    File "/usr/local/autotest/site-packages/django/db/models/query.py", line 927, in _fill_cache
      self._result_cache.append(next(self._iter))
    File "/usr/local/autotest/site-packages/django/db/models/query.py", line 301, in iterator
      for row in compiler.results_iter():
    File "/usr/local/autotest/site-packages/django/db/models/sql/compiler.py", line 775, in results_iter
      for rows in self.execute_sql(MULTI):
    File "/usr/local/autotest/site-packages/django/db/models/sql/compiler.py", line 839, in execute_sql
      cursor = self.connection.cursor()
    File "/usr/local/autotest/site-packages/django/db/backends/__init__.py", line 326, in cursor
      cursor = util.CursorWrapper(self._cursor(), self)
    File "/usr/local/autotest/site-packages/django/db/backends/mysql/base.py", line 405, in _cursor
      self.connection = Database.connect(**kwargs)
    File "/usr/local/autotest/site-packages/MySQLdb/__init__.py", line 81, in Connect
      return Connection(*args, **kwargs)
    File "/usr/local/autotest/site-packages/MySQLdb/connections.py", line 187, in __init__
      super(Connection, self).__init__(*args, **kwargs2)
  OperationalError: (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 0")
  )
  Retrying in 5.164849 seconds...
  <class 'autotest_lib.frontend.afe.json_rpc.proxy.JSONRPCException'>(OperationalError: (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 0")
  Traceback (most recent call last):
    File "/usr/local/autotest/frontend/afe/json_rpc/serviceHandler.py", line 109, in dispatchRequest
      results['result'] = self.invokeServiceEndpoint(meth, args)
    File "/usr/local/autotest/frontend/afe/json_rpc/serviceHandler.py", line 147, in invokeServiceEndpoint
      return meth(*args)
    File "/usr/local/autotest/frontend/afe/rpc_handler.py", line 270, in new_fn
      return f(*args, **keyword_args)
    File "/usr/local/autotest/frontend/tko/rpc_interface.py", line 184, in get_detailed_test_views
      test_views = models.TestView.list_objects(filter_data)
    File "/usr/local/autotest/frontend/afe/model_logic.py", line 817, in list_objects
      for model_object in query]
    File "/usr/local/autotest/site-packages/django/db/models/query.py", line 123, in _result_iter
      self._fill_cache()
    File "/usr/local/autotest/site-packages/django/db/models/query.py", line 927, in _fill_cache
      self._result_cache.append(next(self._iter))
    File "/usr/local/autotest/site-packages/django/db/models/query.py", line 301, in iterator
      for row in compiler.results_iter():
    File "/usr/local/autotest/site-packages/django/db/models/sql/compiler.py", line 775, in results_iter
      for rows in self.execute_sql(MULTI):
    File "/usr/local/autotest/site-packages/django/db/models/sql/compiler.py", line 839, in execute_sql
      cursor = self.connection.cursor()
    File "/usr/local/autotest/site-packages/django/db/backends/__init__.py", line 326, in cursor
      cursor = util.CursorWrapper(self._cursor(), self)
    File "/usr/local/autotest/site-packages/django/db/backends/mysql/base.py", line 405, in _cursor
      self.connection = Database.connect(**kwargs)
    File "/usr/local/autotest/site-packages/MySQLdb/__init__.py", line 81, in Connect
      return Connection(*args, **kwargs)
    File "/usr/local/autotest/site-packages/MySQLdb/connections.py", line 187, in __init__
      super(Connection, self).__init__(*args, **kwargs2)

Comment 1 by jdufault@chromium.org, Jan 8 2018

Owner: jrbarnette@chromium.org
Status: Assigned (was: Untriaged)
Assigning to infra deputy (jrbarnette@)

bot: https://luci-milo.appspot.com/buildbot/chromeos.chrome/veyron_minnie-tot-chrome-pfq-informational/7030

Comment 2 by jdufault@chromium.org, Jan 8 2018

Cc: xixuan@chromium.org

Comment 3 by jrbarnette@chromium.org, Jan 9 2018

Components: Infra>Client>ChromeOS

Comment 4 by jrbarnette@chromium.org, Jan 9 2018

Mergedinto: 800132
Status: Duplicate (was: Assigned)
There was a CloudSQL outage in our TKO database instance.  This
failure is in that very instance during the time period of the
known outage.
►

Sign in to add a comment