New issue
Advanced search Search tips

Issue 669577 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Nov 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

MonitoringInvalidFieldTypeError: Metric "...resolve_devserver" was given field "devserver" with invalid value

Project Member Reported by dshi@chromium.org, Nov 29 2016

Issue description

11/29 10:19:30.972 ERROR|         interface:0166| Automatic monitoring flush failed.
Traceback (most recent call last):
  File "/usr/local/autotest/site-packages/chromite/third_party/infra_libs/ts_mon/common/interface.py", line 164, in _flush_and_log_exceptions
    flush()
  File "/usr/local/autotest/site-packages/chromite/third_party/infra_libs/ts_mon/common/interface.py", line 109, in flush
    metric.serialize_to(proto, start_time, fields, value, target)
  File "/usr/local/autotest/site-packages/chromite/third_party/infra_libs/ts_mon/common/metrics.py", line 115, in serialize_to
    self._populate_fields(metric_pb, fields)
  File "/usr/local/autotest/site-packages/chromite/third_party/infra_libs/ts_mon/common/metrics.py", line 142, in _populate_fields
    raise errors.MonitoringInvalidFieldTypeError(self._name, key, value)
MonitoringInvalidFieldTypeError: Metric "chrome/infra/chromeos/autotest/resolve_devserver" was given field "devserver" with invalid value "<autotest_lib.client.common_lib.cros.dev_server.AndroidBuildServer object at 0x7f28d8243e50>" (<class 'autotest_lib.client.common_lib.cros.dev_server.AndroidBuildServer'>).


Found in suite scheduler log.
 
The fsck? Looks like the same as https://bugs.chromium.org/p/chromium/issues/detail?id=667877 but that was reverted.

Is it another stale *.pyc issue?

Comment 2 by dshi@chromium.org, Nov 29 2016

suite scheduler needs to be restarted to pick up the change. It was restarted before the revert was pushed to the lab.

I just restarted it. It should be fixed now. Will check in an hour or so.
Can we restart suite scheduler on push?  This kind of limbo state is confusing.

Comment 4 by dshi@chromium.org, Nov 29 2016

suite scheduler is not 100% safe for restart, it might drop certain suite run during restart. Although it's rare case (it used to happen more because it ran way slower), we don't want to take the risk.

suite scheduler code is rather stable nowadays. And xixuanw is working on a new design to replace it.
Status: Fixed (was: Untriaged)

Sign in to add a comment