New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 722477 link

Starred by 1 user

Issue metadata

Status: Archived
Owner:
Last visit > 30 days ago
Closed: Jun 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Bug



Sign in to add a comment

HWTest infra failure in TKO parse/sponge upload

Project Member Reported by davidri...@chromium.org, May 15 2017

Issue description

The following build failed:
https://uberchromegw.corp.google.com/i/chromeos/builders/cave-paladin/builds/249

From HWTest logs https://luci-logdog.appspot.com/v/?s=chromeos%2Fbb%2Fchromeos%2Fcave-paladin%2F249%2F%2B%2Frecipes%2Fsteps%2FHWTest_  cheets_CTS.android.core.tests.libcore.package.harmony_java_math     ABORT: None
_bvt-inline_%2F0%2Fstdout
  118004940 cave-paladin/R60-9554.0.0-rc3/bvt-inline/cheets_CTS.6.0_r18.x86.android.core.tests.libcore.package.harmony_java_math started on: 2017-05-15 10:49:57 status Aborted

From .parse.log of the failing test:
https://storage.cloud.google.com/chromeos-autotest-results/117671939-chromeos-test/chromeos6-row2-rack18-host14/.parse.log?_ga=1.204327191.640049338.1494870094

INFO:root:Failed to upload to sponge.
tko parser: Failed to upload to sponge.
INFO:root:Traceback (most recent call last):
  File "/usr/local/autotest/site_utils/sponge_lib/sponge_utils.py", line 54, in upload_results
    return upload_utils.UploadInfo(info)
  File "/usr/local/autotest/site-packages/sponge/upload_utils.py", line 40, in UploadInfo
    invocation = formatter.format_data(info)
  File "/usr/local/autotest/site-packages/sponge/sponge_formatter.py", line 188, in format_data
    generate_and_format_child_tests(test_result_info)
  File "/usr/local/autotest/site-packages/sponge/sponge_formatter.py", line 184, in generate_and_format_child_tests
    child_formatter.format_test_result(child_test_result_info)
  File "/usr/local/autotest/site-packages/sponge/common_formatters.py", line 51, in format_test_result
    self._invoke_on_all('format_test_result', info)
  File "/usr/local/autotest/site-packages/sponge/common_formatters.py", line 23, in _invoke_on_all
    getattr(inner, func_name)(*args, **kwargs)
  File "/usr/local/autotest/site-packages/sponge/chromeos_sponge_formatters.py", line 90, in format_test_result
    end_time = long(test.end_time * 1000.0)
  File "/usr/local/autotest/site_utils/sponge_lib/autotest_job_info.py", line 154, in end_time
    return time_utils.to_utc_timestamp(self._test.finished_time)
  File "/usr/local/autotest/client/common_lib/time_utils.py", line 116, in to_utc_timestamp
    local_datetime = datetime_val.replace(tzinfo=tzlocal.get_localzone())
AttributeError: 'NoneType' object has no attribute 'replace'

Can this parse failure manifest into failing the build?

 
Description: Show this description

Comment 2 by dshi@chromium.org, May 15 2017

Cc: bpeake@chromium.org
+bpeake who made that change.

Comment 3 by dshi@chromium.org, May 15 2017

https://chrome-internal-review.googlesource.com/376468
https://chromium-review.googlesource.com/#/c/505940/

The second CL needs a push.

Anyhow, this exception is not the cause of the test failure. It seems the device went offline/unavailable after the sysinfo.iteration.before step, and the test was eventually aborted.
Sounds like it's not an issue with the sponge itself, but how we handle the devices going offline or times out?

Maybe move to a fixit bug since this would seem to be flake?
or looks like dshi's CL would take care of it...
Cc: chingcodes@chromium.org
Owner: dshi@chromium.org
Project Member

Comment 7 by bugdroid1@chromium.org, May 19 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/third_party/autotest/+/395697ddbbcf211271083b05a19531b74fc7e811

commit 395697ddbbcf211271083b05a19531b74fc7e811
Author: Dan Shi <dshi@google.com>
Date: Fri May 19 20:57:59 2017

[autotest] Handle tiem_utils call for None input

BUG= chromium:722477 
TEST=None

Change-Id: I2f4b52ce1896480289f5305ee387a879a4a26ecf
Reviewed-on: https://chromium-review.googlesource.com/505940
Commit-Ready: Dan Shi <dshi@google.com>
Tested-by: Dan Shi <dshi@google.com>
Reviewed-by: Benjamin Peake <bpeake@chromium.org>
Reviewed-by: Chris Ching <chingcodes@chromium.org>

[modify] https://crrev.com/395697ddbbcf211271083b05a19531b74fc7e811/client/common_lib/time_utils.py
[modify] https://crrev.com/395697ddbbcf211271083b05a19531b74fc7e811/site_utils/sponge_lib/sponge_utils.py

Comment 8 by dshi@chromium.org, Jun 2 2017

Status: Fixed (was: Untriaged)
Project Member

Comment 9 by bugdroid1@chromium.org, Jun 16 2017

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/chromeos/autotest-private-utils/+/925a6625abc16930d7976fc029e4b4f20e89e61e

commit 925a6625abc16930d7976fc029e4b4f20e89e61e
Author: Dan Shi <dshi@google.com>
Date: Mon May 15 20:52:16 2017

Labels: VerifyIn-61

Comment 11 by dchan@chromium.org, Jan 22 2018

Status: Archived (was: Fixed)

Sign in to add a comment