New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 821508 link

Starred by 2 users

Issue metadata

Status: Available
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

[Findit] Flaky test "testAnalysisRequestQueuedAsExpected"

Project Member Reported by wylieb@chromium.org, Mar 13 2018

Issue description

======================================================================
ERROR: test.findit_api_test.FinditApiTest.testAnalysisRequestQueuedAsExpected (/Users/wylieb/infra/infra/appengine/findit/test/findit_api_test.expected/FinditApiTest.testAnalysisRequestQueuedAsExpected.json)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/wylieb/infra/infra/ENV/lib/python2.7/site-packages/expect_tests/pipeline.py", line 398, in process_test
    subresult = subtest.run()
  File "/Users/wylieb/infra/infra/ENV/lib/python2.7/site-packages/expect_tests/type_definitions.py", line 253, in run
    return self.func_call(context=context)
  File "/Users/wylieb/infra/infra/ENV/lib/python2.7/site-packages/expect_tests/type_definitions.py", line 168, in __call__
    return f.func(*f.args, **f.kwargs)
  File "/Users/wylieb/infra/infra/ENV/lib/python2.7/site-packages/expect_tests/unittest_helper.py", line 40, in _RunTestCaseSingle
    return Result(test_method())
  File "/Users/wylieb/infra/infra/ENV/lib/python2.7/site-packages/mock.py", line 1220, in patched
    return func(*args, **keywargs)
  File "/Users/wylieb/infra/infra/appengine/findit/test/findit_api_test.py", line 1132, in testAnalysisRequestQueuedAsExpected
    self.assertEqual(expected_result, response.json_body.get('results', []))
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/unittest/case.py", line 515, in assertEqual
    assertion_func(first, second, msg=msg)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/unittest/case.py", line 744, in assertListEqual
    self.assertSequenceEqual(list1, list2, msg, seq_type=list)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/unittest/case.py", line 726, in assertSequenceEqual
    self.fail(msg)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/unittest/case.py", line 412, in fail
    raise self.failureException(msg)
AssertionError: Lists differ: [] != [{u'is_flaky_test': False, u'b...

Second list contains 1 additional elements.
First extra element 0:
{u'is_flaky_test': False, u'build_number': 5, u'first_known_failed_build_number': 3, u'is_sub_test': False, u'master_url': u'https://build.chromium.org/p/m', u'is_supported': True, u'builder_name': u'b', u'has_findings': False, u'is_finished': True, u'try_job_status': u'FINISHED', u'analysis_approach': u'HEURISTIC', u'step_name': u'test'}

- []
+ [{u'analysis_approach': u'HEURISTIC',
+   u'build_number': 5,
+   u'builder_name': u'b',
+   u'first_known_failed_build_number': 3,
+   u'has_findings': False,
+   u'is_finished': True,
+   u'is_flaky_test': False,
+   u'is_sub_test': False,
+   u'is_supported': True,
+   u'master_url': u'https://build.chromium.org/p/m',
+   u'step_name': u'test',
+   u'try_job_status': u'FINISHED'}]

==== captured logging output ====
LOG:
INFO: 1 build failure(s), while 1 are supported

STDOUT:
(empty)

STDERR:
(empty)



----------------------------------------------------------------------
Ran 2250 tests in 91.573s (actual tests runtime: 310.462s)

FAILED (errors=1)
Code coverage is 99.9%, target is 99%.

 

Sign in to add a comment