New issue
Advanced search Search tips

Issue 748516 link

Starred by 1 user
Status: Duplicate
Merged: issue 711588
Owner:
mattm@chromium.org
Closed: Jul 2017
Components:
EstimatedDays: ----
NextAction: ----
OS: Mac
Pri: 2
Type: Bug

Blocking:
issue 748242



Sign in to add a comment

Some net_unittests HTTPSEVCRLSetTest and HTTPSOCSPTest tests fail on 10.13

Project Member Reported by rsesek@chromium.org, Jul 25 2017 
Chrome Version: 4b523c1060e2bc62bceb42e3d1674635cd48f2e0
OS: macOS 10.13 High Sierra

What steps will reproduce the problem?
(1) Run net_unittests on 10.13
(2) Observe the following test failures:


[ RUN      ] HTTPSEVCRLSetTest.MissingCRLSetAndInvalidOCSP
OCSP server started on 127.0.0.1:51133...
HTTPS server started on https://127.0.0.1:51134...
sending server_data: {"host": "127.0.0.1", "port": 51134} (36 bytes)
handling ocsp request
handling ocsp request
../../net/url_request/url_request_unittest.cc:10777: Failure
      Expected: ExpectedCertStatusForFailedOnlineEVRevocationCheck()
      Which is: 32
To be equal to: cert_status & CERT_STATUS_ALL_ERRORS
      Which is: 0
../../net/url_request/url_request_unittest.cc:10779: Failure
Value of: cert_status & CERT_STATUS_IS_EV
  Actual: true
Expected: false
[  FAILED  ] HTTPSEVCRLSetTest.MissingCRLSetAndInvalidOCSP (225 ms)


[ RUN      ] HTTPSEVCRLSetTest.FreshCRLSetNotCovered
OCSP server started on 127.0.0.1:51138...
HTTPS server started on https://127.0.0.1:51139...
sending server_data: {"host": "127.0.0.1", "port": 51139} (36 bytes)
handling ocsp request
handling ocsp request
../../net/url_request/url_request_unittest.cc:10904: Failure
      Expected: ExpectedCertStatusForFailedOnlineEVRevocationCheck()
      Which is: 32
To be equal to: cert_status & CERT_STATUS_ALL_ERRORS
      Which is: 0
../../net/url_request/url_request_unittest.cc:10906: Failure
Value of: cert_status & CERT_STATUS_IS_EV
  Actual: true
Expected: false
[  FAILED  ] HTTPSEVCRLSetTest.FreshCRLSetNotCovered (227 ms)
[17428/17430] HTTPSEVCRLSetTest.FreshCRLSetNotCovered (227 ms)
[ RUN      ] HTTPSEVCRLSetTest.ExpiredCRLSet
OCSP server started on 127.0.0.1:51143...
HTTPS server started on https://127.0.0.1:51144...
sending server_data: {"host": "127.0.0.1", "port": 51144} (36 bytes)
handling ocsp request
handling ocsp request
../../net/url_request/url_request_unittest.cc:10851: Failure
      Expected: ExpectedCertStatusForFailedOnlineEVRevocationCheck()
      Which is: 32
To be equal to: cert_status & CERT_STATUS_ALL_ERRORS
      Which is: 0
../../net/url_request/url_request_unittest.cc:10853: Failure
Value of: cert_status & CERT_STATUS_IS_EV
  Actual: true
Expected: false
[  FAILED  ] HTTPSEVCRLSetTest.ExpiredCRLSet (224 ms)


[ RUN      ] HTTPSOCSPTest.Invalid
OCSP server started on 127.0.0.1:51149...
HTTPS server started on https://127.0.0.1:51150...
sending server_data: {"host": "127.0.0.1", "port": 51150} (36 bytes)
handling ocsp request
handling ocsp request
../../net/url_request/url_request_unittest.cc:10114: Failure
      Expected: ExpectedCertStatusForFailedOnlineRevocationCheck()
      Which is: 32
To be equal to: cert_status & CERT_STATUS_ALL_ERRORS
      Which is: 0
../../net/url_request/url_request_unittest.cc:10117: Failure
Value of: cert_status & CERT_STATUS_IS_EV
  Actual: true
Expected: false
[  FAILED  ] HTTPSOCSPTest.Invalid (14597 ms)


What is the expected result?
Test passes

What happens instead?
Test fails

Please use labels and text to provide additional information.

Job: https://luci-milo.appspot.com/buildbot/chromium.fyi/Chromium%20Mac%2010.13/2
Logs: https://luci-logdog.appspot.com/v/?s=chromium%2Fbb%2Fchromium.fyi%2FChromium_Mac_10.13%2F2%2F%2B%2Frecipes%2Fsteps%2Fnet_unittests%2F0%2Fstdout


For graphics-related bugs, please copy/paste the contents of the about:gpu
page at the end of this report.

Comment 1 by rsleevi@chromium.org, Jul 25 2017 

Looks like it may be a bug in Apple's new revocation checking logic - or may be an intentional design.

At WWDC they announced they're using their own custom revocation system. We may need to disable these tests on 10.13 outright.

Comment 2 by mattm@chromium.org, Jul 25 2017

Owner: mattm@chromium.org
Status: Assigned (was: Untriaged)
Could also just be 711588 which has been happening since 10.12.something due to the changes in the result status codes, and which I totally dropped on the floor. I can take a look..

Comment 3 by mattm@chromium.org, Jul 25 2017 

How can I run jobs on that bot?
I tried git cl try -m "chromium.fyi" -b "Chromium_Mac_10.13"
but I get error:
ERROR: Access denied: User user:mattm@chromium.org cannot add builds to bucket master.chromium.fyi
same with trying with google.com account:
ERROR: Access denied: User user:mattm@google.com cannot add builds to bucket master.chromium.fyi

It doesn't show up on the try job selector on chromium-review.googlesource.com either.

Comment 4 by rsesek@chromium.org, Jul 26 2017 

We only have an FYI bot at the moment, no trybots. I'd be happy to run any test programs and report back with the output on a 10.13 machine/VM. We also have VMWare images available at go/mac-litterbox that you can run.

Comment 5 by mattm@chromium.org, Jul 27 2017

Mergedinto: 711588
Status: Duplicate (was: Assigned)
Okay I installed 10.13 on my test machine and verified that it's the same cause as  issue 711588 . Will continue there.
►

Sign in to add a comment