New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 595444 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Mar 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: All
Pri: 0
Type: Bug



Sign in to add a comment

High rate of corrupted Safe Browsing databases

Project Member Reported by nparker@chromium.org, Mar 16 2016

Issue description

SB2.DatabaseFailure metric started climbing on dev-windows around Feb 18, 2016.  Graph: https://goto.google.com/hmbrz.  It has rolled out w/ canary/dev/beta releases, so it's a client-side bug.  It affects W/M/C/L platforms.


My build from head doesn't yet reproduce this problem.

We're suspecting this CL: https://chromium.googlesource.com/chromium/src/+/a933956f59c648142b325d431a9d21f167e0d596%5E%21/chrome/browser/safe_browsing/safe_browsing_database.cc
 
Also seeing increments to SB2.FormatEvent[FORMAT_EVENT_FOUND_UNKNOWN] which implies the magic value in the file header is wrong, or the version is too large.
Cc: proberge@chromium.org
+progerge -- Can you confirm if the you've tested that goog-whitemodule-digest256 list works within chrome, and it'll match a test entry?  It loads/stores locally on my local build, but looks like it's corrupt on a majority of canary/dev users.

UMA value SB2.DatabaseSizeKilobytes.ModuleWhitelist has never been set, which is odd
Cc: nparker@chromium.org
Owner: proberge@chromium.org
One culprit: Once this store is found to be corrupted, it does not actually get deleted in SafeBrowsingDatabaseNew::Delete().  I've confirmed that once it's corrupted, it'll remain so.

proberge -- Can you fix this and merge to M50? Thx.

Comment 4 by proberge@google.com, Mar 17 2016

Ack. Thanks for letting me know!

@2: Yes, I've tested that the list works within Chrome. We've had a test entry in the list since February 25, which is still loaded on my local build.

I'll look into the corruption deletion.

Comment 6 by proberge@google.com, Mar 18 2016

Can you add the Merge-Request-50 label to this bug? I don't think I can add it without being the reporter.
Labels: Merge-Request-50
Better graph of failures: https://goto.google.com/vfafm
We should verify that Canary starts to drop quickly next week, and dev/beta soon after.  The upward slope is the based on total users who have every had that file get corrupted.

Comment 9 by tin...@google.com, Mar 18 2016

Labels: -Merge-Request-50 Merge-Approved-50
Merge approved for M50 (branch 2661). Pls merge after verified in Canary next Mon, then it can get into dev/beta soon after.
Thanks Tina, I'll hold off on submitting the merge until next Monday.
Looks like it's dropping in Canary in dev, as expected. Will submit the merge.
Project Member

Comment 12 by bugdroid1@chromium.org, Mar 21 2016

Labels: -merge-approved-50 merge-merged-2661
The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/a14cbfd08b6b71b33b05f91b248f7b1ced022af3

commit a14cbfd08b6b71b33b05f91b248f7b1ced022af3
Author: proberge <proberge@chromium.org>
Date: Mon Mar 21 13:48:49 2016

Properly handle the Module SBDatabase when it's corrupted

NOTRY=true
NOPRESUBMIT=true

BUG= 595444 

Review URL: https://codereview.chromium.org/1807253002

Cr-Commit-Position: refs/heads/master@{#381809}
(cherry picked from commit 78dad59bea7ba92dfa77efd3d79fed9d6baad85b)

Review URL: https://codereview.chromium.org/1814213002

Cr-Commit-Position: refs/branch-heads/2661@{#308}
Cr-Branched-From: ef6f6ae5e4c96622286b563658d5cd62a6cf1197-refs/heads/master@{#378081}

[modify] https://crrev.com/a14cbfd08b6b71b33b05f91b248f7b1ced022af3/chrome/browser/safe_browsing/safe_browsing_database.cc
[modify] https://crrev.com/a14cbfd08b6b71b33b05f91b248f7b1ced022af3/chrome/browser/safe_browsing/safe_browsing_database.h
[modify] https://crrev.com/a14cbfd08b6b71b33b05f91b248f7b1ced022af3/tools/metrics/histograms/histograms.xml

If this is fixed+merged, go ahead and and mark it as such.  Thanx.
Status: Fixed (was: Assigned)

Sign in to add a comment