Investigate storing Rice encoded hashes on disk |
|
Issue descriptionV4Store currently stores RAW hashes on disk so that the load from disk on startup is fast. My non-scientific tests showed that Rice decoding takes a total of ~8 seconds for Malware and SocEng lists on Linux. It is unacceptable to block resource loads for that long. This is doable if we can find a way to speed up Rice-decoding hash prefixes.
,
Mar 7 2017
I agree with this, but something to keep in mind is update I/O costs, especially for low-end devices which may have inadequate flash controllers. Even there, though, I think the better wins are in strategies which use log files to collect incremental changes with periodic compaction, which can plausibly cut I/O by an amortized order of magnitude. |
|
►
Sign in to add a comment |
|
Comment 1 by vakh@chromium.org
, Mar 7 2017Status: WontFix (was: Assigned)