New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 870806 link

Starred by 2 users

Issue metadata

Status: Fixed
Owner:
Closed: Oct 9
Cc:
EstimatedDays: ----
NextAction: ----
OS: Linux , Android , Windows , iOS , Chrome , Mac , Fuchsia
Pri: 1
Type: Bug

Blocking:
issue 870813



Sign in to add a comment

Add UMA for LevelDB memory use for ProtoDatabase users.

Project Member Reported by thildebr@chromium.org, Aug 3

Issue description

To track improvements in memory use with the new unified database vs. the current multiple database approach, we need to add a histogram to measure the memory used after initialization of a LevelDB, the memory use of the MemTable.
 
Labels: Target-69
We should get this data as soon as posslble to ensure we are able to evaluate upcoming changes to the LevelDB infrastructure, so setting target to M-69.
Blocking: 870813
Project Member

Comment 3 by bugdroid1@chromium.org, Aug 13

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/c67cfe86a16a2c174ab32af869e3b434ccc93400

commit c67cfe86a16a2c174ab32af869e3b434ccc93400
Author: Troy Hildebrandt <thildebr@chromium.org>
Date: Mon Aug 13 18:14:40 2018

Add and record a histogram for LevelDB memory use after init.

Adds LevelDB.ApproximateMemoryUse.<clientname> histograms for memory
use after initialization. This should give us the size of the MemTable
right after initialization.

BUG= 870806 ,870813

Change-Id: I2c6ea6f176e92c319718ed29b6fb9192792bf7f1
Reviewed-on: https://chromium-review.googlesource.com/1162357
Commit-Queue: Troy Hildebrandt <thildebr@chromium.org>
Reviewed-by: Tommy Nyquist <nyquist@chromium.org>
Reviewed-by: Mark Pearson <mpearson@chromium.org>
Cr-Commit-Position: refs/heads/master@{#582641}
[modify] https://crrev.com/c67cfe86a16a2c174ab32af869e3b434ccc93400/components/leveldb_proto/leveldb_database.cc
[modify] https://crrev.com/c67cfe86a16a2c174ab32af869e3b434ccc93400/components/leveldb_proto/leveldb_database.h
[modify] https://crrev.com/c67cfe86a16a2c174ab32af869e3b434ccc93400/tools/metrics/histograms/histograms.xml

I think that when this has gone through a day of canary, we should ask for a merge to M69. You might want to give the TPM a heads up though.
Project Member

Comment 5 by bugdroid1@chromium.org, Sep 17

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/f802f9338c8a1c8dd115db21feae55eec77be553

commit f802f9338c8a1c8dd115db21feae55eec77be553
Author: Troy Hildebrandt <thildebr@chromium.org>
Date: Mon Sep 17 18:12:19 2018

Fix LevelDB approximate memory use histogram calculation.

Subtracts the share block cache charge from the approximate memory use
we receive from the LevelDB.

Bug:  870806 ,870813
Change-Id: I90f22d6ad9c7acc29746618bde77386ab3741e17
Reviewed-on: https://chromium-review.googlesource.com/1180271
Reviewed-by: Alexei Svitkine <asvitkine@chromium.org>
Reviewed-by: Tommy Nyquist <nyquist@chromium.org>
Commit-Queue: Troy Hildebrandt <thildebr@chromium.org>
Cr-Commit-Position: refs/heads/master@{#591740}
[modify] https://crrev.com/f802f9338c8a1c8dd115db21feae55eec77be553/components/leveldb_proto/leveldb_database.cc
[modify] https://crrev.com/f802f9338c8a1c8dd115db21feae55eec77be553/components/leveldb_proto/leveldb_database.h
[modify] https://crrev.com/f802f9338c8a1c8dd115db21feae55eec77be553/tools/metrics/histograms/histograms.xml

Cc: ssid@chromium.org
Labels: Merge-Request-70
Requesting a merge for the CL in #5.

Confirmed it's collecting good data in dev/canary for the last few days with no issues, very small change that just makes the approximate memory histogram more meaningful, and is very low risk.

Interest in this being merged has also been expressed by ssid@ to potentially help track down a memory regression.
Project Member

Comment 7 by sheriffbot@chromium.org, Sep 21

Labels: -Merge-Request-70 Merge-Review-70 Hotlist-Merge-Review
This bug requires manual review: M70 has already been promoted to the beta branch, so this requires manual review
Please contact the milestone owner if you have questions.
Owners: benmason@(Android), kariahda@(iOS), geohsu@(ChromeOS), abdulsyed@(Desktop)

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Please mark which OS's this is impacting. 
Labels: OS-Android OS-Chrome OS-Fuchsia OS-iOS OS-Linux OS-Mac OS-Windows
The issue I'm trying to track using the UMA is issue 887068, mentioned in comment #6
Labels: -Merge-Review-70 Merge-Approved-70
Labels: -Target-69 Target-70
Project Member

Comment 13 by bugdroid1@chromium.org, Sep 24

Labels: -merge-approved-70 merge-merged-3538
The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/382c65b67da8ef30805792f74aa9f82d5acacbd2

commit 382c65b67da8ef30805792f74aa9f82d5acacbd2
Author: Troy Hildebrandt <thildebr@chromium.org>
Date: Mon Sep 24 17:34:27 2018

Fix LevelDB approximate memory use histogram calculation.

Subtracts the share block cache charge from the approximate memory use
we receive from the LevelDB.

Bug:  870806 ,870813
Change-Id: I90f22d6ad9c7acc29746618bde77386ab3741e17
Reviewed-on: https://chromium-review.googlesource.com/1180271
Reviewed-by: Alexei Svitkine <asvitkine@chromium.org>
Reviewed-by: Tommy Nyquist <nyquist@chromium.org>
Commit-Queue: Troy Hildebrandt <thildebr@chromium.org>
Cr-Original-Commit-Position: refs/heads/master@{#591740}(cherry picked from commit f802f9338c8a1c8dd115db21feae55eec77be553)
Reviewed-on: https://chromium-review.googlesource.com/1240198
Reviewed-by: Troy Hildebrandt <thildebr@chromium.org>
Cr-Commit-Position: refs/branch-heads/3538@{#590}
Cr-Branched-From: 79f7c91a2b2a2932cd447fa6f865cb6662fa8fa6-refs/heads/master@{#587811}
[modify] https://crrev.com/382c65b67da8ef30805792f74aa9f82d5acacbd2/components/leveldb_proto/leveldb_database.cc
[modify] https://crrev.com/382c65b67da8ef30805792f74aa9f82d5acacbd2/components/leveldb_proto/leveldb_database.h
[modify] https://crrev.com/382c65b67da8ef30805792f74aa9f82d5acacbd2/tools/metrics/histograms/histograms.xml

Labels: Merge-Merged-70-3538
The following revision refers to this bug: 
https://chromium.googlesource.com/chromium/src.git/+/382c65b67da8ef30805792f74aa9f82d5acacbd2

Commit: 382c65b67da8ef30805792f74aa9f82d5acacbd2
Author: thildebr@chromium.org
Commiter: thildebr@chromium.org
Date: 2018-09-24 17:34:27 +0000 UTC

Fix LevelDB approximate memory use histogram calculation.

Subtracts the share block cache charge from the approximate memory use
we receive from the LevelDB.

Bug:  870806 ,870813
Change-Id: I90f22d6ad9c7acc29746618bde77386ab3741e17
Reviewed-on: https://chromium-review.googlesource.com/1180271
Reviewed-by: Alexei Svitkine <asvitkine@chromium.org>
Reviewed-by: Tommy Nyquist <nyquist@chromium.org>
Commit-Queue: Troy Hildebrandt <thildebr@chromium.org>
Cr-Original-Commit-Position: refs/heads/master@{#591740}(cherry picked from commit f802f9338c8a1c8dd115db21feae55eec77be553)
Reviewed-on: https://chromium-review.googlesource.com/1240198
Reviewed-by: Troy Hildebrandt <thildebr@chromium.org>
Cr-Commit-Position: refs/branch-heads/3538@{#590}
Cr-Branched-From: 79f7c91a2b2a2932cd447fa6f865cb6662fa8fa6-refs/heads/master@{#587811}
Status: Fixed (was: Assigned)

Sign in to add a comment