New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 685809 link

Starred by 1 user

Issue metadata

Status: Untriaged
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

Audit memory reporting mechanisms on macOS [ for waterfall memory tests]

Project Member Reported by erikc...@chromium.org, Jan 26 2017

Issue description

https://chromeperf.appspot.com/report?sid=a1cd291ab19b905530fa1b864c338cd448311848f7c0b5cdcfb638b3c22e5ac1&start_rev=420426&end_rev=446358

These graphs show "reported_by_os:resident_size_avg", and the graphs look bad, but also suspiciously linear. We should audit all the memory-reporting mechanisms to make sure they're sane.

e.g. what is "reported_by_os:resident_size_avg" actually measuring?
 
Screen Shot 2017-01-26 at 2.27.40 PM.png
205 KB View Download
Note that we are seeing the difference in the traces under total resident browser memory. However, we are not seeing differences in categories. Also note that while the total resident memory is showing ~100MB, the categories only add up to ~20MB. 

https://00e9e64bac56ee7e0a7663398e94f2ec105a2f4e52a9927741-apidata.googleusercontent.com/download/storage/v1/b/chrome-telemetry-output/o/trace-file-id_0-2017-01-24_23-12-34-38154.html?qk=AD5uMEvntr-d6gjGIbWUo3HDcBWEJI6SFlaqGJOLax2zQ80iTycNMQMRd4SlnOUVRiUABb7d-G4aFEgKFMHkfnvP26P11K0LJ3LdUpVNnPGOG-wbx3otrdavtGWPKNqWkVDd18VzYtB9Xaqu6DOgZM7HX51kDtGuVRpOYs3nDTizydEhYq-NpjCOWiIxNS1TeTvVGZYd7ZNT9G74OLco1mKQGeKu4kH-OqcyvdPxyWT8BxJOV0c4HlUNuXjb7kTkkoML-p8D0eiAFtFrUTVGlSW7DZ243a3n9L8LhExmh3os3YT4EK-blZWrXxj3NM6qW6R9QNTkqdXJBSW4_uDoU-UZFYXcJVqquNd4gkOFwOrlsuJUvhfCwACEZaKnh5CQLSK69j4hgg9cz95bR6xNM3eFe2pWUNVFn0Juae0YY2m4M6BNE4esf1H1M7hu6DJxaO_1B2No9vQxY5Z58mMOHMNLWP6cj-ZTo3R-qgWJuVoDLQwYa4xUhAalKdU1yujFvsttwYICerVQPeaj0PbkAH7dCIwPwAQ95SuZAszmrveLOh8AOvjBqTqz-A7k2aNGS_lGrRSj0WiX3vBvJNaqp4QBhK9klJd5crEBt6y9DqnpW47UfK2CGiU17QS8--xnErNHrccOgdSts2_yfMkNk1aX3Wd3nRD5mjtUnzfSLOblXIcO86PY0VBeC8oTbAUz0uUybEkhfIJPNiw6KtWg55POs1qVk3VrY_-85nSsCLEvja_PzLoOCgvGe3V3jIqagUVirEVDx_gZflCzmd9cyXK6XGeyBgAIzuDO33CkDElrXSzfboIkR7lLGoa3WgpJGhZ-_Tk8I1ITRxxJAA-3n12xMAva34hE9g

https://00e9e64bac16ff153c8ef9f1f57bb5f34fa1b48e7acb98cdb1-apidata.googleusercontent.com/download/storage/v1/b/chrome-telemetry-output/o/trace-file-id_0-2016-11-30_21-07-47-46943.html?qk=AD5uMEtr4PZZnKIDWtQufSYlTQ1-H-RyYvVwUEhDkVBbED02tkOHwmDExuJXwJhZfCCZp70czDfDejRAAVR5ra9g8haKk-qxq9mIPDeR6lF1B1J19IWGDPw_El3Ttjj3r2gGKoS_tdrv8kCKXJ9q3xASTaMYo9b3f0Dmv9bJHOFgwbCS2DEYY1hpvU9fulBXFi8O3mi4aPWoZ3KPTDSq_wPbd_4OFsmZlLvqoPCPT-fgZmCAZR6AHlltrdTgYb2EmEeq8Q7PPAbePXKhJLa1ld35ekwIBstCV6f-kvsVFBGIJvm8JN0K4N9a8EvI09ACTorgZN1CMcoz_DUuYyDBInCpR7V8HiIaViSmfZ4PwPjxU6zovMux0OhHp8mBEA3UIVn0ZTXUNvbzcl1gkiLxJJGyE56v_pDwd6KH-7dQJSLODVbfoEoxaC7hwj1rXNGl0FhfdczvCoxx_8VFPgi5xA8R88FVbfWlAD9Ii8uULl0nwDOvCGkRmh994UMSOFNoleav5yTwvJx2NFTwJvhIl30C3Ag-BxLCqnnjOMuzLbptrOeorxeqSCp3rCkeFdp9QH_wMCyMrF-B6CJkaBgKHw35asKx3q-Zh8EwfUndCdFMPMUIGIZBHiRNy6Yggd52_UPANFtfQg2ZIHZ-CErHfu9Ydzd6RYRJKWtupamPaPJ_cu6o0EBhjDqUJjc6bKFbPwm9WlXFlphlcYyGl-ZBC6rq7yCL4bnXrdBAsB574K_3e4aN7S0WW141VI2eaDr_kxYJA5vXS85J38QLzayJvjbJE8BO9IwJKYoPtyyp8JEW8cYwNdRysPTQXz6J8yjAolBAlTfiOrKXIk3QLbhgPmLGzRCocnd3Mg
Interesting datapoint. For a brand new Canary browser process on OSX with just about:blank opened:

memory-infra in chrome://Tracing reports 
  total resident: 203 MB
  malloc: 65 MB effective
          83 MB incl the tracing overhead
          124 MB virtual size

vmmap of the same process shows:
All malloc zones:
  123 MB virtual size
  75  MB allocated


so the numbers for malloc roughly match (the divergencies in the accounting of tracing overheads are WAI and are going to be dealt with by bit.ly/tracingv2)


Activity monitor, for the same process, shows:
Memory: 105 MB
Real Mem: 203 MB
Private Mem: 124 MB

now, the question I have are:
1) What do these numbers reported by activity monitor mean?

It seems that whatever we report in memory-infra as "total resident" match activity monitor's notion of "Real mem".
2) what are those 203 MB? What is there other than malloc (Which itself seems to be reported fine)?

among the various things, vmmap reports 36.6M of shared_memory. That could be one piece.
shared_memory is a missing piece but thankfully there is active work being done here (https://codereview.chromium.org/2535213002/)

Components: Internals>Instrumentation>Memory
Labels: Hotlist-MemoryInfra

Sign in to add a comment