New issue
Advanced search Search tips

Issue 922650 link

Starred by 2 users

Issue metadata

Status: Untriaged
Owner: ----
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

Swarming page causes Chrome to be unusable

Project Member Reported by erikc...@chromium.org, Jan 16 (6 days ago)

Issue description

Site: https://chromium-swarm.appspot.com/task?id=4261753546188d10&refresh=10&show_raw=1
[Occurred again later with https://chromium-swarm.appspot.com/task?id=427039f13cdc0f10&refresh=10&show_raw=1]

Symptoms: Chrome was very barely usable. [10s to switch tabs, etc.]. I was unable to take a heap dump. I was unable to take a trace via chrome://tracing. The renderer for the site and the browser were both spinning at ~150% cores. 

I was able to take activity monitor samples of both of the processes. 

The browser process IO thread seems to be spinning at 100% performing extension + networking related work. The renderer process seems to be non-stop requesting resources. Not sure what we can do without a reliable repro. This might fall into the category of an extension DOSing the browser?
 
Screen Shot 2019-01-16 at 2.17.50 PM.png
42.3 KB View Download
unusable_renderer_sample.txt
3.7 MB View Download
unusable_browser_sample.txt
1022 KB View Download

Comment 1 by erikc...@chromium.org, Jan 18 (5 days ago)

This occurred again, on a different device. Not sure if it's the same problem. Chrome grew in memory by ~15GB over ~30 seconds. The memory was spread out 5GB/5GB/5GB over one browser and two renderers. I killed both renderers and memory stopped growing, but the browser is still unresponsive. From an activity monitor sample, it looks like the browser process UI thread is permanently hosed waiting for a command buffer flush. The IO thread is perpetually spinning at 100% doing mojo-related work.
unusable_chrome.txt
158 KB View Download

Comment 2 by erikc...@chromium.org, Jan 18 (5 days ago)

Cc: ellyjo...@chromium.org piman@chromium.org
+ellyjones in case she has any ideas about what to do with the problem I posted in c#0
+piman in case he has any insight into the problems with c#1 [unfortunately I don't have any insight about the renderers, I had to kill them before the machine locked up. This canary chrome is still unusable now, minutes afterwards, in case there's any insight we can gain from an unusable chrome]

Comment 3 by pi...@piman.org, Jan 18 (5 days ago)

busy IO thread will prevent the GPU work from making progress.

Comment 4 by ellyjo...@chromium.org, Today (16 hours ago)

Cc: erikc...@chromium.org
Labels: Needs-Feedback
#2: I don't really know what to add - it looks like we're just doing a ton of work. Does disabling extensions (any specific extension or all of them) ameliorate this?

Comment 5 by erikc...@chromium.org, Today (13 hours ago)

Cc: rockot@google.com
My device from c#1 was still spinning this morning after many hours of up time. I took a sample but forgot to save it -- it looked very similar to the one in c#2. This suggest some type of mojo-related live-lock on the IO thread. Unfortunately, I don't think we have enough info to debug. :(

+rockot to look at the sample in c#2 in case he has any insight into how Mojo could live-lock. 

Comment 6 by rockot@google.com, Today (13 hours ago)

That stack looks like the stack you see when a child process dies. Is it possible that something is causing us to rapidly spawn new processes that then die immediately?

Comment 7 by erikc...@chromium.org, Today (11 hours ago)

I was able to repro the issue again with steps in opening comment. After I killed the browser process, the renderers have continued !! to spin at 100% CPU on their IO threads, consuming ~10GB each. :(


sample_50775_after_browser_killed.txt
252 KB View Download
sample_50828.txt
1.6 MB View Download
sample_50775.txt
182 KB View Download
sample_44682.txt
1011 KB View Download
vmmaps.zip
951 KB Download

Sign in to add a comment