[Findit] Estimate statistics of gitiles-blame requests and gitiles-view requests. |
|||||||
Issue description[Findit] Estimate statistics of gitiles-blame requests and gitiles-view requests. The default quota of gitile is: gitiles-blame (All blame requests): 30/5mins gitiles-view (All changelogs requests): 1200/5mins Findit for crash right now only supports fracas, but we are about to support cracas and clusterfuzz. Gather statistics for these 2 kinds of requests for Fracas and estimate quota we need for cracas and clusterfuzz, so we can ask gitile team to increase the quota accordingly.
,
Sep 27 2016
After the quota issue is resolved, we can migrate the current findit for crash from googleplex to appspot, so the remote_api would work fine for findit for crash.
,
Sep 29 2016
From the statistics of last 2 days: For Fracas: ~622 total crahses/day, 2~40 crashes/30mins (Fracas sends a bunch of requests per half hour) gitiles-blame requests(git blame): 4~15/5mins gitiles-view requests(git changelogs and DEPS file git changelog): 5~20/5mins mmandlis@, can you estimate how many crashes would cracas send to findit? mbarbella@, can you give me some estimation about cluterfuzz if later we integrate? Thanks!
,
Oct 4 2016
,
Oct 4 2016
At the moment we run Cracas Analysis hourly and process about 10K signatures. I think we'll start with just querying FindIt about the ones "new" and "spike" and "up" on canary. Then we'll expand to sending "new" and "spike" and "up" on additional channels. This might be several hundreds per hour. Is this reasonable? Thanks!
,
Oct 4 2016
I think it's reasonable, however I still need some clusterfuzz data and ask git team. Thanks!
,
Oct 7 2016
Regarding ClusterFuzz, it catches a few hundreds of crashes a day, although they might not even out in the 24 hours.
,
Oct 7 2016
As far as the burstiness issue, we could always just have/let findit queue things up and deal with them as it has quota available. We'll want to monitor it to make sure things don't get too backlogged, but that can be fairly easily automated. In the long run we'll want to be smarter about how we issue requests to gitiles and cache responses, but I don't know that that's critical just yet.
,
Oct 20 2016
,
Nov 17 2016
,
Nov 17 2016
,
Jan 3 2017
After integration with Cracas, the quota seems fine. Keep monitoring and update the quota if needed.
,
May 15 2017
|
|||||||
►
Sign in to add a comment |
|||||||
Comment 1 by kateso...@chromium.org
, Sep 27 2016