Parallel download Finch experiment group may compare different sample sets. |
||
Issue descriptionCurrently we have an issue that the Control group always read the default configuration of parallel download defined in the code. However, when tweaking the server config, we can use different slice size, which will result in experiment groups comparing different sample sets and undermine the credibility of metrics. For example, ThreeRequestEnabled group use 1.33MB as min slice size, then it compares with control group which read default min slice size of 2MB from code. Then files from 1.33MB to 2MB is not in control group but belongs to ThreeRequestEnabled group. We can add a finch parameter to disable parallel download while the feature is enabled. In this way, we can create a control group that enabled the feature and get the configuration and disable parallel download in the same time.
,
Jan 10 2018
This may need a new finch experiment on M65, probably on beta channel only where we can have fairly large number of users.
,
Jan 16 2018
The config for experiment on M65 is merged. |
||
►
Sign in to add a comment |
||
Comment 1 by bugdroid1@chromium.org
, Dec 14 2017