New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 865538 link

Starred by 3 users

Issue metadata

Status: Assigned
Owner:
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug

Blocked on:
issue 829416

Blocking:
issue 865539
issue 921906
issue 921039


Participants' hotlists:
new-perf-windows-config


Sign in to add a comment

Deploy new windows configurations on perf waterfall

Project Member Reported by nednguyen@chromium.org, Jul 19

Issue description

Intended coverage:
Low End Laptop
Coverage: Windows 7 running 32-bit chrome
Rough Specs: 2 core, 8GB ram, Intel 630 HD Graphics, non-SSD drive
Potential Models: 
Acer Aspire 5, skylake processor
Dell Latitude 3580, kaby lake processor
Lenovo ThinkPad E470 20H1, kaby lake processor


High End Laptop
Coverage: Windows 10 running 64-bit chrome
Rough Specs: 4 core, 8GB RAM, High DPI, SSD, NVIDIA Graphics
Potential Models:
Lenovo P51, kaby lake processor
Dell Precision 5520, kaby lake processor

Expected number of hardware for each configuration:
48 (32 for perf waterfall & 16 for pinpoint)

This bug is for adding the machines to the perf waterfall.
 
Blocking: 865539
Blockedon: 829416
Cc: crouleau@chromium.org
Once issue 829416 is completed and we can run the benchmarks on those models, how will we decide which of the models to choose? Here's what I can think of:

1. Lab team preference: ask the lab folk which devices are the easiest to work with and prefer those.

2. Stability: Run the devices on the fyi waterfall for a while and prefer devices that fail the least over that time period.

3. Speed: Prefer the devices that take the least time to run the benchmarks.

4. Cost: Prefer the cheapest devices. 

Are there any other things we should be considering as we pick the model?

Is there a design doc for this work?
Owner: crouleau@chromium.org
Status: Assigned (was: Untriaged)
Tentatively assigning this to myself.
Cc: nedngu...@google.com eyaich@chromium.org
Ned, Emily, could you please advise per #4?

Potential models are 

Windows 10
Lenovo P51
Dell Precision 5520

Windows 7
Dell Latitude 3580
Lenovo ThinkPad E470 20H1

(Acer model was removed because lab folk were having trouble with it)
#4: another important factors are they cover important code areas/usage areas.

I suggest you discuss your choices with GPU team (kbr@, vmiura@) & windows team (brucedawson@) to see if those devices represent the Windows user base
Makes sense. Do you know if these models choices were already audited by the GPU team and the windows team? How did we pick these potential models originally? Is there a design doc?
Cc: nednguyen@chromium.org benhenry@chromium.org vhang@chromium.org
 Issue 779642  has been merged into this issue.
#8: there is no design doc, but I forwarded you the thread offline
We thoroughly vetted our choices with the gpu and windows team per this document: https://docs.google.com/document/d/1ybt8ytIq6iNVQtwlSAjBlXdfDB3PlXVdh2SSMx2lbaU/edit#heading=h.vffoodoufkab

I think at this point the most important thing is stability (which ones can we keep green) and availability.  I think we chose ones with the labs team that they were able to purchase in bulk, so it is a matter of getting them on the FYI and seeing which ones are having trouble and speed is important as well.
Blocking: 921039
Cc: jmad...@chromium.org
I just contacted our vendor and it looks like all of the laptops we bought are no longer being made and available for purchase.

Dell Precision 5520 -> replace by 5530
Lenovi P51 -> replace by P52

Asking vendor what the possible replacements for the following:

Acer Aspire 5 
Dell Latitude 3580
Lenovo ThinkPad E470

Once I know what's a possible replacements, I'll go through the process of ordering 2 of each again and johnw will help get them online.  We'll need to act a lot faster this second time around and make a decision quickly.
Yes, we can act much more quickly this time. Please ping me before you order two of each again since I need to make sure that we still need all of these. This time, we will short-circuit the process and make sure everything gets done quickly.

Comment 16 by crouleau@chromium.org, Jan 16 (6 days ago)

Labels: -Pri-2 Pri-1

Comment 17 by tikuta@chromium.org, Jan 17 (6 days ago)

Blocking: 921906

Sign in to add a comment