Squawks nightly crosperf tests are using an old vanilla image |
||||
Issue description
The experiment file for squawks is stuck at R59-9368.0.0.
While lllvm_next trybot image is latest and therefore, there is a discrepancy in squawks nightly results.
Experiment file from email:
Note that rtybot image is R59-9392.0.0 while vanilla is a much older image R59-9368.0.0.
label: vanilla_image {
remote: chromeos2-row9-rack10-host7.cros chromeos2-row9-rack10-host9.cros
build: squawks-release/R59-9368.0.0
#actual_image: /usr/local/google2/crostc/chromeos/chroot/tmp/squawks-release/R59-9368.0.0/chromiumos_test_image.bin
#actual_autotest_path: /tmp/squawks-release/R59-9368.0.0/autotest_files
compiler: llvm
chromeos_root: /usr/local/google2/crostc/chromeos
}
label: llvm_next_trybot_image {
remote: chromeos2-row9-rack10-host7.cros chromeos2-row9-rack10-host9.cros
build: trybot-squawks-release/R59-9392.0.0-b9846
#actual_image: /usr/local/google2/crostc/chromeos/chroot/tmp/trybot-squawks-release/R59-9392.0.0-b9846/chromiumos_test_image.bin
compiler: llvm_next
autotest_path: /tmp/squawks-release/R59-9368.0.0/autotest_files
chromeos_root: /usr/local/google2/crostc/chromeos
}
,
Apr 3 2017
The vanilla squawks image is back.
,
Apr 19 2017
The issue is nightly tests pick a last passed vanilla on canary builders. Sometimes builds do not pass for weeks which makes the vanilla outdated for comparison. Assign to laszio@ since he added this logic.
,
Apr 19 2017
Nightly reports today used a very old vanilla again which makes comparison hard to make.
label: vanilla_image {
build: squawks-release/R59-9453.0.0
label: llvm_next_trybot_image {
build: trybot-squawks-release/R60-9475.0.0-b10599
,
Apr 19 2017
why are very old images used?
,
Apr 19 2017
Old images are used since nightly tests pick last passing canary build as vanilla, not the latest one.
,
Apr 20 2017
yes, but this should be one or 2 days old.. why is it older?
,
Apr 20 2017
Squawks canary last passed on April 11 so the vanilla is more than a week old now.
,
Apr 25 2017
Issue 714890 has been merged into this issue.
,
Apr 25 2017
|
||||
►
Sign in to add a comment |
||||
Comment 1 by manojgupta@chromium.org
, Mar 23 2017