Issue metadata
Sign in to add a comment
|
afdo: implement a pipeline to pick up profiles from CWP for chrome |
||||||||||||||||||||||
Issue descriptionTo pick up profiles from CWP, we need to 1. Clean up the gcc/gcov pipeline. The gcc/gcov pipeline is no longer active and the corresponding codes needs a cleanup. 2. Automatically pick up profiles for exp1. 3. Point the location for exp1 to where CWP profiles are populated. 4. Add the staleness check.
,
Feb 20 2018
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/chromite/+/6e5f96a8b7b7571a2a2e1e7b21b86c3825b95190 commit 6e5f96a8b7b7571a2a2e1e7b21b86c3825b95190 Author: Ting-Yuan Huang <laszio@chromium.org> Date: Tue Feb 20 11:53:39 2018 afdo: update profiles from CWP TODO: staleness check, adjust path and filename A pipeline frontend produces AutoFDO profiles from CWP daily. This is the backend to pickup the profiles and update the ebuilds. BUG= chromium:812419 CQ-DEPEND=CL:919540 TEST=afdo_unittest cros tryjob: verified that the ebuild is modified as expected. Change-Id: I06bbae16b256540673fe46785206ae9a85b4547b Reviewed-on: https://chromium-review.googlesource.com/920624 Commit-Ready: Ting-Yuan Huang <laszio@chromium.org> Tested-by: Ting-Yuan Huang <laszio@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org> [modify] https://crrev.com/6e5f96a8b7b7571a2a2e1e7b21b86c3825b95190/cbuildbot/afdo.py [modify] https://crrev.com/6e5f96a8b7b7571a2a2e1e7b21b86c3825b95190/cbuildbot/afdo_unittest.py [modify] https://crrev.com/6e5f96a8b7b7571a2a2e1e7b21b86c3825b95190/cbuildbot/stages/afdo_stages.py
,
Feb 21 2018
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/chromite/+/e2ef78f2be977674faeb3d2f056a44efb8060725 commit e2ef78f2be977674faeb3d2f056a44efb8060725 Author: Ting-Yuan Huang <laszio@chromium.org> Date: Wed Feb 21 04:32:01 2018 afdo: clean gcc/gcov codes up, part2. test_stages.py was missed in the refactoring and resulted in an attribute / function not found error. TEST=tryjob chell-chrome-pfq-tryjob BUG= chromium:812419 Change-Id: Id77819a22d770cd70ab1ff79be88a0db5442783a Reviewed-on: https://chromium-review.googlesource.com/926049 Commit-Ready: ChromeOS CL Exonerator Bot <chromiumos-cl-exonerator@appspot.gserviceaccount.com> Tested-by: Ting-Yuan Huang <laszio@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Mike Frysinger <vapier@chromium.org> [modify] https://crrev.com/e2ef78f2be977674faeb3d2f056a44efb8060725/cbuildbot/stages/test_stages.py
,
Feb 22 2018
,
Feb 22 2018
,
Feb 23 2018
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/chromite/+/b5c6f76c0d37c72c1f014c09a47881ef219e7750 commit b5c6f76c0d37c72c1f014c09a47881ef219e7750 Author: Ting-Yuan Huang <laszio@chromium.org> Date: Fri Feb 23 11:36:22 2018 afdo: update profile location and naming convention for CWP Changing the profiles from, for example, gs://chromeos-localmirror/distfiles/afdo/experimental/cwp/chromeos-chrome-amd64-65.0.3299.0_rc-r1.afdo.bz2 to gs://chromeos-prebuilt/afdo-job/cwp/chrome/R65-3325.65-1519323840.afdo.xz TEST=afdo_unittest, master-chromium-pfq-tryjob BUG= chromium:812419 CQ-DEPEND=CL:932963 Change-Id: I81f85282379c2bf34240b0606aa4d765eb218aa7 Reviewed-on: https://chromium-review.googlesource.com/933087 Commit-Ready: Ting-Yuan Huang <laszio@chromium.org> Tested-by: Ting-Yuan Huang <laszio@chromium.org> Reviewed-by: Ting-Yuan Huang <laszio@chromium.org> [modify] https://crrev.com/b5c6f76c0d37c72c1f014c09a47881ef219e7750/cbuildbot/afdo.py [modify] https://crrev.com/b5c6f76c0d37c72c1f014c09a47881ef219e7750/cbuildbot/afdo_unittest.py
,
Feb 23 2018
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/588841f1355cdd924c6f7c88fde76a15b8521f29 commit 588841f1355cdd924c6f7c88fde76a15b8521f29 Author: Ting-Yuan Huang <laszio@chromium.org> Date: Fri Feb 23 11:36:21 2018 chromeos-chrome: change location for chrome_afdo_exp1 Previously, it was a place where profiles are manually uploaded. Now, the profiles are automatically generated. BUG= chromium:812419 TEST=falco-release-tryjob Change-Id: I4f41094b7f7bd8996f8436532a574e6395400b05 Reviewed-on: https://chromium-review.googlesource.com/932963 Commit-Ready: Ting-Yuan Huang <laszio@chromium.org> Tested-by: Ting-Yuan Huang <laszio@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org> [modify] https://crrev.com/588841f1355cdd924c6f7c88fde76a15b8521f29/chromeos-base/chromeos-chrome/chromeos-chrome-9999.ebuild [modify] https://crrev.com/588841f1355cdd924c6f7c88fde76a15b8521f29/chromeos-base/chromeos-chrome/Manifest
,
Mar 1 2018
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/chromite/+/38d67bb501bbfe64ff8f6f06584b59e7cfdf8a20 commit 38d67bb501bbfe64ff8f6f06584b59e7cfdf8a20 Author: Ting-Yuan Huang <laszio@chromium.org> Date: Thu Mar 01 07:54:38 2018 afdo: update the heuristic of profile selection When a branch just happens, the milestone of master increases by 1. There will be no profile from that milestone until a dev release is pushed for a short period of time. Therefore, a profile from previous branches must be picked instead. Originally, we search toward root in the branch tree for a profile. Now we prefer to look at the previous milestone if there's no profile from current milestone, because: 1. dev channel has few samples. The profile quality is much better from beta, which is always in a branch. 2. Master is actually closer to the branch tip than to the branch point, assuming that most of the changes on a branch are cherry-picked from master. TEST=afdo_unittest, master-chromium-pfq-tryjob BUG= chromium:812419 Change-Id: I80e0c917923820bbceecc2f25569e34ce27a9437 Reviewed-on: https://chromium-review.googlesource.com/935462 Commit-Ready: Ting-Yuan Huang <laszio@chromium.org> Tested-by: Ting-Yuan Huang <laszio@chromium.org> Reviewed-by: Ting-Yuan Huang <laszio@chromium.org> [modify] https://crrev.com/38d67bb501bbfe64ff8f6f06584b59e7cfdf8a20/cbuildbot/afdo.py [modify] https://crrev.com/38d67bb501bbfe64ff8f6f06584b59e7cfdf8a20/cbuildbot/afdo_unittest.py
,
Jul 27
|
|||||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||||
Comment 1 by bugdroid1@chromium.org
, Feb 17 2018