Paygen should generate a clear set of logs that show which payloads will be tests from what source versions.

Today, this data is very tricky to extract.


Sample logs related to the tests specified today:

00:57:30: INFO: Finished generating payloads: Build definition (board=u'auron-paine', version='9765.29.0', channel='dev-channel')
00:57:30: INFO: RunCommand: /b/c/cbuild/repository/.cache/common/gsutil_4.19.tar.gz/gsutil/gsutil ls 'gs://chromeos-image-archive/auron_paine-release/R*-9765.29.0'
00:57:32: INFO: Uploading 3 payload tests
00:57:32: INFO: Emitting control files into /tmp/cbuildbot-tmp6P57_Z/tmpfcTWVQ/autotests/autotest/au_control_files
00:57:32: INFO: RunCommand: /b/c/cbuild/repository/.cache/common/gsutil_4.19.tar.gz/gsutil/gsutil ls 'gs://chromeos-releases/dev-channel/auron-paine/9765.29.0/payloads/chromeos_9765.29.0_auron-paine_dev-channel_full_test.bin-*'
00:57:32: INFO: Source full test payload found at gs://chromeos-releases/dev-channel/auron-paine/9765.29.0/payloads/chromeos_9765.29.0_auron-paine_dev-channel_full_test.bin-177097e7b5737adc655677f695b8f598
00:57:32: INFO: RunCommand: /b/c/cbuild/repository/.cache/common/gsutil_4.19.tar.gz/gsutil/gsutil stat gs://chromeos-releases/dev-channel/auron-paine/9765.29.0/stateful.tgz
00:57:33: INFO: Control file emitted at /tmp/cbuildbot-tmp6P57_Z/tmpfcTWVQ/autotests/autotest/au_control_files/control.paygen_au_dev_full_9765.29.0
00:57:33: INFO: Source full test payload found at gs://chromeos-releases/dev-channel/auron-paine/9765.29.0/payloads/chromeos_9765.29.0_auron-paine_dev-channel_full_test.bin-177097e7b5737adc655677f695b8f598
00:57:33: INFO: RunCommand: /b/c/cbuild/repository/.cache/common/gsutil_4.19.tar.gz/gsutil/gsutil stat gs://chromeos-releases/dev-channel/auron-paine/9765.29.0/stateful.tgz
00:57:33: INFO: Control file emitted at /tmp/cbuildbot-tmp6P57_Z/tmpfcTWVQ/autotests/autotest/au_control_files/control.paygen_au_dev_delta_9765.29.0
00:57:33: INFO: RunCommand: /b/c/cbuild/repository/.cache/common/gsutil_4.19.tar.gz/gsutil/gsutil ls 'gs://chromeos-releases/dev-channel/auron-paine/9765.21.0/payloads/chromeos_9765.21.0_auron-paine_dev-channel_full_test.bin-*'
00:57:33: INFO: Source full test payload found at gs://chromeos-releases/dev-channel/auron-paine/9765.21.0/payloads/chromeos_9765.21.0_auron-paine_dev-channel_full_test.bin-4571bd8f4d32135e0ce96ad5edee7b5d
00:57:33: INFO: RunCommand: /b/c/cbuild/repository/.cache/common/gsutil_4.19.tar.gz/gsutil/gsutil stat gs://chromeos-releases/dev-channel/auron-paine/9765.21.0/stateful.tgz
00:57:34: INFO: Control file emitted at /tmp/cbuildbot-tmp6P57_Z/tmpfcTWVQ/autotests/autotest/au_control_files/control.paygen_au_dev_delta_9765.21.0
00:57:34: INFO: Packing autotest/au_control_files in /tmp/cbuildbot-tmp6P57_Z/tmpfcTWVQ/autotests into /tmp/cbuildbot-tmp6P57_Z/tmpfcTWVQ/autotests/paygen_au_dev_control.tar.bz2
00:57:34: INFO: RunCommand: tar --sparse -I /usr/bin/pbzip2 -cf /tmp/cbuildbot-tmp6P57_Z/tmpfcTWVQ/autotests/paygen_au_dev_control.tar.bz2 autotest/au_control_files in /tmp/cbuildbot-tmp6P57_Z/tmpfcTWVQ/autotests
00:57:34: INFO: Uploading autotest control tarball to gs://chromeos-image-archive/auron_paine-release/R61-9765.29.0/paygen_au_dev_control.tar.bz2
00:57:34: INFO: RunCommand: /b/c/cbuild/repository/.cache/common/gsutil_4.19.tar.gz/gsutil/gsutil cp -a public-read /tmp/cbuildbot-tmp6P57_Z/tmpfcTWVQ/autotests/paygen_au_dev_control.tar.bz2 gs://chromeos-image-archive/auron_paine-release/R61-9765.29.0/paygen_au_dev_control.tar.bz2
00:57:35: INFO: RunCommand: /b/c/cbuild/repository/.cache/common/gsutil_4.19.tar.gz/gsutil/gsutil -o 'Boto:num_retries=10' -h x-goog-if-generation-match:1502782105903918 rm gs://chromeos-releases/dev-channel/auron-paine/9765.29.0/payloads/LOCK_flag
00:57:35: INFO: RunCommand: /b/c/cbuild/repository/.cache/common/gsutil_4.19.tar.gz/gsutil/gsutil rm -R gs://chromeos-releases/dev-channel/auron-paine/9765.29.0/payloads/signing
00:57:36: INFO: Running cidb query on pid 32711, repr(query) starts with <sqlalchemy.sql.expression.Insert object at 0x7f6e73180890>


Sample logs for payloads generated. It would be good to use this as a model:

00:28:29: INFO: All payloads for the build:
00:28:29: INFO:   1: chromeos_9765.29.0_auron-paine_dev-channel_full_paine-mp-v2.bin-375695ce67f66ed6c9858a557b5d5563.signed
00:28:29: INFO:   2: chromeos_9765.29.0_auron-paine_dev-channel_full_test.bin-177097e7b5737adc655677f695b8f598
00:28:29: INFO:   3: chromeos_9765.29.0-9765.29.0_auron-paine_dev-channel_delta_test.bin-0ce9d60381b5668587024d1993293fe0
00:28:29: INFO:   4: chromeos_9765.21.0-9765.29.0_auron-paine_dev-channel_delta_paine-mp-v2.bin-ddef5c744bfede9072d0748cce35a1ca.signed
00:28:29: INFO:   5: chromeos_9765.21.0-9765.29.0_auron-paine_dev-channel_delta_test.bin-30c4168924a91ad02bb7830568cbce38