New issue
Advanced search Search tips

Issue 737628 link

Starred by 3 users

Issue metadata

Status: Verified
Owner:
Closed: Sep 2017
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 2
Type: Feature

Blocked on:
issue 737634
issue 737636
issue 754085
issue 755394
issue 765001



Sign in to add a comment

Add new (still-experimental) Chrome OS integration testing framework

Project Member Reported by derat@chromium.org, Jun 28 2017

Issue description

Still a work-in-progress, but it's coming along. Docs coming soon.
 

Comment 1 by derat@chromium.org, Jun 28 2017

Blockedon: 737634

Comment 2 by derat@chromium.org, Jun 28 2017

Blockedon: 737636

Comment 3 by derat@chromium.org, Jul 15 2017

Components: -Test
Project Member

Comment 4 by bugdroid1@chromium.org, Jul 18 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/6c92b78a8536d3d1c407eaab9b1a384997aa4798

commit 6c92b78a8536d3d1c407eaab9b1a384997aa4798
Author: Daniel Erat <derat@chromium.org>
Date: Tue Jul 18 07:32:51 2017

Update dev-go/dbus to use upstream commit bd29ed602e2c.

The previously-used revision, 25c3068a42a0, lacks the
Conn.RemoveSignal method.

BUG= chromium:737628 
TEST=package builds

Change-Id: Id9adacb0bda5558683b47a219c5d0cc30b8536c1
Reviewed-on: https://chromium-review.googlesource.com/572849
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Andrey Ulanov <andreyu@google.com>
Reviewed-by: Rahul Chaudhry <rahulchaudhry@chromium.org>

[rename] https://crrev.com/6c92b78a8536d3d1c407eaab9b1a384997aa4798/dev-go/dbus/dbus-0.0.2-r5.ebuild
[modify] https://crrev.com/6c92b78a8536d3d1c407eaab9b1a384997aa4798/dev-go/dbus/dbus-0.0.2.ebuild

Comment 5 by derat@chromium.org, Aug 10 2017

Blockedon: 754085

Comment 7 by derat@chromium.org, Aug 14 2017

Blockedon: 755394
Project Member

Comment 8 by bugdroid1@chromium.org, Aug 18 2017

The following revision refers to this bug:
  https://chrome-internal.googlesource.com/chromeos/manifest-internal/+/3dda23b6cadc8b67c0cc394e536c0dd2a9a3f705

commit 3dda23b6cadc8b67c0cc394e536c0dd2a9a3f705
Author: Daniel Erat <derat@chromium.org>
Date: Fri Aug 18 01:42:31 2017

Project Member

Comment 9 by bugdroid1@chromium.org, Aug 18 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/manifest/+/b76a43daf97ccee5f19299cb2324cd06efb402c3

commit b76a43daf97ccee5f19299cb2324cd06efb402c3
Author: Daniel Erat <derat@chromium.org>
Date: Fri Aug 18 01:42:32 2017

manifest: Add src/platform/tast.

BUG= chromium:737628 
TEST=symlinked to .repo/manifest.xml and synced

Change-Id: Ic2cdccdc5c732c5a5a4aef9411e9393589322e7c
Reviewed-on: https://chromium-review.googlesource.com/619278
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[modify] https://crrev.com/b76a43daf97ccee5f19299cb2324cd06efb402c3/full.xml

Project Member

Comment 10 by bugdroid1@chromium.org, Aug 18 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/63e938c72fee7001a7c649b35d6e6f2795652aa8

commit 63e938c72fee7001a7c649b35d6e6f2795652aa8
Author: Daniel Erat <derat@chromium.org>
Date: Fri Aug 18 21:12:44 2017

tast: Add README.md and overview.md.

Add initial documentation.

BUG= chromium:737628 
TEST=none

Change-Id: I4101cbee5eb2b1dc1b96055a7da865305dfe538a
Reviewed-on: https://chromium-review.googlesource.com/621416
Reviewed-by: Jason Clinton <jclinton@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>

[add] https://crrev.com/63e938c72fee7001a7c649b35d6e6f2795652aa8/docs/overview.md
[add] https://crrev.com/63e938c72fee7001a7c649b35d6e6f2795652aa8/README.md

Project Member

Comment 11 by bugdroid1@chromium.org, Aug 22 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/2029c0667ce4ed7ec6a2a5f5540e6a5620afa8bb

commit 2029c0667ce4ed7ec6a2a5f5540e6a5620afa8bb
Author: Daniel Erat <derat@chromium.org>
Date: Tue Aug 22 17:06:51 2017

tast: Add common/testing and common/testing/attr.

Add a shared package used to define, select, and run tests.

BUG= chromium:737628 
TEST=added unit tests; also used a bunch with the rest of
     the not-yet-landed code

Change-Id: I5c7d189fa225145681ae2657a90b0e7053e68d9b
Reviewed-on: https://chromium-review.googlesource.com/621419
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[add] https://crrev.com/2029c0667ce4ed7ec6a2a5f5540e6a5620afa8bb/src/chromiumos/tast/common/testing/test_test.go
[add] https://crrev.com/2029c0667ce4ed7ec6a2a5f5540e6a5620afa8bb/src/chromiumos/tast/common/testing/attr/attr.go
[add] https://crrev.com/2029c0667ce4ed7ec6a2a5f5540e6a5620afa8bb/src/chromiumos/tast/common/testing/registry.go
[add] https://crrev.com/2029c0667ce4ed7ec6a2a5f5540e6a5620afa8bb/src/chromiumos/tast/common/testing/global.go
[add] https://crrev.com/2029c0667ce4ed7ec6a2a5f5540e6a5620afa8bb/src/chromiumos/tast/common/testing/state_test.go
[add] https://crrev.com/2029c0667ce4ed7ec6a2a5f5540e6a5620afa8bb/src/chromiumos/tast/common/testing/state.go
[add] https://crrev.com/2029c0667ce4ed7ec6a2a5f5540e6a5620afa8bb/src/chromiumos/tast/common/testing/attr/attr_test.go
[add] https://crrev.com/2029c0667ce4ed7ec6a2a5f5540e6a5620afa8bb/src/chromiumos/tast/common/testing/test.go
[add] https://crrev.com/2029c0667ce4ed7ec6a2a5f5540e6a5620afa8bb/src/chromiumos/tast/common/testing/registry_test.go

Project Member

Comment 12 by bugdroid1@chromium.org, Aug 22 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/9877659a73326247c4f5630e3d8730f0efd7b165

commit 9877659a73326247c4f5630e3d8730f0efd7b165
Author: Daniel Erat <derat@chromium.org>
Date: Tue Aug 22 20:17:57 2017

tast: Add common/control.

Add a shared package used to read and write control messages
used for communication between test binaries and the tast
executable.

BUG= chromium:737628 
TEST=added unit tests; also used a bunch with the rest of
     the not-yet-landed code

Change-Id: I2e61f4ccd238011a11b6d3a4227cdf52ba64d19a
Reviewed-on: https://chromium-review.googlesource.com/625163
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[add] https://crrev.com/9877659a73326247c4f5630e3d8730f0efd7b165/src/chromiumos/tast/common/control/control.go
[add] https://crrev.com/9877659a73326247c4f5630e3d8730f0efd7b165/src/chromiumos/tast/common/control/control_test.go

Project Member

Comment 13 by bugdroid1@chromium.org, Aug 26 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/58e5d1a21892c34c7c36f566a14ae23c902f7362

commit 58e5d1a21892c34c7c36f566a14ae23c902f7362
Author: Daniel Erat <derat@chromium.org>
Date: Sat Aug 26 14:17:14 2017

tast: Add common/host and common/testutil.

Add a package for establishing SSH connections to remote
hosts and some small test utility functions shared by
multiple packages.

BUG= chromium:737628 
TEST=added unit tests

Change-Id: I9dda21c8158a633885bf3fa6a1f2eddfc573b96c
Reviewed-on: https://chromium-review.googlesource.com/630758
Tested-by: Dan Erat <derat@chromium.org>
Trybot-Ready: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[add] https://crrev.com/58e5d1a21892c34c7c36f566a14ae23c902f7362/src/chromiumos/tast/common/host/test/ssh_server.go
[add] https://crrev.com/58e5d1a21892c34c7c36f566a14ae23c902f7362/src/chromiumos/tast/common/host/ssh.go
[add] https://crrev.com/58e5d1a21892c34c7c36f566a14ae23c902f7362/src/chromiumos/tast/common/testutil/files.go
[add] https://crrev.com/58e5d1a21892c34c7c36f566a14ae23c902f7362/src/chromiumos/tast/common/host/ssh_test.go

Project Member

Comment 14 by bugdroid1@chromium.org, Aug 27 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/83c147c0b1c0c77b82b743da8e75df2bf0be1c48

commit 83c147c0b1c0c77b82b743da8e75df2bf0be1c48
Author: Daniel Erat <derat@chromium.org>
Date: Sun Aug 27 15:17:09 2017

tast: Add common/runner.

Add a shared package that implements functionality needed by
the local_tests and remote_tests executables.

BUG= chromium:737628 
TEST=added unit tests

Change-Id: I807a6da9d0a1e71dbd897c45aaeb7693d656a80c
Reviewed-on: https://chromium-review.googlesource.com/636847
Reviewed-by: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>

[add] https://crrev.com/83c147c0b1c0c77b82b743da8e75df2bf0be1c48/src/chromiumos/tast/common/runner/runner_test.go
[add] https://crrev.com/83c147c0b1c0c77b82b743da8e75df2bf0be1c48/src/chromiumos/tast/common/runner/runner.go

Project Member

Comment 16 by bugdroid1@chromium.org, Aug 29 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/cc8324720168c1ed2e58ededa020e1b2bf82a895

commit cc8324720168c1ed2e58ededa020e1b2bf82a895
Author: Daniel Erat <derat@chromium.org>
Date: Tue Aug 29 01:21:36 2017

tast-common: Add ebuild.

Add an ebuild for shared Go packages used for integration
testing.

BUG= chromium:737628 
TEST=emerged with FEATURES=test

Change-Id: I37c700959b233c641157ee3ed6cbdc9af97026de
Reviewed-on: https://chromium-review.googlesource.com/636060
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>
Reviewed-by: Rahul Chaudhry <rahulchaudhry@chromium.org>

[add] https://crrev.com/cc8324720168c1ed2e58ededa020e1b2bf82a895/chromeos-base/tast-common/tast-common-9999.ebuild

Project Member

Comment 17 by bugdroid1@chromium.org, Aug 29 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/2cc961d46a14500c23735ae27376d078ecb87e1e

commit 2cc961d46a14500c23735ae27376d078ecb87e1e
Author: Daniel Erat <derat@chromium.org>
Date: Tue Aug 29 09:39:08 2017

tast: Add local/logs.

Add a package used by the local-test executable to collect
updates to system log files while tests were running.

BUG= chromium:737628 
TEST=added unit tests

Change-Id: I3ea3b48e78082bf47aa758e92c461cad08c3bebb
Reviewed-on: https://chromium-review.googlesource.com/639214
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[add] https://crrev.com/2cc961d46a14500c23735ae27376d078ecb87e1e/src/chromiumos/tast/local/logs/logs_test.go
[add] https://crrev.com/2cc961d46a14500c23735ae27376d078ecb87e1e/src/chromiumos/tast/local/logs/logs.go

Project Member

Comment 18 by bugdroid1@chromium.org, Aug 31 2017

Project Member

Comment 19 by bugdroid1@chromium.org, Aug 31 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/dd475b24416b4366758b149ae270e0ae2bff4422

commit dd475b24416b4366758b149ae270e0ae2bff4422
Author: Daniel Erat <derat@chromium.org>
Date: Thu Aug 31 01:23:29 2017

tast: Add local/power and local/tests.

Add an initial set of local tests, along with a package that
local tests can use to interact with powerd.

BUG= chromium:737628 
TEST=ran tests (using upcoming code)

Change-Id: I63fc767cbe70023281b87b07136aa63482109a29
Reviewed-on: https://chromium-review.googlesource.com/642506
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Dan Erat <derat@chromium.org>

[add] https://crrev.com/dd475b24416b4366758b149ae270e0ae2bff4422/src/chromiumos/tast/local/tests/power/check_status.go
[add] https://crrev.com/dd475b24416b4366758b149ae270e0ae2bff4422/src/chromiumos/tast/local/tests/example/data/data_files_common.txt
[add] https://crrev.com/dd475b24416b4366758b149ae270e0ae2bff4422/src/chromiumos/tast/local/tests/ui/chrome_sanity.go
[add] https://crrev.com/dd475b24416b4366758b149ae270e0ae2bff4422/src/chromiumos/tast/local/tests/example/data/data_files_aarch64.txt
[add] https://crrev.com/dd475b24416b4366758b149ae270e0ae2bff4422/src/chromiumos/tast/local/tests/example/data/data_files_x86_64.txt
[add] https://crrev.com/dd475b24416b4366758b149ae270e0ae2bff4422/src/chromiumos/tast/local/tests/example/dbus.go
[add] https://crrev.com/dd475b24416b4366758b149ae270e0ae2bff4422/src/chromiumos/tast/local/tests/example/data/data_files_i686.txt
[add] https://crrev.com/dd475b24416b4366758b149ae270e0ae2bff4422/src/chromiumos/tast/local/tests/example/data_files.go
[add] https://crrev.com/dd475b24416b4366758b149ae270e0ae2bff4422/src/chromiumos/tast/local/tests/example/pass.go
[add] https://crrev.com/dd475b24416b4366758b149ae270e0ae2bff4422/src/chromiumos/tast/local/tests/example/data/data_files_armv7l.txt
[add] https://crrev.com/dd475b24416b4366758b149ae270e0ae2bff4422/src/chromiumos/tast/local/power/status.go
[add] https://crrev.com/dd475b24416b4366758b149ae270e0ae2bff4422/src/chromiumos/tast/local/tests/example/fail.go
[add] https://crrev.com/dd475b24416b4366758b149ae270e0ae2bff4422/src/chromiumos/tast/local/tests/security/log_perms.go

Project Member

Comment 20 by bugdroid1@chromium.org, Aug 31 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/24f52efe3d7aeea0caebefacb38f7399084f6ec0

commit 24f52efe3d7aeea0caebefacb38f7399084f6ec0
Author: Daniel Erat <derat@chromium.org>
Date: Thu Aug 31 01:23:29 2017

tast: Add local_tests executable.

Add code for the executable containing local tests.

BUG= chromium:737628 
TEST=local tests pass

Change-Id: Ia059693d0a6fa48f6834d1d11951f7b7764fdfe6
Reviewed-on: https://chromium-review.googlesource.com/643706
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[add] https://crrev.com/24f52efe3d7aeea0caebefacb38f7399084f6ec0/src/chromiumos/tast/local/data_files.go
[add] https://crrev.com/24f52efe3d7aeea0caebefacb38f7399084f6ec0/src/chromiumos/tast/local/data_files_test.go
[add] https://crrev.com/24f52efe3d7aeea0caebefacb38f7399084f6ec0/src/chromiumos/tast/local/main.go

Project Member

Comment 21 by bugdroid1@chromium.org, Aug 31 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/69996f84ef951ffc90e268faa6eb608cfa8b911c

commit 69996f84ef951ffc90e268faa6eb608cfa8b911c
Author: Daniel Erat <derat@chromium.org>
Date: Thu Aug 31 07:24:09 2017

tast-local-tests: Add ebuild.

Add an ebuild for local integration tests.

BUG= chromium:737628 
TEST=emerged with FEATURES=test

Change-Id: I16ba76df99b6fef692401ddb92d8e05859102c3a
Reviewed-on: https://chromium-review.googlesource.com/644767
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[add] https://crrev.com/69996f84ef951ffc90e268faa6eb608cfa8b911c/chromeos-base/tast-local-tests/tast-local-tests-9999.ebuild

Project Member

Comment 22 by bugdroid1@chromium.org, Aug 31 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/c1ca4d52ce7604eb64a076b8a1b7103f58e1e4d1

commit c1ca4d52ce7604eb64a076b8a1b7103f58e1e4d1
Author: Daniel Erat <derat@chromium.org>
Date: Thu Aug 31 09:37:09 2017

tast: Move common test-running code to runner.RunTests.

Move test-running functionality out of the local_tests
executable and into the common/runner package so it can be
shared with remote_tests.

BUG= chromium:737628 
TEST=local and remote tests work

Change-Id: Icd7c6c0f28d1e44029b81122ccb774cf9c2bd0fe
Reviewed-on: https://chromium-review.googlesource.com/644729
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[modify] https://crrev.com/c1ca4d52ce7604eb64a076b8a1b7103f58e1e4d1/src/chromiumos/tast/common/testing/state.go
[modify] https://crrev.com/c1ca4d52ce7604eb64a076b8a1b7103f58e1e4d1/src/chromiumos/tast/common/runner/runner_test.go
[modify] https://crrev.com/c1ca4d52ce7604eb64a076b8a1b7103f58e1e4d1/src/chromiumos/tast/local/main.go
[modify] https://crrev.com/c1ca4d52ce7604eb64a076b8a1b7103f58e1e4d1/src/chromiumos/tast/common/runner/runner.go

Project Member

Comment 23 by bugdroid1@chromium.org, Aug 31 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/de3435e1dbabb7ce562d953f7b0505e6f18d8252

commit de3435e1dbabb7ce562d953f7b0505e6f18d8252
Author: Daniel Erat <derat@chromium.org>
Date: Thu Aug 31 18:52:50 2017

tast: Add remote_tests executable.

Add the executable containing remote tests, along with the
remote/dut package and a single test that reboots the DUT.

BUG= chromium:737628 
TEST=test passes

Change-Id: Ica477ff77efd8ef63cd112a8346a25099cb83305
Reviewed-on: https://chromium-review.googlesource.com/644772
Commit-Ready: Dan Erat (OOO Fri-Mon) <derat@chromium.org>
Tested-by: Dan Erat (OOO Fri-Mon) <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[add] https://crrev.com/de3435e1dbabb7ce562d953f7b0505e6f18d8252/src/chromiumos/tast/remote/dut/dut.go
[add] https://crrev.com/de3435e1dbabb7ce562d953f7b0505e6f18d8252/src/chromiumos/tast/remote/main.go
[add] https://crrev.com/de3435e1dbabb7ce562d953f7b0505e6f18d8252/src/chromiumos/tast/remote/tests/power/reboot.go

Project Member

Comment 24 by bugdroid1@chromium.org, Sep 1 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/1686f5f2edb37decda7d9146e2a0fbe936907f7a

commit 1686f5f2edb37decda7d9146e2a0fbe936907f7a
Author: Daniel Erat <derat@chromium.org>
Date: Fri Sep 01 07:44:32 2017

tast: Add tast/timing.

Add a package used to collect and write timing information
about invocations of the tast executable.

BUG= chromium:737628 
TEST=tests pass

Change-Id: I6a85bee386fbb125476552e5f468aa7939b31a93
Reviewed-on: https://chromium-review.googlesource.com/646579
Commit-Ready: Dan Erat (OOO Fri-Mon) <derat@chromium.org>
Tested-by: Dan Erat (OOO Fri-Mon) <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[add] https://crrev.com/1686f5f2edb37decda7d9146e2a0fbe936907f7a/src/chromiumos/tast/tast/timing/timing.go
[add] https://crrev.com/1686f5f2edb37decda7d9146e2a0fbe936907f7a/src/chromiumos/tast/tast/timing/timing_test.go

Project Member

Comment 25 by bugdroid1@chromium.org, Sep 1 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/c38ca104ddfb95a2202b156ec37d6199a403d8f7

commit c38ca104ddfb95a2202b156ec37d6199a403d8f7
Author: Daniel Erat <derat@chromium.org>
Date: Fri Sep 01 07:44:31 2017

tast: Add tast/logging.

Add the tast/logging package, used by the tast executable to
log its status.

BUG= chromium:737628 
TEST=tests pass

Change-Id: Ib6f947d3d777f19ee7a39442bfce18dd842fb468
Reviewed-on: https://chromium-review.googlesource.com/646710
Commit-Ready: Dan Erat (OOO Fri-Mon) <derat@chromium.org>
Tested-by: Dan Erat (OOO Fri-Mon) <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[add] https://crrev.com/c38ca104ddfb95a2202b156ec37d6199a403d8f7/src/chromiumos/tast/tast/logging/logger.go
[add] https://crrev.com/c38ca104ddfb95a2202b156ec37d6199a403d8f7/src/chromiumos/tast/tast/logging/simple.go
[add] https://crrev.com/c38ca104ddfb95a2202b156ec37d6199a403d8f7/src/chromiumos/tast/tast/logging/simple_test.go

Project Member

Comment 26 by bugdroid1@chromium.org, Sep 2 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/8250e8019bcf6a3e0a301c80771ebd81b58a8894

commit 8250e8019bcf6a3e0a301c80771ebd81b58a8894
Author: Daniel Erat <derat@chromium.org>
Date: Sat Sep 02 02:01:34 2017

tast: Add tast/build.

Add a package that's used by the tast executable to build
test executables.

BUG= chromium:737628 
TEST=tests pass

Change-Id: Ibda73678731809da1c1653312a57e7e8ab295f5b
Reviewed-on: https://chromium-review.googlesource.com/648365
Commit-Ready: Dan Erat (OOO Fri-Mon) <derat@chromium.org>
Tested-by: Dan Erat (OOO Fri-Mon) <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[add] https://crrev.com/8250e8019bcf6a3e0a301c80771ebd81b58a8894/src/chromiumos/tast/tast/build/build.go
[add] https://crrev.com/8250e8019bcf6a3e0a301c80771ebd81b58a8894/src/chromiumos/tast/tast/build/config.go
[add] https://crrev.com/8250e8019bcf6a3e0a301c80771ebd81b58a8894/src/chromiumos/tast/tast/build/build_test.go

Project Member

Comment 29 by bugdroid1@chromium.org, Sep 4 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/978dbbb6ceefb339aead439ba30adb577cd86fa3

commit 978dbbb6ceefb339aead439ba30adb577cd86fa3
Author: Daniel Erat <derat@chromium.org>
Date: Mon Sep 04 05:27:47 2017

tast: Improve stderr handling when reading test output.

Update the tast/run package to keep stdout and stderr
separate when running test executables. Introduce a new
firstLineReader type to simplify reading the first line of
stderr.

BUG= chromium:737628 
TEST=added tests; also made test executables write to stderr
     before exiting with 1 and verified that the first line
     was logged

Change-Id: I21c544baecb6768f03d6299092f85db591c94973
Reviewed-on: https://chromium-review.googlesource.com/648634
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Dan Erat <derat@chromium.org>

[add] https://crrev.com/978dbbb6ceefb339aead439ba30adb577cd86fa3/src/chromiumos/tast/tast/run/line.go
[add] https://crrev.com/978dbbb6ceefb339aead439ba30adb577cd86fa3/src/chromiumos/tast/tast/run/line_test.go
[modify] https://crrev.com/978dbbb6ceefb339aead439ba30adb577cd86fa3/src/chromiumos/tast/common/host/ssh.go
[modify] https://crrev.com/978dbbb6ceefb339aead439ba30adb577cd86fa3/src/chromiumos/tast/tast/run/remote.go
[modify] https://crrev.com/978dbbb6ceefb339aead439ba30adb577cd86fa3/src/chromiumos/tast/tast/run/local.go

Project Member

Comment 30 by bugdroid1@chromium.org, Sep 4 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/3dac9409375c6fcbc66cee64300b4f255817027b

commit 3dac9409375c6fcbc66cee64300b4f255817027b
Author: Daniel Erat <derat@chromium.org>
Date: Mon Sep 04 20:05:50 2017

Add tast-cmd and tast-remote-tests.

Add packages for integration testing:

chromeos-base/tast-cmd: Host test controller.
chromeos-base/tast-remote-tests: Remote ("server") tests.

BUG= chromium:737628 
TEST=built both with FEATURES=test

Change-Id: I80bf9676a0652cd44c3f599c017a7289c63541ac
Reviewed-on: https://chromium-review.googlesource.com/649286
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[add] https://crrev.com/3dac9409375c6fcbc66cee64300b4f255817027b/chromeos-base/tast-remote-tests/tast-remote-tests-9999.ebuild
[add] https://crrev.com/3dac9409375c6fcbc66cee64300b4f255817027b/chromeos-base/tast-cmd/tast-cmd-9999.ebuild

Project Member

Comment 31 by bugdroid1@chromium.org, Sep 5 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/1ba7722344ff77bb4783a2670dda14853cd3004b

commit 1ba7722344ff77bb4783a2670dda14853cd3004b
Author: Daniel Erat <derat@chromium.org>
Date: Tue Sep 05 03:50:49 2017

tast: Add fast_build.sh.

Add a script to make it easy to quickly compile/test/vet
code during development.

BUG= chromium:737628 
TEST=ran it

Change-Id: Ic7529d5a34f9e7268a300b9d40de2e235672b8e6
Reviewed-on: https://chromium-review.googlesource.com/649287
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Dan Erat <derat@chromium.org>

[add] https://crrev.com/1ba7722344ff77bb4783a2670dda14853cd3004b/src/chromiumos/tast/tast/fast_build.sh

Project Member

Comment 32 by bugdroid1@chromium.org, Sep 13 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/9ee669d95d3cd27ea0ee2b5bea7c00c481cb241e

commit 9ee669d95d3cd27ea0ee2b5bea7c00c481cb241e
Author: Daniel Erat <derat@chromium.org>
Date: Wed Sep 13 04:37:09 2017

tast: Give local/chrome access to autotestPrivate API.

Make the local/chrome package load an extension that can be
used to access the autotestPrivate API, which is needed to
do things like enabling the Play Store from within tests.

BUG= chromium:737628 
TEST=added some unit tests; also used in conjunction with
     followup change that adds a test to check that android
     boots

Change-Id: Ia2bc8c0dfc7c185246d7361bb7cecac4655c3a01
Reviewed-on: https://chromium-review.googlesource.com/664066
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Dan Erat <derat@chromium.org>

[add] https://crrev.com/9ee669d95d3cd27ea0ee2b5bea7c00c481cb241e/src/chromiumos/tast/local/chrome/extensions.go
[modify] https://crrev.com/9ee669d95d3cd27ea0ee2b5bea7c00c481cb241e/src/chromiumos/tast/local/chrome/util.go
[add] https://crrev.com/9ee669d95d3cd27ea0ee2b5bea7c00c481cb241e/src/chromiumos/tast/local/chrome/extensions_test.go
[modify] https://crrev.com/9ee669d95d3cd27ea0ee2b5bea7c00c481cb241e/src/chromiumos/tast/local/chrome/chrome.go

Comment 33 by derat@chromium.org, Sep 13 2017

Blockedon: 765001
Project Member

Comment 34 by bugdroid1@chromium.org, Sep 15 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/c11c6d7b577938818813d9b509e8a06f6ee96f29

commit c11c6d7b577938818813d9b509e8a06f6ee96f29
Author: Daniel Erat <derat@chromium.org>
Date: Fri Sep 15 05:25:01 2017

tast: Check dependencies before building tests.

When run with -build (currently the default), "tast run ..."
rebuilds the test executable. To do this, it relies on the
executable's dependencies' source code having already been
checked out as a side effect of the dependencies having
previously been built by Portage. (/usr/lib/gopath is used
by default, although this change adds a -sysgopath flag that
can be used to specify a different workspace.)

This change makes tast use Portage's equery command to check
that the test package's dependencies are installed before
performing the build. If they aren't, a command that can be
used to install them is printed. Checking dependencies can
take close to a second; -checkdeps=false can be passed to
skip the check.

BUG= chromium:737628 
TEST=unit tests pass; also manually verified that for both
     local and remote tests, an error is printed if
     dependencies are missing and that the check is skipped
     when -checkdeps=false is passed

Change-Id: I532821307e638f27b7dfe013e840b371c63b7547
Reviewed-on: https://chromium-review.googlesource.com/664379
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[modify] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/tast/run_cmd.go
[modify] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/tast/build_cmd.go
[modify] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/tast/build/build_test.go
[modify] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/tast/build/build.go
[add] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/tast/build/portage.go
[modify] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/tast/build/config.go
[add] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/tast/build/portage_test.go

Project Member

Comment 35 by bugdroid1@chromium.org, Sep 18 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast-tests/+/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de

commit 623ee02ab0f78ae0d5480437a1b5affe6e6ed6de
Author: Daniel Erat <derat@chromium.org>
Date: Mon Sep 18 16:35:17 2017

tast-tests: Add local/ and remote/.

Copy the src/chromiumos/tast/{local,remote} directories from
https://chromium.googlesource.com/chromiumos/platform/tast/
as of commit c11c6d7b577938818813d9b509e8a06f6ee96f29.
There's not much in the way of commit history to preserve
yet.

I'm doing this to (mostly) separate the tests themselves
from the infrastructure for running them. local/main.go and
remote/main.go, along with a few helper files, are coming
along with this move, but most of the test-running
infrastructure still lives under the common/ directory in
the main tast repository.

BUG= chromium:737628 
TEST=built via updated ebuilds; also built using an updated
     tast executable

Change-Id: Ia30995858fc90a3ee113bb4e106307f679066711
Reviewed-on: https://chromium-review.googlesource.com/669889
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/data_files.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/logs/logs_test.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/tests/example/data/data_files_x86_64.txt
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/remote/main.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/tests/example/data/data_files_i686.txt
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/remote/tests/power/reboot.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/dbusutil/constants.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/upstart/upstart.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/tests/ui/chrome_sanity.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/remote/dut/dut.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/data_files_test.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/tests/example/dbus.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/README.md
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/chrome/extensions.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/logs/logs.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/tests/example/data/data_files_armv7l.txt
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/dbusutil/service.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/tests/example/data_files.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/tests/example/data/data_files_aarch64.txt
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/chrome/extensions_test.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/dbusutil/signal.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/tests/power/check_status.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/chrome/cryptohome.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/dbusutil/match_test.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/chrome/util.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/dbusutil/match.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/tests/example/data/data_files_common.txt
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/chrome/conn.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/chrome/chrome.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/tests/example/pass.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/power/status.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/main.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/tests/security/log_perms.go
[add] https://crrev.com/623ee02ab0f78ae0d5480437a1b5affe6e6ed6de/src/chromiumos/tast/local/tests/example/fail.go

Project Member

Comment 36 by bugdroid1@chromium.org, Sep 18 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/e537583487be3821f63ebd40ab3a4f63080edb1f

commit e537583487be3821f63ebd40ab3a4f63080edb1f
Author: Daniel Erat <derat@chromium.org>
Date: Mon Sep 18 16:35:17 2017

tast-{local,remote}-tests: Build from tast-tests repository.

Tests have been moved from the main tast repository to
tast-tests. Update the tast-local-tests and
tast-remote-tests ebuild files to build from the new
location.

BUG= chromium:737628 
TEST=built successfully with FEATURES=test
CQ-DEPEND=Ia30995858fc90a3ee113bb4e106307f679066711

Change-Id: I43421997870f37dc0f82436e7e85b85db91141f2
Reviewed-on: https://chromium-review.googlesource.com/669682
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[modify] https://crrev.com/e537583487be3821f63ebd40ab3a4f63080edb1f/chromeos-base/tast-local-tests/tast-local-tests-9999.ebuild
[modify] https://crrev.com/e537583487be3821f63ebd40ab3a4f63080edb1f/chromeos-base/tast-remote-tests/tast-remote-tests-9999.ebuild

Project Member

Comment 37 by bugdroid1@chromium.org, Sep 18 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/908ad9074ecf7286b6057201a14387520e9a5b9b

commit 908ad9074ecf7286b6057201a14387520e9a5b9b
Author: Daniel Erat <derat@chromium.org>
Date: Mon Sep 18 16:35:18 2017

tast: Build tests from tast-tests repository.

Update the tast command to build tests from the tast-tests
repository rather than from the main tast repository (where
they were formerly located).

Also remove the local/ and remote/ directories (since
they're now located in tast-tests).

BUG= chromium:737628 
TEST=built local and remote tests using the tast command
CQ-DEPEND=Ia30995858fc90a3ee113bb4e106307f679066711
CQ-DEPEND=I43421997870f37dc0f82436e7e85b85db91141f2

Change-Id: Ieb7af00d2b5250d87cb5f71f633c7e8f4be49959
Reviewed-on: https://chromium-review.googlesource.com/669956
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/data_files.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/logs/logs_test.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/tests/example/data/data_files_x86_64.txt
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/remote/main.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/tests/example/data/data_files_i686.txt
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/remote/tests/power/reboot.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/dbusutil/constants.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/upstart/upstart.go
[modify] https://crrev.com/908ad9074ecf7286b6057201a14387520e9a5b9b/src/chromiumos/tast/tast/build/build_test.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/tests/ui/chrome_sanity.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/remote/dut/dut.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/data_files_test.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/tests/example/dbus.go
[modify] https://crrev.com/908ad9074ecf7286b6057201a14387520e9a5b9b/src/chromiumos/tast/tast/build/config.go
[modify] https://crrev.com/908ad9074ecf7286b6057201a14387520e9a5b9b/README.md
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/chrome/extensions.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/logs/logs.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/tests/example/data/data_files_armv7l.txt
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/dbusutil/service.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/tests/example/data_files.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/tests/example/data/data_files_aarch64.txt
[modify] https://crrev.com/908ad9074ecf7286b6057201a14387520e9a5b9b/src/chromiumos/tast/tast/build/build.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/chrome/extensions_test.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/dbusutil/signal.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/tests/power/check_status.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/chrome/cryptohome.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/dbusutil/match_test.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/chrome/util.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/dbusutil/match.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/tests/example/data/data_files_common.txt
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/chrome/conn.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/chrome/chrome.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/tests/example/pass.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/power/status.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/main.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/tests/security/log_perms.go
[delete] https://crrev.com/c11c6d7b577938818813d9b509e8a06f6ee96f29/src/chromiumos/tast/local/tests/example/fail.go

Project Member

Comment 38 by bugdroid1@chromium.org, Sep 19 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast-tests/+/99ae5809df74c914e7225d922dd71cc56e107d01

commit 99ae5809df74c914e7225d922dd71cc56e107d01
Author: Daniel Erat <derat@chromium.org>
Date: Tue Sep 19 18:19:16 2017

tast: Add basic ARC support to local/chrome.

Add an ARCEnabled option that can be passed to chrome.New to
disable ARC opt-in verification, enable the Play Store via
the autotestPrivate API, and wait for Android to report that
it's finished booting.

Also add a trivial ui.ARCSanity local test that exercises
this code.

BUG= chromium:737628 
TEST=ui.ARCSanity passes

Change-Id: Iec4092d0f478f59d41f059e1b10b6942ab7aa9c1
Reviewed-on: https://chromium-review.googlesource.com/671678
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[add] https://crrev.com/99ae5809df74c914e7225d922dd71cc56e107d01/src/chromiumos/tast/local/chrome/arc.go
[modify] https://crrev.com/99ae5809df74c914e7225d922dd71cc56e107d01/src/chromiumos/tast/local/chrome/chrome.go
[add] https://crrev.com/99ae5809df74c914e7225d922dd71cc56e107d01/src/chromiumos/tast/local/tests/ui/arc_sanity.go

Project Member

Comment 39 by bugdroid1@chromium.org, Sep 20 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast-tests/+/41ddf72dd111a553541676221a85037ca350ffd6

commit 41ddf72dd111a553541676221a85037ca350ffd6
Author: Daniel Erat <derat@chromium.org>
Date: Wed Sep 20 00:30:53 2017

tast-tests: Remove support for arch-specific data files.

Remove the -arch flags from the local_tests and remote_tests
executables, and update the example.DataFiles test to not
register architecture-specific data files.

BUG= chromium:737628 
TEST=example.DataFiles passes
CQ-DEPEND=I7b023dab4adcae791b73c2698c0b90e1a34e4abc

Change-Id: Ibd29ff522ddb27fb46463f31432125951f5a28c7
Reviewed-on: https://chromium-review.googlesource.com/673307
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[modify] https://crrev.com/41ddf72dd111a553541676221a85037ca350ffd6/src/chromiumos/tast/local/data_files.go
[modify] https://crrev.com/41ddf72dd111a553541676221a85037ca350ffd6/src/chromiumos/tast/remote/main.go
[delete] https://crrev.com/99ae5809df74c914e7225d922dd71cc56e107d01/src/chromiumos/tast/local/tests/example/data/data_files_common.txt
[delete] https://crrev.com/99ae5809df74c914e7225d922dd71cc56e107d01/src/chromiumos/tast/local/tests/example/data/data_files_aarch64.txt
[delete] https://crrev.com/99ae5809df74c914e7225d922dd71cc56e107d01/src/chromiumos/tast/local/tests/example/data/data_files_x86_64.txt
[add] https://crrev.com/41ddf72dd111a553541676221a85037ca350ffd6/src/chromiumos/tast/local/tests/example/data/data_files_data1.txt
[modify] https://crrev.com/41ddf72dd111a553541676221a85037ca350ffd6/src/chromiumos/tast/local/data_files_test.go
[delete] https://crrev.com/99ae5809df74c914e7225d922dd71cc56e107d01/src/chromiumos/tast/local/tests/example/data/data_files_i686.txt
[modify] https://crrev.com/41ddf72dd111a553541676221a85037ca350ffd6/src/chromiumos/tast/local/tests/example/data_files.go
[delete] https://crrev.com/99ae5809df74c914e7225d922dd71cc56e107d01/src/chromiumos/tast/local/tests/example/data/data_files_armv7l.txt
[modify] https://crrev.com/41ddf72dd111a553541676221a85037ca350ffd6/src/chromiumos/tast/local/main.go

Project Member

Comment 40 by bugdroid1@chromium.org, Sep 20 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/e3f446a99ea3ef4f54cb512024994974192c831e

commit e3f446a99ea3ef4f54cb512024994974192c831e
Author: Daniel Erat <derat@chromium.org>
Date: Wed Sep 20 00:30:53 2017

tast: Remove support for arch-specific data files.

Remove support for letting tests define different versions
of data files for different system architectures by
including "{arch}" in filenames.

This feature creates packaging difficulties and isn't
something that's currently used by Autotest-based tests. If
tests need to run binaries, those executables should be
built by a separate package that's incorporated into test
images instead of being checked into a repository in
compiled form.

BUG= chromium:737628 
TEST=unit tests and the example.DataFiles local test pass
CQ-DEPEND=Ibd29ff522ddb27fb46463f31432125951f5a28c7

Change-Id: I7b023dab4adcae791b73c2698c0b90e1a34e4abc
Reviewed-on: https://chromium-review.googlesource.com/673306
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[modify] https://crrev.com/e3f446a99ea3ef4f54cb512024994974192c831e/src/chromiumos/tast/common/testing/test_test.go
[modify] https://crrev.com/e3f446a99ea3ef4f54cb512024994974192c831e/src/chromiumos/tast/tast/run/remote.go
[modify] https://crrev.com/e3f446a99ea3ef4f54cb512024994974192c831e/src/chromiumos/tast/common/runner/runner_test.go
[modify] https://crrev.com/e3f446a99ea3ef4f54cb512024994974192c831e/src/chromiumos/tast/common/testing/state_test.go
[modify] https://crrev.com/e3f446a99ea3ef4f54cb512024994974192c831e/src/chromiumos/tast/common/testing/state.go
[modify] https://crrev.com/e3f446a99ea3ef4f54cb512024994974192c831e/src/chromiumos/tast/common/testing/test.go
[modify] https://crrev.com/e3f446a99ea3ef4f54cb512024994974192c831e/src/chromiumos/tast/tast/run/local.go
[modify] https://crrev.com/e3f446a99ea3ef4f54cb512024994974192c831e/src/chromiumos/tast/common/runner/runner.go

Project Member

Comment 41 by bugdroid1@chromium.org, Sep 20 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/6971cbd6c0d842a186bd879250d3a6f6239ec8f9

commit 6971cbd6c0d842a186bd879250d3a6f6239ec8f9
Author: Daniel Erat <derat@chromium.org>
Date: Wed Sep 20 00:30:56 2017

tast: Update fast_build.sh to support multiple source repos.

Update the fast_build.sh script now that test source code
has been moved into a new tast-tests repository.

BUG= chromium:737628 
TEST=manually verified that fast_build.sh is still able to
     build the tast executable and that it tests or vets all
     packages when run with -T or -C

Change-Id: I46edb3679dc57747ecb060a587fcf7bde2403a1c
Reviewed-on: https://chromium-review.googlesource.com/673309
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[modify] https://crrev.com/6971cbd6c0d842a186bd879250d3a6f6239ec8f9/src/chromiumos/tast/tast/fast_build.sh

Project Member

Comment 42 by bugdroid1@chromium.org, Sep 20 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/84b030c62529fd912f55705877282244ed3729a9

commit 84b030c62529fd912f55705877282244ed3729a9
Author: Daniel Erat <derat@chromium.org>
Date: Wed Sep 20 09:20:15 2017

tast-local-tests: Install test data.

Make the tast-local-test package install test data under
/usr/share/tast/data.

BUG= chromium:737628 
TEST=built it and verified test data was installed
CQ-DEPEND=Ib09bccbbcfacbf4905fa9cb3214f35658c70cd15

Change-Id: Ifb28061d2bcbefb493e7b73ae3241a8040f8bb49
Reviewed-on: https://chromium-review.googlesource.com/674090
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[modify] https://crrev.com/84b030c62529fd912f55705877282244ed3729a9/chromeos-base/tast-local-tests/tast-local-tests-9999.ebuild

Project Member

Comment 43 by bugdroid1@chromium.org, Sep 20 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/cb4534f887d5d618859d172d8e02ec366a1fe073

commit cb4534f887d5d618859d172d8e02ec366a1fe073
Author: Daniel Erat <derat@chromium.org>
Date: Wed Sep 20 09:20:15 2017

tast: Support local test data files baked into system image.

When running a local_tests binary that was built into the
system image, use test data from /usr/share/tast/data.
Previously, test data was always pushed by the tast command.

Also push test data to /usr/local/share/tast/data instead of
/tmp/test-data.

BUG= chromium:737628 
TEST=after deploying tast-local-tests,
     "tast run <target> example.DataFiles" works with both
     -build=true and -build=false
CQ-DEPEND=Ifb28061d2bcbefb493e7b73ae3241a8040f8bb49

Change-Id: Ib09bccbbcfacbf4905fa9cb3214f35658c70cd15
Reviewed-on: https://chromium-review.googlesource.com/674176
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[modify] https://crrev.com/cb4534f887d5d618859d172d8e02ec366a1fe073/src/chromiumos/tast/tast/run/local.go

Project Member

Comment 44 by bugdroid1@chromium.org, Sep 21 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/da14389d80d53391b8dba81c52e7938e08a75d7d

commit da14389d80d53391b8dba81c52e7938e08a75d7d
Author: Daniel Erat <derat@chromium.org>
Date: Thu Sep 21 04:46:07 2017

tast-cmd: Build chromiumos/tast/cmd.

Update the tast-cmd ebuild to build chromiumos/tast/cmd,
formerly named chromiumos/tast/tast.

BUG= chromium:737628 
TEST=built with FEATURES=test
CQ-DEPEND=I850392d0c35f93f547a90c2fc9a6d8a88be65c36

Change-Id: I549c5e053efba3bab7f0e1822c1c285665901b14
Reviewed-on: https://chromium-review.googlesource.com/676275
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[modify] https://crrev.com/da14389d80d53391b8dba81c52e7938e08a75d7d/chromeos-base/tast-cmd/tast-cmd-9999.ebuild

Project Member

Comment 45 by bugdroid1@chromium.org, Sep 21 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a

commit 5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a
Author: Daniel Erat <derat@chromium.org>
Date: Thu Sep 21 04:46:07 2017

tast: Rename chromiumos/tast/tast to chromiumos/tast/cmd.

Rename the awkwardly-named directory housing the main
package for the tast executable.

Also update fast_build.sh's "go vet" invocation for Go 1.9,
where vet no longer supports -pkgdir.

BUG= chromium:737628 
TEST=fast_build.sh works with no args, -V, and -T;
     chromeos-base/tast-cmd also builds for host with
     FEATURES=test
CQ-DEPEND=I549c5e053efba3bab7f0e1822c1c285665901b14

Change-Id: I850392d0c35f93f547a90c2fc9a6d8a88be65c36
Reviewed-on: https://chromium-review.googlesource.com/676274
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/run/results_test.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/run/remote.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/logging/logger.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/run/line_test.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/logging/simple_test.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/build/portage_test.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/timing/timing_test.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/timing/timing.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/fast_build.sh
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/run/results.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/build/build_test.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/main.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/run/line.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/build_cmd.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/run/config.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/chroot.go
[modify] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/README.md
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/run_cmd.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/run/local.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/build/portage.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/build/config.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/logging/simple.go
[rename] https://crrev.com/5e5423168cb72cb1d5bb94c2f51ced84c1cf0a2a/src/chromiumos/tast/cmd/build/build.go

Project Member

Comment 46 by bugdroid1@chromium.org, Sep 23 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/845ab930f48eb77655c326170e0d221eec3f0806

commit 845ab930f48eb77655c326170e0d221eec3f0806
Author: Daniel Erat <derat@chromium.org>
Date: Sat Sep 23 07:40:04 2017

tast: Update to run builtin local tests from /usr/local/bin.

The local_tests executable gets installed to /usr/local/bin
on test images, so update "tast run" to look there instead
of /usr/bin.

Also update pushed executables and data files to go to
/usr/local/bin/local_tests_pushed and
/usr/local/share/tast/data_pushed so as to not overwrite
builtin files.

BUG= chromium:737628 
TEST="tast run" works with both -build=true and -build=false
     against a device running a test image
CQ-DEPEND=I0fa61f55f19ce99e316e6d1c453c007423132078

Change-Id: I1ac702184fa0c1226a88834912c8bf08a97cf327
Reviewed-on: https://chromium-review.googlesource.com/678239
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[modify] https://crrev.com/845ab930f48eb77655c326170e0d221eec3f0806/src/chromiumos/tast/cmd/run/local.go

Project Member

Comment 47 by bugdroid1@chromium.org, Sep 23 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/8ff95d81ab9cac625760e745e15939ceb382d856

commit 8ff95d81ab9cac625760e745e15939ceb382d856
Author: Daniel Erat <derat@chromium.org>
Date: Sat Sep 23 07:40:04 2017

target-chromium-os-test: Add tast-local-tests.

Include the chromeos-base/tast-local-tests package in test
images.

BUG= chromium:737628 
TEST=did a build and checked that local_tests exists

Change-Id: I0fa61f55f19ce99e316e6d1c453c007423132078
Reviewed-on: https://chromium-review.googlesource.com/678114
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[rename] https://crrev.com/8ff95d81ab9cac625760e745e15939ceb382d856/virtual/target-chromium-os-test/target-chromium-os-test-1-r53.ebuild
[modify] https://crrev.com/8ff95d81ab9cac625760e745e15939ceb382d856/virtual/target-chromium-os-test/target-chromium-os-test-1.ebuild

Project Member

Comment 48 by bugdroid1@chromium.org, Sep 24 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/30545fe3982bfbbcfb81f0d0e7add620681b7a19

commit 30545fe3982bfbbcfb81f0d0e7add620681b7a19
Author: Daniel Erat <derat@chromium.org>
Date: Sun Sep 24 22:12:02 2017

tast-cmd: Assign executable name.

Fix a bug introduced by da14389d80d5, which handled a
directory being renamed from "tast" to "cmd" but failed to
assign a hardcoded "tast" name for the resulting executable.

BUG= chromium:737628 
TEST=verified that tast-cmd installs /usr/bin/tast instead
     of /usr/bin/cmd
TBR=jclinton@chromium.org

Change-Id: I72b1feb974173452fea029a2d5734b885c4f73da
Reviewed-on: https://chromium-review.googlesource.com/680534
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>
Reviewed-by: Dan Erat <derat@chromium.org>

[modify] https://crrev.com/30545fe3982bfbbcfb81f0d0e7add620681b7a19/chromeos-base/tast-cmd/tast-cmd-9999.ebuild

Project Member

Comment 49 by bugdroid1@chromium.org, Sep 25 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/af086d77fe23109b085d9d292dfa5c344d76cf43

commit af086d77fe23109b085d9d292dfa5c344d76cf43
Author: Daniel Erat <derat@chromium.org>
Date: Mon Sep 25 01:19:08 2017

tast: Correct incorrect description for -sysgopath.

Update the description for the tast command's -sysgopath
flag, which does not permit empty values.

BUG= chromium:737628 
TEST=none
TBR=jclinton@chromium.org

Change-Id: Ibe960c86c06b0106f648e1b552fc445feaeca8cd
Reviewed-on: https://chromium-review.googlesource.com/680595
Reviewed-by: Dan Erat <derat@chromium.org>
Commit-Queue: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Trybot-Ready: Dan Erat <derat@chromium.org>

[modify] https://crrev.com/af086d77fe23109b085d9d292dfa5c344d76cf43/src/chromiumos/tast/cmd/build/config.go

Project Member

Comment 50 by bugdroid1@chromium.org, Sep 25 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/ebe5c8556002b3402e0325160701663ea30ee812

commit ebe5c8556002b3402e0325160701663ea30ee812
Author: Daniel Erat <derat@chromium.org>
Date: Mon Sep 25 18:32:18 2017

target-chromium-os-sdk: Add chromeos-base/tast-cmd.

Install the tast executable so it can be used to run
integration tests.

BUG= chromium:737628 
TEST=ran update_chroot and verified that tast is installed

Change-Id: I34945aa8902b12a4a2f0413745f2a7b54b1ecfa3
Reviewed-on: https://chromium-review.googlesource.com/680594
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Jason Clinton <jclinton@chromium.org>

[modify] https://crrev.com/ebe5c8556002b3402e0325160701663ea30ee812/virtual/target-chromium-os-sdk/target-chromium-os-sdk-1.ebuild
[rename] https://crrev.com/ebe5c8556002b3402e0325160701663ea30ee812/virtual/target-chromium-os-sdk/target-chromium-os-sdk-1-r85.ebuild

Comment 51 by derat@chromium.org, Sep 25 2017

Status: Verified (was: Started)
The core code is checked in and built by default now, so I'll close out this bug and file new ones for additional features.
Project Member

Comment 52 by bugdroid1@chromium.org, Sep 26 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/tast/+/354b1f23121e9308e5fe3b4db80d486328a2ba0c

commit 354b1f23121e9308e5fe3b4db80d486328a2ba0c
Author: Daniel Erat <derat@chromium.org>
Date: Tue Sep 26 17:56:18 2017

tast: Add running_tests.md and writing_tests.md.

Add documents describing how to run and write tests.

BUG= chromium:737628 
TEST=none

Change-Id: Ib9dc18f24d6d55e6784ce3d240f5f4e09573cd0f
Reviewed-on: https://chromium-review.googlesource.com/684540
Reviewed-by: Jason Clinton <jclinton@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>

[add] https://crrev.com/354b1f23121e9308e5fe3b4db80d486328a2ba0c/docs/writing_tests.md
[add] https://crrev.com/354b1f23121e9308e5fe3b4db80d486328a2ba0c/docs/running_tests.md

Labels: Proj-Tast

Comment 54 by derat@chromium.org, Jan 23 2018

Components: Tests>Tast

Sign in to add a comment