New issue
Advanced search Search tips
Note: Color blocks (like █ or █) mean that a user may not be available. Tooltip shows the reason.

Issue 636568 link

Starred by 2 users
Status: Assigned
Owner:
█ krishna...@chromium.org
Last visit > 30 days ago
Cc:
█ scunning...@google.com
dchan@chromium.org
█ trapti@google.com
krishnargv@google.com
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 3
Type: Bug
m53

Blocked on:
issue 638237


Sign in to add a comment

Browser tests : 5 of tests are reported missing

Project Member Reported by monachow@google.com, Aug 10 2016 
M      ChromeOS    Chrome          ARC         Type     Channel
53     8530.49.0   53.0.2785.55                release  beta


STEPS:
Detal steps is at https://testtracker.googleplex.com/efforts/testcase/detail/7097703?tp_id=379&result=&environment=
Summary of the steps
(1) run this command
    python browsertest_status.py --tests_file=$HOME/enterprise_tests --version=53.0.2785.55

What is the expected output?
All automated enterprise  browsertest tests should pass.  At this time, there should be total of 165 tests.

What do you see instead?
Test Status: Missing (5)
  1) ExtensionCrxInstallerTest.DoNotGrantScopes
  2) ExtensionCrxInstallerTest.ExperimentalExtensionFromOutsideGalleryWithFlag
  3) ExtensionCrxInstallerTest.GrantScopes
  4) ExtensionCrxInstallerTest.PlatformAppCrx
  5) PolicyTest.SSLVersionFallbackMin
Test Result: Failed or other Error (0)


My observation is that based on //src/chrome/browser/extensions/crx_installer_browsertest.cc,  it seems to me that some of tests have been renamed.

1) ExtensionCrxInstallerTest.DoNotGrantScopes  has renamed to ExtensionCrxInstallerTestWithExperimentalApis.DoNotGrantScopes)

2) ExtensionCrxInstallerTest.ExperimentalExtensionFromOutsideGalleryWithFlag has renamed to ExtensionCrxInstallerTestWithExperimentalApis.ExperimentalExtensionFromOutsideGalleryWithFlag

3) ExtensionCrxInstallerTest.GrantScopes has renamed to ExtensionCrxInstallerTestWithExperimentalApis.MAYBE_GrantScopes

4) ExtensionCrxInstallerTest.PlatformAppCrx has renamed to ExtensionCrxInstallerTestWithExperimentalApis.PlatformAppCrx

5) PolicyTest.SSLVersionFallbackMin.  I can't find this test.

Please confirm if the tests have been renamed.

Comment 1 by monachow@google.com, Aug 10 2016

Cc: krishnargv@google.com dchan@chromium.org trapti@google.com scunning...@google.com
Project Member

Comment 2 by sheriffbot@chromium.org, Aug 11 2016

Labels: Hotlist-Google

Comment 3 by krishna...@chromium.org, Aug 12 2016

Owner: krishna...@chromium.org
Status: Assigned (was: Unconfirmed)
Assigning this to myself to figure out why these browsertests are missing. 
My initial guess is that these tests have been renamed.

Comment 4 by scunning...@chromium.org, Aug 16 2016

Blockedon: 638237

Comment 5 by scunning...@chromium.org, Sep 16 2016 

PolicyTest.SSLVersionFallbackMin test was removed by CL https://codereview.chromium.org/2098723002. Test has been removed from the test_suites/enterprise_tests file.
Project Member

Comment 6 by bugdroid1@chromium.org, Sep 16 2016 

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/platform/crostestutils/+/769609b502582a617f9a949591159afbf0ecdac7

commit 769609b502582a617f9a949591159afbf0ecdac7
Author: Scott Cunningham <scunningham@chromium.org>
Date: Fri Sep 16 19:30:57 2016

Update test_suites/enterprise_tests with latest tests.

Added new tests:
LauncherPlatformAppBrowserTest.LaunchUnpinned
LauncherPlatformAppBrowserTest.LaunchPinned
LauncherPlatformAppBrowserTest.UnpinRunning
ShelfAppBrowserTest.OverflowBubble

Removed deleted tests:
PolicyTest.SSLVersionFallbackMin

Also removed some obsolete comments.

BUG=chromium:636568
TEST=Run ./browsertest_status.py --tests_file=test_suites/enterprise_tests

Change-Id: I4c333052bedd09e06e15c14ed94881361425c20e
Reviewed-on: https://chromium-review.googlesource.com/386422
Tested-by: Scott Cunningham <scunningham@chromium.org>
Trybot-Ready: Scott Cunningham <scunningham@chromium.org>
Reviewed-by: danny chan <dchan@chromium.org>

[modify] https://crrev.com/769609b502582a617f9a949591159afbf0ecdac7/provingground/browsertest_status/test_suites/enterprise_tests

Comment 7 by monachow@google.com, Oct 25 2016 



Test Status: Missing (6)
 1) ExtensionCrxInstallerTest.DoNotGrantScopes
 2) ExtensionCrxInstallerTest.ExperimentalExtensionFromOutsideGalleryWithFlag
 3) ExtensionCrxInstallerTest.GrantScopes
 4) ExtensionCrxInstallerTest.PlatformAppCrx
 5) PolicyTest.DisableSpdy
 6) PolicyTest.ReplaceSearchTerms

Comment 8 by trapti@google.com, Nov 2 2016 


M	ChromeOS	Chrome	ARC	Type	Channel
55	8872.35.0	55.0.2883.35	3426244	release	beta

Test Status: Missing (10)
  1) ExistingUserControllerPublicSessionTest.AutoLoginNoDelay
  2) ExistingUserControllerTest.ExistingUserLogin
  3) ExtensionCrxInstallerTest.DoNotGrantScopes
  4) ExtensionCrxInstallerTest.ExperimentalExtensionFromOutsideGalleryWithFlag
  5) ExtensionCrxInstallerTest.GrantScopes
  6) ExtensionCrxInstallerTest.PlatformAppCrx
  7) PolicyTest.DisableScreenshotsFile
  8) PolicyTest.DisableSpdy
  9) PolicyTest.ForceSafeSearch
  10) PolicyTest.ReplaceSearchTerms

Comment 9 by monachow@google.com, Nov 9 2016 

Reproducible.
M	ChromeOS	Chrome	ARC	Type	Channel
55	8872.44.0	55.0.2883.42	3448313	release	beta

python browsertest_status.py --tests_file=test_suites/enterprise_tests --version=55.0.2883.42


Test Status: Missing (10)
  1) ExistingUserControllerPublicSessionTest.AutoLoginNoDelay
  2) ExistingUserControllerTest.ExistingUserLogin
  3) ExtensionCrxInstallerTest.DoNotGrantScopes
  4) ExtensionCrxInstallerTest.ExperimentalExtensionFromOutsideGalleryWithFlag
  5) ExtensionCrxInstallerTest.GrantScopes
  6) ExtensionCrxInstallerTest.PlatformAppCrx
  7) PolicyTest.DisableScreenshotsFile
  8) PolicyTest.DisableSpdy
  9) PolicyTest.ForceSafeSearch
  10) PolicyTest.ReplaceSearchTerms
Test Result: Failed or other Error (0)

Comment 10 by monachow@google.com, Nov 17 2016 

reproducible:
M	ChromeOS	Chrome	ARC	Type	Channel
55	8872.54.0	55.0.2883.54	3500695	release	beta
device: Yuna PVT

use this command to run:
src/platform/crostestutils/provingground/browsertest_status$ python browsertest_status.py --tests_file=test_suites/enterprise_tests --version=55.0.2883.54



Test Status: Missing (10)
  1) ExistingUserControllerPublicSessionTest.AutoLoginNoDelay
  2) ExistingUserControllerTest.ExistingUserLogin
  3) ExtensionCrxInstallerTest.DoNotGrantScopes
  4) ExtensionCrxInstallerTest.ExperimentalExtensionFromOutsideGalleryWithFlag
  5) ExtensionCrxInstallerTest.GrantScopes
  6) ExtensionCrxInstallerTest.PlatformAppCrx
  7) PolicyTest.DisableScreenshotsFile
  8) PolicyTest.DisableSpdy
  9) PolicyTest.ForceSafeSearch
  10) PolicyTest.ReplaceSearchTerms
Test Result: Failed or other Error (0)

Comment 11 by monachow@google.com, Jan 5 2017 

# of missing tests are increasing.
M	ChromeOS	Chrome	ARC	Type	Channel
56	9000.50.0	56.0.2924.53	3612333	release	beta

Test Status: Missing (17)
  1) ExistingUserControllerPublicSessionTest.AutoLoginNoDelay
  2) ExistingUserControllerPublicSessionTest.LoginStopsAutoLogin
  3) ExistingUserControllerTest.ExistingUserLogin
  4) ExtensionCrxInstallerTest.DoNotGrantScopes
  5) ExtensionCrxInstallerTest.ExperimentalExtensionFromOutsideGalleryWithFlag
  6) ExtensionCrxInstallerTest.GrantScopes
  7) ExtensionCrxInstallerTest.PlatformAppCrx
  8) PolicyTest.AlwaysAuthorizePlugins
  9) PolicyTest.DisableScreenshotsFile
  10) PolicyTest.DisableSpdy
  11) PolicyTest.DisabledPlugins
  12) PolicyTest.DisabledPluginsExceptions
  13) PolicyTest.EnabledPlugins
  14) PolicyTest.ForceSafeSearch
  15) PolicyTest.ReplaceSearchTerms
  16) PolicyTest.SSLVersionFallbackMin
  17) SamlTest.CredentialPassingAPI
Test Result: Failed or other Error (0)
►

Sign in to add a comment