New issue
Advanced search Search tips

Issue 669423 link

Starred by 1 user
Status: Fixed
Owner:
serg...@chromium.org
Closed: Dec 2016
Cc:
estaab@chromium.org
chanli@chromium.org
seanmccullough@chromium.org
liaoyuke@chromium.org
st...@chromium.org
zhangtiff@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug



Sign in to add a comment

Send small percentage of test results to test-results-test

Project Member Reported by serg...@chromium.org, Nov 29 2016 
Currently, we do not upload any test results to the the test instance of test results (test-results-test.appspot.com). Because of this deploying to it does not represent conditions in the production instance.

To avoid modifying test launchers, we can replicate small percentage of uploading requests issued to test-result.appspot.com to the test-results-test.appspot.com on the server side.

Based on https://viceroy.corp.google.com/chrome_infra/Appengine/test_results#_VG_LS5VHjF8, we receive ~800 RPM on average, therefore IMHO sending 1% of the requests (8 RPM) to the test instance should be quite reasonable.

WDYT?

Comment 1 by serg...@chromium.org, Nov 29 2016

Blocking: 660849

Comment 2 by estaab@chromium.org, Dec 1 2016

Status: Available (was: Untriaged)
Sounds good to get more data into test-results-test. How are you thinking we'll get 1% data into test-results-test? Will we query test-results and do the same upload to test-results-test, or something else?

Comment 3 by serg...@chromium.org, Dec 1 2016 

I was planning on replicating HTTP requests sent to prod, from prod to staging. The prod server will generate a random number and if less than 0.01, it will put a task into task queue to generate same request to test instance.

Comment 4 by serg...@chromium.org, Dec 1 2016

Blocking: -660849

Comment 5 by serg...@chromium.org, Dec 1 2016

Owner: serg...@chromium.org
Status: Started (was: Available)
Project Member

Comment 6 by bugdroid1@chromium.org, Dec 13 2016 

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build.git/+/55b9c5bec8947f4d4a0152d0c9525d6f03664b18

commit 55b9c5bec8947f4d4a0152d0c9525d6f03664b18
Author: Sergiy Byelozyorov <sergiyb@chromium.org>
Date: Tue Dec 13 10:00:59 2016

Report test-results from FYI to the staging server

BUG= 669423 
TBR=phajdan.jr@chromium.org

Change-Id: I2a96b9f0506e08517ecd46ac3e556bc797015cd2
Reviewed-on: https://chromium-review.googlesource.com/418797
Reviewed-by: Andrii Shyshkalov <tandrii@chromium.org>
Commit-Queue: Sergiy Byelozyorov <sergiyb@chromium.org>

[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipe_modules/chromium_tests/chromium_fyi.py
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipe_modules/test_results/config.py
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/dynamic_gtest_asan_android.json
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Android_Remoting_Tests.json
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Android_Tests__trial__dbg_.json
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Chromium_Linux_Goma_Canary.json
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Chromium_Linux_Goma_Canary__clobber_.json
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Chromium_Linux_Precise_Goma_LinkTest.json
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Chromium_Mac_10_9_Goma_Canary.json
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Chromium_Mac_10_9_Goma_Canary__clobber_.json
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Chromium_Mac_10_9_Goma_Canary__dbg_.json
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Chromium_Mac_10_9_Goma_Canary__dbg__clobber_.json
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/full_chromium_fyi_CrWin7Goma.json
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/full_chromium_fyi_CrWin7Goma_clbr_.json
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/full_chromium_fyi_CrWin7Goma_dbg_.json
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/full_chromium_fyi_CrWin7Goma_dll_.json
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/full_chromium_fyi_CrWinClangGoma.json
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/full_chromium_fyi_CrWinGoma.json
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/full_chromium_fyi_CrWinGoma_dll_.json
[modify] https://crrev.com/55b9c5bec8947f4d4a0152d0c9525d6f03664b18/scripts/slave/recipes/chromium.expected/full_chromium_fyi_Linux_remote_run_Tester.json
Project Member

Comment 7 by bugdroid1@chromium.org, Dec 13 2016 

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/tools/build.git/+/3efef0acc0fce1a44befecc8f55c669bddc82c3c

commit 3efef0acc0fce1a44befecc8f55c669bddc82c3c
Author: Sergiy Byelozyorov <sergiyb@chromium.org>
Date: Tue Dec 13 10:36:22 2016

Update/fix expectation file

Broke in http://crosreview.com/418797.

BUG= 669423 

Change-Id: I21b13d873ee535a0818cd9686e1cf7d12c15fb65
Reviewed-on: https://chromium-review.googlesource.com/418996
Reviewed-by: Andrii Shyshkalov <tandrii@chromium.org>
Commit-Queue: Sergiy Byelozyorov <sergiyb@chromium.org>

[modify] https://crrev.com/3efef0acc0fce1a44befecc8f55c669bddc82c3c/scripts/slave/recipes/chromium.expected/dynamic_gtest_asan_android.json

Comment 8 by serg...@chromium.org, Dec 13 2016

Status: Fixed (was: Started)
►

Sign in to add a comment