New issue
Advanced search Search tips

Issue 843253 link

Starred by 2 users

Issue metadata

Status: Available
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

ci_results_archiver: Some AFE job keyvals missing?

Project Member Reported by nya@chromium.org, May 15 2018

Issue description

While looking at BigQuery data I found an afe_job entry in BigQuery table is different from that of the original table.

http://cautotest/afe/#tab_id=view_job&object_id=198899956

SELECT
  kv.key
FROM
  `google.com:chromeos-lab.ci_results.afe_jobs20180510` j,
  j.keyvals kv
WHERE
  afe_job_id = 198899956
;

Row	key	 
1	builds	 
2	cidb_build_id	 
3	cidb_build_stage_id	 
4	parent_job_id

MySQL [chromeos_autotest_db]> select `key` from afe_job_keyvals where job_id = 198899956;
+---------------------+
| key                 |
+---------------------+
| cidb_build_stage_id |
| builds              |
| cidb_build_id       |
| parent_job_id       |
| build               |
| suite               |
| experimental        |
+---------------------+
7 rows in set (0.18 sec)

 

Comment 1 by nya@chromium.org, May 15 2018

Is it possible new afe_job_keyvals are inserted after afe_job is created?

Comment 2 by nya@chromium.org, May 15 2018

I noticed this because I found a Stainless test entry with image = NULL.

SELECT 
  _TABLE_SUFFIX AS suffix,
  COUNT(1) AS null_cnt
FROM
  `google.com:stainless-prod.stainless.tests*`
WHERE image IS NULL
GROUP BY _TABLE_SUFFIX
ORDER BY suffix DESC

Row	suffix	null_cnt	 
1	20180515	5	 
2	20180510	5	 
3	20180509	6	 
4	20180508	1	 
5	20180507	10	 
6	20180506	3	 
7	20180505	4	 
8	20180504	5	 
9	20180503	16	 
10	20180502	2	 

Looks like races. We do not have such entries between 5/11 and 5/14 when we had outage.

Status: Available (was: Untriaged)

Sign in to add a comment