New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 678727 link

Starred by 1 user

Issue metadata

Status: Archived
Owner:
Last visit > 30 days ago
Closed: Jan 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Bug



Sign in to add a comment

test for pushing failed with "fatal: Could not write new index file."

Project Member Reported by nxia@chromium.org, Jan 5 2017

Issue description

ayatane@ mentioned test_for_pushing has another error besides crbug.com/678699.

shuqianz@, can you take a look?
 

[chromeos-autotest.hot.corp.google.com] out: DEBUG:root:Running '/usr/bin/ssh -a -x -N -o ControlMaster=yes -o ControlPath=/tmp/_autotmp_ORY04kssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmpKChYY0 -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l chromeos-test -p 22 chromeos-drone2-staging.hot.corp.google.com'
[chromeos-autotest.hot.corp.google.com] out: ERROR:root:[stderr] fatal: Could not write new index file.
[chromeos-autotest.hot.corp.google.com] out: DEBUG:root:[stdout] Checking tree status:
[chromeos-autotest.hot.corp.google.com] out: ERROR:root:[stderr] Traceback (most recent call last):
[chromeos-autotest.hot.corp.google.com] out: ERROR:root:[stderr]   File "/usr/local/autotest/site_utils/deploy_server_local.py", line 519, in <module>
[chromeos-autotest.hot.corp.google.com] out: ERROR:root:[stderr]     sys.exit(main(sys.argv[1:]))
[chromeos-autotest.hot.corp.google.com] out: ERROR:root:[stderr]   File "/usr/local/autotest/site_utils/deploy_server_local.py", line 477, in main
[chromeos-autotest.hot.corp.google.com] out: ERROR:root:[stderr]     verify_repo_clean()
[chromeos-autotest.hot.corp.google.com] out: ERROR:root:[stderr]   File "/usr/local/autotest/site_utils/deploy_server_local.py", line 80, in verify_repo_clean
[chromeos-autotest.hot.corp.google.com] out: ERROR:root:[stderr]     subprocess.check_output(['git', 'reset', '--hard'])
[chromeos-autotest.hot.corp.google.com] out: ERROR:root:[stderr]   File "/usr/lib/python2.7/subprocess.py", line 573, in check_output
[chromeos-autotest.hot.corp.google.com] out: ERROR:root:[stderr]     raise CalledProcessError(retcode, cmd, output=output)
[chromeos-autotest.hot.corp.google.com] out: ERROR:root:[stderr] subprocess.CalledProcessError: Command '['git', 'reset', '--hard']' returned non-zero exit status 128

 
Status: Fixed (was: Untriaged)
Not enough space left on push shard, which causes it fail to update. Clean the server, and now it is back to normal. Deputy can monitor the 1pm testing push to track the testing results.
Is it normal for space to fill up, or is something leaking files?  Maybe we should automate the cleanup.
We have automated cleanup on push master, but not on push shard. I do plan to add one in push shard too. :)

Comment 4 by dchan@google.com, Mar 4 2017

Labels: VerifyIn-58

Comment 5 by dchan@google.com, Apr 17 2017

Labels: VerifyIn-59

Comment 6 by dchan@google.com, May 30 2017

Labels: VerifyIn-60

Comment 7 by dchan@chromium.org, Aug 1 2017

Labels: VerifyIn-61

Comment 8 by dchan@chromium.org, Oct 14 2017

Status: Archived (was: Fixed)

Sign in to add a comment