Backup not timing out - crashed my server

[oma]

I changed some settings, from SFTP to FTP and the 'backup perform' process started hanging and piling up without me noticing. htop showed that. Crontab kept created new ones. I'm thinking there should be some timeout on store_with so that it can continue to the error mailer. wdyt?

[tombruijn]

@oma what settings did you change? What settings do you use before and after?

[oma]

@tombruijn there were two problems

1. backup job not timing out. crontab started new backup every 15.min and I ended up witha stack of hanging processes
2. sftp not working (causing issue of 1.). I gave it up, storing on S3. Sorry for being lazy and not helping to resolve it. It did work with FTP, I practically just change the store_with if I recall correctly.

[tombruijn]

@oma thanks for the update. Since I won't be able to easily reproduce it, it will take a while before I can take a look at it.

If anyone else runs into this issue, please report your errors and config in this issue so we can take a look at it.

[pechorin]

I use S3 for storing backup and my server crashes (o_O) while uploading archives to s3. this is last log lines:

[2015/02/18 17:03:28][info] Cleaning up the temporary files...
[2015/02/18 17:03:30][info] Storage::S3 Started...
[2015/02/18 17:03:30][info] Storing 'htz/db_backups/rails_backup/2015.02.18.17.02.39/rails_backup.tar-aaa'...
[2015/02/18 17:03:30][info]   Initiate Multipart 'htz/db_backups/rails_backup/2015.02.18.17.02.39/rails_backup.tar-aaa'
[2015/02/18 17:03:31][info]   Uploading 2 Parts...
[2015/02/18 17:03:34][info]   ...90% Complete...
[2015/02/18 17:03:36][info]   Complete Multipart 'htz/db_backups/rails_backup/2015.02.18.17.02.39/rails_backup.tar-aaa'
[2015/02/18 17:03:37][info] Storing 'htz/db_backups/rails_backup/2015.02.18.17.02.39/rails_backup.tar-aab'...
[2015/02/18 17:03:37][info]   Initiate Multipart 'htz/db_backups/rails_backup/2015.02.18.17.02.39/rails_backup.tar-aab'
[2015/02/18 17:03:37][info]   Uploading 2 Parts...
[2015/02/18 17:03:40][info]   ...90% Complete...
[2015/02/18 17:03:43][info]   Complete Multipart 'htz/db_backups/rails_backup/2015.02.18.17.02.39/rails_backup.tar-aab'
[2015/02/18 17:03:43][info] Storing 'htz/db_backups/rails_backup/2015.02.18.17.02.39/rails_backup.tar-aac'...
[2015/02/18 17:03:43][info]   Initiate Multipart 'htz/db_backups/rails_backup/2015.02.18.17.02.39/rails_backup.tar-aac'
[2015/02/18 17:03:44][info]   Uploading 2 Parts...

It is't regular behavior, so i can't reproduce this. Sometimes it crashes server machine, some times not.
Can anybody help me, which system logs can help me to fix this issuue? And why it is possible to crash my server? o_O

I also noticed, what if i kill backup process while it perform it runs again (maybe this is normal behavior). Thanks a lot!