New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
oom-kill #8023
Comments
borg needs enough memory for its hashtables / indexes:
There are some formulas in the docs that might be useful to estimate memory needs. |
borg has no means to "ignore swap" - it just uses normal Python and a little C stdlib malloc/free, nothing special. But I guess you would not want it to significantly use swap (if you have a choice), because that would be rather slow. So, just give it 8 or 16 Gigs? |
Of course I'd prefer not to use swap than... to use swap. :-) Giving 8 gigs is not an option because I do not have 8 gigs... How to reduce client memory usage or force python to swap? Slower backup is not a problem for me. I have time and disk space. I don't have ram. :-) |
As I said, borg has no influence on whether it uses swap or not. That's rather a kernel thing. To reduce memory usage, you can try to have repos with fewer chunks or you can try to reduce the size of the files cache or work without files cache (much slower). |
I have problem with borg backup while trying to back up ~550.000 of small files. My borg lives inside a lxc container and I get this in dmesg:
Borg process simply ends with message:
[pid] Killed
The container has 2GB of ram and 8GB of swap. Borg seems to ignore swap at all.
In the beginning the container had only 1GB ram and borg was being killed every time during backup process. So I increased ram to 1.5GB and it helped, but after some time, when borg repository grew up, 1.5G became not enough and I increased ram to 2GB. Now 2GB seems to be not enough. What is going on?
I suspect borg deduplication cache might take plenty of ram, but... why is swap ignored? (I dont care if backup process is slow, I only want it to be done...)
I have just increased ram to 2.25G and borg works again, but... any ideas how to solve the problem in other way than to again and again increase ram?
The text was updated successfully, but these errors were encountered: