Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Database using up too much space #435

Open
ipg0 opened this issue Mar 15, 2023 · 1 comment
Open

Database using up too much space #435

ipg0 opened this issue Mar 15, 2023 · 1 comment
Labels

Comments

@ipg0
Copy link

ipg0 commented Mar 15, 2023

Describe the bug
Nominatim database is expected to be about 900 GB, but while still importing, the database grew to more than 1.5 TB and continues to grow.

To Reproduce
Steps to reproduce the behavior:
Container started with command:

docker run -d -e PBF_PATH=/sources/data.osm.pbf -e REPLICATION_URL=https://planet.openstreetmap.org/replication/day/ -e THREADS=16 -e NOMINATIM_PASSWORD=[redacted] -e IMPORT_STYLE=address -e POSTGRES_SHARED_BUFFERS=4GB -e POSTGRES_MAX_WAL_SIZE=16GB -e POSTGRES_CHECKPOINT_TIMEOUT=30min -v /var/lib/pgsql/geocode-replicated/osm.pbf/:/import/:Z -v /var/lib/pgsql/geocode-replicated/pgsql/:/var/lib/postgresql/14/main/:Z -v /var/lib/pgsql/geocode-replicated/nominatim:/nominatim/:Z -v /var/lib/maps/geocode-sources/:/sources/:Z --shm-size=16g --memory=32g --memory-swap=100g -p 7071:8080 -p 5440:5432 --name nominatim-replicated mediagis/nominatim:4.2

The import process is now at the Starting interpolation lines (location_property_osmline) stage.
The Postgres directory is over 1.5 TB.

Expected behavior
Database size for planet data is expected to be about 900 GB.

Server:

  • OS & Version: CentOS 7
  • Docker Version: 19.03.13
  • Nominatim Version: 4.2.1

Additional context
The problem is I have only allocated 2TB to the Nominatim database volume, including additional files it now only has about 300 GB of free space left.

@ipg0 ipg0 added the bug label Mar 15, 2023
@gsg-git
Copy link
Contributor

gsg-git commented Oct 4, 2023

I think you should add the flatnode file:
-v nominatim-flatnode:/nominatim/flatnode

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants