-
-
Notifications
You must be signed in to change notification settings - Fork 479
Closed
Description
On an HDD-based Ubuntu system, I fully imported the planet file monthly. However, the last import failed due to lack of disk space.
2023-10-15 20:58:04 ERROR: Database error: ERROR: could not extend file "base/361191441/368615606.137": No space left on device
Questions:
- Who creates the file (PostgreSQL or osm2pgsql)?
- Where is the file located/created?
- What could I do about the problem?
Additional question:
- Is it possible to run only the "post processing" step?
Import command:
nohup ./osm2pgsql-1.9.2 --username postgres --multi-geometry --hstore --slim --drop --flat-nodes nodes.bin --create --cache 24000 --number-processes 10 --database osmplanet --style openstreetmap-carto.style --tag-transform-script openstreetmap-carto.lua --input-reader=pbf planet-latest.osm.pbf >load_osmplanet.out 2>&1 &
osm2pgsql output:
$ cat load_osmplanet.out
nohup: ignoring input
2023-10-13 08:46:07 osm2pgsql version 1.9.2 (1.9.2)
2023-10-13 08:46:07 Database version: 12.16 (Ubuntu 12.16-0ubuntu0.20.04.1)
2023-10-13 08:46:07 PostGIS version: 3.0
2023-10-13 08:46:07 Storing properties to table '"public"."osm2pgsql_properties"'.
2023-10-13 08:46:07 Setting up table 'planet_osm_point'
2023-10-13 08:46:07 Setting up table 'planet_osm_line'
2023-10-13 08:46:08 Setting up table 'planet_osm_polygon'
2023-10-13 08:46:08 Setting up table 'planet_osm_roads'
2023-10-15 15:43:05 Reading input files done in 197817s (54h 56m 57s).
2023-10-15 15:43:05 Processed 8658483163 nodes in 3760s (1h 2m 40s) - 2303k/s
2023-10-15 15:43:05 Processed 971692934 ways in 30307s (8h 25m 7s) - 32k/s
2023-10-15 15:43:05 Processed 11340554 relations in 163750s (45h 29m 10s) - 69/s
2023-10-15 15:43:40 Dropping table 'planet_osm_nodes'
2023-10-15 15:43:41 Table 'planet_osm_nodes' dropped in 0s
2023-10-15 15:43:41 Dropping table 'planet_osm_ways'
2023-10-15 15:44:48 Table 'planet_osm_ways' dropped in 67s (1m 7s)
2023-10-15 15:44:48 Dropping table 'planet_osm_rels'
2023-10-15 15:44:50 Table 'planet_osm_rels' dropped in 2s
2023-10-15 15:44:50 Done postprocessing on table 'planet_osm_nodes' in 0s
2023-10-15 15:44:50 Done postprocessing on table 'planet_osm_ways' in 0s
2023-10-15 15:44:50 Done postprocessing on table 'planet_osm_rels' in 0s
2023-10-15 15:44:51 Clustering table 'planet_osm_roads' by geometry...
2023-10-15 15:44:51 Clustering table 'planet_osm_polygon' by geometry...
2023-10-15 15:44:51 Clustering table 'planet_osm_line' by geometry...
2023-10-15 15:44:51 Clustering table 'planet_osm_point' by geometry...
2023-10-15 16:16:22 Creating geometry index on table 'planet_osm_roads'...
2023-10-15 16:34:10 Analyzing table 'planet_osm_roads'...
2023-10-15 16:34:14 Creating geometry index on table 'planet_osm_point'...
2023-10-15 18:01:46 Analyzing table 'planet_osm_point'...
2023-10-15 18:09:03 All postprocessing on table 'planet_osm_point' done in 8653s (2h 24m 13s).
2023-10-15 20:58:04 All postprocessing on table 'planet_osm_roads' done in 3004s (50m 4s).
2023-10-15 20:58:04 ERROR: Database error: ERROR: could not extend file "base/361191441/368615606.137": No space left on device
HINT: Check free disk space.
HDD space:
$ df -h
Filesystem Size Used Avail Use% Mounted on
udev 63G 0 63G 0% /dev
tmpfs 13G 1.2M 13G 1% /run
/dev/md2 2.0T 1.4T 471G 76% / <- database
tmpfs 63G 16K 63G 1% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 63G 0 63G 0% /sys/fs/cgroup
/dev/loop1 41M 41M 0 100% /snap/snapd/20092
/dev/loop0 62M 62M 0 100% /snap/zig/8241
/dev/loop3 128K 128K 0 100% /snap/bare/5
/dev/loop2 41M 41M 0 100% /snap/snapd/20290
/dev/md3 5.3T 727G 4.3T 15% /home <- osm2pgsql
/dev/md1 485M 161M 299M 35% /boot
tmpfs 13G 0 13G 0% /run/user/1000
tmpfs 13G 0 13G 0% /run/user/1004
Metadata
Metadata
Assignees
Labels
No labels