Skip to content

Question: could not extend file "base/361191441/368615606.137": No space left on device #2092

@Klaus-Tockloth

Description

@Klaus-Tockloth

On an HDD-based Ubuntu system, I fully imported the planet file monthly. However, the last import failed due to lack of disk space.

2023-10-15 20:58:04  ERROR: Database error: ERROR:  could not extend file "base/361191441/368615606.137": No space left on device

Questions:

  • Who creates the file (PostgreSQL or osm2pgsql)?
  • Where is the file located/created?
  • What could I do about the problem?

Additional question:

  • Is it possible to run only the "post processing" step?

Import command:

nohup ./osm2pgsql-1.9.2 --username postgres --multi-geometry --hstore --slim --drop --flat-nodes nodes.bin --create --cache 24000 --number-processes 10 --database osmplanet --style openstreetmap-carto.style --tag-transform-script openstreetmap-carto.lua --input-reader=pbf planet-latest.osm.pbf >load_osmplanet.out 2>&1 &

osm2pgsql output:

$ cat load_osmplanet.out
nohup: ignoring input
2023-10-13 08:46:07  osm2pgsql version 1.9.2 (1.9.2)
2023-10-13 08:46:07  Database version: 12.16 (Ubuntu 12.16-0ubuntu0.20.04.1)
2023-10-13 08:46:07  PostGIS version: 3.0
2023-10-13 08:46:07  Storing properties to table '"public"."osm2pgsql_properties"'.
2023-10-13 08:46:07  Setting up table 'planet_osm_point'
2023-10-13 08:46:07  Setting up table 'planet_osm_line'
2023-10-13 08:46:08  Setting up table 'planet_osm_polygon'
2023-10-13 08:46:08  Setting up table 'planet_osm_roads'
2023-10-15 15:43:05  Reading input files done in 197817s (54h 56m 57s).                   
2023-10-15 15:43:05    Processed 8658483163 nodes in 3760s (1h 2m 40s) - 2303k/s
2023-10-15 15:43:05    Processed 971692934 ways in 30307s (8h 25m 7s) - 32k/s
2023-10-15 15:43:05    Processed 11340554 relations in 163750s (45h 29m 10s) - 69/s
2023-10-15 15:43:40  Dropping table 'planet_osm_nodes'
2023-10-15 15:43:41  Table 'planet_osm_nodes' dropped in 0s
2023-10-15 15:43:41  Dropping table 'planet_osm_ways'
2023-10-15 15:44:48  Table 'planet_osm_ways' dropped in 67s (1m 7s)
2023-10-15 15:44:48  Dropping table 'planet_osm_rels'
2023-10-15 15:44:50  Table 'planet_osm_rels' dropped in 2s
2023-10-15 15:44:50  Done postprocessing on table 'planet_osm_nodes' in 0s
2023-10-15 15:44:50  Done postprocessing on table 'planet_osm_ways' in 0s
2023-10-15 15:44:50  Done postprocessing on table 'planet_osm_rels' in 0s
2023-10-15 15:44:51  Clustering table 'planet_osm_roads' by geometry...
2023-10-15 15:44:51  Clustering table 'planet_osm_polygon' by geometry...
2023-10-15 15:44:51  Clustering table 'planet_osm_line' by geometry...
2023-10-15 15:44:51  Clustering table 'planet_osm_point' by geometry...
2023-10-15 16:16:22  Creating geometry index on table 'planet_osm_roads'...
2023-10-15 16:34:10  Analyzing table 'planet_osm_roads'...
2023-10-15 16:34:14  Creating geometry index on table 'planet_osm_point'...
2023-10-15 18:01:46  Analyzing table 'planet_osm_point'...
2023-10-15 18:09:03  All postprocessing on table 'planet_osm_point' done in 8653s (2h 24m 13s).
2023-10-15 20:58:04  All postprocessing on table 'planet_osm_roads' done in 3004s (50m 4s).
2023-10-15 20:58:04  ERROR: Database error: ERROR:  could not extend file "base/361191441/368615606.137": No space left on device
HINT:  Check free disk space.

HDD space:

$ df -h
Filesystem      Size  Used Avail Use% Mounted on
udev             63G     0   63G   0% /dev
tmpfs            13G  1.2M   13G   1% /run
/dev/md2        2.0T  1.4T  471G  76% /                    <- database
tmpfs            63G   16K   63G   1% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs            63G     0   63G   0% /sys/fs/cgroup
/dev/loop1       41M   41M     0 100% /snap/snapd/20092
/dev/loop0       62M   62M     0 100% /snap/zig/8241
/dev/loop3      128K  128K     0 100% /snap/bare/5
/dev/loop2       41M   41M     0 100% /snap/snapd/20290
/dev/md3        5.3T  727G  4.3T  15% /home                <- osm2pgsql
/dev/md1        485M  161M  299M  35% /boot
tmpfs            13G     0   13G   0% /run/user/1000
tmpfs            13G     0   13G   0% /run/user/1004

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions