osmbpfextract is a program to filter OpenStreetMap PBF format data files. The filter performs six passes on the input PBF filter, and then writes a new output PBF file. The six passes are:
- Find the OSMHeaders data block and ensure that we support reading this file.
- Find ways that match a given tag criteria (eg. leisure=golf_course), and extract their node references.
- Calculate bounding boxes for each way given the bounding boxes found in (2).
- Find all the nodes within the bounding boxes from (3).
- Find all the ways that reference nodes found in (4).
- Find all the nodes that are referenced by the ways found in (5).
The nodes and ways collected in passes (3), (4) and (5) are then output into a new PBF format data file.
osmbpfextract is written in _Go. It is highly concurrent, so you can expect it to use up all your CPU power. osmbpfextract can filter out 1MB of golf course areas from a 1GB PBF file in about 9 minutes, using 789% of a Core i7 processor.
Building osmbpfextract is easy:
go install ./...
This app has been rebuilt from the original to just filter highways and output the result to nodes and ways files.
osmbpfextract -i alberta.osm.pbf
| -i | Input file |
| -o | Output file |
| -t | Filter tag key |
| -v | Filter tag value |
| --high-memory | Cache every decompressed block in memory. This can cause a 25% performance improvement in filtering, but is only recommended for small files. For a ~100MB PBF file, this will increase memory usage by about 100MB; for a 1GB PBF file, memory usage will jump to 8GB or more. |
This code is a fork of https://github.com/mfenniak/go-osmpbf-filter with significant reworking.