⚡

GeoArrow (Apache Arrow)

Open Beta

.arrow · application/vnd.apache.arrow.file

GeoArrow е колонен формат за геопространствени данни, базиран на Apache Arrow. Идеален за анализ на големи данни, ML конвейери и визуализация. Работи с DuckDB, Pandas, Polars и други инструменти, съвместими с Arrow.

Експортирайте GeoArrow сега ✨ Отворена бета версия — безплатно, без ограничения

Основни характеристики

✓Колонно съхранение

✓Четене без копиране

✓Съвместимост с екосистемата Arrow

Example GeoArrow export (central Moscow, 1x0.5 km) — Example: central Moscow, ~1×0.5 km, medium detail

За формата GeoArrow

Apache Arrow is the standard for representing tables in memory: columns lie contiguously, the schema is described explicitly, and different programs read the very same bytes without copying or re-encoding. GeoArrow is the agreement on how to store geometry inside that structure so that GeoPandas, DuckDB, Polars, deck.gl and GDAL understand it.

The format is taken when data is not displayed but computed: spatial joins over millions of features, feature preparation for a model, a dashboard on top of a columnar engine. At those volumes, parsing text GeoJSON eats more time than the analysis itself.

The output is a single .arrow file (Apache Arrow IPC, also known as Feather v2). All the layers are merged into one table, and every row has a layer column with the name of its source layer. Geometry is stored as a binary column in WKB format, and the WGS84 (EPSG:4326) coordinate system is described in the schema metadata per the GeoArrow 1.0.0 convention.

By default the file is compressed with the zstd codec; you can choose lz4 or no compression at all. There is a safety limit of 10 million features per export, so as not to eat up the server's memory.

Коя програма отваря файлове GeoArrow

Следните програми и приложения могат да отварят, редактират и работят с файлове GeoArrow (Apache Arrow) (.arrow), експортирани от OSM2CDR:

💻DuckDB 💻Apache Arrow 💻Pandas 💻Polars 💻GeoPandas

Format specifications

Open standard
3D coordinates supported
Lossless (no quality loss)
Stores feature attributes
Output: 1 file
GeoArrow .arrow (Apache Arrow extension). In-memory columnar geometry, zero-copy interop with pandas, R, Julia.

Кой използва карти в GeoArrow

🏗

Анализ на големи данни

Millions of features are read by an analytical engine with no text parsing.

💻

ML процеси

Ready spatial features for training models — straight away as a table.

📊

Колонен анализ

Queries on individual columns run faster than on row-based formats.

🎨

Визуализация

A source for lonboard and deck.gl, which draw Arrow tables directly.

🗺

Научни изчисления

The same file is read by Python, R and Julia — exchange between teams with no conversion.

Как да експортирате GeoArrow

Изберете област

Начертайте правоъгълник или полигон на интерактивната карта на osm2cdr.ru

Изберете GeoArrow

Изберете GeoArrow (Apache Arrow) от списъка с 127 налични формата за експорт

Експорт

Щракнете върху „Експорт“ и получете файла си .arrow за 1-5 минути

Изтегляне

Изтеглете готовия файл GeoArrow и го отворете в DuckDB

Как да отворите след експорта

Python — pyarrow.ipc.open_file("map.arrow").read_all() gives you the table; the geometry is restored from the WKB column with shapely.from_wkb or geopandas.
DuckDB — INSTALL spatial; LOAD spatial; then SELECT * FROM 'map.arrow' and ST_GeomFromWKB on the geometry column.
Polars and pandas — pl.read_ipc("map.arrow") or reading through pyarrow: the attribute part works like an ordinary table, with no geo wrapping.
R and Julia — the arrow packages read the same file: it is one format across all languages, no conversion needed.
Visualization and GIS — lonboard and deck.gl draw Arrow tables directly; for QGIS it is easier to convert to GeoPackage with ogr2ogr (GDAL 3.8 and newer).