Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Geospatial extensions for Polars

Rust-based WebAssembly bindings to read and write Apache Parquet data

Apache Kafka® compatible broker with S3, PostgreSQL, Apache Iceberg and Delta Lake

GeoArrow in Rust, Python, and JavaScript (WebAssembly) with vectorized geometry operations

A Rust DataFrame implementation, built on Apache Arrow

A minimal Python library for Apache Arrow, connecting to the Rust arrow crate

Oxbow makes genomic data ready for high-performance analytics.

A lightweight Logging and Tracing observability solution for Rust, built with Apache Arrow, Apache Parquet and Apache DataFusion.

Scalable Observability

A Book about how SQLite works. Rewriting SQLite in Rust for Learning and Fun and writing a book I wished I had when started.

Building block library for using Apache Arrow in Rust WebAssembly modules.

Integration between arrow-rs and extendr

An experimental (work-in-progress) statically typed implementation of Apache Arrow

ModelarDB: Model-Based Time Series Management from Edge to Client

Interoperability between Polars and Clickhouse

Efficiently evolve your old fixed-length data files into modern file formats.

A simple distributed SQL query engine written in Rust

In-memory Columnar Database

Efficiently convert XML data to Apache Arrow format for high-performance data processing