Apache Parquet & Arrow
Apache
Data lake and analytics pipelines standardize on Parquet file layout and Arrow IPC — specs at apache.org project sites.
What It Is
Apache Software Foundation columnar formats: Parquet (on-disk analytics) and Arrow (in-memory + IPC serialization).
Taxonomy
Per-project documentation: Parquet format · Arrow columnar · ORC (separate project)
Top-Level Categories
Master Catalog
Sub-Indexes & Guides
Open-source foundation publishing columnar and analytics file formats widely used in data pipelines: Apache Parquet (columnar storage) and Apache Arrow (in-memory columnar + IPC serialization). Specs are maintained on parquet.apache.org and arrow.apache.org.
View all bodies →Curated specs from Apache
Parquet is the standard lakehouse/warehouse on-disk format (Spark, DuckDB, BigQuery export, Snowflake). Column chunk layout explains why analytics workloads beat row-oriented JSON/CSV.
Arrow is the interchange layer between Python/R/JVM analytics, DuckDB, and Parquet readers. IPC framing is how columnar data crosses process boundaries without JSON overhead.