Apache Calcite

Apache Spark - A unified analytics engine for large-scale data processing

Mirror of Apache Hadoop

Apache Hive

Mirror of Apache Parquet

Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.

Apache Avro is a data serialization system.

Claude Code is an agentic coding tool that lives in your terminal, understands your codebase, and helps you code faster by executing routine tasks, explaining complex code, and handling git workflo…

A composable and fully extensible C++ execution engine library for data management systems.

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

Apache Amoro (incubating) is a Lakehouse management system built on open data lake formats.

Scala 2 compiler and standard library. For bugs, see scala/bug

Apache Iceberg

Apache Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.

Apache Arrow DataFusion Comet Spark Accelerator

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

Official Dockerfile for Apache Spark

Apache Spark Website

Upserts, Deletes And Incremental Processing on Big Data.

Snappy compressor/decompressor for Java

A collection of Custom Service Descriptors, can install custom spark version

JVM readings

OpenMLDB is an open-source machine learning database that provides a full-stack FeatureOps solution for production.

Algorithms, 4th edition textbook code and libraries

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

Detecting Logic Bugs in DBMS

Kyuubi is a unified multi-tenant JDBC interface for large-scale data processing and analytics, built on top of Apache Spark