Apache Hive

Apache Amoro (incubating) is a Lakehouse management system built on open data lake formats.

Uniffle is a high performance, general purpose Remote Shuffle Service.

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

The official home of the Presto distributed SQL query engine for big data

Apache Spark - A unified analytics engine for large-scale data processing

Apache Iceberg

Zstandard - Fast real-time compression algorithm

Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

腾讯云官方文档

project to rewrite Apache iceberg metadata when tables from one location to another

A toolkit to run Ray applications on Kubernetes

Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing

A Cloud Native Batch System (Project under CNCF)

CS，如此简单!

Apache Hadoop

Apache Parquet

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

这是一个通过源码来部署kubernetes开发环境的文档，因为自己也还在探索，所以这个文档会同步跟新。