This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)

Apache Flink

Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

This repository contains a Kafka Connect source connector for copying data from IBM MQ into Apache Kafka.

Kafka Connect connector for JDBC-compatible databases

Spark integrations for working with Lance datasets

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, Du…

Apache Flink Kubernetes Operator

Fluss is a streaming storage built for real-time analytics.

Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.

Mirror of Apache Kafka

A process for exposing JMX Beans via HTTP for Prometheus consumption

MySQL Binary Log connector

Apache Paimon(incubating) is a streaming data lake platform that supports high-speed data ingestion, change data tracking and efficient real-time analytics.

Flink Connector for Apache Doris

Apache Arrow DataFusion SQL Query Engine

A Kafka Connect plugin to make it easier to work with XML data in Kafka Connect pipelines

SeaTunnel is a distributed, high-performance data integration platform for the synchronization and transformation of massive data (offline & real-time).

TiSpark is built for running Apache Spark on top of TiDB/TiKV

Apache DataFusion Comet Spark Accelerator

Dataframes powered by a multithreaded, vectorized query engine, written in Rust

XChange is a Java library providing a streamlined API for interacting with 60+ Bitcoin and Altcoin exchanges providing a consistent interface for trading and accessing market data.

Apache OpenDAL: One Layer, All Storage.

Apache Parquet Java

Apache Spark - A unified analytics engine for large-scale data processing

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.

Implementation of Apache ORC file format use Apache Arrow in-memory format

Official Rust implementation of Apache Arrow

Rust implementation of Apache ORC