Flink Agents is an Agentic AI framework based on Apache Flink

An extensible, state of the art columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.

Next-Gen Big Data File Format

BtrBlocks: Efficient Columnar Compression for Data Lakes (SIGMOD 2023 Paper)

Intelligent Storage Acceleration Library

A blazingly fast multi-language serialization framework powered by JIT and zero-copy.

The Feldera Incremental Computation Engine

A feedback-driven fault injection tool for reproducing distributed systems failures

Open, Multi-modal Catalog for Data & AI

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

The next generation of cloud-native big data management expert , Aims to help users rapidly build stable, efficient, and scalable cloud-native platforms for big data.

Deep Learning System core principles introduction.

Firefly: 大模型训练工具，支持训练Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

Open Source D-APM (Data-Application Performance Monitoring) for Apache Spark

🔥 🔥 🔥 An intelligent and versatile general-purpose SQL client and reporting tool for databases which integrates ChatGPT capabilities.

SQLMesh is a data transformation framework that brings the benefits of DevOps to data teams. It enables data scientists, analysts, and engineers to efficiently run and deploy data transformations w…

Python SQL Parser and Transpiler

PostgreSQL Languages AST and statements prettifier: master branch covers PG10, v2 branch covers PG12, v3 covers PG13, v4 covers PG14, v5 covers PG15

The Lineage Analysis system for FlinkSQL supports advanced syntax such as Watermark, UDTF, CEP, Windowing TVFs, and CTAS.

Next generation of automated data exploratory analysis and visualization platform.

PyGWalker: Turn your pandas dataframe into an interactive UI for visual analysis

Auto-Steer

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

Drag & drop UI to build your customized LLM flow

Enable Next-Gen Large Language Model Applications. Join our Discord: https://discord.gg/pAbnFJrkgZ

A colab gradio web UI for running Large Language Models