Intelligent Router for Mixture-of-Models

CUDA Templates and Python DSLs for High-Performance Linear Algebra

A high-throughput and memory-efficient inference and serving engine for LLMs

📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉

SGLang is a fast serving framework for large language models and vision language models.

Zero Bubble Pipeline Parallelism

A tutorial of building an LSM-Tree storage engine in a week!

Cloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.

Burn - A Flexible and Comprehensive Deep Learning Framework in Rust

Vector database plugin for Postgres, written in Rust, specifically designed for LLM

Powerful system container and virtual machine manager

A truly Open Source MongoDB alternative

APISIX Ingress Controller for Kubernetes