Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

SGLang is a fast serving framework for large language models and vision language models.

Redis for LLMs

A Datacenter Scale Distributed Inference Serving Framework

`std::execution`, the proposed C++ framework for asynchronous and parallel programming.

Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O

NVIDIA Inference Xfer Library (NIXL)

a high performance library for building cache simulators

Hybrid memory and disk cache in Rust

A tutorial of building an LSM-Tree storage engine in a week!

A library for building fast, reliable and evolvable network services.

An OLAP database system for educational purpose

DatenLord, Computing Defined Storage, an application-orientated, cloud-native distributed storage system

CMU-DB's Cascades optimizer framework