Codespaces but open-source, client-only and unopinionated: Works with any IDE and lets you use any cloud, kubernetes or just localhost docker.

Open deep learning compiler stack for cpu, gpu and specialized accelerators

An open-source, next-generation "runc" that empowers rootless containers to run workloads such as Systemd, Docker, Kubernetes, just like VMs.

A novel data compression framework

JAX backend for SGL

Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs

Abseil Common Libraries (Python)

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

A machine learning compiler for GPUs, CPUs, and ML accelerators

A JAX-native LLM Post-Training Library

Sccache is a ccache-like tool. It is used as a compiler wrapper and avoids compilation when possible. Sccache has the capability to utilize caching in remote storage environments, including various…

contaiNERD CTL - Docker-compatible CLI for containerd, with support for Compose, Rootless, eStargz, OCIcrypt, IPFS, ...

A high-performance JavaScript runtime for Flutter applications, built with Rust and powered by QuickJS.

Memray is a memory profiler for Python

Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

Settings management using pydantic

Kimi K2 is the large language model series developed by Moonshot AI team

Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.

A Quirky Assortment of CuTe Kernels

Technical report of Kimina-Prover Preview.

Official Repo for Open-Reasoner-Zero

Kimina Lean server (+ client SDK)

Mirage Persistent Kernel: Compiling LLMs into a MegaKernel

slime is an LLM post-training framework for RL Scaling.

Lightning-Fast RL for LLM Reasoning and Agents. Made Simple & Flexible.