Advanced Scalable Systems for X

slime is a LLM post-training framework aiming for RL Scaling.

A Survey of Reinforcement Learning for Large Reasoning Models

My learning notes/codes for ML SYS.

Checkpoint-engine is a simple middleware to update model weights in LLM inference engines

Tweaked vLLM for Cornserve

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

Easy, Fast, and Scalable Multimodal AI

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

SGLang is a fast serving framework for large language models and vision language models.

This repo is meant to serve as a guide for Machine Learning/AI technical interviews.

A throughput-oriented high-performance serving framework for LLMs

📖A curated list of Awesome LLM/VLM Inference Papers with codes, such as FlashAttention, PagedAttention, Parallelism, etc. 🎉🎉

A high-throughput and memory-efficient inference and serving engine for LLMs

Programmer's guide about how to cook at home (Simplified Chinese only).

This repo is written for TechJI 2024 kitty wksp.