A Lightweight LLM Inference Performance Simulator

从无名小卒到大模型（LLM）大英雄~ 欢迎关注后续！！！

cluster data collected from production clusters in Alibaba for cluster management research

a static analytical model for LLM distributed training

Offline optimization of your disaggregated Dynamo graph

SGLang is a fast serving framework for large language models and vision language models.

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

LLM serving cluster simulator

A large-scale simulation framework for LLM inference

A low-latency & high-throughput serving engine for LLMs

A high-throughput and memory-efficient inference and serving engine for LLMs

[TBD] "m4: A Learned Flow-level Network Simulator" by Chenning Li, Anton A. Zabreyko, Arash Nasr-Esfahany, Kevin Zhao, Prateesh Goyal, Mohammad Alizadeh, Thomas Anderson.

Simulating Distributed Training at Scale

pytorch distribute tutorials

A Datacenter Scale Distributed Inference Serving Framework

The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.

Distributed Triton for Parallel Systems

Python client for Baidu Yun (Personal Cloud Storage) 百度云/百度网盘Python客户端