A high-throughput and memory-efficient inference and serving engine for LLMs

A benchmark framework for Tensorflow

Supercharge Your LLM with the Fastest KV Cache Layer

Machine Learning Toolkit for Kubernetes

Bootstrap Kubernetes the hard way. No scripts.

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.

Ongoing research training transformer models at scale

Curated collection of papers in machine learning systems

Production-Grade Container Scheduling and Management

Linux kernel source tree

study

Blocks specific sites from appearing in Google search results

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.