Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.

Minimalistic large language model 3D-parallelism training

Minimalistic 4D-parallelism distributed training framework for education purpose

Samples for CUDA Developers which demonstrates features in CUDA Toolkit

Building blocks for foundation models.

Material for gpu-mode lectures

GPU programming related news and material links

Helpful tools and examples for working with flex-attention

A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 🍓 and reasoning techniques.

The simplest, fastest repository for training/finetuning small-sized VLMs.

LLM inference in C/C++

Neural Networks: Zero to Hero