Introduction to Machine Learning Systems

A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.

Achieve state of the art inference performance with modern accelerators on Kubernetes

A JAX-native LLM Post-Training Library

Get started with building Fullstack Agents using Gemini 2.5 and LangGraph

A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.

Just another reasonably minimal repo for class-conditional training of pixel-space diffusion transformers.

Official inference framework for 1-bit LLMs

Low-precision matrix multiplication

LLM inference in C/C++

The simplest, fastest repository for training/finetuning medium-sized GPTs.

New repo collection for NVIDIA Cosmos: https://github.com/nvidia-cosmos

Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, sparsely activated memory layers complement compute-heavy dense f…

Push platform for realtime and bidirectional communication between clients and servers

A Lightweight Recommendation System

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama mode…

An open source payments switch written in Rust to make payments fast, reliable and affordable

End-to-end recipes for optimizing diffusion models with torchao and diffusers (inference and FP8 training).

A stand-alone implementation of several NumPy dtype extensions used in machine learning.

Framework for enhancing LLMs for RAG tasks using fine-tuning.

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

Hybrid ML + physics model of the Earth's atmosphere

Official inference repo for FLUX.1 models

Intermediate Graphics Library (IGL) is a cross-platform library that commands the GPU. It provides a single low-level cross-platform interface on top of various graphics APIs (e.g. OpenGL, Metal an…

Agentic components of the Llama Stack APIs

Universal LLM Deployment Engine with ML Compilation

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)