A high-throughput and memory-efficient inference and serving engine for LLMs

Ongoing research training transformer models at scale

verl: Volcano Engine Reinforcement Learning for LLMs

A PyTorch native platform for training generative AI models

Distributed Compiler based on Triton for Parallel Systems

Quantized Attention achieves speedup of 2-5x and 3-11x compared to FlashAttention and xformers, without lossing end-to-end metrics across language, image, and video models.

Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixels with Hunyuan3D World Model

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

GGUF Quantization support for native ComfyUI models

🔊 Text-Prompted Generative Audio Model

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".

Tensors and Dynamic neural networks in Python with strong GPU acceleration

The LLVM Project is a collection of modular and reusable compiler and toolchain technologies. Note: the repository does not accept github pull requests at this moment. Please submit your patches at…

A C++ standalone library for machine learning

The full minitorch student suite.

Go binding for Pytorch C++ API (libtorch)

The Unified Machine Learning Framework

Open deep learning compiler stack for cpu, gpu and specialized accelerators

An Open Source Machine Learning Framework for Everyone

Loop Nest - Linear algebra compiler and code generator.

Solidity, the Smart Contract Programming Language

A thin, highly portable toolkit for efficiently compiling dense loop-based computation.