Audio Large Language Models

A PyTorch library for implementing flow matching algorithms, featuring continuous and discrete flow matching implementations. It includes practical examples for both text and image modalities.

Fine-tune the Whisper speech recognition model to support training without timestamp data, training with timestamp data, and training without speech data. Accelerate inference and support Web deplo…

A nearly-live implementation of OpenAI's Whisper.

A PyTorch native platform for training generative AI models

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3, Qwen3-MoE, DeepSeek-R1, GLM4.5, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Llava, …

State-of-the-art deep learning based audio codec supporting both mono 24 kHz audio and stereo 48 kHz audio.

Examples in the MLX framework

Vector (and Scalar) Quantization, in Pytorch

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

A nanoGPT pipeline packed in a spreadsheet