A fork to add multimodal model training to open-r1

Fully open reproduction of DeepSeek-R1

Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

MLX-VLM is a package for running Vision LLMs locally on your Mac using MLX.

Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜

Fast and accurate automatic speech recognition (ASR) for edge devices

High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.

An extremely fast implementation of whisper optimized for Apple Silicon using MLX.

Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.

Sound analysis/synthesis tools for music applications

VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs

Manage scalable open LLM inference endpoints in Slurm clusters

[arXiv2024] Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models

Everything about MetaCLIP: curation/training code, metadata, distribution and pre-trained models.

Inflate DenseNet and ResNet as per I3D with ImageNet weight transfer

Guides, tutorials and documentation about the central HPC resources

audioLIME: Listenable Explanations Using Source Separation

Pytorch implementation of Self-Attention Generative Adversarial Networks (SAGAN)

A set of tools to deal with GANs