Beta version for SLAM-LLM

Towards Comprehensive Benchmark for End-to-End Spoken Dialogue Models

AcadHomepage: A Modern and Responsive Academic Personal Homepage

OpenS2S : Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model

GLM-4-Voice | 端到端中英语音对话模型

Kimi-Audio, an open-source audio foundation model excelling in audio understanding, generation, and conversation

MIO: A Foundation Model on Multimodal Tokens

Qwen2.5-Omni is an end-to-end multimodal model by Qwen team at Alibaba Cloud, capable of understanding text, audio, vision, video, and performing real-time speech generation.

Official code for "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"

Official code for "EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting"

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

SALMONN: Speech Audio Language Music Open Neural Network

MiniCPM-o 2.6: A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone

Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model

✨✨VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction

HumanOmni

Ola: Pushing the Frontiers of Omni-Modal Language Model

Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics, Fundamental Sciences such as Mathematics, and Ominous.

使用vllm加速cosyvoice2的推理

Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。

The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.

Neural Networks: Zero to Hero-[My learning notes]