The official API server for Exllama. OAI compatible, lightweight, and fast.

Wan: Open and Advanced Large-Scale Video Generative Models

A comprehensive ComfyUI integration for Microsoft's VibeVoice text-to-speech model, enabling high-quality single and multi-speaker voice synthesis directly within your ComfyUI workflows.

ComfyUI custom node for the VibeVoice TTS. Expressive, long-form, multi-speaker conversational audio

Common recipes to run vLLM

llama.cpp fork with additional SOTA quants and improved performance

Proxy for OpenAI

GLM-4.5: An open-source large language model designed for intelligent agents by Z.ai

LLM inference in C/C++

SGLang is a fast serving framework for large language models and vision language models.

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

LisanBench is a lightweight benchmark for LLMs that stresses forward planning, vocabulary depth, constraint adherence, attention, and long-context "stamina" all at once.

SoTA open-source TTS

A flexible enhancer for YouTube on iOS

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations

Wan: Open and Advanced Large-Scale Video Generative Models

Text to speech chrome extension that works with local openai compatible TTS models

Clean up your online footprint without blowing away everything, analyze the content of comments to identify anything that might be likely to reveal PII that you may not want correlated with your an…

Large Language Model Text Generation Inference

HunyuanVideo: A Systematic Framework For Large Video Generation Model

OBS plugin for local speech recognition and captioning using AI

This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full article text

Go ahead and axolotl questions