Stars
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
Code for the the article "LLM inference from first principles"
My learning notes for ML SYS.
A highly optimized LLM inference acceleration engine for Llama and its variants.
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production
A sound cloning tool with a web interface, using your voice or any sound to record audio / 一个带web界面的声音克隆工具，使用你的音色或任意声音来录制音频
A generative speech model for daily dialogue.
Fuse ChatTTS with OpenVoice, upload a 10-second audio clip, and clone your personalized ChatTTS voice.
Step-by-step Jupyter notebook tutorials for ChatTTS
[SIGGRAPH Asia 2022] VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild
Unsupervised text tokenizer for Neural Network-based text generation.
ChatGLM-6B HTTP流式解码API的Flask、FastAPI实现，以及开箱即用的Web页面。 a stream decoding demo of ChatGLM-6B using Flask or FastAPI, with web page out-of-the-box.
A Vector Database Tutorial (over CMU-DB's BusTub system)
A simple toy demo of a local voice assistant with whisper and large language model.
《代码随想录》LeetCode 刷题攻略：200道经典题目刷题顺序，共60w字的详细图解，视频难点剖析，50余张思维导图，支持C++，Java，Python，Go，JavaScript等多语言版本，从此算法学习不再迷茫！🔥🔥 来看看，你会发现相见恨晚！🚀
AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术
A fast multi-producer, multi-consumer lock-free concurrent queue for C++11
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), ga…
LangChain 的中文入门教程
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of …
新闻网页正文通用抽取器 Beta 版.
《面向开发者的 ChatGPT 提示词工程》非官方版中英双语字幕 Unofficial subtitles of "ChatGPT Prompt Engineering for Developers"
Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)
Learn how to design, develop, deploy and iterate on production-grade ML applications.
This is an AI agent for Street Fighter II Champion Edition.