Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory…

🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN

verl: Volcano Engine Reinforcement Learning for LLMs

A high-throughput and memory-efficient inference and serving engine for LLMs

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention & RFT)

Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.

抢占显卡

Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Using GPT to parse PDF

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

OpenCompass is an LLM evaluation platform, supporting a wide range of models (InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization

✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models. The first work to correct hallucinations in MLLMs.