High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

DeepEP: an efficient expert-parallel communication library

Development repository for the Triton language and compiler

A high-throughput and memory-efficient inference and serving engine for LLMs

👑 Easy-to-use and powerful NLP library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Ques…

Paddle Multimodal Integration and eXploration, supporting text-to-image, image generation, multi-modal CV tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model too…

Multi-platform high performance deep learning inference engine (『飞桨』多平台高性能深度学习预测引擎）

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

PaddlePaddle TestSuite

CUDA Templates for Linear Algebra Subroutines

real Transformer TeraFLOPS on various GPUs

Yinghan's Code Sample

Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentation, Interactive Segmentation, Panoptic Segmentation, Image …

Linux kernel source tree

lib, demo, model, data

Simple samples for TensorRT programming