一种大模型推理引擎的实现。

ncnn is a high-performance neural network inference framework optimized for the mobile platform

LLM inference in C/C++

📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉

一种经过优化的推理引擎核心。

😞

Fast and memory-efficient exact attention

The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices

OCRmyPDF adds an OCR text layer to scanned PDF files, allowing them to be searched

Build, run, manage multi-agent systems.

AI education materials for Chinese students, teachers and IT professionals.

LLM training in simple, raw C/CUDA