Stars
xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism
MemOS (Preview) | Intelligence Begins with Memory
Persist and reuse KV Cache to speedup your LLM.
Define, Prompt and Test MCP enabled Agents and Workflows
CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)
Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper
Community maintained hardware plugin for vLLM on Ascend
A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
免费学代码系列:小白python入门、数据分析data analyst、机器学习machine learning、深度学习deep learning、kaggle实战
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
Llama中文社区,实时汇总最新Llama学习资料,构建最好的中文Llama大模型开源生态,完全开源可商用
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
Croissant is a high-level format for machine learning datasets that brings together four rich layers.
An I/O benchmark for deep Learning applications
骆驼(Luotuo): Open Sourced Chinese Language Models. Developed by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子昂 @ 商汤科技
Chat凉宫春日, An open sourced Role-Playing chatbot Cheng Li, Ziang Leng, and others.
Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activelo…
FFCV: Fast Forward Computer Vision (and other ML workloads!)
Secure Transformer Inference is a protocol for serving Transformer-based models securely.
HDF5 for Python -- The h5py package is a Pythonic interface to the HDF5 binary data format.
Alluxio, data orchestration for analytics and machine learning in the cloud
InFi is a library for building input filters for resource-efficient inference.
Human Activity Recognition example using TensorFlow on smartphone sensors dataset and an LSTM RNN. Classifying the type of movement amongst six activity categories - Guillaume Chevalier
A curated list of awesome Machine Learning frameworks, libraries and software.
USTC成绩自动通知脚本