Distributed query engine providing simple and reliable data processing for any modality and scale

Interrupts-off or softirqs-off latency tracer

Clipboard extension app for macOS.

MIT Chord/DHash

Exploration of the Dynamo paper in Python

CUDA SGEMM optimization note

Repository hosting code for "Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations" (https://arxiv.org/abs/2402.17152).

Official git repository for libdivide: optimized integer division

Student version of Assignment 1 for Stanford CS336 - Language Modeling From Scratch

Seamless operability between C++11 and Python

Codes & examples for "CUDA - From Correctness to Performance"

A unified architecture deep learning framework designed specifically for ultra-large-scale sparse models.

Lightning-Fast RL for LLM Reasoning and Agents. Made Simple & Flexible.

An Open Source Machine Learning Framework for Everyone

A machine learning compiler for GPUs, CPUs, and ML accelerators

SGLang is a fast serving framework for large language models and vision language models.

Checkpoint-engine is a simple middleware to update model weights in LLM inference engines

Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3 (NeurIPS'25).

slime is an LLM post-training framework for RL Scaling.

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations

MQSim is a fast & accurate simulator for modern multi-queue (MQ) and SATA SSDs. MQSim faithfully models new high-bandwidth protocol implementations, steady-state SSD conditions, and full end-to-end…

A fast multi-producer, multi-consumer lock-free concurrent queue for C++11

Apache Parquet Format

PetPS: Supporting Huge Embedding Models with Tiered Memory

A collection of LLM memes

[SIGMOD '24] CaaS-LSM: Compaction-as-a-Service for LSM-based Key-Value Stores in Storage Disaggregated Infrastructure

A Deep Learning Recommender System

大概是2020年最全的免费可商用字体，这里收录的商免字体都能找到明确的授权出处，可以放心使用，持续更新中...