Stars
A high-throughput and memory-efficient inference and serving engine for LLMs
Inspect: A framework for large language model evaluations
Post-training with Tinker
Distributed Task Queue (development branch)
Neon: Serverless Postgres. We separated storage and compute to offer autoscaling, code-like database branching, and scale to zero.
The most comprehensive authentication framework for TypeScript
An extremely fast Python type checker and language server, written in Rust.
Lightweight coding agent that runs in your terminal
Open Source Metering and Usage Based Billing API ⭐️ Consumption tracking, Subscription management, Pricing iterations, Payment orchestration & Revenue analytics
An extremely fast Python linter and code formatter, written in Rust.
Reproducing Gaussian Splatting
A Data Streaming Library for Efficient Neural Network Training
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
A playbook for systematically maximizing the performance of deep learning models.
Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)
Toolkit for creating, sharing and using natural language prompts.
Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
Alternative to https://github.com/Dynalon/mdwiki-seed
A framework for few-shot evaluation of language models.
Profiling and inspecting memory in pytorch
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.