High performance distributed cache system. Built by Rust.

The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface.

Social media share buttons and share counts for React

s1: Simple test-time scaling

This is a repo with links to everything you'd ever want to learn about data engineering

Latency and Memory Analysis of Transformer Models for Training and Inference

A large-scale simulation framework for LLM inference

ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale

A machine learning compiler for GPUs, CPUs, and ML accelerators

Focus on prompting and generating

Kolmogorov Arnold Networks

Supplementary code for https://astralord.github.io/posts/exploring-parallel-strategies-with-jax/

A native PyTorch Library for large model training

Puzzles for learning Triton

Pipeline Parallelism for PyTorch

Ongoing research training transformer models at scale

FlashInfer: Kernel Library for LLM Serving

A high-throughput and memory-efficient inference and serving engine for LLMs

Whisper realtime streaming for long speech-to-text transcription and translation

ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22)

Stanford DSPy: The framework for programming with foundation models

The simplest, fastest repository for training/finetuning medium-sized GPTs.

RayLLM - LLMs on Ray

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.