Hubble is a suite of fully open-source large language models (LLMs) for the scientific study of LLM memorization.

PyTorch-native post-training at scale

Python implementation of Bayesian online changepoint detection

Tora: Torchtune-LoRA for RL

AlgoTune is a NeurIPS 2025 benchmark made up of 154 math, physics, and computer science problems. The goal is write code that solves each problem, and is faster than existing implementations.

A lightweight library for beautiful game of life embeds.

A command-line tool for building static sites from Observable Notebooks

A comprehensive toolkit for streamlining data editing, search, and inspection for large-scale language model training and interpretability.

Official Implementation of wd1

Reproduce ICLR2025 Energy-Based Diffusion Language Models for Text Generation

Implementation of Sharpe-ratio-based active learning strategies for aligning large language models using Direct Preference Optimization (DPO).

Sample-Efficient Preference Alignment in LLMs via Active Exploration

Official implementation for the paper "Toward Scientific Reasoning in LLMs: Training from Expert Discussions via Reinforcement Learning"

A High-Efficiency System of Large Language Model Based Search Agents

Resa: Transparent Reasoning Models via SAEs

Uncertainty-guided Likelihood Tree Search

Tina: Tiny Reasoning Models via LoRA

This package contains the original 2012 AlexNet code.

You like pytorch? You like micrograd? You love tinygrad! ❤️

(WIP) A small but powerful, homemade PyTorch from scratch.

Gene-MTEB Benchmark for Genomic Embedding

Pretraining Code for METAGENE-1

Friends of OLMo and their links.

Code and Data for Compare without Despair: Reliable Preference Evaluation with Generation Separability