FSDP Transformer in JAX/NNX

A pure Python utility for maintaining preemptible TPUs

Everything you want to know about Google Cloud TPU

NanoGPT (124M) in 3 minutes

The simplest, fastest repository for training/finetuning medium-sized GPTs.

Bayesian Neural Network Surrogates for Bayesian Optimization

Online variational GPs

For optimization algorithm research and development.

Tips for Writing a Research Paper using LaTeX

ICML 2023: Reduce, Reuse, Recycle: Composing Energy-Based Diffusion Models with MCMC

Implementation of SpliceAI, Illumina's deep neural network to predict variant effects on splicing, in PyTorch.

This is a list of peer-reviewed representative papers on deep learning dynamics (optimization dynamics of neural networks). The success of deep learning attributes to both network architecture and …

Friends don't let friends make certain types of data visualization - What are they and why are they bad.

A modern look at the relationship between sharpness and generalization [ICML 2023]

gradient flow in pytorch

JAX - A curated list of resources https://github.com/google/jax

Bayesian inference and posterior analysis for Python

Demos for the paper Generalized Variational Inference (Knoblauch, Jewson & Damoulas, 2019)

PyTorch-based library for Riemannian Manifold Hamiltonian Monte Carlo (RMHMC) and inference in Bayesian neural networks

A PyTorch Implementation of Convolutional Conditional Neural Process.

PokeWilds - A Gen 2 Game/Engine using libGDX

Foundation Models for Genomics & Transcriptomics

The Cartoon Cartoon Summer Resort Shockwave game series ported to the modern web. (+Scooby Doo Hollywood Horror)

Code release for "Git Re-Basin: Merging Models modulo Permutation Symmetries"

Captcha image generator for Zkaptcha

SAM: Sharpness-Aware Minimization (PyTorch)

Code for my medium article