Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 17+ clouds, or on-prem).

verl: Volcano Engine Reinforcement Learning for LLMs

SGLang is a fast serving framework for large language models and vision language models.

A simple, performant and scalable Jax LLM!

example LLVM pass

Inference code for LLaMA models

The code for NeurIPS 2023 paper DSR

Flask and Bootstrap Web App for GCP cloud deployment of the "Monte Carlo dropout method for uncertainty quantification in image segmentation"

Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.

Evolutionary Scale Modeling (esm): Pretrained language models for proteins

Official repository for discrete Walk-Jump Sampling (dWJS)

Official implementation of "Neuralangelo: High-Fidelity Neural Surface Reconstruction" (CVPR 2023)

JAX implementation of instant-ngp (NeRF part)

Additive manufacturing simulation with JAX.

Algebraic Multigrid Solvers in Python

Use Jax functions in Pytorch

NeMo: a toolkit for conversational AI

Systems design is the process of defining the architecture, modules, interfaces, and data for a system to satisfy specified requirements. Systems design could be seen as the application of systems …