Ctrl-World: A Controllable Generative World Model for Robot Manipualtion

[ICCV 2023] MOSE: A New Dataset for Video Object Segmentation in Complex Scenes

DROID Policy Learning and Evaluation

SLAM-Former: Putting SLAM into One Transformer

A minimal implementation of DeepMind's Genie world model

LeIsaac provides teleoperation functionality in IsaacLab using the SO101Leader (LeRobot), including data collection, data conversion, and subsequent policy training.

Implementation of Slot Attention from GoogleAI

Pytorch Implementation of paper "Object-Centric Learning with Slot Attention"

Official implementation of the ICML 2025 paper "SOLD: Slot Object-Centric Latent Dynamics Models for Relational Manipulation Learning from Pixels"

Vector (and Scalar) Quantization, in Pytorch

Unified Implementations of Offline Reinforcement Learning Algorithms

A framework for training world models with virtual environments, complete with annotated environment dataset (RetroAct), exploration agent (AutoExplore Agent), and GenieRedux-G - an implementation …

High-Level Control Library for Franka Robots with Python and C++ Support

Judo: a hackable sampling-based MPC toolbox

A PyTorch library for implementing flow matching algorithms, featuring continuous and discrete flow matching implementations. It includes practical examples for both text and image modalities.

Machine learning robotics engineer preparation material.

Control Spot legged robot with audio, build semantic navigation maps and support visual question answering

An open, modular framework for zero-shot, language conditioned pick-and-drop tasks in arbitrary homes.

Open source implementation to the paper "IKFlow: Generating Diverse Inverse Kinematics Solutions"

Sampling-based model predictive control on GPU with JAX/MJX

Tensors, for human consumption

Codebase for Kinova Gen3 training in Isaac Lab, sim2real transfer and ROS deployment.

Code for the ICLR 2024 spotlight paper: "Learning to Act without Actions" (introducing Latent Action Policies)

JAX reimplementation of the DeepMind paper "Genie: Generative Interactive Environments"

Pytorch implementation of "Genie: Generative Interactive Environments", Bruce et al. (2024).