TorchDynamo is a Python-level JIT compiler designed to make unmodified PyTorch programs faster. TorchDynamo hooks into the frame evaluation API in CPython (PEP 523) to dynamically modify Python bytecode right before it is executed. It rewrites Python bytecode in order to extract sequences of PyTorch operations into an FX Graph which is then just-in-time compiled with an ensemble of different backends and autotuning. It creates this FX Graph through bytecode analysis and is designed to mix Python execution with compiled backends to get the best of both worlds: usability and performance.

Links for more information and development progress updates:

• Update 1: An Experiment in Dynamic Python Bytecode Transformation
• Update 2: 1.48x Geomean Speedup on TorchBench CPU Inference
• Update 3: GPU Inference Edition
• Update 4: LazyTensor & nvFuser Experiments