This project is a nix devshell for using ComfyUI as it is meant to be without running into a lot of different problems regarding torch and other dependencies. Lots of inspiration from this repo. Everything is kept in a python virtual env.

git clone --recurse-submodule https://github.com/aldenparker/comfyui-nix-devshell
cd comfyui-nix-devshell
nix develop ./#cuda # Make sure change this based on what you are running
cd ComfyUI
python -m pip install -r requirements.txt

Each nix develop ./#<variant> automatically creates and activates .venv, so which python inside the shell always points to a writable virtualenv instead of the read-only Nix store. If you run into issues, delete .venv and reinstall requirements.

Entering nix develop .#rocm automatically points pip at the ROCm wheel index (https://download.pytorch.org/whl/rocm6.4) while keeping PyPI as a fallback for everything else. After launching that shell, remove any stale venv (rm -rf .venv) and reinstall requirements so torch/vision/audio come from the ROCm repo instead of pulling CUDA builds. You may need to install different versions of the torch packages based on your hardware. Look at the ComfyUI repo to make sure.

Nvidia can be somewhat complicated when it comes to meshing with python. To make sure that it works and you do not get a driver mismatch, make sure that the current locked driver version is the version your host system is running. The current version locked are below:

CUDA: 570.153.02
CUDA-BETA: 575.51.02