See Docker Installation (if not already installed)
Install at least Python 3.10 with Pip (if not already installed). Earlier versions might work but are not tested.
git clone https://github.com/CR1337/xLLaMa.gitcd xLLaMapython3 -m venv .venvsource .venv/bin/activateIf you are on the production server with GPUs 2 and 3, run
bin/setupelse run
bin/setup-localFor running in the background (recommended for production):
bin/runFor seeing terminal output (recommended for development):
bin/run-blockingIf you are not on the production server with GPUs 2 and 3 use
bin/run-localor
bin/run-blocking-localrespectively.
Open the application in a browser at http://localhost:8080. You can replace localhost with the IP of the server.
bin/stopor if you are not on the production server with GPUs 2 and 3
bin/stop-local