Popular repositories Loading

1. exllamav3 exllamav3 Public

   Forked from turboderp-org/exllamav3

   An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

   Python 3

2. ik_llama.cpp ik_llama.cpp Public

   Forked from ikawrakow/ik_llama.cpp

   llama.cpp fork with additional SOTA quants and improved performance

   C++ 1

3. exllamav2_dev exllamav2_dev Public

   Forked from turboderp-org/exllamav2

   A fast inference library for running LLMs locally on modern consumer-class GPUs

   Python

4. exui_dev exui_dev Public

   Forked from turboderp-org/exui

   Web UI for ExLlamaV2

   JavaScript

5. FramePack FramePack Public

   Forked from lllyasviel/FramePack

   Lets make video diffusion practical!

   Python

6. text-generation-webui text-generation-webui Public

   Forked from oobabooga/text-generation-webui

   A Gradio web UI for Large Language Models with support for multiple inference backends.

   Python