Repositories list

• exo

  Public
  Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚

  Python

  •2.2k•0•0•0•Updated Jul 16, 2024Jul 16, 2024

• cognita

  Public
  RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

  Python

  •

  Apache License 2.0

  •360•0•0•0•Updated Apr 27, 2024Apr 27, 2024

• LLocalSearch

  Public
  LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progress of the agents and the final answer. No OpenAI or Google API keys are needed.

  Go

  •

  Apache License 2.0

  •373•0•0•0•Updated Apr 4, 2024Apr 4, 2024

• continue

  Public
  ⏩ The easiest way to code with any LLM—Continue is an open-source autopilot for VS Code and JetBrains

  TypeScript

  •

  Apache License 2.0

  •3.7k•0•0•0•Updated Feb 18, 2024Feb 18, 2024

• DeepSeek-Coder

  Public
  DeepSeek Coder: Let the Code Write Itself

  Python

  •

  MIT License

  •2.6k•0•0•0•Updated Feb 18, 2024Feb 18, 2024

• reor

  Public
  AI note-taking app that runs models locally.

  TypeScript

  •

  GNU General Public License v3.0

  •508•0•0•0•Updated Feb 15, 2024Feb 15, 2024

• trt-llm-rag-windows

  Public
  A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM

  Python

  •

  Other

  •420•0•0•0•Updated Feb 13, 2024Feb 13, 2024

• whisper.cpp

  Public
  Port of OpenAI's Whisper model in C/C++

  C

  •

  MIT License

  •4.9k•0•0•0•Updated Feb 13, 2024Feb 13, 2024

• gradio

  Public
  Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

  Python

  •

  Apache License 2.0

  •3.1k•0•0•0•Updated Feb 10, 2024Feb 10, 2024

• mlc-llm

  Public
  Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

  Python

  •

  Apache License 2.0

  •1.9k•0•0•0•Updated Feb 10, 2024Feb 10, 2024

• anything-llm

  Public
  Open-source multi-user ChatGPT for all LLMs, embedders, and vector databases. Unlimited documents, messages, and users in one privacy-focused app. Now available as a desktop application!

  JavaScript

  •

  MIT License

  •5.4k•0•0•0•Updated Feb 7, 2024Feb 7, 2024

• ollama-webui

  Public
  ChatGPT-Style Web UI Client for Ollama 🦙

  Svelte

  •

  MIT License

  •16k•0•0•0•Updated Feb 5, 2024Feb 5, 2024

• exllamav2

  Public
  A fast inference library for running LLMs locally on modern consumer-class GPUs

  Python

  •

  MIT License

  •324•1•0•0•Updated Feb 1, 2024Feb 1, 2024

• tabby

  Public
  Self-hosted AI coding assistant

  Rust

  •

  Other

  •1.6k•0•0•0•Updated Jan 29, 2024Jan 29, 2024

• ollama

  Public
  Get up and running with Llama 2, Mistral, and other large language models locally.

  Go

  •

  MIT License

  •14k•0•0•0•Updated Jan 29, 2024Jan 29, 2024

• ollama-webui-lite

  Public
  Ollama WebUI Stripped 🦙

  Svelte

  •

  MIT License

  •138•0•0•0•Updated Jan 28, 2024Jan 28, 2024

• LocalAI

  Public
  🤖 The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs ggml, gguf, GPTQ, onnx, TF compatible models: llama, llama2, rwkv, whisper, vicuna, koala, cerebras, falcon, dolly, starcoder, and many others

  C++

  •

  MIT License

  •3k•0•0•0•Updated Jan 24, 2024Jan 24, 2024

• llama-coder

  Public
  Replace Copilot with a more powerful and local AI

  TypeScript

  •

  MIT License

  •168•0•0•0•Updated Jan 23, 2024Jan 23, 2024

• distributed-llama

  Public
  Run LLMs on weak devices or make powerful devices even more powerful by distributing the workload and dividing the RAM usage.

  C++

  •

  MIT License

  •190•1•0•0•Updated Jan 20, 2024Jan 20, 2024

• jan

  Public
  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer

  TypeScript

  •

  GNU Affero General Public License v3.0

  •2.4k•0•0•0•Updated Jan 17, 2024Jan 17, 2024

• GPU-Benchmarks-on-LLM-Inference

  Public
  Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?

  Jupyter Notebook

  •69•0•0•0•Updated Dec 25, 2023Dec 25, 2023

• PowerInfer

  Public
  High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

  C

  •

  MIT License

  •450•0•0•0•Updated Dec 20, 2023Dec 20, 2023

• candle

  Public
  Minimalist ML framework for Rust

  Rust

  •

  Apache License 2.0

  •1.3k•0•0•0•Updated Dec 18, 2023Dec 18, 2023

• insanely-fast-whisper

  Public
  Jupyter Notebook

  •

  Apache License 2.0

  •625•0•0•0•Updated Dec 17, 2023Dec 17, 2023

• macOSpilot-ai-assistant

  Public
  Voice + Vision powered AI assistant that answers questions about any application, in context and in audio.

  JavaScript

  •50•0•0•0•Updated Dec 12, 2023Dec 12, 2023

• SillyTavern

  Public
  LLM Frontend for Power Users.

  JavaScript

  •

  GNU Affero General Public License v3.0

  •4.2k•0•0•0•Updated Dec 11, 2023Dec 11, 2023

• TavernAI

  Public
  Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)

  JavaScript

  •342•1•0•0•Updated Dec 11, 2023Dec 11, 2023

• koboldcpp

  Public
  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

  C

  •

  GNU Affero General Public License v3.0

  •14k•0•0•0•Updated Dec 11, 2023Dec 11, 2023

• mirror

  Public
  Python

  •18•0•0•0•Updated Dec 11, 2023Dec 11, 2023

• LibreChat

  Public
  Enhanced ChatGPT Clone: Features OpenAI, GPT-4 Vision, Bing, Anthropic, OpenRouter, PaLM 2, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. More features in development

  TypeScript

  •

  MIT License

  •6.1k•0•0•0•Updated Dec 2, 2023Dec 2, 2023