A cosy home for your LLMs.

Audio playback and capture library written in C, in a single source file.

Local LLM-assisted text completion for Qt Creator.

Simple GUI around whisper.cpp for voice-to-text on Linux

Local LLM-assisted text completion for Qt Creator.

MLPerf Client is a benchmark for Windows, Linux and macOS, focusing on client form factors in ML inference scenarios.

Kernels & AI inference engine for mobile devices.

Emacs package for LLM-assisted code/text completion

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

The application performs real-time inference on audio from an ALSA capture device

TTS support with GGML

LLM plugin for interacting with llama-server models

Running any GGUF SLMs/LLMs locally, on-device in Android

DINOv2 inference engine written in C/C++ using ggml and OpenCV.

Qwen3 is the large language model series developed by Qwen team, Alibaba Cloud.

Real-time webcam demo with SmolVLM and llama.cpp server

📎 Clippy, now with some AI

Command to convert from color text (ANSI or 256) to image.

Simple frontend for LLMs built in react-native.

Speech-to-text transcription VST3/ARA plugin

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Notes and exploration code for learning about AI/ML

Go language bindings for the ggwave C++ library

Rounding vectors

Easy to use interface for the Whisper model optimized for all GPUs!

Run Orpheus 3B Locally With LM Studio