Stars
SearXNG is a free internet metasearch engine which aggregates results from various search services and databases. Users are neither tracked nor profiled.
🔍 AI search engine - self-host with local or cloud LLMs
A high-throughput and memory-efficient inference and serving engine for LLMs
⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.
Python tool for converting files and office documents to Markdown.
Community maintained fork of pdfminer - we fathom PDF
Safe, Open, High-Performance — PDF for AI
A markdown parser and compiler. Built for speed.
Markdown parser, done right. 100% CommonMark support, extensions, syntax plugins & high speed. Now in Python!
A fast yet powerful Python Markdown parser with renderers and plugins.
AI Code Guide is a roadmap to start coding with AI
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discr…
🐶 Kubernetes CLI To Manage Your Clusters In Style!
Papers from the computer science community to read and discuss.
📚 Freely available programming books
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
llama3 implementation one matrix multiplication at a time
A minimal LLM chat app that runs entirely in your browser
Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.
LLMPerf is a library for validating and benchmarking LLMs
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
This is my repo following the book "Python Workout: 50 Ten-minute Exercises" by Reuven M. Lerner
AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data…