Stars
Curated resources, research, and tools for securing AI systems
An open-source framework for verifiably private AI inference
The Intelligent Inference Scheduler for Large-scale Inference Services.
GoMLX: An Accelerated Machine Learning Framework For Go
ASQI (AI Solutions Quality Index) Engineer - run containerised AI tests and map to score cards!
A Golang package that implements CDC chunkers with a generic interface
A CLI host application that enables Large Language Models (LLMs) to interact with external tools through the Model Context Protocol (MCP).
Distributed KV cache scheduling & offloading libraries
A powerful AI coding agent. Built for the terminal.
vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)
A JWT based API for managing users and issuing JWT tokens
Cost-efficient and pluggable Infrastructure components for GenAI inference
The definitive Web UI for local AI, with powerful features and easy setup.
LostRuins / koboldcpp
Forked from ggml-org/llama.cppRun GGUF models easily with a KoboldAI UI. One File. Zero Install.
open source Kubernetes-native API gateway for microservices built on the Envoy Proxy
An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
High-speed Large Language Model Serving for Local Deployment
Find vulnerabilities, misconfigurations, secrets, SBOM in containers, Kubernetes, code repositories, clouds and more
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
🦍 Kong for Kubernetes: The official Ingress Controller for Kubernetes.
Fast and extensible multi-platform HTTP/1-2-3 web server with automatic HTTPS
Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search