A high-throughput and memory-efficient inference and serving engine for LLMs

AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.

Supercharge Your LLM Application Evaluations 🚀

The open LLM Ops platform - Traces, Analytics, Evaluations, Datasets and Prompt Optimization ✨

trpc-agent-go is a powerful Go framework for building intelligent agent systems using large language models (LLMs) and tools.

The LLM Evaluation Framework

Dynamiq is an orchestration framework for agentic AI and LLM applications

AgentScope: Agent-Oriented Programming for Building LLM Applications

The unified stack for multi-agent systems.

Minimal CLI coding agent by Mistral

The glamourous AI coding agent for your favourite terminal 💘

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting yo…

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Open-source observability for your LLM application, based on OpenTelemetry

An open-source AI agent that brings the power of Gemini directly into your terminal.

OpenTelemetry Auto Instrumentation using eBPF

OpenTelemetry Compile-Time Instrumentation for Golang

Nacos client in Golang

Datadog APM client for Node.js

OpenTelemetry instrumentation for JavaScript modules

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry

OpenTelemetry Go API and SDK

Extract clean conversation logs from Claude Code's internal storage

🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.