Open-source observability for your LLM application, based on OpenTelemetry

🪢 Langfuse documentation -- Langfuse is the open source LLM Engineering Platform. Observability, evals, prompt management, playground and metrics to debug and improve LLM apps

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

A high-throughput and memory-efficient inference and serving engine for LLMs

Documentation for Traceloop & OpenLLMetry

Routing proxy for TGIS

A fork of github.com/vllm-project/vllm

The OpenTelemetry website and documentation

MicroMCAD

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.

Open Data Hub operator implementation, based on Kubeflow Operator

Holistic job manager on Kubernetes

Operator for installation and lifecycle management of CodeFlare distributed workload stack, starting with MCAD and InstaScale

Transform flow logs into metrics

Like Prometheus, but for logs.

An OpenShift / Kubernetes operator for network observability

Network Observability plugin for the Openshift Console

Tensors, ready for human consumption

Paper implementations from scratch and machine learning tutorials

Toolbox of models, callbacks, and datasets for AI/ML researchers.

Original Pytorch implementation of the GPDM model introduced in "Generating natural images with direct patch distributions matching"

A Go framework for end-to-end testing of components running in Kubernetes clusters.

🥑 Language focused docker images, minus the operating system.