🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with co…

Community-maintained Kubernetes config and Helm chart for Langfuse

The open source version of the Amazon EKS user guide. You can submit feedback & requests for changes by submitting issues in this repo or by making proposed changes & submitting a pull request.

User documentation for Knative components.

Giving Kubernetes Superpowers to everyone

Pure Python framework for writing Juju charms

vLLM performance dashboard

📜Fork for tracking CNCF projects

A Kubernetes controller for Elastic Load Balancers

🔍 Haystack is an open source NLP framework that leverages pre-trained Transformer models. It enables developers to quickly implement production-ready semantic search, question answering, summarizat…

SDK for Python (devo-sdk). Send events to Devo and make queries.

KubeFlow on AWS

Serverless Inferencing on Kubernetes

The open source version of the Amazon Comprehend docs. You can submit feedback & requests for changes by submitting issues in this repo or by making proposed changes & submitting a pull request

An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more

Dashboard for sacred

Test infrastructure and tooling for Kubeflow.

Code repository for our paper "Failing Loudly: An Empirical Study of Methods for Detecting Dataset Shift": https://arxiv.org/abs/1810.11953

A repository for Kustomize manifests

Machine Learning Toolkit for Kubernetes

IntelliJ Knative plugin

Kubernetes Node Autoscaling: built for flexibility, performance, and scalability.