This repository contains comprehensive pricing and configuration data for LLMs. It powers cost attribution for 200+ enterprises running 400B+ tokens through Portkey AI Gateway every day.

Create and improve AI agents that get better over time with automatic optimization and continuous learning

Ultra-fast semantic tool filtering for MCP (Model Context Protocol) servers using embedding similarity. Reduce your tool context from 1000+ tools down to the most relevant 10-20 tools in under 10ms.

MCP Testing Tool — Like Postman, but for the Model Context Protocol.

Define, Prompt and Test MCP enabled Agents and Workflows

A Model Context Protocol (MCP) server implementation for the Portkey AI platform, providing a standardized interface for managing AI configurations, workspaces, and analytics.

Swarm.js is a Node.js implementation of OpenAI’s experimental Swarm framework. This SDK allows developers to orchestrate multi-agent systems using OpenAI’s API in a lightweight and ergonomic way, w…

Model Context Protocol Servers

Notes on tests in integrating Portkey with LibreChat

Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks

A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

Kubernetes Configs for Portkey Gateway deployment

OpenAPI specification for the Portkey API

A chat interface for portkey

Parse vision is an open source tool to visualise what OCR is parsing in a PDF document to help developers and product teams identify if the parsing has missed some vital information from the document.

visually integration test your backend

Graph Neural Network Library for PyTorch

JS port and JS/WASM bindings for openai/tiktoken

Build reliable, secure, and production-ready AI apps easily.

[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

Build reliable, secure, and production-ready AI apps easily.

Structured Outputs

ISIN database for casparser

Personal CRM. Remember everything about your friends, family and business relationships.

Client-side JavaScript PDF generation for everyone.

REST API test framework. BDD and exploits promises

Wordpress Admin & Theme inspired by Svbtle