A high-throughput and memory-efficient inference and serving engine for LLMs

Go ahead and axolotl questions

Open-source framework for building AI-powered apps in JavaScript, Go, and Python, built and used in production by Google

Python Imaging Library (Fork)

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Evaluation and Tracking for LLM Experiments and AI Agents

Supercharge Your LLM Application Evaluations 🚀

The LLM Evaluation Framework

scikit-learn: machine learning in Python

Tensors and Dynamic neural networks in Python with strong GPU acceleration

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

💫 Industrial-strength Natural Language Processing (NLP) in Python

The TypeScript MCP framework

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Set of tools to assess and improve LLM security.

Adding guardrails to large language models.

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

Visual testing tool for MCP servers

GenAI Agent Framework, the Pydantic way

Build resilient language agents as graphs.

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

Build AI Agents, Visually

<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

A programming framework for agentic AI

AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data…

LlamaIndex is the leading framework for building LLM-powered agents over your data.

🦜🔗 The platform for reliable agents.

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM