Optimize prompts, code, and more with AI-powered Reflective Text Evolution

DSPy: The framework for programming—not prompting—language models

A framework for optimizing DSPy programs with RL

A framework for few-shot evaluation of language models.

Community-contributed instructions, prompts, and configurations to help you make the most of GitHub Copilot.

From RAG chatbots to code assistants to complex agentic pipelines and beyond, build LLM systems that run better, faster, and cheaper with tracing, evaluations, and dashboards.

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 2, and other large language models.

A framework for building, orchestrating and deploying AI agents and multi-agent workflows with support for Python and .NET.

The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents

An open-source, code-first Python toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

🦜🔗 Build context-aware reasoning applications

High-performance runtime for multi-agent systems. Build, run and manage secure multi-agent systems in your cloud.

Official Pipecat docs repo

Pipecat example applications. Use and learn from these patterns to build your own voice AI applications.

Documentation for the Strands Agents SDK. A model-driven approach to building AI agents in just a few lines of code.

Make your first open-source contribution.

Examples and guides for using the OpenAI API

The papers are organized according to our survey: Evaluating Large Language Models: A Comprehensive Survey.

The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".