A curated list of open source repositories for AI Engineers
If you want to contribute to this list, please make a PR
- AI Gateway
- AI Workload Manager
- Copilot Development
- Dataset Engineering
- Evaluation
- Fine Tuning
- Function Calling
- Graph RAG
- Guardrails
- Local Model Inference
- LLM Agent Framework
- Model Serving
- Observability
- Pre Training
- Prompt Engineering
- RAG Framework
- Structured Extraction
- Structured Generation
- Vector DB
| Name (site) | Github |
|---|---|
| Kong |  |
| Litellm |  |
| Portkey |  |
| RouteLLM |  |
| GPTRouter |  |
| tensorzero |  |
| missing studio |  |
| Name (site) | Github |
|---|---|
| Ray |  |
| higgsfield |  |
| Dstack |  |
| Name (site) | Github |
|---|---|
| copilotkit |  |
| OpenCopilot |  |
| Name (site) | Github |
|---|---|
| label studio |  |
| CleanLab |  |
| Snorkel |  |
| Lilac |  |
| litdata |  |
| Name (site) | Github |
|---|---|
| Eval |  |
| RAGAS |  |
| Giskard |  |
| promptfoo |  |
| arize ai |  |
| uptrain |  |
| trulens |  |
| tonic-validate |  |
| LangEvals |  |
| Poyro |  |
| Name (site) | Github |
|---|---|
| Unsloth |  |
| ludwig |  |
| NeMo/Nvidia |  |
| LMFlow |  |
| litgpt |  |
| Axolotl |  |
| xTuring |  |
| Name (site) | Github |
|---|---|
| Gorilla |  |
| Tiger |  |
| NPI AI |  |
| empower |  |
| Composio |  |
| Name (site) | Github |
|---|---|
| graphRAG |  |
| cognee |  |
| FalkorDB |  |
| llm-graph-builder |  |
| tidb |  |
| Name (site) | Github |
|---|---|
| NeMo-Guardrails |  |
| Guardrails |  |
| Name (site) | Github |
|---|---|
| llama cpp |  |
| whisper cpp |  |
| ollama |  |
| gpt4all |  |
| private-gpt |  |
| open-interpreter |  |
| LocalAI |  |
| jan |  |
| dalai |  |
| Name (site) | Github |
|---|---|
| vLLM |  |
| TensorRT-LLM |  |
| bentoml |  |
| lightllm |  |
| openfoundry |  |
| LitServe |  |
| truss |  |
| Name (site) | Github |
|---|---|
| pezzo |  |
| helicone |  |
| Portkey | |
| Langfuse |  |
| langtrace |  |
| traceloop |  |
| trulens | |
| log10 |  |
| LangWatch |  |
| burr |  |
| hamilton |  |
| Name (site) | Github |
|---|---|
| Colossal AI |  |
| FastChat |  |
| pytorch-lightning |  |
| llm c |  |
| miniGPT |  |
| Name (site) | Github |
|---|---|
| DSPy |  |
| Langfuse | |
| hamilton | |
| Name (site) | Github |
|---|---|
| Armur |  |
| Name (site) | Github |
|---|---|
| Unstructured |  |
| omniparse |  |
| unstract |  |
| indexify |  |
| firecrawl |  |
| Scrapegraph-ai |  |
| extractous |  |
| Name (site) | Github |
|---|---|
| guidance |  |
| outlines |  |
| instructor |  |
| jsonformer |  |
| sglang |  |
| Name (site) | Github |
|---|---|
| milvus |  |
| Qdrant |  |
| Chroma |  |
| Weaviate |  |
| pgvector |  |
| deeplake |  |
| txtai |  |
| marqo |  |
| lancedb |  |
| nucliaDB |  |
| oasysdb |  |
| lantern |  |
| vespa |  |