Unified Model Serving Framework 🍱

A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

GPT Index (LlamaIndex) is a project consisting of a set of data structures designed to make it easier to use large external knowledge bases with LLMs.

A library of data loaders for LLMs made by the community -- to be used with GPT Index and/or LangChain

The AMM Laboratory

Docker container for running PyTorch scripts to train and host PyTorch models on SageMaker

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

A high-throughput and memory-efficient inference and serving engine for LLMs

Weaviate is an open source vector search engine that stores both objects and vectors, allowing for combining vector search with structured filtering with the fault-tolerance and scalability of a cl…