Achieve state of the art inference performance with modern accelerators on Kubernetes

helm charts for deploying models with llm-d

A high-throughput and memory-efficient inference and serving engine for LLMs

llm-d helm charts and deployment examples

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Large Language Model Text Generation Inference

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

Public repo for HF blog posts

Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)

A blazing fast inference solution for text embeddings models

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch

🦜🔗 Build context-aware reasoning applications

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

Train transformer language models with reinforcement learning.

Minimalistic large language model 3D-parallelism training

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Pretrain, finetune and serve LLMs on Intel platforms with Ray

Ongoing research training transformer language models at scale, including: BERT & GPT-2

This repo contains the code and data for "MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning"

TensorFlow and PyTorch Reference models for Gaudi(R)

🔍 Haystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-4, ChatGPT and alike). Haystack offers production-ready tools to quickly build complex d…

Material Dashboard - Open Source Bootstrap 5 Material Design Admin

Vue Material Dashboard - Open Source Material Design Admin

Official Python client library for kubernetes

ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22)

Occlum is a memory-safe, multi-process library OS for Intel SGX

Building Large-Scale AI Applications for Distributed Big Data