Inference scheduler for llm-d

llm-d benchmark scripts and tooling

A high-throughput and memory-efficient inference and serving engine for LLMs

Website for llm-d: This repository builds the website seen at llm-d.ai

Gateway API Inference Extension

A variety of instructions and demos for setting up

llm-d helm charts and deployment examples

Distributed KV cache coordinator

Redis for LLMs

Scale from single vLLM instance to distributed vLLM deployment without changing any application code.

Cost-efficient and pluggable Infrastructure components for GenAI inference

LangChain for Go, the easiest way to write LLM-based programs in Go

KubeStellar - a flexible solution for challenges associated with multi-cluster configuration management for edge, multi-cloud, and hybrid cloud

Status add-on for Open Cluster Management transport

Repository for sample controller. Complements sample-apiserver

The user interface for the cluster management portion of open-cluster-management.

Open Cluster Management console Helm chart

DEPRECATED. Code was merged with console. https://github.com/open-cluster-management/console

Technion CS Project for Pa'amonim HR.

A repository to hold the application that runs scrambler.