LLM inference in C/C++

Test Orchestrator for Performance and Scalability of AI pLatforms

A dynamic library providing Virtualization-based process isolation capabilities

Ramalama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of …

Some Publicly Available Jupyter Notebooks for RHODS testing

Multi Architecture Provisioning Tool

Single Node Cluster creation scripts for OpenShift 4.x as used by CRC

Release tooling for OpenShift

CRC is a tool to help you run containers. It manages local VMs to run a OpenShift 4.x cluster, Microshift or Podman optimized for testing and development purposes

An external provider for Llama Stack allowing for the use of RamaLama for inference.

Port of OpenAI's Whisper model in C/C++

Tensors and Dynamic neural networks in Python with strong GPU acceleration

🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

OpenShift container platform performance dashboard