Library providing helpers for the Linux kernel io_uring support

Comprehensive LiteRT example project with Bazel build system, demonstrating simple inference app, and profiling using XNNPACK and GPU delegates

Framework modeling the bank-level Compute-near-Memory architecture SideDRAM

my robot

bpftop provides a dynamic real-time view of running eBPF programs. It displays the average runtime, events per second, and estimated total CPU % for each program.

Hands-on for RTCSA25 Tutorial

Achieve state of the art inference performance with modern accelerators on Kubernetes

0x.Tools: X-Ray vision for Linux systems

BCC - Tools for BPF-based Linux IO analysis, networking, monitoring, and more

SGLang is a fast serving framework for large language models and vision language models.

Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation (NeurIPS 2025)

Flexible I/O Tester

minimal-litert example with makefile

This a public repository for SoftPreempt

A modern model graph visualizer and debugger

A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.

A machine learning compiler for GPUs, CPUs, and ML accelerators

Backward compatible ML compute opset inspired by HLO/MHLO

AI Edge Quantizer: flexible post training quantization for LiteRT models.

Awesome LLMs on Device: A Comprehensive Survey

stb single-file public domain libraries for C/C++

Production First and Production Ready End-to-End Speech Recognition Toolkit

Fast Multimodal LLM on Mobile Devices

Release repo for our SLAM Handbook

Universal LLM Deployment Engine with ML Compilation

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

The Qualcomm® AI Hub Models are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

A book teaching assembly language programming on the ARM 64 bit ISA. Along the way, good programming practices and insights into code development are offered which apply directly to higher level la…