📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉

flash attention tutorial written in python, triton, cuda, cutlass

Fast and memory-efficient exact attention

A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.

A machine learning accelerator core designed for energy-efficient AI at the edge.

Inference Llama 2 in one file of pure C

a static analytical model for LLM distributed training

msprof_analyze

Criticality-aware Framework for Modeling Computer Performance

Spike, a RISC-V ISA Simulator

Ventus GPGPU ISA Simulator Based on Spike

for high performance dcache

RISC-V vector and tensor compute extensions for Vortex GPGPU acceleration for ML workloads. Optimized for transformer models, CNNs, and generative AI with configurable precision (FP32/16/BF16/INT8).

Gemmini extensions for Spike

ONNXim is a fast cycle-level simulator that can model multi-core NPUs for DNN inference