TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

A high-throughput and memory-efficient inference and serving engine for LLMs

Evaluating Large Language Models for CUDA Code Generation ComputeEval is a framework designed to generate and evaluate CUDA code from Large Language Models.

Scalable toolkit for efficient model reinforcement

The simplest, fastest repository for training/finetuning medium-sized GPTs.

CUDA Library Samples

NeMo: a toolkit for conversational AI

Perf monitoring CLI tool for Apple Silicon

Efficient Distributed GPU Programming for Exascale, an SC/ISC Tutorial

Learning Convolutional Neural Networks with Interactive Visualization.

cuDF - GPU DataFrame Library

High-performance TensorFlow library for quantitative finance.

http://nlp.seas.harvard.edu/2018/04/03/attention.html

Code & Data for "Tabular Transformers for Modeling Multivariate Time Series" (ICASSP, 2021)

Implementation of "Attention Is All You Need" using pytorch

Optimized primitives for collective multi-GPU communication

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

Source code examples from the Parallel Forall Blog

TensorFlow for macOS 11.0+ accelerated using Apple's ML Compute framework.

CUDA Python Low-level Bindings

FIL backend for the Triton Inference Server

An Aspiring Drop-In Replacement for NumPy at Scale

SciPy library main repository

A Python-embedded modeling language for convex optimization problems.

Code for Machine Learning for Algorithmic Trading, 2nd edition.

Simple transformer implementation from scratch in pytorch.