verl: Volcano Engine Reinforcement Learning for LLMs

Bridge Megatron-Core to Hugging Face/Reinforcement Learning

(best/better) practices of megatron on veRL and tuning guide

Ongoing research training transformer models at scale

GPU Stress Test is a tool to stress the compute engine of NVIDIA Tesla GPU’s by running a BLAS matrix multiply using different data types. It can be compiled and run on both Linux and Windows.

Aceso adapted to heterogeneous environments

Bamboo is a system for running large pipeline-parallel DNNs affordably, reliably, and efficiently using spot instances.

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilizatio…

Optimized primitives for collective multi-GPU communication

利用pandas将excel中数据抽取，以三元组形式加载到neo4j数据库中构建相关知识图谱

A repository for Kustomize manifests