Learn and understand Docker&Container technologies, with real DevOps practice!

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs o…

MPI programming lessons in C and executable code examples

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries