Deep learning for dummies. All the practical details and useful utilities that go into working with real models.

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries