GitHub - huggingface accelerate: A simple way to launch, train, and . . . 🤗 Accelerate was created for PyTorch users who like to write the training loop of PyTorch models but are reluctant to write and maintain the boilerplate code needed to use multi-GPUs TPU fp16 🤗 Accelerate abstracts exactly and only the boilerplate code related to multi-GPUs TPU fp16 and leaves the rest of your code unchanged Here is an example: