deepspeed

Expert guidance for distributed training with DeepSpeed - ZeRO optimization stages, pipeline parallelism, FP16/BF16/FP8, 1-bit Adam, sparse attention

Provides expert guidance for distributed training with DeepSpeed, optimizing large-scale deep learning models efficiently.