Skip to main content

distributed-llm-pretraining-torchtitan

Facilitates distributed LLM pretraining in PyTorch using TorchTitan, optimizing for performance across multiple GPUs.

Install this skill

or
96/100

Security score

The distributed-llm-pretraining-torchtitan skill was audited on May 23, 2026 and we found 4 security issues across 1 threat category. Review the findings below before installing.

Categories Tested

Security Issues

low line 34

External URL reference

SourceSKILL.md
34# Get HF token from https://huggingface.co/settings/tokens
low line 359

External URL reference

SourceSKILL.md
359- Paper: https://arxiv.org/abs/2410.06511
low line 360

External URL reference

SourceSKILL.md
360- ICLR 2025: https://iclr.cc/virtual/2025/poster/29620
low line 361

External URL reference

SourceSKILL.md
361- PyTorch Forum: https://discuss.pytorch.org/c/distributed/torchtitan/44
Scanned on May 23, 2026
View Security Dashboard
Installation guide →