Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing.
no risky patterns detected
Type: Agent skill (SKILL.md) · Category: LLM & Model APIs · Source: https://github.com/dabit3/sonic-agent/tree/HEAD/optional-skills/mlops/torchtitan
| Capabilities (fewer powerful permissions = higher) | 50/50 |
| Maintenance | 26/35 |
| Documentation | 15/15 |
Always review files before installing. How scores work. Request a correction