skill trail.
Activity 0Favorites0
SKILL

model-architecture-torchtitan

Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing.

Target: Learning & research. Automatically collected · unverified.

Use with Claude Code

A guide for this combination is not available yet, and compatibility has not been verified.

Requirements

  • Only the author’s Skill metadata is included. Read the full instructions to check dependencies, licensing and conditions of use.

Choose an AI tool with documented instructions, or save the resource and request a guide after the page loads.

Read the author’s documentation ↗