distributed-llm-pretraining-torchtitan
Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing.
Signing
SignedSLSA L2- Signed by
- skills-hub.ai distributor
- Method
- Distributor-signed by skills-hub.aiCryptographically signed by the skills-hub.ai distributor key at publish time.
- Signed
Install this skill
Run this command in your terminal. No account required — it auto-detects your AI tool and installs the skill file.
npx @skills-hub-ai/cli install ai-research-distributed-llm-pretraining-torchtitanSetup by platform
Install
One-click setup for your editorRun in your project root
npx @skills-hub-ai/cli install ai-research-distributed-llm-pretraining-torchtitan --target claude-codeInstructions
Security
Reviews (0)
Frequently asked questions about distributed-llm-pretraining-torchtitan
What does the distributed-llm-pretraining-torchtitan skill do?
Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing. It's a reusable SKILL.md instruction set that loads into your AI coding assistant on demand, no prompt engineering, no copy-pasting every session.
How do I install the distributed-llm-pretraining-torchtitan skill?
Run `npx @skills-hub-ai/cli install ai-research-distributed-llm-pretraining-torchtitan` from your terminal. The CLI writes the SKILL.md to the correct location for your AI tool (e.g. ~/.claude/skills/ai-research-distributed-llm-pretraining-torchtitan/ for Claude Code or ~/.cursor/skills/ for Cursor with --target cursor) and adds it to your project's .skills.json lockfile.
Which AI tools does distributed-llm-pretraining-torchtitan work with?
distributed-llm-pretraining-torchtitan runs in Claude Code. It follows the open Agent Skills standard (SKILL.md), so the same skill works in every supported tool without modification.
Is the distributed-llm-pretraining-torchtitan skill free?
Yes. Every skill on skills-hub.ai is free and open-source. There are no premium tiers, paywalls, or usage limits. You only pay for whatever AI assistant you're already using.
How do I use distributed-llm-pretraining-torchtitan after installing it?
In Claude Code, type `/ai-research-distributed-llm-pretraining-torchtitan` (or whatever slash command the skill registers) and the AI follows the skill's instructions immediately. You can also reference it by name in natural language, your AI loads the skill into context when relevant.
Can I share the distributed-llm-pretraining-torchtitan skill with my team?
Yes. Commit your project's .skills.json lockfile and teammates run `npx @skills-hub-ai/cli install` (no args) to install every skill at the exact version you pinned. Organization-scoped installs work via skills-hub.ai organizations.