@nvidia/mcore-run-on-slurm

How to launch distributed Megatron-LM training jobs on a SLURM cluster. Covers a minimal sbatch skeleton, environment-variable setup for torch.distributed.run, CUDA_DEVICE_MAX_CONNECTIONS rules across hardware and parallelism modes, container conventions, monitoring, and per-rank failure diagnosis.

View in AI SkillSafe app
Scanned · no findings
0 downloads
0 stars
0 demos
SKILL.md

Embed badges

Add these to your README to show the skill's verification status.

SkillSafe verified badge
Verified badge
[![SkillSafe verified badge](https://api.skillsafe.ai/v1/badge/@nvidia/mcore-run-on-slurm/verified)](https://skillsafe.ai/skill/@nvidia/mcore-run-on-slurm/)
Installs badge
Installs badge
[![Installs badge](https://api.skillsafe.ai/v1/badge/@nvidia/mcore-run-on-slurm/installs)](https://skillsafe.ai/skill/@nvidia/mcore-run-on-slurm/)
Scan badge
Scan badge
[![Scan badge](https://api.skillsafe.ai/v1/badge/@nvidia/mcore-run-on-slurm/scan)](https://skillsafe.ai/skill/@nvidia/mcore-run-on-slurm/)
Eval pass rate badge
Eval pass rate
[![Eval pass rate badge](https://api.skillsafe.ai/v1/badge/@nvidia/mcore-run-on-slurm/eval)](https://skillsafe.ai/skill/@nvidia/mcore-run-on-slurm/)