Loading catalogue content.

Skill

mcore-run-on-slurm

How to launch distributed Megatron-LM training jobs on a SLURM cluster. Covers a minimal sbatch skeleton, environment-variable setup for torch.distributed.run, CUDA_DEVICE_MAX_CONNECTIONS rules across hardware and parallelism modes, container conventions, monitoring, and per-rank failure diagnosis.

Add to kit

Sign in to add this skill to one of your kits.

Sign in

Compatibility

No compatibility declared

Tags

Top Kits

Popular kits using this skill

All kits ›