Browse Teach Curate

Array Jobs: One Submission Expanded into Many Indexed Tasks

This is the mechanism by which 'one sample at a time on my laptop' becomes 'ten thousand samples at once', which is the central move of the outcome. It is also where reproducibility is won or lost, since an unrecorded index mapping makes the outputs unattributable.

jeremy Video

Submitting Array Jobs with sbatch --array in the Slurm Cluster Scheduler

A job array is a scheduler construct that lets a single submission define many near-identical jobs which share the same resource specification and differ only in an index, so that inputs with identic…