Job Dependencies and the Fan-Out then Gather Pattern
The outcome requires an analysis, not a task, to finish unattended. Almost every real scientific pipeline has at least one aggregation step, and without dependency semantics the researcher must sit at the terminal and submit stage two by hand, which also destroys unattended reproducibility.
This Concept is waiting for its first lesson!
The outcome requires an analysis, not a task, to finish unattended. Almost every real scientific pipeline has at least one aggregation step, and without dependency semantics the researcher must sit at the terminal and submit stage two by hand, which also destroys unattended reproducibility.
Are you a teacher? Sign in to start contributing.
Sign In