Skip to content

NP³ MS Workflow v1.2.0

Choose a tag to compare

@crisfbazz crisfbazz released this 10 Jul 18:33
· 160 commits to master since this release

A new command called join_jobs was created and added to the NP³ MS Workflow! The join_jobs command is used to join NP³ jobs (results of the run or the join_jobs commands) into a single united job. Concatenate different jobs without the need of running them all together again. It uses the clean results from the provided NP³ jobs and execute the main pipeline from Step 3 to 10 with some modifications and adaptations. The join_jobs can be used to join the results from multiple original jobs and also from previous joined jobs with a new original or joined job.

The join_jobs command may be useful for processing growing libraries, which will have new datasets being included from time to time; or for processing very large jobs, which may be divided into smaller jobs and then joined by chunks with a smaller memory footprint (divide and conquer strategy).

This new command is properly documented in the workflow Manual, which describes the data organization to execute it, the new expected format of the metadata_join table and details on its methods!