-
Notifications
You must be signed in to change notification settings - Fork 254
docs: Managing Nextflow work directory growth #3644
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
✅ Deploy Preview for nf-core-docs ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
✅ Deploy Preview for nf-core-main-site ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
|
@nf-core-bot fix linting |
sites/docs/src/content/docs/tutorials/storage_utilization/managing_work_directory_growth.md
Outdated
Show resolved
Hide resolved
…ging_work_directory_growth.md Co-authored-by: Matthias Hörtenhuber <[email protected]>
sites/docs/src/content/docs/tutorials/storage_utilization/managing_work_directory_growth.md
Outdated
Show resolved
Hide resolved
sites/docs/src/content/docs/tutorials/storage_utilization/managing_work_directory_growth.md
Outdated
Show resolved
Hide resolved
sites/docs/src/content/docs/tutorials/storage_utilization/managing_work_directory_growth.md
Outdated
Show resolved
Hide resolved
sites/docs/src/content/docs/tutorials/storage_utilization/managing_work_directory_growth.md
Show resolved
Hide resolved
sites/docs/src/content/docs/tutorials/storage_utilization/managing_work_directory_growth.md
Outdated
Show resolved
Hide resolved
sites/docs/src/content/docs/tutorials/storage_utilization/managing_work_directory_growth.md
Outdated
Show resolved
Hide resolved
sites/docs/src/content/docs/tutorials/storage_utilization/managing_work_directory_growth.md
Outdated
Show resolved
Hide resolved
sites/docs/src/content/docs/tutorials/storage_utilization/managing_work_directory_growth.md
Outdated
Show resolved
Hide resolved
sites/docs/src/content/docs/tutorials/storage_utilization/managing_work_directory_growth.md
Outdated
Show resolved
Hide resolved
sites/docs/src/content/docs/tutorials/storage_utilization/managing_work_directory_growth.md
Outdated
Show resolved
Hide resolved
Co-authored-by: Phil Ewels <[email protected]>
mahesh-panchal
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Also in the optimized process, I would recommend adding rm of intermediate files if temp files are used.
sites/docs/src/content/docs/tutorials/storage_utilization/managing_work_directory_growth.md
Outdated
Show resolved
Hide resolved
sites/docs/src/content/docs/tutorials/storage_utilization/managing_work_directory_growth.md
Outdated
Show resolved
Hide resolved
sites/docs/src/content/docs/tutorials/storage_utilization/managing_work_directory_growth.md
Outdated
Show resolved
Hide resolved
sites/docs/src/content/docs/tutorials/storage_utilization/managing_work_directory_growth.md
Show resolved
Hide resolved
|
Thanks for the reviews @mahesh-panchal and @ewels Let me know if there is anything else that can be improved (and that I've captured your comments correctly) |
sites/docs/src/content/docs/tutorials/storage_utilization/managing_work_directory_growth.md
Outdated
Show resolved
Hide resolved
Co-authored-by: Mahesh Binzer-Panchal <[email protected]>
| Nextflow's built-in `clean` command enables targeted removal of work directories. The following command preserves work directories from the current execution while removing directories from previous executions: | ||
|
|
||
| ```bash | ||
| nextflow clean -f -before $(nextflow log -q | tail -n 1) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I just learned there's a last keyword so one doesn't need $(nextflow log -q | tail -n 1)
It's barely documented. https://www.nextflow.io/docs/latest/cli.html#execution-logs
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@netlify /docs/tutorials/storage_utilization/managing_work_directory_growth