Skip to content

Conversation

@christopher-hakkaart
Copy link
Member

@christopher-hakkaart christopher-hakkaart commented Nov 11, 2025

  • Adding managing Nextflow work directory growth guide
    • The guide is lightweight solution to outline ways to help manage storage issues caused by intermediate files

@netlify /docs/tutorials/storage_utilization/managing_work_directory_growth

@netlify
Copy link

netlify bot commented Nov 11, 2025

Deploy Preview for nf-core-docs ready!

Name Link
🔨 Latest commit 036858f
🔍 Latest deploy log https://app.netlify.com/projects/nf-core-docs/deploys/6914f54241f98000080b9dac
😎 Deploy Preview https://deploy-preview-3644--nf-core-docs.netlify.app/docs/tutorials/storage_utilization/managing_work_directory_growth
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@netlify
Copy link

netlify bot commented Nov 11, 2025

Deploy Preview for nf-core-main-site ready!

Name Link
🔨 Latest commit 036858f
🔍 Latest deploy log https://app.netlify.com/projects/nf-core-main-site/deploys/6914f542024a620008c7ad7d
😎 Deploy Preview https://deploy-preview-3644--nf-core-main-site.netlify.app/docs/tutorials/storage_utilization/managing_work_directory_growth
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@christopher-hakkaart
Copy link
Member Author

@nf-core-bot fix linting

@christopher-hakkaart christopher-hakkaart marked this pull request as ready for review November 11, 2025 20:29
Copy link
Member

@mahesh-panchal mahesh-panchal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also in the optimized process, I would recommend adding rm of intermediate files if temp files are used.

@christopher-hakkaart
Copy link
Member Author

Thanks for the reviews @mahesh-panchal and @ewels

Let me know if there is anything else that can be improved (and that I've captured your comments correctly)

@christopher-hakkaart christopher-hakkaart merged commit 4ddd108 into main Nov 12, 2025
12 checks passed
@christopher-hakkaart christopher-hakkaart deleted the chris-storage branch November 12, 2025 21:08
Nextflow's built-in `clean` command enables targeted removal of work directories. The following command preserves work directories from the current execution while removing directories from previous executions:

```bash
nextflow clean -f -before $(nextflow log -q | tail -n 1)
Copy link
Member

@mahesh-panchal mahesh-panchal Nov 14, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just learned there's a last keyword so one doesn't need $(nextflow log -q | tail -n 1)

It's barely documented. https://www.nextflow.io/docs/latest/cli.html#execution-logs

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants