Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TAG MOP Workflows #55

Merged
merged 23 commits into from
May 16, 2024
Merged

TAG MOP Workflows #55

merged 23 commits into from
May 16, 2024

Conversation

yueyaog
Copy link
Collaborator

@yueyaog yueyaog commented Apr 14, 2024

In order to reduce cloud storage cost, I have created two WDLs to remove files no longer needed. TAG_Mop.wdl will remove system files and run fissfc mop. And I also updated the Cleanup_Failed_Submissions.wdl to remove failed submission for older Terra workspace as well.

}
runtime {
docker: mopDocker
memory: "32 GiB"
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

make mem and cpus optional

bucket_name = fapi.get_workspace(namespace, workspaceName).json()['workspace']['bucketName']

# Collect the system files to delete
storage_client = storage.Client()
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add namespace broadtagteam in the client call

Copy link
Collaborator Author

@yueyaog yueyaog left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

make some changes

@yueyaog yueyaog requested review from lfleming1022 May 16, 2024 18:26
@yueyaog yueyaog merged commit dbb0e06 into master May 16, 2024
1 check passed
@yueyaog yueyaog deleted the tag-mop-yg branch May 16, 2024 18:39
stellaning1120 pushed a commit that referenced this pull request Sep 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants