Skip to content

Restrict azcopy memory usage by task setting #6161

Open
@adamrtalbot

Description

@adamrtalbot

New feature

Sometimes azcopy can use more memory than is available. See #5799 (comment) for a description.

Use case

We can set the maximum azcopy memory usage so that it does not exhaust local memory and crash.

Suggested implementation

We should be able to add the following environment variable in the same manner as other azcopy opts: AZCOPY_BUFFER_GB https://learn.microsoft.com/en-us/azure/storage/common/storage-use-azcopy-optimize#optimize-memory-use

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions