Skip to content

Improve Apify RQ storage client resilience to concurrent processing #529

@vdusek

Description

@vdusek

The current implementation of the Apify Request Queue storage client (both in the v2 and v3 versions of the SDK) is not resilient to concurrent processing scenarios, which leads to flaky behavior in tests that simulate parallel workers. This is evident in test_concurrent_processing_simulation, which has been skipped.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request.t-toolingIssues with this label are in the ownership of the tooling team.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions