Skip to content

Full Parallel Environment Runner does not handle return_after_episode_num as expected/optimally #8

@SamNPowers

Description

@SamNPowers

Each Batch runner spun up by FullParallel will attempt to do the full set of return_after_episode_num episodes...then in task_base, it'll just take the first n. This:
a. means more episodes are run than necessary
b. may prioritize faster episodes -- i.e. if one parallel process gets 6 short episodes (e.g. failures), that will return first, and be prioritized over longer runs, biasing the results of the data

(This is why current eval is done sequentially, but it is not optimal.)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions