Skip to content

Pin default Hugging Face dataset revision - #5

Merged
emmepra merged 1 commit into
devfrom
fix/hf-dataset-revision-pin
May 20, 2026
Merged

Pin default Hugging Face dataset revision#5
emmepra merged 1 commit into
devfrom
fix/hf-dataset-revision-pin

Conversation

@emmepra

@emmepra emmepra commented May 20, 2026

Copy link
Copy Markdown
Contributor

Summary

Changes

  • Pins the default Hugging Face dataset revision used by the Inspect loader and task.
  • Documents the default revision and keeps explicit dataset_revision overrides available.
  • Adds regression coverage for the loader and task defaults.

Verification

  • uv run --python 3.11 --extra test python -m compileall ahb_eval scripts src tests
  • uv run --python 3.11 --extra test python -m pytest
  • uv run --python 3.11 --extra test inspect eval src/ahb_inspect/tasks.py@ahb --model mockllm/model --model-role grader=mockllm/model --limit 1 --no-log-realtime
  • uv run --python 3.11 --extra test inspect eval ahb_inspect/ahb --model mockllm/model --model-role grader=mockllm/model --limit 1 --no-log-realtime

@emmepra
emmepra merged commit 4b7b631 into dev May 20, 2026
1 check passed
@emmepra
emmepra deleted the fix/hf-dataset-revision-pin branch May 20, 2026 07:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant