Skip to content

MAINT: Make Rust the package hallucination default - #2504

Merged
Richard Lundeen (rlundeen2) merged 2 commits into
microsoft:mainfrom
jbolor21:jbolor/package-hallucination-rust-default
Aug 26, 2026
Merged

MAINT: Make Rust the package hallucination default#2504
Richard Lundeen (rlundeen2) merged 2 commits into
microsoft:mainfrom
jbolor21:jbolor/package-hallucination-rust-default

Conversation

@jbolor21

@jbolor21 jbolor21 commented Aug 26, 2026

Copy link
Copy Markdown
Contributor

Summary

  • makes Rust the default package-hallucination scenario technique while keeping Python, JavaScript, and Ruby available
  • loads non-default package registry datasets lazily when their techniques are selected
  • builds each atomic attack with the scorer for its selected language ecosystem
  • updates the scanner documentation and bumps the scenario version for the breaking default-technique change

Testing

  • uv run pytest -q tests/unit/scenario/garak/test_package_hallucination.py
  • uv run pytest -q tests/unit/setup/test_load_default_datasets.py
  • uv run ruff check pyrit/scenario/scenarios/garak/package_hallucination.py tests/unit/scenario/garak/test_package_hallucination.py doc/scanner/garak.py
  • uv run ruff format --check pyrit/scenario/scenarios/garak/package_hallucination.py tests/unit/scenario/garak/test_package_hallucination.py doc/scanner/garak.py

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Copilot-Session: b0d3a615-86bf-40e1-8140-92c9ba39b35e
Comment thread pyrit/scenario/scenarios/garak/package_hallucination.py
Comment thread pyrit/scenario/scenarios/garak/package_hallucination.py
Comment thread pyrit/scenario/scenarios/garak/package_hallucination.py
Comment thread pyrit/scenario/scenarios/garak/package_hallucination.py Outdated
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@rlundeen2
Richard Lundeen (rlundeen2) added this pull request to the merge queue Aug 26, 2026
Merged via the queue into microsoft:main with commit 215880e Aug 26, 2026
54 checks passed
@jbolor21
jbolor21 deleted the jbolor/package-hallucination-rust-default branch August 27, 2026 15:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants