Skip to content

FEAT: Add multilingual scenario - #2392

Merged
Richard Lundeen (rlundeen2) merged 8 commits into
microsoft:mainfrom
fdubut:multilingual
Aug 19, 2026
Merged

FEAT: Add multilingual scenario#2392
Richard Lundeen (rlundeen2) merged 8 commits into
microsoft:mainfrom
fdubut:multilingual

Conversation

@fdubut

Copy link
Copy Markdown
Contributor

Description

A new AIRT scenario that tests the resilience of a target model against non-English attacks.

Two attack techniques:

  • The objective is translated to a given language using TranslationConverter.
  • The objective is translated word-by-word to different languages using RandomTranslationConverter.

The number of languages randomly selected from the most spoken languages (languages_most_spoken.yaml) is configurable, or callers can pass their own language list.

Tests and Documentation

  • Added unit tests for the new scenario, all passing.
  • Updated the AIRT scenario doc with an example run of the new scenario.

Comment thread pyrit/scenario/scenarios/airt/multilingual.py
Comment thread pyrit/scenario/scenarios/airt/multilingual.py Outdated
Comment thread pyrit/scenario/scenarios/airt/multilingual.py Outdated
Comment thread pyrit/scenario/scenarios/airt/multilingual.py Outdated
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 00d2ef6d-0445-4a59-af21-ca032a7eb915
@rlundeen2
Richard Lundeen (rlundeen2) added this pull request to the merge queue Aug 19, 2026
Merged via the queue into microsoft:main with commit 460b9ff Aug 19, 2026
54 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants