Skip to content

Handle outputs segmented into multiple units (with ProbScalarizedModel only)#11

Merged
dennislwei merged 22 commits intomainfrom
mexgen
Jan 6, 2026
Merged

Handle outputs segmented into multiple units (with ProbScalarizedModel only)#11
dennislwei merged 22 commits intomainfrom
mexgen

Conversation

@dennislwei
Copy link
Member

@dennislwei dennislwei commented Jan 5, 2026 •
edited
Loading

  1. Segment output text or take pre-segmented output
  2. Attribute each unit of output to input units
  3. Evaluate attribution of each output unit using PerturbCurveEvaluator

NOTE: Items 2 and 3 are implemented only for the ProbScalarizedModel scalarizer.

@dennislwei
clarify that output_orig can be a single unit or multiple units (but …
712ad60 
…not a batch)

Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
handle segmented reference outputs (multiple output units) in ProbSca…
7cd863a 
…larizedModel

- Find token boundaries of output units
- Aggregate log probs within each output unit

Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
update test case in test_prob_scalarized_model.py
4b5018c 
- GeneratedOutput object should always contain output_text in addition to output_ids

Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
handle multiple output units in CLIME (fit_linear_model) with ProbSca…
0e54a23 
…larizedModel only

Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
handle multiple output units in LSHAP with ProbScalarizedModel only
5c1ebd1 
Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
update PerturbCurveEvaluator
a53ff76 
Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
update MExGen notebooks to save output token IDs and pass them to
fb2ce85 
explainer

Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
handle multiple output units/score columns in PerturbCurveEvaluator w…
bfbb47c 
…ith ProbScalarizedModel only

Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
segment output text if desired
d3b0128 
Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
merge non-alphanumeric output units into adjacent units
55df9af 
Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
fix finding token boundaries of output units
d1af6ea 
- look for token in next unit as well in order to skip split tokens and special tokens

Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
filter out output units with zero length in terms of tokens
ae36906 
Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
further fix finding token boundaries of output units
ffca359 
- Remove search for current token in next unit, only check whether current unit is long enough

Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
Revert "filter out output units with zero length in terms of tokens"
92caefe 
This reverts commit ae36906.

Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
handle output units with zero length by skipping the mean over tokens
fe34b3c 
Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
squeeze importance score arrays only if num_output_units==1
e8110e6 
Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
fix if-else structure
e15f1f7 
Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
find_unit_boundaries(): keep idx_token in range
51fd0c5 
Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
squeeze only axis=1 of importance score arrays
278ed04 
Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
_compute_log_probs_vllm: break large batches into multiple calls
d5db662 
Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
MExGenExplainer.segment_output: fix indenting
4bdfa81 
Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei
a few comment clarifications and formatting fixes
96cafa4 
Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei dennislwei merged commit 5bd1c76 into main Jan 6, 2026
2 checks passed
dennislwei added a commit to emiehling/ICX360 that referenced this pull request Jan 8, 2026
@dennislwei
resolve conflict with PR IBM#11 in prob.py
23a32b4 
Signed-off-by: Dennis Wei <dwei@us.ibm.com>
dennislwei added a commit to emiehling/ICX360 that referenced this pull request Jan 8, 2026
@dennislwei
return output unit boundaries from _compute_log_probs_pipeline to be …
ecb33b7 
…compatible with PR IBM#11

Signed-off-by: Dennis Wei <dwei@us.ibm.com>
@dennislwei dennislwei mentioned this pull request Jan 8, 2026
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@dennislwei