Skip to content

Commit 48b55e3

Browse files
committed
Add note about 100%
1 parent df9b925 commit 48b55e3

1 file changed

Lines changed: 5 additions & 1 deletion

File tree

‎src/programbench/eval/eval_batch.py‎

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -117,7 +117,11 @@ def summary(self) -> Group:
117117
Text(f"{self.resolve_ratio * 100:.0f}", style="bold"),
118118
f"{self.total_instances} instances",
119119
)
120-
return Group(table)
120+
note = Text(
121+
"Note: A score of 100 does not mean solved (due to rounding). Only ✅ indicates a solved task.",
122+
style="dim",
123+
)
124+
return Group(table, note)
121125

122126

123127
def _can_reprocess(result: EvaluationResult) -> bool:

0 commit comments

Comments
 (0)