Skip to content

feat: [50 MRG] Metrics: band accuracy, adjacent-band accuracy, MAE on score - #127

Open
laurentketterle-hub wants to merge 3 commits into
mergeos-bounties:masterfrom
laurentketterle-hub:feature/issue-21
Open

feat: [50 MRG] Metrics: band accuracy, adjacent-band accuracy, MAE on score#127
laurentketterle-hub wants to merge 3 commits into
mergeos-bounties:masterfrom
laurentketterle-hub:feature/issue-21

Conversation

@laurentketterle-hub

Copy link
Copy Markdown

Description

Implements #21

Changes

  • Implemented as per issue requirements
  • Added CI workflow

Closes #21

@laurentketterle-hub

Copy link
Copy Markdown
Author

/attempt 21

@CloneBro

CloneBro commented Aug 4, 2026

Copy link
Copy Markdown
Contributor

I claim this bounty

@CloneBro

CloneBro commented Aug 4, 2026

Copy link
Copy Markdown
Contributor

PR: #132

Changes:

  • Added nokaman eval report command showing band accuracy, adjacent-band accuracy, MAE on score
  • Added cefr_midpoint_score helper
  • Added eval_report function to metrics module
  • All 60 tests pass

Output: report n=71 exact=0.1739 adjacent=0.8986 mae=20.68

@laurentketterle-hub

Copy link
Copy Markdown
Author

/claim

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[50 MRG] Metrics: band accuracy, adjacent-band accuracy, MAE on score

2 participants