Skip to content

Pull requests: huggingface/evaluate

New pull request New
26 Open 142 Closed
26 Open 142 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add RAIL Score metric for responsible AI evaluation
#743 opened Apr 1, 2026 by SumitVermakgp Loading…
1
auto-update metrics spaces to latest gradio versions with action; fixes #713
#740 opened Mar 28, 2026 by plutonium-239 Loading…
1
3
fix: replace deprecated squared=False with root_mean_squared_error in MSE metric
#735 opened Feb 23, 2026 by dhruvildarji Loading…
1
Add optional batch_size parameter to BLEURT compute method
#734 opened Feb 16, 2026 by aakash-agarwal-002 Loading…
Fix/label distribution entropy
#733 opened Feb 13, 2026 by michaelellis003 Loading…
1
refactor: use HfApi instead of Repository for hub sync
#732 opened Feb 8, 2026 by Ashutosh0x Loading…
1
Extend perplexity metric to include geometric mean
#731 opened Feb 2, 2026 by LuggiStruggi Loading…
BLEU: support tokenizer string alias and clarify input edge cases
#730 opened Jan 28, 2026 by Vangmay Loading…
1
Add human-centered trust & uncertainty metrics to Hugging Face Evaluate
#728 opened Jan 26, 2026 by dyra-12 Loading…
7 of 8 tasks
Suppress NLTK download logs for meteor and word_length
#726 opened Jan 5, 2026 by 52147 Loading…
1
Add input validation for predictions and references in accuracy metric
#725 opened Dec 31, 2025 by Rushi1696 Loading…
Add length validation for predictions and references in accuracy metric
#721 opened Dec 10, 2025 by ajeetkartikay Loading…
Fix minor typos and wording in README
#720 opened Dec 10, 2025 by ajeetkartikay Loading…
1
add CLIPScore metric
#706 opened Sep 25, 2025 by Sunhill666 Loading…
1
Refactor IOU and accuracy calculations with np.divide
#700 opened Sep 10, 2025 by gboeer Loading…
BLEU: add COCO/PTB tokenization mode (tokenizer_name) for parity with pycocoevalcap
#698 opened Aug 13, 2025 by bavi404 Loading…
1
Fix: compute correct IoU in mean_iou metric (#421)
#692 opened Jul 16, 2025 by UddavGoshika Loading…
1
Add politeness_score metricCreate politeness_score.py
#676 opened May 24, 2025 by epaunova Loading…
Feat: Add normalize option to CER and WER metrics for normalized score calculation
#667 opened Mar 24, 2025 by skyil7 Loading…
2
[Feature] Add G-Pass@k Metric
#657 opened Dec 23, 2024 by jnanliu Loading…
Add Diarization Error Rate (DER) metric
#557 opened Mar 4, 2024 by medahmedkrichen Loading…
Add Frechet Inception Distance (FID) Score
#556 opened Mar 2, 2024 by medahmedkrichen Loading…
Add draft progress bar for 3 tasks
#549 opened Feb 16, 2024 by boyleconnor • Draft
support multilabel confusion matrix
#533 opened Jan 5, 2024 by 0ssamaak0 Loading…
16
Customize Gradio Interface that is Launched
#298 opened Sep 22, 2022 by abidlabs Member Loading…
2
ProTip! Mix and match filters to narrow down what you’re looking for.