Skip to content

feat: add MSE evaluation metric#716

Open
Hungreeee wants to merge 1 commit into
PrunaAI:mainfrom
Hungreeee:feat/mse-metric
Open

feat: add MSE evaluation metric#716
Hungreeee wants to merge 1 commit into
PrunaAI:mainfrom
Hungreeee:feat/mse-metric

Conversation

@Hungreeee

Copy link
Copy Markdown

Description

This PR adds a new MSE metric for Pruna's evaluation framework, along with the relevant unit tests for it.

Related Issue

Fixes #388

Type of Change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Refactor (no functional change)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Documentation update

Testing

  • I added or updated tests covering my changes
  • Existing tests pass locally (uv run pytest -m "cpu and not slow")

For full setup and testing instructions, see the Contributing Guide.

Checklist

  • My code follows the style guidelines of this project
  • I have performed a self-review of my code, especially for agent-assisted changes
  • I updated the documentation where necessary

Thanks for contributing to Pruna! We're excited to review your work.

New to contributing? Check out our Contributing Guide for everything you need to get started.

Note:

  • Draft PRs or PRs without a clear and detailed overview may be delayed.
  • Please mark your PR as Ready for Review and ensure the sections above are filled out.
  • Contributions that are entirely AI-generated without meaningful human review are discouraged.

@sdiazlor
sdiazlor requested a review from begumcig July 22, 2026 09:45
@sdiazlor

Copy link
Copy Markdown
Collaborator

Hi @Hungreeee. Thanks for the PR!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[FEATURE] Add a simple MSE Metric

2 participants