Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

results are different than the paper #356

Open
mehrnia opened this issue Jan 16, 2025 · 2 comments
Open

results are different than the paper #356

mehrnia opened this issue Jan 16, 2025 · 2 comments

Comments

@mehrnia
Copy link

mehrnia commented Jan 16, 2025

Hi,
Thank you for providing such a nice instructions to fine-tune sam2 and get medsam2.
I followed the instructions in your Github carefully and hopefully got the result. I did not change any number and I stuck to your instructions.
and trained the model based on your instructions.
what is the reason that the evaluation results that I get is different than the ones in your paper: "Segment Anything in Medical Images and Videos: Benchmark and Deployment"
I attached my results and your results that I'm comparing with:

Image

Image

Image

@JunMa11
Copy link
Collaborator

JunMa11 commented Jan 24, 2025

Hi @mehrnia ,

We have run the fine-tuning process twice and the results were similar. Could you please provide more details on your training protocol?

@mehrnia
Copy link
Author

mehrnia commented Jan 25, 2025

Hi,
thank you for the response.
I was wondering what do you mean by the protocol?
I'm follwoing the the instructions below:
https://github.com/bowang-lab/MedSAM/tree/MedSAM2?tab=readme-ov-file#fine-tune-sam2-on-the-abdomen-ct-dataset

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants