Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reproduction on CIFAR-100 LT IF=100 #5

Open
rtu715 opened this issue Oct 29, 2024 · 0 comments
Open

Reproduction on CIFAR-100 LT IF=100 #5

rtu715 opened this issue Oct 29, 2024 · 0 comments

Comments

@rtu715
Copy link

rtu715 commented Oct 29, 2024

Hello authors, I have ran training on a single GPU and tested both the original batch size and an increased batch size (2X since given script runs on two GPUs). In all these cases, the training script does not yield a model with comparable accuracy as those reported in the paper.

The results are the following:

BEST NUMBERS ----->
Overall / Head / Med / Tail
AVERAGE:  45.3  /  64.972  /  45.2  /  20.966
CLS    :  29.66  /  58.556  /  23.371  /  1.414
DIST   :  37.83  /  33.556  /  39.657  /  40.966

I wonder how these detailed results compare to yours, and moreover, what other items are necessary to reproduce the DeiT-LT results? I am happy to provide more details as well. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant