Skip to content

Request for Random Seeds: ResNet-20 on CIFAR-100 Reproduction (Table 3) #2

@G-Tenderfoot

Description

@G-Tenderfoot

Hello authors,

Thank you for open-sourcing this impressive work. I am currently trying to reproduce the results reported in Table 3 of the paper.
Specifically, I am focusing on the ResNet-20 on CIFAR-100 experiments:

·MCNC (w/o LoRA): Reported accuracy ~34.7%
·MCNC (w/ LoRA): Reported accuracy ~36.7%

In my reproduction attempts using the provided scripts, I noticed that the final accuracy is quite sensitive to the initialization of the random generator. My results tend to fluctuate around 33.5% ~ 34.3%, and it is difficult to consistently match the reported baseline performance.

Could you please share the specific random seeds used to achieve the results in Table 3? Having a fixed seed that guarantees the reported baseline performance would be extremely helpful for debugging and ensuring my experimental setup is correct.
Thank you for your time and help!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions