Inquiry on GPU Usage and Time Requirement for Reproducing ShortGPT Experiment

[wangyinkai6]

Dear Author,

I am intrigued by the graphics card model you utilized in your experiment. Could you kindly inform me of the specific model and the approximate time required to complete the experiment? I am planning to attempt to reproduce your experimental results, but I currently have only 2 RTX4090 GPUs. Is it feasible to successfully replicate ShortGPT with this setup? I look forward to your valuable insights. Thank you!

[sramshetty]

Sorry for the delayed response, not sure if this will still be helpful, but I got my results using a 3090ti. The time required is something I can't quite recall, but I would recommend starting with just a few samples for the importance calculation.

[wangyinkai6]

Thank you for your reply. I’m not sure why 4090 24G is reporting an Out Of Memory error, but in the end, I ran it on the CPU. The results are similar to the paper, but it took 4 hours.