New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Llama3 Lora报错：RuntimeError: element 0 of tensors does not require grad and does not have a grad_fn #229

Open

AndyLuo1029 opened this issue Jul 31, 2024 · 0 comments

AndyLuo1029 commented Jul 31, 2024

用transformer库之前就下载好的LLaMA3_1-8B-Instruct模型，没有使用modelscope下载，执行trainer.train后：

截屏2024-07-31 16 08 18

截屏2024-07-31 16 08 26

截屏2024-07-31 16 08 34

求解答谢谢T T

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment