Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

针对作者的 LLaMA3-8B-Instruct 的微调代码运行 所出现的问题 #215

Open
linmyl opened this issue Jul 20, 2024 · 2 comments
Open

Comments

@linmyl
Copy link

linmyl commented Jul 20, 2024

我采用的是联通AI改的中文版LLAMA 3 -8B的大模型,然后用这个模型来做微调,自己设计一个五十条的长文本json数据集,稍微改了一下代码,用于适应我的指令微调任务,但是在任务进行过程中,出现了三个问题:一个是并行处理警告,一个是内核版本过低,还有一个是pytorch缓存和检查点警告。有点不确定该如何修改,以及不知道代码是否存在其他问题。求大佬解答。
TI`YUC%I 409G)X1NIHA

@KMnO4-zx
Copy link
Contributor

可以把具体的报错信息贴一下吗,这里只是警告

@linmyl
Copy link
Author

linmyl commented Jul 27, 2024

可以把具体的报错信息贴一下吗,这里只是警告

代码是可以正常运行,没有其他报错,就是那几个警告,以及“内核版本过低”那里有个进度条显示空的,不知道会不会影响效果。
_O}I6J~YH159M}K620$IJ P

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants