Skip to content

Comments

support moe_layer_freq@qwen_moe#440

Open
laohur wants to merge 1 commit intoalibaba:mainfrom
laohur:main
Open

support moe_layer_freq@qwen_moe#440
laohur wants to merge 1 commit intoalibaba:mainfrom
laohur:main

Conversation

@laohur
Copy link

@laohur laohur commented Jan 20, 2025

支持指定密集层与稀疏层
支持可选共享专家

@CLAassistant
Copy link

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

@jerryli1981
Copy link
Collaborator

您好,方便加下钉钉群。进群后私聊下我吗?我们建议将Megatron-LM底座升级?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants