Skip to content

mtp for verl#62

Open
ArronHZG wants to merge 9 commits intoISEEKYAN:mainfrom
ArronHZG:feature/verl_mtp
Open

mtp for verl#62
ArronHZG wants to merge 9 commits intoISEEKYAN:mainfrom
ArronHZG:feature/verl_mtp

Conversation

@ArronHZG
Copy link

No description provided.

def __init__(self, hf_dir: str):
index_file = os.path.join(hf_dir, "model.safetensors.index.json")
config = AutoConfig.from_pretrained(hf_dir)
config = AutoConfig.from_pretrained(hf_dir, trust_remote_code=True)
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we can't set trust_remove_code by default

hf_model_path, trust_remote_code=trust_remote_code
)

if hasattr(config, "num_nextn_predict_layers"):
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why do we set this, is this a debug code?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants