Name		Name	Last commit message	Last commit date
parent directory ..
README.md		README.md
__init__.py		__init__.py
configuration_internlm2.py		configuration_internlm2.py
internevo.patch		internevo.patch
modeling_internlm2.py		modeling_internlm2.py

README.md

Info

model:

https://huggingface.co/internlm/internlm2-7b/blob/main/modeling_internlm2.py

config:

https://huggingface.co/internlm/internlm2-7b/blob/main/configuration_internlm2.py

commit id:

3909fd287ddfc6d9c9ac4b4e57b101ad7fd8d204

Usage

How to apply InternEvo patch to support Variable-Length and Intern Sequence Parallel training?

patch modeling_internlm2.py internevo.patch