Name		Name	Last commit message	Last commit date
parent directory ..
README.md		README.md
__init__.py		__init__.py
configuration_llama.py		configuration_llama.py
internevo.patch		internevo.patch
modeling_llama.py		modeling_llama.py

README.md

Info

model:

https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/modeling_llama.py

config:

https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/configuration_llama.py

commit id:

e39b6c1c7cdc890b6849b8c9de545fc9590ba871

Usage

How to apply InternEvo patch to support Variable-Length and Intern Sequence Parallel training?

patch modeling_llama.py internevo.patch