File tree Expand file tree Collapse file tree 1 file changed +3
-3
lines changed Expand file tree Collapse file tree 1 file changed +3
-3
lines changed Original file line number Diff line number Diff line change 1
1
# MaLA-500: Massive Language Adaptation of Large Language Models
2
2
3
- [ ![ Model] ( https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Model-blue )] ( https://huggingface.co/MaLA-LM/mala-500 )
3
+ [ ![ Model] ( https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Model-blue )] ( https://huggingface.co/collections/ MaLA-LM/mala-500-660e57f8e53e3cc2ccd31cb9 )
4
4
[ ![ Data] ( https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Data-green )] ( https://huggingface.co/datasets/cis-lmu/Glot500 )
5
5
[ ![ arXiv] ( https://img.shields.io/badge/arXiv-2305.12182-b31b1b.svg )] ( https://arxiv.org/abs/2401.13303 )
6
6
@@ -30,8 +30,8 @@ from peft import PeftModel
30
30
31
31
base_model = AutoModelForCausalLM.from_pretrained(' meta-llama/Llama-2-7b-hf' )
32
32
base_model.resize_token_embeddings(260164 )
33
- tokenizer = AutoTokenizer.from_pretrained(' MaLA-LM/mala-500' )
34
- model = PeftModel.from_pretrained(base_model, ' MaLA-LM/mala-500' )
33
+ tokenizer = AutoTokenizer.from_pretrained(' MaLA-LM/mala-500-10b-v2 ' )
34
+ model = PeftModel.from_pretrained(base_model, ' MaLA-LM/mala-500-10b-v2 ' )
35
35
```
36
36
37
37
## Codebase
You can’t perform that action at this time.
0 commit comments