Skip to content

Commit 33a65e9

Browse files
committed
Document Sync by Tina
1 parent b36dea7 commit 33a65e9

File tree

1 file changed

+13
-0
lines changed

1 file changed

+13
-0
lines changed
+13
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
# Supported Models
2+
3+
ServerlessLLM supports a plethora of language models from [Huggingface (HF) Transformers](https://huggingface.co/models). This page lists the models and model architectures currently supported by ServerlessLLM.
4+
5+
To test a model, simply add it to the `supported_models.json` inside `/ServerlessLLM/tests/inference_tests` and the Github Actions will automatically test whether not it is supported.
6+
7+
## Text-only Language Models
8+
9+
Architecture |Models |Example HF Models |vLLM |Transformers
10+
------------------|--------------|--------------------|-----|-------------
11+
`OPTForCausalLM` |OPT, OPT-IML |`facebook/opt-6.7b` |✅ |✅
12+
13+

0 commit comments

Comments
 (0)