Skip to content

Commit

Permalink
fix typo in quart docs
Browse files Browse the repository at this point in the history
  • Loading branch information
rchan26 committed Dec 5, 2024
1 parent b8b420e commit 624e253
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions docs/quart.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,6 @@
## Quart API

To query models from Huggingface that are not available via the `text-generation-inference` API, we have written a simple [script to start up a Quart API](https://github.com/alan-turing-institute/prompto/blob/main/src/prompto/apis/quart/quart_api.py)
``` that can be used to query a text-generation model from the [Huggingface model hub](https://huggingface.co/models) using the Huggingface `transformers` library. This can be started using the `prompto_quart_server` command, e.g.
To query models from Huggingface that are not available via the `text-generation-inference` API, we have written a simple [script to start up a Quart API](https://github.com/alan-turing-institute/prompto/blob/main/src/prompto/apis/quart/quart_api.py) that can be used to query a text-generation model from the [Huggingface model hub](https://huggingface.co/models) using the Huggingface `transformers` library. This can be started using the `prompto_quart_server` command, e.g.
```bash
prompto_quart_server \
--model-name vicgalle/gpt2-open-instruct-v1 \
Expand Down

0 comments on commit 624e253

Please sign in to comment.