Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Base model download requires more than 13GB of space #247

Open
PricelessToolkit opened this issue Oct 20, 2024 · 1 comment
Open

Base model download requires more than 13GB of space #247

PricelessToolkit opened this issue Oct 20, 2024 · 1 comment

Comments

@PricelessToolkit
Copy link

Hi,

I attempted to run the following command using the base model:

docker run -d --gpus all -p 9000:9000 -e ASR_MODEL=base -e ASR_ENGINE=openai_whisper onerahmet/openai-whisper-asr-webservice:latest-gpu

However, I found that 13GB of available space on my SSD was insufficient. Is the container downloading additional models beyond the base model, or is there something else contributing to the large storage requirement? and how I can select the precision int8

Thank you!

@ayancey
Copy link
Collaborator

ayancey commented Oct 20, 2024

CUDA binaries are pretty large too.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants