Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

whisper.android: change language and model on-the-fly #2595

Open
amalgame21 opened this issue Nov 29, 2024 · 2 comments
Open

whisper.android: change language and model on-the-fly #2595

amalgame21 opened this issue Nov 29, 2024 · 2 comments

Comments

@amalgame21
Copy link

amalgame21 commented Nov 29, 2024

I read this #1099 so that I can configure the language in build time.

I am using large-v3 model because only this model have my prefer language done properly.
However I want to toggle "en" and "" (auto) and my prefer language on the fly, and I want to loa different model on-the-fly (because for english it is much faster in base model), so that I no longer need to compile multiple apk for different purpose.

How can I do that? Thanks!

@mrfragger
Copy link

Split your audio into chapters or chunks and encode the English ones then the other language ones..then just combine back all the subs into one subtitle.

@amalgame21
Copy link
Author

Split your audio into chapters or chunks and encode the English ones then the other language ones..then just combine back all the subs into one subtitle.

  1. I want it to be a VTT text input method. In this case I have to set the language into "yue", and use Large v3 model, because it is the only module support "yue".
  2. I want it to be a translation tool while traveling to other place like Japan. In this case I have to set the language into "jp" or "en" when I am talking to japanese people and set the language to "en" or "zh" or "yue" when the Japanese people are talking. In this case, I might use a lightweight module to increase the speed.

So I have to compile at least 2 different apk to achieve both use case.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants