This project is no longer supported. Please see the official implementation : "https://github.com/alphacep/vosk-unity-asr"
Implementation of the Vosk offline speech to text (STT) library inside of Unity. I created this just to see if it could be done. Contributions are welcomed!
Tested Using
- Unity 2020.3+
- Windows 64
- Android Arm64
Notes
- Samples Include external packages. See the Third Part Notices for license information.
- Core files are included under the
Packagesfolder. - Models can be found on the Vosk Project website.
Vosk is an offline open source speech recognition toolkit. It enables speech recognition models for 18 languages and dialects - English, Indian English, German, French, Spanish, Portuguese, Chinese, Russian, Turkish, Vietnamese, Italian, Dutch, Catalan, Arabic, Greek, Farsi, Filipino, Ukrainian.
Vosk models are small (50 Mb) but provide continuous large vocabulary transcription, zero-latency response with streaming API, reconfigurable vocabulary and speaker identification.
Speech recognition bindings implemented for various programming languages like Python, Java, Node.JS, C#, C++ and others.
Vosk supplies speech recognition for chatbots, smart home appliances, virtual assistants. It can also create subtitles for movies, transcription for lectures and interviews.
Vosk scales from small devices like Raspberry Pi or Android smartphone to big clusters.
The DemoScene can be run on android or standalone.
Launch the scene and begin speaking, next should appear on after you spot speaking for two seconds. -- Minimum Volume may need to be changed if you are in an noisy environment.
The Controller GameObject has two components that are responsible for the transcription.
Voice Processor - Handles the microphone input. Microphone can be enable and disabled. Auto detection can be disabled by passing false when calling the StartRecording method.
VoskSpeechToText - Passes the microphone input into Vosk. If KeyPhrases are not assigned, the recognizer will recognize all words in the Models dictionary. The detection starts by default but can be started by hand by calling StartVoskSTT.
Notes
Streaming voice detection is not implemented.
Models should be included in StreamingAssets as a zip or directory.