Skip to content

deploy/parakeet-stt: add edge-stt take-home (3-mode CLI + harness + results)#5

Merged
ai-hpc merged 1 commit into
mainfrom
add-edge-stt-takehome
Jun 11, 2026
Merged

deploy/parakeet-stt: add edge-stt take-home (3-mode CLI + harness + results)#5
ai-hpc merged 1 commit into
mainfrom
add-edge-stt-takehome

Conversation

@ai-hpc

@ai-hpc ai-hpc commented Jun 11, 2026

Copy link
Copy Markdown
Member

Adds the Edge AI STT assessment under deploy/parakeet-stt/edge-stt/ — additive; the existing production STT-server deploy files (README, genie-parakeet.service, parakeet-stt-server.py, serve-mode.patch) are untouched.

Contents (edge-stt/):

  • One ./transcribe CLI over three modes — A offline (parakeet.cpp ggml CUDA), B true-streaming (sherpa-onnx Zipformer), C multilingual (Whisper-tiny LID + Parakeet-v3).
  • WER/RTF/memory harness, locked deps (requirements.lock), and measured LibriSpeech-300 results.
  • Primary engine parakeet.cpp: tdt=q5_k 1.808% / 61x, ctc=q8_0 2.383% / 107x, +450 MB; sherpa-onnx is the reproducible alternative + the B/C engines. TensorRT deferred.
  • README has a fresh-Jetson deployment guide; STAGE2-MEMO + TRADE-OFFS cover the architecture reasoning.

Audio payloads / models are gitignored (regenerated by scripts/get-data.sh + scripts/get-models.sh).

…arness + results)

Edge AI STT assessment under edge-stt/: one ./transcribe CLI over three modes
(A offline parakeet.cpp, B streaming Zipformer, C multilingual LID), the WER/RTF/memory
harness, locked deps, and measured LibriSpeech-300 results. Primary engine parakeet.cpp
(tdt=q5_k 1.808%/61x, ctc=q8_0 2.383%/107x, +450MB); sherpa-onnx for Modes B/C and the
reproducible alternative. Does not touch the production STT-server deploy files.
@ai-hpc ai-hpc merged commit b767410 into main Jun 11, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant