Whisper Transcription Locally: Where Realtime Ends on RK3588
Whisper is entirely usable on RK3588, but offline batch and streaming have very different expectations. Batch works; realtime takes conditions Offline batch: the small model transcribes one hour of audio in 15-25 minutes; faster-whisper INT8 goes faster still; Streaming: needs VAD segmentation plus chunked inference with 3-8 s latency — fine for subtitles, not interpretation; […]