feat: add streaming support for real-time TTS

- Added generate_stream() method for token-by-token streaming
- Added generate_and_play() method for real-time playback
- Added decode_chunk() to ncodec codec
- First audio chunk in ~180ms (390% faster than non-streaming)
- Updated README with streaming documentation
This commit is contained in:
2026-03-22 04:40:37 +01:00
commit 88e07487ee
16 changed files with 4671 additions and 0 deletions
+6
View File
@@ -0,0 +1,6 @@
lmdeploy
librosa
fastaudiosr @ git+https://github.com/ysharma3501/FlashSR.git
ncodec @ git+https://github.com/ysharma3501/FastBiCodec.git
einops
onnxruntime-gpu