88e07487ee
- Added generate_stream() method for token-by-token streaming - Added generate_and_play() method for real-time playback - Added decode_chunk() to ncodec codec - First audio chunk in ~180ms (390% faster than non-streaming) - Updated README with streaming documentation
7 lines
161 B
Plaintext
7 lines
161 B
Plaintext
lmdeploy
|
|
librosa
|
|
fastaudiosr @ git+https://github.com/ysharma3501/FlashSR.git
|
|
ncodec @ git+https://github.com/ysharma3501/FastBiCodec.git
|
|
einops
|
|
onnxruntime-gpu
|