Implement streaming responses from Open-WebUI and update configuration for streaming support
This commit is contained in:
@@ -18,5 +18,7 @@ tools:
|
||||
- Tool_ID_1
|
||||
- Tool_ID_2
|
||||
|
||||
use_streaming: true # Allows to stream the answer to feel more interactive.
|
||||
|
||||
# optional system prompt (you can leave it empty to use the default one or the systemprompt given in open-webui for the specific model)
|
||||
system_prompt: ""
|
||||
system_prompt: ""
|
||||
|
||||
Reference in New Issue
Block a user