Several Bedrock models (but not all) support streaming responses but DevoxxGenie does not currently support this.
@stephanj I have implemented in a branch but would appreciate your input on configuration. Some options:
- Repurpose/rename the existing 'Local Large Language Model' => 'Enable Stream Mode' checkbox such that it applies to all models. E.g. rename to 'Model Response' => 'Enable Stream Mode'. Currently this configuration checkbox impacts Bedrock models anyway.
 
- New configuration checkbox specifically to enable streaming responses for Bedrock models.
 
Cheers,
John