ChatBedrockConverse response not streaming

[gituser022]

Hi Shivanshu,

I have tried the simple streaming use-case and replaced just with bedrock FM instead of open AI , when I tried to run streamlit, I see following issues

1. its not streaming but gathers all response
2. response from assistant is saved to streamlit state but not printed until there is a new user prompt. It can be simply fixed, not an issue but if it is fixed in repo, it will be helpful to others.

I have attached files.

Thanks

Archive.zip

[shiv248]

ah @gituser022 as we predicted it is an issue with ChatBedrockConverse not with the streamlit components, I just tested with chatfireworks and chatopenai.

from a quick search try adding streaming=True to the params. the issue was brought up in the langchain-aws repo.
I would recommend forwarding any further issues to the threads below, they are better suited to help you.
langchain-ai/langchain-aws#217
langchain-ai/langchain-aws#241