You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Apr 3, 2024. It is now read-only.
Hello,
I'm setting up a MultiPromptChain that I call asynchronously as follows:
resp=await multichain.arun(input=standalone_question,include_run_info=False,return_only_outputs=True)
or:
resp=await multichain.acall(inputs={"input":standalone_question,},include_run_info=False,return_only_outputs=True)
The MutiPromptChain is constructed based on a streaming llm as follows:
My problem is that I get a non desirable markdown code snippet with a JSON object;
with the response in the websocket. Fo example:
{
"destination":"......................................",
"next_inputs":"....................................................."
}
followed by the answer to the question.
I don't want that json object to be streamed in the websocket; just the answer to the question.
Is there a way to do it?
Thanks for answering.
Bassam.
The text was updated successfully, but these errors were encountered:
Hello,
I'm setting up a MultiPromptChain that I call asynchronously as follows:
resp=await multichain.arun(input=standalone_question,include_run_info=False,return_only_outputs=True)
or:
resp=await multichain.acall(inputs={"input":standalone_question,},include_run_info=False,return_only_outputs=True)
The MutiPromptChain is constructed based on a streaming llm as follows:
stream_handler = StreamingLLMCallbackHandler(websocket)
stream_manager = BaseCallbackManager([stream_handler])
llm = ChatOpenAI(
model_name=model,
temperature=0.9,
streaming=True,
callback_manager=stream_manager,
verbose=False,
openai_api_key=openai_apik)
My problem is that I get a non desirable markdown code snippet with a JSON object;
with the response in the websocket. Fo example:
{
"destination":"......................................",
"next_inputs":"....................................................."
}
followed by the answer to the question.
I don't want that json object to be streamed in the websocket; just the answer to the question.
Is there a way to do it?
Thanks for answering.
Bassam.
The text was updated successfully, but these errors were encountered: