Slow response at first question

[kientv]

I see that llmchain much slower response at first question than second question. I'm using existing upsert (not insert upsert).

Look like cold start of cloud run (through I'm using VM)

[kientv]

Maybe because chroma 'starting component PersistentLocalHnswSegment' at first time every day.

[kientv]

In first time of the day, This question return timeout and don't make any request to OpenAI.

chatbot | 2023-11-24 10:35:09 [INFO]: ⬆️ POST /api/v1/prediction/a2ac71ef-71a2-45ba-86a0-332754154593
chroma | INFO: [24-11-2023 10:35:33] 172.18.0.3:47146 - "POST /api/v1/collections HTTP/1.1" 200
chatbot | 2023-11-24 10:36:41 [INFO]: [server]: Chatflow a2ac71ef-71a2-45ba-86a0-332754154593 added into ChatflowPool
chatbot | Error in handler LangChainTracer, handleChainStart: TimeoutError: The operation was aborted due to timeout
chroma | INFO: [24-11-2023 10:38:30] 172.18.0.3:44402 - "POST /api/v1/collections/b5a0b9bd-e594-4059-b4c2-11a66259f070/query HTTP/1.1" 200