Token limitation.

[macezar]

Been playing with the app and had a bigger conversation about book writing. At some point, it just stopped working, and when I tried to request a different prompt, I got the following error

I am aware this in an API limitation, but it doesn't give you any chance to change what is being sent, or even inform you to start a new chat.

I ran on chatgpt the same type of conversation, and there the assistant simply "forgets" what is said at the start, and generates responses that deviate from what you asked at the start.

Any change we also have this here?

[miocat2876]

Previous question records also seem to count toward the token count.

All I know is that I need to add a key value of "conversation_id" to the request.

please check