Button to stop the chat response

[oracle-code]

Please provide us with the following information:

This issue is for a: (mark with an x)

- [ ] bug report -> please search issues before submitting
- [x] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Minimal steps to reproduce

none

Any log messages given by the failure

none

Expected/desired behavior

I would like to stop the chat response if I see that the answer produced is not good. Stopping during the response is essential since I don't want the token to be consumed entirely. Also for the front end, I would like the submit arrow in the chat box to turn to a stop icon while the response is being produced.

OS and Version?

Windows 7, 8 or 10. Linux (which distribution). macOS (Yosemite? El Capitan? Sierra?)

azd version?

run azd version and copy paste here.

Versions

Mention any other details that might be useful

---

Thanks! We'll be in touch soon.

[oracle-code]

@pamelafox Any idea or know anyone who would know where to start to deploy this feature? I know that the app is built in an asynchronous way but other GenAI LLM apps are handling the stop feature when you see the assistant response.

[pamelafox]

Check out our discussion here:
#1221
The UI can be added, but I believe you may still end up with same token usage.