New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feat]: Allow editing assistant responses #137

Open

dave1010 opened this issue Dec 11, 2024 · 0 comments

Labels

dave1010 commented Dec 11, 2024

Description

#128 introduced the ability to edit user messages, which is great.

It would also be useful to be able to edit the model's responses. This would work in an identical way to editing user messages.

Use Case

It's often much more effective to correct the model's own response, rather than adding a new user message.
Editing the model's response also allows you to persuade the model much more too, as it thinks that it's already said something.
Removing text from the model's response if it's too verbose can speed up inference.

dave1010 added the enhancement label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment