Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Retry with ValidationError injected into follow-up call for standard tool calls (and not just extraction) #298

Open
willbakst opened this issue Jun 4, 2024 · 0 comments
Labels
Feature Request New feature or request

Comments

@willbakst
Copy link
Contributor

Description

We currently offer support for retrying with the ValidationError injected into the follow-up call for extractors. This is fairly straightforward since we know we're looking for a tool.

When using tools directly, it's less certain how to implement this; HOWEVER, it would be just as valuable since there is no guarantee the tool is correct the same way it might not be correct for extraction.

Of course, the hope if that through prompt engineering the model will get it correct on the first try, but this is unlikely given the current quality of these models, so having the retry fallback at least provides additional support for better responses while the models improve.

We already support retries, but we don't support injecting the tool. I'm not certain of the interface so this needs to be further fleshed out before work on it can begin.

@willbakst willbakst added the Feature Request New feature or request label Jun 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature Request New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant