New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[AI in AvnI] Rule generation with RAG #772

Open

Tracked by

mahalakshme opened this issue Aug 13, 2024 · 0 comments

Open

Tracked by

[AI in AvnI] Rule generation with RAG #772

mahalakshme opened this issue Aug 13, 2024 · 0 comments

Contributor

mahalakshme commented Aug 13, 2024 •

edited

Loading

AC:

Generate form element rule from user prompt
Try to achieve at least 70% accuracy(ie., 7/10 results need to be correct)
Compare the results of above with 1/2/3/4/5-order inference using HELM or ROGUE
Mention the time needed to generate the result
Should be testable - so provide instructions for the QA to be able to test

Tech details:

Can use RAG with LangChain

mahalakshme mentioned this issue

Self-service improvements - phase 2 avniproject/avni-product#1643

Open

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment