Is there a way to add "world info" cards to a session, persistent or otherwise? #2150
Unanswered
FrankDMartinez
asked this question in
Q&A
Replies: 1 comment
-
It wouldn't be doing anything special. It would be some extra information information in the prompt submitted to the LLM. If you can find out the format KoboldCPP uses, you could replicate what it does pretty easily. If you want to avoid having to repeatedly evaluate that part of the prompt (presumably it won't change often) you could look into the prompt caching options. A super simple example of what I'm talking about (with Alpaca style prompting)
And presumably you'll get "Rover" as the answer. Depending on the model, the prompt format/method for supplying additional information may need tweaking. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I know KoboldCPP allows for "world info" cards to be added for new information, such as if I want to update the name of the Prime Minister. However, I was unable to find an equivalent for LLaMa.cpp. Any suggestions?
Thanks in advance.
Beta Was this translation helpful? Give feedback.
All reactions