Added LangChain examples to MD doc #521
Conversation
oracle-contributor-agreement
bot
added
the
OCA Verified
| ) | ||
|
|
||
| #Invocation | ||
| messages = [ |
There was a problem hiding this comment.
This example does not work for Mistral model as it does not take system message. Maybe we should mention this as well. There are some discussions: vllm-project/vllm#2112
There was a problem hiding this comment.
As suggested in the latest conversation in the above thread, I tried the MD endpoint for Mistral-7B-Instruct-v0.3, and it's working with the same sample code.
There was a problem hiding this comment.
Which conversation are your referring to? It does not seem to work for me in with vllm and the Mistral-7B-Instruct-v0.3 model.
There was a problem hiding this comment.
Looks like you are using a newer version of the model with the updated chat template. The model provided by the service 83e9aa1 does not support system message. For this to work, users will have to download the newer version instead of using the one provided by the service.
No description provided.