You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
when i use model DeepSeek-R1-Distill-Qwen-7B bellow error occurs
RuntimeError: Exception from C:\Jenkins\workspace\private-ci\ie\build-windows-vs2019\b\repos\openvino.genai\src\cpp\src\tokenizer.cpp:546:
Chat template for the current model is not supported by Jinja2Cpp. Please apply template manually to your prompt before calling generate. For example: <start_of_turn>user{user_prompt}<end_of_turn><start_of_turn>model
Hello @CodeABao,
Thank you for reporting the issue!
That is known Jinja2Cpplimitation and we are going to workaround it soon inside the GenAI. So far please send the template manually and use the notebook as a ref.
Hello @CodeABao, Thank you for reporting the issue! That is known Jinja2Cpplimitation and we are going to workaround it soon inside the GenAI. So far please send the template manually and use the notebook as a ref.
thanks,
when i input "hi", the output is below.
when i stop it and execute it again, the issues occurs.
I don't think stopping a cell and expecting that everything rolls back to a valid state is a good idea in general. Plus GenAI doesn't restore its state for sure if it was cancelled in any other way but callback.
I don't think stopping a cell and expecting that everything rolls back to a valid state is a good idea in general. Plus GenAI doesn't restore its state for sure if it was cancelled in any other way but callback.
when i use model DeepSeek-R1-Distill-Qwen-7B bellow error occurs
RuntimeError: Exception from C:\Jenkins\workspace\private-ci\ie\build-windows-vs2019\b\repos\openvino.genai\src\cpp\src\tokenizer.cpp:546:
Chat template for the current model is not supported by Jinja2Cpp. Please apply template manually to your prompt before calling generate. For example: <start_of_turn>user{user_prompt}<end_of_turn><start_of_turn>model
tokenizer_config.json
The text was updated successfully, but these errors were encountered: