You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Environment, CPU architecture, OS, and Version:
linux + vulkan
Describe the bug
I am excluding the proper think tags since I cannot get them to show due to markdown.
deepseek-r1-distill-qwen-7b (and other deepseek models I've tested) exclude the initial think tag, but include the "/think" tag after. This is creates an issue with some frontends such as open webui, since they recently added support for think tags and hiding/showing/giving stats on thinking.
To Reproduce
Ask any question, response begins with reasoning directly, and ends with /think but has no beginning think tag.
Expected behavior
I expect think to precede the thinking.
An example output from: why is the sky blue?
Okay, the user is asking, "why is the sky blue?" I remember that there are a few explanations for this, so I need to figure out which one is the most accurate based on the provided context.
Looking at the context, there are two sources with the same question. Both sources explain that the sky appears blue because of the scattering of sunlight by atmospheric molecules. When sunlight enters the Earth's atmosphere, it's made up of all the colors of the spectrum. As it travels through the air, shorter wavelengths like blue and violet are scattered more than the longer wavelengths like red and orange. This scattering makes the sky appear blue, especially when the sun is high in the sky.
The context also mentions that in polluted skies, small particles like dust can scatter more blue light, making the sky look more blue. However, the user's question is general, so I don't need to include that unless it's necessary. Also, I should cite the sources that provide this information. Since both sources are from Britannica, I'll use [britannica.com] for the context.
I should structure my answer to first explain the phenomenon, then mention the factors that contribute to the sky's color. I'll include the citation at the end to give credit to the source. I'll keep it concise and clear, making sure it addresses the user's question directly.
The sky appears blue primarily due to the scattering of sunlight by molecules in the Earth's atmosphere. Sunlight is composed of all the colors of the visible spectrum, but shorter wavelengths like blue and violet are scattered more than longer wavelengths like red and orange. This scattering effect is more pronounced when the sun is high in the sky, as the sunlight travels through a larger portion of the atmosphere. The result is that the sky appears blue to our eyes [britannica.com].
The text was updated successfully, but these errors were encountered:
LocalAI version:
464686a
Environment, CPU architecture, OS, and Version:
linux + vulkan
Describe the bug
I am excluding the proper think tags since I cannot get them to show due to markdown.
deepseek-r1-distill-qwen-7b (and other deepseek models I've tested) exclude the initial think tag, but include the "/think" tag after. This is creates an issue with some frontends such as open webui, since they recently added support for think tags and hiding/showing/giving stats on thinking.
To Reproduce
Ask any question, response begins with reasoning directly, and ends with /think but has no beginning think tag.
Expected behavior
I expect think to precede the thinking.
An example output from: why is the sky blue?
The text was updated successfully, but these errors were encountered: