bug: Incorrect Formatting in messages to Claude API

[piasnikj]

Jan version

0.5.15

Describe the Bug

I just upgraded from 0.5.14 and since this update there is a clear issue with response formatting for interactions with the Claude API. Reproducible on multiple machines.

Version 0.5.15

This becomes far worse if you are expecting a nicely formatted response with lists and other more complex formatting.

Version 0.5.14

Steps to Reproduce

Enter any prompt that interacts with Claude's API (Sonnet).

Screenshots / Logs

No response

What is your OS?

• MacOS
• Windows
• Linux

[Fuan1]

I have the same issue and after doing several tests, it seems to get worse in areas that require a lot of symbols such as mathematical answers.

[Sm0ove]

A workaround for the response format conversion was recently posted on the discord channel:

https://discord.com/channels/1107178041848909847/1341839071454040115/1341998275250884698

{% if input_request.stream %} {"object": "chat.completion.chunk", "model": "{{ input_request.model }}", "choices": [{"index": 0, "delta": { {% if input_request.type == "message_start" %} "role": "assistant", "content": null {% else if input_request.type == "ping" %} "role": "assistant", "content": null {% else if input_request.type == "content_block_delta" %} "role": "assistant", "content": {{ tojson(input_request.delta.text) }} {% else if input_request.type == "content_block_stop" %} "role": "assistant", "content": null {% else if input_request.type == "content_block_stop" %} "role": "assistant", "content": null {% endif %} }, {% if input_request.type == "content_block_stop" %} "finish_reason": "stop" {% else %} "finish_reason": null {% endif %} }]} {% else %} {{tojson(input_request)}} {% endif %}