Model name not set when using langfuse + vercel ai sdk + azure open ai

[oysteinborg-try]

Hi,
we are using the vercel ai sdk and the azure open ai proivder, as documented here: https://sdk.vercel.ai/providers/ai-sdk-providers/azure
When invoking streamText, or any other vercel ai sdk functions, the model name does not get set by the langfuseexporter

const streamResult = streamText({
  model: azure('gpt-4o'),
  ...

Output from langfuseexporter debug:

"id":"cb893129ba276daf",
"startTime":"2025-01-29T20:40:16.652Z",
"traceId":"8374ca67-8ecf-437b-b805-2eb850384aa",
"parentObservationId":"f7758888946238da",
"name":"ai.streamText.doStream",
"endTime":"2025-01-29T20:40:17.568Z",
"completionStartTime":"2025-01-29T20:40:17.044Z",
"model":"",
"modelParameters":{"toolChoice":"{\"type\":\"auto\"}","system":"azure-openai.chat","maxRetries":"2"}

The "Model cost" widget on the Langfuse dashboard show the correct number of tokens but we are unable to map to an empty model, so there are no cost associated.

Any thoughts on how to solve this?

[dosubot[bot]]

Hello, @oysteinborg-try! I'm here to help you with any bugs, questions, or contributions you may have. Let's dive into the issue you're experiencing!

I found two similar open issues related to model name parsing with Azure in the Langfuse repository:

1. bug(vercel-ai-sdk): Model name parsing fails for Azure - This issue is open, and no solution has been found in the comments.
2. AzureOpenAI model name not correctly parsed for ada models - This issue is also open, with no solution found in the comments.

For your specific problem, ensure that the model keyword argument is correctly set when using the Azure OpenAI provider. Langfuse requires this to parse the model name properly. You might want to verify that the azure function is correctly configured to pass the model name to Langfuse. If the issue persists, it might be related to the known issues mentioned above.

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}

[marcklingen]

@oysteinborg-try are you on the latest versions of the SDKs? If yes, please file a bug report as a github issue

[oysteinborg-try]

Yes, the latest sdks.
I opened this: #5286