Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does magentic support o1 and o1-mini models? #410

Open
Lawouach opened this issue Jan 28, 2025 · 1 comment
Open

Does magentic support o1 and o1-mini models? #410

Lawouach opened this issue Jan 28, 2025 · 1 comment

Comments

@Lawouach
Copy link

Lawouach commented Jan 28, 2025

Hi,

I was trying to use these models today while generating structured output with OpenaiChatModel. But, I ran into issues as these models do not support the same range of parameters as older models like gpt-4. Thus magentic breaks quite heavily.

Notably, the o1 models don't:

  • support to set max_tokens (aside from setting it to 1)
  • allow the parallel_tool_calls parameter
  • support tools
@jackmpcollins
Copy link
Owner

Right now all structured output in magentic uses tool calls which these models don't support. o1 (but not o1-mini I think) supports openai's structured outputs, which magentic should really be using in the case where a single structured output is desired (no union in return type and no functions provided). Issue for that is #295 Apart from that, I think we just have to wait for openai to add support for tools. The parallel_tool_calls and max_tokens parameters could be optionally omitted.

https://platform.openai.com/docs/guides/structured-outputs#supported-models

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants