-
Notifications
You must be signed in to change notification settings - Fork 17.9k
groq: add support for accessing reasoning output from Groq models #31662
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎ 1 Skipped Deployment
|
CodSpeed Walltime Performance ReportMerging #31662 will not alter performanceComparing
|
CodSpeed Instrumentation Performance ReportMerging #31662 will not alter performanceComparing Summary
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks!
The streaming test seemed to pass consistently for me btw |
…instead of model_kwargs
Description: return reasoning output in
additional_kwargs
asreasoning_content
Issue: Resolves #31052
Warning: the
test_reasoning_output_stream
integration test fails sporadically? After a failure, re-running seems to always result in a run that passes. Unsure whether this is on our end or Groq's.