AWS Bedrock models tools support

[DEG-7]

Hi team,
Could you extend the tools support to AWS Bedrock models?

Amazon Bedrock supports tool calling with the following models.
Anthropic Claude 3 models
Mistral AI Large
Cohere Command R and Command R+

AWS Bedrock documentation: https://docs.aws.amazon.com/bedrock/latest/userguide/tool-use.html

Thanks for the great work !!

[maxjiang153]

I'm working on this, but first one is Anthropic Claude 3 models.

Mistral AI models and Cohere Command R models have not been merged yet:
#808
#667

[maxjiang153]

@tzolov plz take a look at recent AWS Bedrock PRs, I wonder if creating a PR includes all supported tool models instead of once a time.

[markpollack]

Thanks, this is a large change, so will take a bit to digest.

[piratovi]

@tzolov Hi guys! Any updates about Anthropic Claude 3 tools support ?

[tzolov]

@piratovi we are working on it PR #1650
The main parts hopefully will be released with the forthcoming M4 milestone.

[tzolov]

Resolved by the Amazon Bedrock Converse API.

Following the Bedrock recommendations, Spring AI is transitioning to using Amazon Bedrock’s Converse API for all chat conversation implementations in Spring AI. While the existing InvokeModel API supports conversation applications, we strongly recommend adopting the Converse API for all Char conversation models.
The Converse API does not support embedding operations, so these will remain in the current API and the embedding model functionality in the existing InvokeModel API will be maintained

Bedrock Converse provides a unified interface for conversational AI models with enhanced capabilities including tool calling, multimodal inputs, and streaming responses.