Skip to content

feat: add AWS Bedrock provider support#3402

Open
zw2497 wants to merge 4 commits intochatboxai:mainfrom
zw2497:feat/add-bedrock-provider
Open

feat: add AWS Bedrock provider support#3402
zw2497 wants to merge 4 commits intochatboxai:mainfrom
zw2497:feat/add-bedrock-provider

Conversation

@zw2497
Copy link

@zw2497 zw2497 commented Jan 16, 2026

Fixes #1156

Add AWS Bedrock as a new LLM provider with support for Claude, Nova, Llama and other Bedrock models.

Features

  • Dynamic model fetching via AWS ListInferenceProfiles API
  • Auto-detect model capabilities (vision, tool_use, reasoning)
  • AWS credentials configuration (Access Key + Secret + Region)
  • 4 default models included

Technical Notes

  • Uses @ai-sdk/amazon-bedrock@3.0.73 (for compatibility with @ai-sdk/provider v2)
  • Uses inference profile IDs (e.g. global.anthropic.claude-sonnet-4-5-20250929-v1:0) for on-demand throughput

Add AWS Bedrock as a new LLM provider with dynamic model fetching via inference profiles API.
Includes support for Claude, Nova, Llama and other Bedrock models.
- Add type field to prevent unnecessary API calls to Chatbox AI backend
- Increase maxResults to 1000 for faster profile fetching
- Extract accurate token limits from converse.maxTokensMaximum field
- Parse context window from model descriptions (e.g., Nova 2 Lite 1M context)
- Support LEGACY status models (e.g., Claude 3.5 Sonnet)
@coderabbitai
Copy link
Contributor

coderabbitai bot commented Jan 16, 2026

Important

Review skipped

Auto reviews are disabled on this repository.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

- Add Bedrock credentials check to needEditSetting
- Change AWS Region from dropdown to text input for flexibility
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature] Add Bedrock integration to support Amazon Titan, Jurassic AI, Anthropic's Models via AWS Account

1 participant