feat: add global inference support for AWS Bedrock models #8751
+362
−11
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This PR attempts to address Issue #8750 by adding support for AWS Bedrock's Global Inference feature, which automatically routes requests to the optimal AWS region for supported models.
Changes
awsUseGlobalInferencesetting to provider configuration schemaglobal.prefix support in Bedrock provider for supported modelsSupported Models
The following models support global inference:
anthropic.claude-sonnet-4-20250514-v1:0)anthropic.claude-sonnet-4-5-20250929-v1:0)anthropic.claude-opus-4-20250514-v1:0)anthropic.claude-opus-4-1-20250805-v1:0)anthropic.claude-3-7-sonnet-20250219-v1:0)anthropic.claude-haiku-4-5-20251001-v1:0)Testing
UI Experience
The new global inference checkbox:
Fixes #8750
Feedback and guidance are welcome!
Important
Adds global inference support for AWS Bedrock models, prioritizing it over cross-region inference, with UI updates and comprehensive tests.
awsUseGlobalInferencesetting toprovider-settings.tsfor AWS Bedrock models.global.prefix support inAwsBedrockHandlerfor supported models.AwsBedrockHandler.Bedrock.tsx, disabling cross-region inference when enabled.bedrock-global-inference.spec.tswith 21 test cases for global inference behavior.bedrock.tsto include models supporting global inference.settings.jsonfor UI text related to global inference.This description was created by
for 9b4c326. You can customize this summary. It will automatically update as commits are pushed.