DA-690: AWS Bedrock Agents Demo with Couchbase #35

teetangh · 2025-02-20T23:07:49Z

No description provided.

…otebook

…otebook - Updated IAM role and policy creation with more robust error handling - Added bedrock-agent-runtime client for improved agent invocation - Improved document processing with better logging and error tracking - Refactored agent invocation to handle streaming responses - Added error handling for agent interactions

github-actions · 2025-02-20T23:08:04Z

Caution

Notebooks or Frontmatter Files Have Been Modified

Please ensure that a frontmatter.md file is accompanying the notebook file, and that the frontmatter is up to date.
These changes will be published to the developer portal tutorials only if frontmatter.md is included.
Proofread all changes before merging, as changes to notebook and frontmatter content will update the developer tutorial.

3 Notebook Files Modified:

Notebook File	Frontmatter Included?
`awsbedrock-agents/custom-control-approach/Bedrock_Agents_Custom_Control.ipynb`	✅
`awsbedrock-agents/lambda-approach/Bedrock_Agents_Lambda.ipynb`	✅
`awsbedrock-agents/lamda-old/Bedrock_Agents_Lambda.ipynb`	✅

3 Frontmatter Files Modified:

Frontmatter File
`awsbedrock-agents/custom-control-approach/frontmatter.md`
`awsbedrock-agents/lambda-approach/frontmatter.md`
`awsbedrock-agents/lamda-old/frontmatter.md`
Note: frontmatter will be checked and tested in the Test Frontmatter* workflow.*

- Simplified AWS client creation using a single session - Updated IAM role permissions to be more comprehensive - Modified document processing to use vector store directly - Changed default model to Claude 3 Haiku - Updated file path for documents.json - Commented out agent-based document processing

…model invocation - Added robust policy version management in IAM role creation - Implemented error handling for agent creation process - Updated default model to Amazon Nova Pro - Added fallback mechanism for vector store search and direct model invocation - Improved logging and error tracking for agent interactions

- Updated model from Nova Pro to Claude v2 - Modified model invocation parameters for better text formatting - Simplified response parsing for formatted research findings - Removed complex JSON payload in favor of direct prompt-based formatting

- Added support for two agent action group execution strategies: 1. Custom Control with direct function calls 2. Lambda function-based execution - Created Lambda deployment script for agent functions - Updated multi-agent workflow to demonstrate both approaches - Added .gitignore entries for Lambda build artifacts

… mechanism - Added retry logic and exponential backoff for Lambda function deployment - Implemented error handling for various AWS service exceptions - Added role readiness wait time to handle IAM role propagation - Enhanced logging and error tracking during Lambda function packaging and deployment - Added input validation for AWS account ID

…e and reliability - Updated Lambda function code to use Claude 3 Sonnet model with new message-based API - Enhanced Lambda deployment script with: * Increased timeouts and memory allocation * Improved error handling for large payloads * Dependency cleanup to reduce package size - Added more comprehensive IAM permissions for Bedrock and agent interactions - Updated requirements.txt to use latest Couchbase library - Fixed file paths for Lambda deployment and document loading

…dling, and agent preparation - Added comprehensive logging for agent invocation and tracing - Implemented search index setup with robust error handling - Enhanced collection setup with document clearing and improved logging - Added agent preparation steps for researcher and writer agents - Updated Lambda function deployment to handle existing functions - Improved error handling and status tracking for agent action groups - Added more detailed logging for agent interactions and Lambda deployments

- Removed Lambda function deployment from main workflow - Updated action group creation to use "customControl" executor - Simplified action group names and descriptions - Commented out package cleanup steps in Lambda deployment scripts - Added dotenv loading to Lambda function scripts - Removed explicit prompt formatting in writer Lambda function

…handling - Added comprehensive debugging for agent function invocations - Implemented dynamic handling of search_documents and format_content functions - Added detailed logging and error tracing for agent responses - Updated invoke_agent method to support vector store integration - Improved error messages and debugging output for agent interactions - Passed vector_store to both Lambda and Custom Control approaches in main script

…e Integration - Added comprehensive debugging for agent function invocations - Enabled trace logging in invoke_agent method for detailed response tracking - Created .env file generation for Lambda functions with vector store configuration - Updated researcher and writer Lambda functions to support vector store integration - Improved error handling and trace information logging - Added more detailed console output for agent response debugging

…matting

…g print statements

awsbedrock-agents/multi_agent_bedrock.py

nithishr · 2025-03-14T19:37:05Z

@teetangh I see two different notebooks in here. Have you tested this with the developer portal to see if multiple notebooks in a folder are supported?

Also, I see two implementations here in the Python files as well as the Jupyter notebooks. I would like to understand the rationale for this.

An alternative for this would be to have the Jupyter notebooks here & move the Python code to a separate repo for easier testing.

lokesh-couchbase · 2025-03-17T07:28:46Z

Answering Q1:
@nithishr , same folder is right now not supported. Maybe we can change the actions file to support this. I think a parent folder could be added. Then multiple tutorials can be added in seperate folders inside the parent

teetangh · 2025-03-17T19:07:54Z

@nithishr

Lambda approach creates AWS Lambda functions that serve as the executors for the agent action groups, deploying separate functions for the researcher and writer agents. When the agent needs to perform an action like searching documents, it invokes the corresponding Lambda function which handles the request, performs the vector search, and returns results.
The Custom Control approach instead uses the "RETURN_CONTROL" mechanism where, when the agent needs to perform an action, control is returned to the main application which then directly executes the required functionality such as vector searches.

Both implementations achieve the same end result - allowing Bedrock agents to perform vector searches and format content - but through different architectural patterns.

teetangh · 2025-03-17T19:09:31Z

@nithishr @lokesh-couchbase

@ejscribner says It looks like it should work but not 100% sure

lokesh-couchbase · 2025-03-17T19:16:10Z

tests will pass, however the frontmatter in main build can be wrong.

… on custom control and lambda approaches

…and lambda approaches

teetangh · 2025-03-20T06:34:01Z

@nithishr

have made 2 folders for 2 notebooks.
moved all python files to a seperate repo. kept just the 2 lamda functions.

awsbedrock-agents/custom-control-approach/Bedrock_Agents._Custom_Control.ipynb

awsbedrock-agents/README.md

awsbedrock-agents/lamda-approach/Bedrock_Agents_Lambda.ipynb

awsbedrock-agents/lamda-approach/documents.json

awsbedrock-agents/lamda-approach/lambda_functions/deploy.py

teetangh · 2025-04-06T21:43:34Z

@nithishr added all explanations

nithishr

Looks better but still needs improvement

awsbedrock-agents/README.md

awsbedrock-agents/custom-control-approach/Bedrock_Agents._Custom_Control.ipynb

nithishr · 2025-04-09T08:22:39Z

awsbedrock-agents/lamda-approach/lambda_functions/bedrock_agent_researcher.py

Same comments as the other one.

Do you need to handle returnControl in the agent invoker?

Adding the default localhost in the connection string could cause problems if the user is running it in lambda env as that will never work

Why do you need to wait for the collection to be available before querying? That is not a known pattern

nithishr · 2025-04-09T08:23:51Z

awsbedrock-agents/lamda-approach/lambda_functions/deploy.py

+                    MemorySize=1536,  # Increased to 1.5GB
+                    Environment={
+                        'Variables': {
+                            'CB_HOST': os.getenv('CB_HOST', 'couchbase://localhost'),


Setting localhost in lambda env?

awsbedrock-agents/lamda-approach/lambda_functions/deploy.py

…I schemas

awsbedrock-agents/lamda-old/lambda_main.py

+with open(lambda_env_path, 'w') as f:
+    f.write(f"CB_HOST={CB_HOST}\n")
+    f.write(f"CB_USERNAME={CB_USERNAME}\n")
+    f.write(f"CB_PASSWORD={CB_PASSWORD}\n")


teetangh added 4 commits February 19, 2025 06:27

added basic files

631094a

Add sequence and architecture diagrams to multi-agent collaboration n…

2fba0c8

…otebook

added diagrams

65b833d

teetangh self-assigned this Feb 20, 2025

teetangh added 17 commits February 21, 2025 05:30

added python script version

89584c6

moved around the files

ef32a01

added formatter

274d792

added lamda demos

e3d2264

Enhance Lambda functions with improved event logging and response for…

482e9c0

…matting

Refactor Lambda functions to improve event processing and remove debu…

ec0e899

…g print statements

updated mluti-agent bedrock with both approaches

ce05602

github-advanced-security bot found potential problems Mar 3, 2025

View reviewed changes

awsbedrock-agents/multi_agent_bedrock.py Fixed Show fixed Hide fixed

teetangh added 4 commits March 3, 2025 20:27

Add utility functions for vector store management and refactor imports

c8427df

updated deployment of lambda functions for better performance

f8b106f

removed legacy files

ffb2c5d

removed agents tags

95a1dd7

teetangh requested a review from nithishr March 6, 2025 08:33

teetangh marked this pull request as ready for review March 6, 2025 08:34

remove 'agents' tag from frontmatter in tutorial

8b91384

teetangh added 3 commits March 20, 2025 11:59

refactored file organisation

c934f2b

remove outdated formatter files and add new frontmatter for tutorials…

e69b1c0

… on custom control and lambda approaches

update tutorial titles for clarity and consistency in custom control …

0c09572

…and lambda approaches

nithishr requested changes Apr 3, 2025

View reviewed changes

fixed comments

e68e82d

teetangh requested a review from nithishr April 6, 2025 21:43

nithishr requested changes Apr 9, 2025

View reviewed changes

teetangh added 10 commits April 16, 2025 08:52

enhance README with ROC pattern link and remove license section

de56261

remove . from the file name of notebook

2c8ad36

add initial Lambda function setup with requirements, Makefile, and AP…

7d20dad

…I schemas

add documents.json with Cline AI assistant overview and features

e1b760d

added basic working main noteboook

e7cdc6c

created script

555b05a

refactor main notebook for improved structure and readability

278e4cb

updated custom control tutorial

aa6082a

better formatting

a396153

complete refactor of the lambda approach

4e47826

github-advanced-security bot found potential problems May 8, 2025

View reviewed changes

add notes for bucket creation and index configuration in Lambda notebook

7206748

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

DA-690: AWS Bedrock Agents Demo with Couchbase #35

DA-690: AWS Bedrock Agents Demo with Couchbase #35

teetangh commented Feb 20, 2025

github-actions bot commented Feb 20, 2025 •

edited

Loading

Notebooks or Frontmatter Files Have Been Modified

nithishr commented Mar 14, 2025

lokesh-couchbase commented Mar 17, 2025 •

edited

Loading

teetangh commented Mar 17, 2025

teetangh commented Mar 17, 2025

lokesh-couchbase commented Mar 17, 2025

teetangh commented Mar 20, 2025

teetangh commented Apr 6, 2025

nithishr left a comment

nithishr Apr 9, 2025

nithishr Apr 9, 2025

Check failure

Copilot Autofix

DA-690: AWS Bedrock Agents Demo with Couchbase #35

Are you sure you want to change the base?

DA-690: AWS Bedrock Agents Demo with Couchbase #35

Conversation

teetangh commented Feb 20, 2025

github-actions bot commented Feb 20, 2025 • edited Loading

Notebooks or Frontmatter Files Have Been Modified

3 Notebook Files Modified:

3 Frontmatter Files Modified:

nithishr commented Mar 14, 2025

lokesh-couchbase commented Mar 17, 2025 • edited Loading

teetangh commented Mar 17, 2025

teetangh commented Mar 17, 2025

lokesh-couchbase commented Mar 17, 2025

teetangh commented Mar 20, 2025

teetangh commented Apr 6, 2025

nithishr left a comment

Choose a reason for hiding this comment

nithishr Apr 9, 2025

Choose a reason for hiding this comment

nithishr Apr 9, 2025

Choose a reason for hiding this comment

Check failure

Copilot Autofix

github-actions bot commented Feb 20, 2025 •

edited

Loading

lokesh-couchbase commented Mar 17, 2025 •

edited

Loading