tests: mcp agent evals for new tool

[Kylejeong2]

what

adding simple eval tests to make sure agent tool works/doesn't regress during changes

[greptile-apps]

Greptile Summary

• Added three new evaluation test workflows across different config files to validate the new browserbase_stagehand_agent tool
• Tests cover basic agent navigation, smoke testing, and complex multi-step tasks to ensure the agent functionality works correctly and doesn't regress

Confidence Score: 5/5

• This PR is safe to merge with no risk
• All changes are test configuration additions with no production code modifications, properly structured test workflows, and appropriate dependency updates
• No files require special attention

Important Files Changed

Filename	Overview
evals/mcp-eval-basic.config.json	Added agent-basic-test workflow to test autonomous agent with simple navigation task
evals/mcp-eval-minimal.config.json	Added smoke-test-agent workflow to verify agent tool works with basic task
evals/mcp-eval.config.json	Added agent-complex-task-test workflow with multi-step Hacker News scraping task

Sequence Diagram

sequenceDiagram
    participant User
    participant EvalRunner
    participant MCPServer
    participant Agent
    participant Browser
    participant Website
    
    User->>EvalRunner: "Run agent eval test"
    EvalRunner->>MCPServer: "browserbase_session_create"
    MCPServer->>Browser: "Initialize browser session"
    Browser-->>MCPServer: "Session ID"
    EvalRunner->>MCPServer: "browserbase_stagehand_agent(prompt)"
    MCPServer->>Agent: "execute(instruction, maxSteps=20)"
    Agent->>Browser: "Navigate to URL"
    Browser->>Website: "HTTP request"
    Website-->>Browser: "Page content"
    Agent->>Browser: "Extract data"
    Browser-->>Agent: "Extracted result"
    Agent-->>MCPServer: "result.message"
    MCPServer-->>EvalRunner: "Agent result"
    EvalRunner->>MCPServer: "browserbase_session_close"
    MCPServer->>Browser: "Close session"
    EvalRunner-->>User: "Test result (pass/fail)"

Loading

[greptile-apps]

_{4 files reviewed, no comments}

_{Edit Code Review Agent Settings | Greptile
React with 👍 or 👎 to share your feedback on this new summary format}