Repro:
- (pending sample) configure strand agentic sample to use anthropic model on openai-access-gateway
- make a prompt which will trigger the tool (e.g. "show me books about mid-century fashion")
Expected: Receive response from LLM with information about books
Actual: Get "Error in /chat endpoint"
Analysis: The issue appears to be coming from the openai-access-gateway. With a few issues:
- schema not properly matching message structure
- anthropic model generates data which causes the content to not be recognized
- anthropic "usage" is not properly mapped to openai format
Repro:
Expected: Receive response from LLM with information about books
Actual: Get "Error in /chat endpoint"
Analysis: The issue appears to be coming from the openai-access-gateway. With a few issues: