Skip to content

Probe cross-format provider behavior for reasoning, tools, and streaming #270

@Oaklight

Description

@Oaklight

Context

Follow-up from #268 and part of the provider reasoning documentation effort in #267.

We need active probing across providers and API formats to decide shim policies and cross-format conversion behavior instead of relying on assumptions. The immediate trigger was Argo Anthropic rejecting prior thinking blocks with missing/empty/invalid signatures, which led to unsigned_reasoning_blocks: preserve for argo--anthropic.

Goal

Build and run a cross-format probing matrix covering:

  • source API format → target shim/API format
  • stream and non-stream paths
  • reasoning/thinking blocks with:
    • no signature
    • empty signature
    • valid provider-generated signature where available
  • tool calls and tool results
  • provider metadata round-trip fields:
    • Anthropic thinking.signature
    • Google thoughtSignature
    • OpenAI-compatible reasoning_details / encrypted_content

Initial provider/shim scope

  • argo--anthropic
  • argo--openai_chat
  • openrouter
  • google
  • minimax--openai_chat
  • minimax--anthropic
  • volcengine--openai_chat
  • volcengine--openai_responses
  • deepseek

Outputs

Related

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions