feat(framework): Add Open Responses compatible `/responses` endpoint to Runtime API by charlesbvll · Pull Request #7941 · flwrlabs/flower

charlesbvll · 2026-08-19T15:06:32Z

New Flow

  AgentApp
    │ OpenAI SDK: POST /v1/runtime/responses
    │ Authorization: Bearer <AgentApp task token>
    ▼
  Flower Responses endpoint
    │ creates child MODEL task + stores ModelRequest
    ▼
  flwr-model
    │ calls configured model provider
    │ publishes Open Responses events
    ▼
  Flower endpoint
    │ relays events as SSE
    ▼
  OpenAI SDK stream iterator

Decisions made

Expose POST /v1/runtime/responses through a regular FastAPI JSON/SSE router because the existing Runtime router uses ProtobufRoute
Authenticate with Authorization: Bearer <task-token> so standard Open Responses-compatible SDKs can call the endpoint directly
Accept only AgentApp task tokens
Reuse the existing model execution path by creating a child flwr-model task and sending it the existing ModelRequest
Keep provider routing, task relationships, run attribution, and usage accounting unchanged
Support both non-streaming JSON responses and SSE streaming in the initial implementation
Initially support only the fields already represented by ModelRequest
- model
- input
- stream
- tools
- tool_choice
- reasoning
- previous_response_id
- instructions
- max_output_tokens
- metadata
- text
Reject unsupported fields explicitly instead of silently ignoring them
Correlate replies atomically through reply_to_message_id
- Model replies for concurrent requests share the same AgentApp destination
- Filtering must happen inside the destructive CoreState claim so one request cannot consume another request's reply
Filter stream events by the child model task so unrelated events from the same run cannot enter the SDK stream
Consume the final task reply before exposing a terminal SSE event, preventing it from remaining in the AgentApp mailbox
Mark unfinished child model tasks as STOPPED when the request times out or the client disconnects
Inject FLWR_RUNTIME_BASE_URL and FLWR_RUNTIME_API_KEY before loading the AgentApp
Keep the existing agent.responses.create(...) path unchanged
Do not add the OpenAI SDK as a framework runtime dependency
No database migration is required because reply correlation and task IDs are already stored

Open questions

Is the initial request-field subset sufficient for the first release -> Yes we keep just the used subset
Which additional Open Responses event types, if any, need explicit support
Should HTTP errors follow the exact OpenAI error contract, including status codes and error fields, or is compatibility at the SDK level sufficient
Is marking the child task as STOPPED enough on disconnect, or should we also add executor-level cancellation to terminate an in-flight provider request immediately
Should agent.responses.create(...) eventually become a wrapper around this endpoint or remain on its current lower-level Runtime path -> We leave it unchanged for now
Should the OpenAI SDK end-to-end example be included in this PR or added separately

Deps

This branch is stacked on the Runtime HTTP work in refactor(framework): Switch RuntimeAPI to HTTP from gRPC #7936 and should be reconciled with its final merged form
Documentation work should be coordinated with docs(agent): Add openresponses guide #7930
This implements the supported Flower subset of the Open Responses API and does not claim complete API compatibility

Co-authored-by: Heng Pan <pan@flower.ai>

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

# Conflicts: # framework/py/flwr/common/logger.py

# Conflicts: # framework/py/flwr/simulation/app.py # framework/py/flwr/simulation/simulationio_connection.py # framework/py/flwr/supercore/cli/flower_superexec.py # framework/py/flwr/supercore/task_process/agent/run_agentapp.py # framework/py/flwr/supercore/task_process/connector/run_connector.py # framework/py/flwr/supercore/task_process/model/run_model.py # framework/py/flwr/superlink/runtime/run_serverapp.py # framework/py/flwr/supernode/runtime/run_clientapp.py

# Conflicts: # framework/py/flwr/superlink/cli/flower_superlink.py

…added test

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 1387d0c882

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 1efe8c45bd

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 7182df9e7e

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 533818a120

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 0bfa19d24d

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

danielnugraha · 2026-08-21T18:43:29Z

+    if certificates is None:
+        return None
+
+    # OpenAI/httpx reads custom CAs from SSL_CERT_FILE, which requires a path.


@panh99 I'm not sure about this bit of code it seems different to the certificates that we have in the codebase. Can you check this?

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 5e972c14c5

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: c061a6a06c

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 6d5e28e3ed

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

danielnugraha · 2026-08-22T06:42:45Z

@@ -0,0 +1,437 @@
+# Copyright 2026 Flower Labs GmbH. All Rights Reserved.


Can we unify the runtime/responses and agent/session.py? Right now we have the duplication
RuntimeAgentResponses.create()
→ CreateTask
→ PushTaskMessage
→ poll PullTaskMessage

POST /v1/runtime/responses
→ CreateTask
→ store_task_message
→ poll LinkState

The CreateTask > Push/StoreTaskMessage > Poll can be unified.

danielnugraha

Can we split this PR to make it more manageable?

proto and corestate changes
create a shared file that both POST /v1/runtime/responses and RuntimeAgentResponses.create calls
POST /v1/runtime/responses implementation

jafermarq and others added 24 commits August 18, 2026 16:30

init

e1c5416

Merge branch 'main' into add-http-retry-invoker

a9450a3

incorporate feedback

b41aeb7

fix pylint

58dca8a

Merge branch 'main' into add-http-retry-invoker

1b0c12d

Update framework/py/flwr/supercore/protobuf/client.py

0336d7d

Co-authored-by: Heng Pan <pan@flower.ai>

Update framework/py/flwr/supercore/protobuf/client.py

aeedfed

Narrow retryable HTTP transport errors

5e2266c

init

6acd131

fix circular import

43a4e4a

update year in copyright

bc1b69d

Merge branch 'main' into add-http-grid

50d3ed0

Merge branch 'main' into add-http-grid

c112954

tweaks after merge w/ main

26cc81d

Potential fix for pull request finding

64e28b3

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Potential fix for pull request finding

9f239a2

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

prep

e409289

fix for local superlink

f1da2e9

Merge branch 'main' into switch-runtime-api-to-http-only

a370597

# Conflicts: # framework/py/flwr/common/logger.py

stop using --clientappio-api-address in CI tests

5476ec9

using client in favour of stub

6c73d04

format

813bf26

Merge branch 'main' into switch-runtime-api-to-http-only

3177242

feat(framework): Add openresponses compatible interface

4161d8f

github-actions Bot added the Maintainer Used to determine what PRs (mainly) come from Flower maintainers. label Aug 19, 2026

jafermarq added 5 commits August 19, 2026 17:14

port must be over 0

9fb4631

Merge branch 'main' into switch-runtime-api-to-http-only

7d54dd8

# Conflicts: # framework/py/flwr/superlink/cli/flower_superlink.py

Use exit handler for Runtime HTTP shutdown

d62aeb7

updated docstrings description when no certificates/insecure is set; …

a7338d4

…added test

chatgpt-codex-connector Bot reviewed Aug 21, 2026

View reviewed changes

Comment thread framework/py/flwr/superlink/routers/runtime/responses.py Outdated

Comment thread framework/py/flwr/supercore/task_process/agent/run_agentapp.py

Switch to task_ids

1efe8c4

chatgpt-codex-connector Bot reviewed Aug 21, 2026

View reviewed changes

Comment thread framework/py/flwr/superlink/routers/runtime/responses.py

Address comments

7182df9

chatgpt-codex-connector Bot reviewed Aug 21, 2026

View reviewed changes

Comment thread framework/py/flwr/superlink/routers/runtime/responses.py

Comment thread framework/py/flwr/supercore/task_process/agent/run_agentapp.py Outdated

Address comments

533818a

chatgpt-codex-connector Bot reviewed Aug 21, 2026

View reviewed changes

Comment thread framework/py/flwr/superlink/routers/runtime/responses.py Outdated

charlesbvll added 2 commits August 21, 2026 17:07

Merge main into it

71f7c09

Merge branch 'main' into add-runtime-responses-endpoint

0bfa19d

chatgpt-codex-connector Bot reviewed Aug 21, 2026

View reviewed changes

Comment thread framework/py/flwr/superlink/routers/runtime/responses.py Outdated

charlesbvll added 2 commits August 21, 2026 17:29

Address comments

e20b209

Address comments

11a2cd1

danielnugraha reviewed Aug 21, 2026

View reviewed changes

Comment thread framework/proto/flwr/proto/runtime.proto

danielnugraha reviewed Aug 21, 2026

View reviewed changes

panh99 reviewed Aug 21, 2026

View reviewed changes

Comment thread framework/proto/flwr/proto/runtime.proto

panh99 reviewed Aug 21, 2026

View reviewed changes

Comment thread framework/py/flwr/superlink/routers/runtime/__init__.py

Apply suggestion from @panh99

9f9eb3a

danielnugraha reviewed Aug 21, 2026

View reviewed changes

Comment thread framework/py/flwr/superlink/routers/runtime/responses.py

Merge branch 'main' into add-runtime-responses-endpoint

5e972c1

chatgpt-codex-connector Bot reviewed Aug 21, 2026

View reviewed changes

Comment thread framework/py/flwr/supercore/task_process/agent/run_agentapp.py Outdated

Add ModelRequest.from_payload

c061a6a

chatgpt-codex-connector Bot reviewed Aug 21, 2026

View reviewed changes

Comment thread framework/py/flwr/superlink/routers/runtime/responses.py

Address comments

6d5e28e

chatgpt-codex-connector Bot reviewed Aug 21, 2026

View reviewed changes

Comment thread framework/py/flwr/superlink/routers/runtime/responses.py

charlesbvll added 2 commits August 21, 2026 23:50

Recompile protos

332335f

Safer claim

597e85e

danielnugraha reviewed Aug 22, 2026

View reviewed changes

charlesbvll added 2 commits August 22, 2026 11:21

Remove duplication

73e0161

Fix sorting

1b2ce80

		@@ -0,0 +1,437 @@
		# Copyright 2026 Flower Labs GmbH. All Rights Reserved.

Uh oh!

Conversation

charlesbvll commented Aug 19, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

New Flow

Decisions made

Open questions

Deps

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

Uh oh!

danielnugraha Aug 21, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

danielnugraha Aug 22, 2026

Choose a reason for hiding this comment

Uh oh!

danielnugraha left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

charlesbvll commented Aug 19, 2026 •

edited

Loading