feat(kubernetes): add native Kubernetes execution + prerequisite stack (cherry-pick #1245+#1274+#1280+#1322+#1325+#1326+#1347 to release/0.13.0)

[ajcasagrande]

Combined cherry-pick of:

• feat: control-plane groundwork for k8s execution — dead-component detection, result finalization, ZMQ reconnect #1325: feat: control-plane groundwork for k8s execution (9668416)
• feat(k8s): AIPerf goes k8s-native — operator, CRDs, JobSet execution, and the aiperf kube CLI #1326: feat(k8s): AIPerf goes k8s-native — operator, CRDs, JobSet execution, and the aiperf kube CLI (f481e5d)

Conflicts resolved against release/0.13.0 base (via prerequisite stack #1245→#1274→#1280→#1322→#1347).

Also includes prerequisite stack cherry-picks:

• fix(mmap): make get_conversation thread-safe, prefault pages, drop executor hop (fix(mmap): make get_conversation thread-safe, prefault pages, drop executor hop #1245)
• fix(dataset): restore random_pool batch-size support with --input-file (fix(dataset): restore random_pool batch-size support with --input-file #1274)
• fix(config): stop silently dropping CLI flags passed with --config (fix(config): stop silently dropping CLI flags passed with --config #1280)
• fix(test-harness): implement num_prompt_special_tokens on FakeTokenizer (fix(test-harness): implement num_prompt_special_tokens on FakeTokenizer #1322)
• feat: Support stateful responses API with previous_response_id chaining (feat: Support stateful responses API with previous_response_id chaining #1347)

Signed-off-by: Anthony Casagrande acasagrande@nvidia.com
Signed-off-by: Elias Bermudez dbermudez@nvidia.com
Signed-off-by: Jacob Murry jacobmurry@google.com
Co-authored-by: Xianjie Qiao 5410381+qiaoxj07@users.noreply.github.com
Co-authored-by: Elias Bermudez dbermudez@nvidia.com
Co-authored-by: Jacob Murry jacobmurry@google.com

---

_{Stack created with GitHub Stacks CLI • Give Feedback 💬}

[github-actions]

Try out this PR

Quick install:

pip install --upgrade --force-reinstall git+https://github.com/ai-dynamo/aiperf.git@f34ac152c75d2c801c18d4b98fee3cceb7289b35

Recommended with virtual environment (using uv):

uv venv --python 3.12 && source .venv/bin/activate
uv pip install --upgrade --force-reinstall git+https://github.com/ai-dynamo/aiperf.git@f34ac152c75d2c801c18d4b98fee3cceb7289b35

---

Last updated for commit: f34ac15 • Browse code

[github-actions]

Fern Docs Preview: https://nvidia-preview-01a05fe7-4ca2-7149-b196-25c13870ee27.docs.buildwithfern.com/aiperf/dev

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

[debermudez]

This is a combination of a bunch of PRs from the main branch. We combined them to simplify the cherry pick process.