Agentic CI: Issue & PR Triage Tracker #562

Activity

1. andreatnvidia

   pinned this issue on Apr 20, 2026
2. github-actions commented on May 11, 2026

   

   github-actionsBot

   on May 11, 2026 – with GitHub Actions

   Last edited by github-actions

   Contributor

   More actions

   Repository Triage Report — 2026-10-19

   Open issues: 54 | Open PRs: 5 | Healthy (no action needed): 18

   ---

   Close as resolved (0)

   No open issue has a merged PR that closes it. (#946 is only "Related to" in merged #955, which sharded the pools but left the transport-limit work open.)

   Close as duplicate (0)

   No clear duplicates. #92 and #1033 overlap partly; see below.

   Needs maintainer decision (9)

   #	Title	Action	Evidence	Rationale
   #92 / #1033	Support more Model Providers (VertexAI, Bedrock) / Responses API and Vertex AI	Decide whether #1033 supersedes #92	#1033 body says its Vertex section was "folded in from #92"	Two issues track the same Vertex scope; #92 also covers Bedrock, so this is only a partial overlap.
   #946	Decouple HTTP connection pool limits from max_parallel_requests	Re-scope or close	Author comment: capping pools at 768 cut throughput 10–12%; #955 merged as partial work	The latest results don't support the original fix.
   #1045	Parquet checkpointing adds null dictionary entries and rejects mixed JSON arrays	Decide approach	bug, needs-discussion, opened 3d ago	Bug filed with an explicit request for discussion.
   #711	Allow model providers to restrict workflows to approved models	Decide direction	needs-discussion, no activity since 2026-05-29	Policy feature without an agreed design.
   #677	Add first-class reranking model support	Decide direction	needs-discussion, no activity since 2026-05-19	New model type, scope undecided.
   #354	Add other common params to ChatCompletionInferenceParams	Decide which params	needs-discussion, updated 2026-09-23	The list of params to add is still open.
   #352	Control order of multi-modal context along with prompts	Decide direction	on-roadmap, needs-discussion	On the roadmap but the design isn't settled.
   #182	Improve validation in structured generation columns	Decide scope or close	needs-discussion, idle since 2026-01-30	Broad request with no agreed scope for 9 months.

   Ready for assignment (10)

   #	Title	Action	Evidence	Rationale
   #1048	get_models: build facades for the caller's model configs, with async clients	Assign	No assignee, opened 3d ago	Names the exact code path (get_models empty builder, SYNC clients).
   #1017	Codex rollout reader drops raw reasoning from open-model servers	Assign	bug, triaged, no assignee	Contained parser fix.
   #1010	Agent skills hide information in unspecified field	Assign	bug, low priority, no assignee	Move argument-hint content into fields the spec supports; small change.
   #996	drop flag on a column depends on order of add_column and add_processor	Assign	triaged, updated 2d ago	Root cause found in the builder's add_processor side effect.
   #994	Embedding column crashes on the stringified JSON list its docstring documents	Assign	bug, triaged, no assignee	Mismatch between docstring and parser; small fix.
   #956	Expose structured model cost/usage in DatasetCreationResults	Assign	enhancement, triaged, updated 2026-10-06	Clear result-API addition.
   #741	Public async runs cannot tune row-group horizon/adaptive admission	Assign	High-priority bug, updated 2026-10-06	Clear gap in the public RunConfig; needs an async scheduler owner.
   #503	Add request/response logging hook to native model client	Assign	Updated 2026-10-06, no assignee	Self-contained hook in the model client.
   #400	Enable non-existent tool fallback with MCP server	Assign	Updated 2026-10-06, no assignee	Recent activity; scope is narrow.
   #246	Update health-checks to account for multi-modality	Assign	Updated 2026-10-06, no assignee	Health checks need to cover modalities the workflow already declares.

   Stuck PR (2)

   #	Title	Action	Evidence	Rationale
   #943	fix(compiler): support columns_added and columns_removed in processor config (#394)	Review or nudge author	Last push 2026-09-17 (32d); only bot comments since	External fix for triaged #394 with no maintainer review yet.
   #1041	docs: clarify column dependency sources (fixes #1002)	Ask author to sign off commits	DCOAssistant check failing, still a draft	DCO sign-off is missing; otherwise active (3d old).

   Duplicate PRs (0)

   No issue is referenced by more than one open PR.

   Stale, consider closing (20)

   #	Title	Action	Evidence	Rationale
   #862	Support es_SV locale in PersonSampler	Close with note or triage	68d idle, no assignee	External request with no response.
   #860	Expose terminal failed-column and seed-row provenance in public results	Triage or close	68d idle	No traction.
   #837	chore: consolidate docs/ and fern/ into one tree	Triage or close	81d idle	Docs work with no owner.
   #804	Harden Agentic CI PR reviews for forked PRs	Triage or close	104d idle	No owner.
   #790	feat: generate an exact number of rows matching a criterion	Triage or close	110d idle	Feature with no follow-up.
   #760	enforce from __future__ import annotations via ruff FA102	Assign or close	122d idle; FA102 still not in ruff config	Small chore; good first issue if kept.
   #758	Native provider request support for non-chat plugin model calls	Triage or close	124d idle	No traction.
   #694	Consolidate user configuration into a single TOML file	Triage or close	103d idle	No traction.
   #695	Report per-column idle time in end-of-run metrics	Fold into epic #645 or close	151d idle	Overlaps the async observability epic.
   #660	Document async scheduling architecture	Fold into epic #645 or close	158d idle	plan, no owner.
   #651	Design resource-vector and provider-aware admission policies	Fold into epic #645 or close	151d idle	Spike with no owner.
   #659	uv tool update removes plugin installs	Triage or close	158d idle, bug	Unconfirmed bug, no response.
   #637	Split docs preview build and deploy workflows	Triage or close	159d idle	No traction.
   #619	Push datasets to Harbor Hub	Triage or close	165d idle	No traction.
   #601	tests: cover structural_impact.py pure helpers	Triage or close	168d idle	No owner.
   #573	Concrete schemas for all nemotron-personas datasets	Triage or close	178d idle	No traction.
   #563	Skill: auto-port custom columns to plugin packages	Triage or close	182d idle	No traction.
   #386	Add structured metadata to log records	Triage or close	192d idle	No traction.
   #362	Keep record fields that failed to parse as null	Triage or close	224d idle	May overlap open discussion #182.
   #211	Batch-level error rates for early shutdown	Confirm roadmap status	172d idle, on-roadmap	Roadmap item with no activity.

   ---

   Healthy items (15 issues, 3 PRs)

   • Structured-output parsing drops valid dictionary entries #1043 Structured-output parsing drops valid dictionary entries — thomlake — 2026-10-16 (assigned; PR fix: preserve dictionary entries in structured-output parsing #1046)
   • docs: required_columns description is incomplete for LLM and multimodal columns #1002 docs: required_columns description incomplete — Khprateek — 2026-10-16 (PR docs: clarify column dependency sources #1041)
   • Jinja2 templates cannot reference columns created by PRE_BATCH processors #394 Jinja2 templates cannot reference PRE_BATCH processor columns — andreatnvidia — 2026-09-23 (PR fix(compiler): support columns_added and columns_removed in processor config (#394) #943)
   • Run Slurm generation without a client image using a versioned vLLM serving image #969 Run Slurm generation without a client image — nabinchha — 2026-09-30 (assigned)
   • Harden Slurm inference routing, backpressure, and failover #966 Harden Slurm inference routing, backpressure, and failover — nabinchha — 2026-09-29 (assigned)
   • Persist allocation-local performance telemetry for Slurm runs and benchmarks #947 Persist allocation-local performance telemetry for Slurm runs — andreatnvidia — 2026-09-17 (Slurm epic Epic: Slurm batch execution v1 #850)
   • Add keyed execution for group-scoped consistent generation #885 Add keyed execution for group-scoped consistent generation — andreatnvidia — 2026-08-21 (becomes stale in 1d)
   • Harden the Slurm runtime and validate sealed release artifacts #870 Harden the Slurm runtime and validate sealed release artifacts — nabinchha — 2026-08-15 (assigned)
   • Epic: Slurm batch execution v1 #850 Epic: Slurm batch execution v1 — andreatnvidia — 2026-09-29 (active epic)
   • refactor: interface-layer OpenTelemetry runtime follow-ups deferred from #802 #809 refactor: interface-layer OpenTelemetry follow-ups — nabinchha — 2026-07-08 (assigned)
   • Public async runs do not expose capacity diagnostics needed to explain endpoint idle time #727 Public async runs lack capacity diagnostics — eric-tramel — 2026-09-17 (assigned)
   • Epic: Async Scheduling Resource Metadata, Admission, and Observability #645 Epic: Async Scheduling Resource Metadata — eric-tramel — 2026-05-14 (assigned)
   • refactor: introduce AsyncRunController and explicit sinks for async build/preview #447 refactor: introduce AsyncRunController — andreatnvidia — 2026-03-25 (assigned)
   • Add more stages to processors, and allow for custom processors via callbacks #159 Add more stages to processors — andreatnvidia — 2026-03-02 (assigned)
   • Agentic CI: Issue & PR Triage Tracker #562 Agentic CI: Issue & PR Triage Tracker — andreatnvidia — 2026-10-12 (tracking issue)
   • PR docs(agentic-ci): fix ModelFacade image method names in models.md #1049 docs(agentic-ci): fix ModelFacade image method names — github-actions — 2026-10-19
   • PR fix: preserve dictionary entries in structured-output parsing #1046 fix: preserve dictionary entries in structured-output parsing — nabinchha — 2026-10-16
   • PR feat(slurm): integrate Slurm execution for 1.0.0 release #1040 feat(slurm): integrate Slurm execution for 1.0.0 (draft) — nabinchha — 2026-10-16

   Summary

   • 41 items flagged for action across 7 buckets (9 decision, 10 ready, 2 stuck PRs, 20 stale)
   • 2 PRs flagged (2 stuck, 0 duplicate)
   • 18 healthy items (collapsed above)
   • Repeatedly-failed fix attempts: not evaluated (.agentic-ci-state/ not available in this run)
3. NVIDIA-NeMo

   deleted a comment from github-actions on May 12, 2026