WIP: eval: per-episode metric sort UI on gallery index#461

Merged

eugenevinitsky merged 26 commits into

emerge/temp_trainingfrom

May 30, 2026

Commits on May 28, 2026

drive: map_dir accepts a single .bin; validation_replay enable flag; yaml smoke test

Eugene Vinitsky
and
claude
committed
test_single_agent_yaml: ruff format

Eugene Vinitsky
and
claude
committed
test_single_agent_yaml: drop history-of-change prose from docstrings

Eugene Vinitsky
and
claude
committed
test_single_agent_yaml: drop value-spot-checks; keep argparse smoke

Eugene Vinitsky
and
claude
committed
drive: guard isfile() so map_dir=None falls through to listdir path

Eugene Vinitsky
and
claude
committed
test_drive_scenario_length: pass real map_dir so the test actually runs

Eugene Vinitsky
and
claude
committed
drive: disable validation_gigaflow eval in single-agent yaml

Eugene Vinitsky
and
claude
committed
Merge origin/emerge/temp_training into ev/single_agent_runs

Eugene Vinitsky
and
claude
committed

Commits on May 29, 2026

drive: add [eval.dnf_triage] evaluator for triage_html rollout viz

Eugene Vinitsky
and
claude
committed
drive: single-agent triage_html eval rendering via yaml override

Eugene Vinitsky
and
claude
committed
Merge emerge/temp_training into ev/dnf-triage (resolve yaml to keep triage_html eval enabled)
Eugene Vinitsky
committed
eval: include scenarios_done counter in triage_html filename stem

Eugene Vinitsky
and
claude
committed
eval: build the gallery index for triage_html too (was obs_html-only)

Eugene Vinitsky
and
claude
committed
yaml: switch single-agent eval render to obs_html

Eugene Vinitsky
and
claude
committed
drive: per-episode dnf_rate in CompletedEpisodeSummary

authored and
Eugene Vinitsky
committed
eval: per-episode metric sort UI on gallery index.html

Eugene Vinitsky
and
claude
committed
eval: fix gallery-sort helper using Path.name instead of unimported os
Eugene Vinitsky
committed

Commits on May 30, 2026

eval: import viz inside _render_pass_html

Eugene Vinitsky
and
claude
committed
eval: hoist viz import to module-level

Eugene Vinitsky
and
claude
committed
viz: accept any .html file in the gallery index, sort lexicographically

Eugene Vinitsky
and
claude
committed
drive.ini: pin validation eval num_agents=1024, dnf_triage to single-agent

Eugene Vinitsky
and
claude
committed
eval: write per-episode CSV before render so the gallery reads this run's metrics

Eugene Vinitsky
and
claude
committed
viz: render pooled road-edge slots in red, lanes in teal

Eugene Vinitsky
and
claude
committed
eval: pair gallery metrics over all episodes, not just episode_index=0

Eugene Vinitsky
and
claude
committed
eval: gallery FILE_METRICS from render-pass info, not the metric-pass CSV

Eugene Vinitsky
and
claude
committed
viz: ruff-format build_gallery_index

Eugene Vinitsky
and
claude
committed