v2.0.0 Advanced ML, RL Policy Optimization & Real-World Integration

v2.0.0 — Advanced ML, RL Policy Optimization & Real-World Integration

Major release adding GPU-accelerated model training, reinforcement learning–based policy search, live HPC cluster connectors, and a full documentation site.

Performance Breakthroughs

• LightGBM backend: 50× faster model training (7.6s vs 383s), GPU acceleration on NVIDIA GPUs
• RL policy search: 25.5% improvement over EASY_BACKFILL (p95 BSLD 2.85 vs 3.82)
• Ensemble predictor: Multi-backend auto-weighting via inverse pinball loss

Real-World Integration

• Slurm live connector — reads sacct/squeue, converts to canonical format, runs predictions
• PBS Pro live connector — parses qstat JSON output with full job state tracking
• Prediction feedback loop — JSONL persistence, interval coverage tracking, model drift detection with retraining alerts
• Prometheus metrics exporter — zero-dependency /metrics endpoint, FastAPI mountable, Grafana-ready

Documentation Site

• MkDocs Material theme with dark/light mode
• 8 tutorials: quickstart, installation, Rust engine, benchmarks, LightGBM, RL search, live integration, deployment
• Interactive benchmark dashboard (docs/dashboard.html)

Code Quality

• Ruff lint: 0 errors (85+ fixes applied)
• Mypy type-check: 0 errors (5 type fixes)
• 314 unit tests passing
• ruff format applied project-wide

New Files

File	Purpose
python/hpcopt/models/ensemble.py	Multi-backend ensemble predictor
python/hpcopt/simulate/rl_env.py	Gym-like RL scheduling environment
python/hpcopt/integrations/slurm_connector.py	Live Slurm adapter
python/hpcopt/integrations/pbs_connector.py	Live PBS Pro adapter
python/hpcopt/integrations/feedback.py	Prediction accuracy tracker
python/hpcopt/integrations/metrics_exporter.py	Prometheus exporter
mkdocs.yml	Documentation site config
docs/tutorials/*.md	8 tutorial pages
docs/dashboard.html	Interactive results dashboard

Key Metrics

Metric	Value
Simulation speedup (Rust)	16,000–51,000×
Training speedup (LightGBM)	50×
Scheduling quality (RL vs EASY)	+25.5%
BSLD improvement (EASY vs FIFO)	92–99.6%
Unit tests	314 passing

Full Changelog: v1.2.0...v2.0.0