Skip to content

Latest commit

 

History

History
53 lines (39 loc) · 1.64 KB

File metadata and controls

53 lines (39 loc) · 1.64 KB

RESULTS.md — Verified Paper Metrics

Generated by analysis/produce_paper_metrics.py. All numbers in the paper should come from here.

Checkpoint: model_ckpts/model_final_30_conditioned.pth Test set: N = 39189 samples Extinction threshold (for generated): θ = 0.005

Reconstruction

Metric Value 95% CI
$R^2$ normalized (pooled, all timepoints) 0.9335
$R^2$ normalized (per-sample mean) 0.9219 [0.9214, 0.9224]
$R^2$ original scale (pooled) 0.9654
MAE normalized 0.0541
MSE normalized 0.00589

Per-curve $R^2$ (normalized): 0.936, 0.935, 0.933, 0.918, 0.931, 0.938, 0.936

Max-value prediction (curves 1–6)

Metric Value 95% CI
Pooled $R^2$ 0.9711 [0.9709, 0.9713]

Per-curve $R^2$: 0.946, 0.946, 0.928, 0.907, 0.869, 0.783

Latent space

Metric Value
Active dims (var ≥ 0.01) 25 / 30
Collapsed dims 5 / 30
PCs for 90% / 95% / 99% var 20 / 22 / 23

LV adherence (n = 2000)

Source Mean 95% CI Median % > 0.9 % > 0.95
Real test data 0.9875 [0.9869, 0.9881] 0.9913 99.7% 97.8%
Generated (raw) 0.9588 [0.9560, 0.9615] 0.9868 85.7% 76.8%
Generated (θ=0.005) 0.9680 [0.9660, 0.9701] 0.9876 91.5% 80.5%

Novelty (nearest-neighbor distance, Euclidean on flattened curves)

Distance Mean
Generated → nearest train 3.4295
Generated → nearest test 3.4402
Test → nearest train (baseline) 3.6235
Generated internal NN 3.8751
Memorization ratio (gen/train ÷ test/train) 0.946