Add Stela (DeepSeek-V4.1-Flash) to leaderboard at 0.8114 (PR #103)

Re-validated all 270 answers with each query's validate.py: stratified
Pass@1 0.8114, micro 227/270, matching the submitter's own scoring.

Leakage review clean on all paths. Opening prompt is byte-exact benchmark
content for all 54 queries; system prompt supplied in the PR is invariant
across all 270 trials; no external fetches, no off-limits reads, and no
passing trial whose gold value is absent from its recorded tool output.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01T6J6ZXiLTnDedsjPP3PnxK

Author: Ruiying-Ma

README.md

@@ -42,36 +42,37 @@ Unlike prior SQL-only or single-database benchmarks, DAB stresses agents under *
 | <sub>7</sub> | <sub>Sarvam Code v0.36 (GLM-5.2)</sub> | <sub>✓</sub> | <sub>0.8208</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-07-28</sub> | <sub>[#75](https://github.com/ucbepic/DataAgentBench/pull/75)</sub> |
 | <sub>8</sub> | <sub>DataTrail v1 (Muse-Spark-1.3, medium effort)</sub> | <sub>✓</sub> | <sub>0.8201</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-09-13</sub> | <sub>[#104](https://github.com/ucbepic/DataAgentBench/pull/104)</sub> |
 | <sub>9</sub> | <sub>SCRIBE (Actioneer) (Claude-Opus-4.7)</sub> | <sub>✓</sub> | <sub>0.8185</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-06-26</sub> | <sub>[#67](https://github.com/ucbepic/DataAgentBench/pull/67)</sub> |
-| <sub>10</sub> | <sub>Alkera (Claude-Opus-4.8)</sub> | <sub>✓</sub> | <sub>0.8044</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-07-15</sub> | <sub>[#69](https://github.com/ucbepic/DataAgentBench/pull/69)</sub> |
-| <sub>11</sub> | <sub>LabRat (Claude-Opus-5 + Cartographer) ⁶</sub> | <sub>✓</sub> | <sub>0.8018</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-08-03</sub> | <sub>[#84](https://github.com/ucbepic/DataAgentBench/pull/84)</sub> |
-| <sub>12</sub> | <sub>Spacedock (Recce) (GPT-5.5)</sub> | <sub></sub> | <sub>0.7850</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-06-23</sub> | <sub>[#63](https://github.com/ucbepic/DataAgentBench/pull/63)</sub> |
-| <sub>13</sub> | <sub>Sarvam Code v0.35 (GLM-5.2)</sub> | <sub>✓</sub> | <sub>0.7812</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-07-27</sub> | <sub>[#74](https://github.com/ucbepic/DataAgentBench/pull/74)</sub> |
-| <sub>14</sub> | <sub>LabRat (GPT-5.6-Luna-Max + Cartographer)</sub> | <sub></sub> | <sub>0.7751</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-07-16</sub> | <sub>[#72](https://github.com/ucbepic/DataAgentBench/pull/72)</sub> |
-| <sub>15</sub> | <sub>Altimate Code (GPT-5.5 + Claude Sonnet 4.6)</sub> | <sub></sub> | <sub>0.7588</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-06-01</sub> | <sub>[#53](https://github.com/ucbepic/DataAgentBench/pull/53)</sub> |
-| <sub>16</sub> | <sub>Phoenix-CLI (Claude-Opus-5)</sub> | <sub></sub> | <sub>0.7556</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-09-04</sub> | <sub>[#94](https://github.com/ucbepic/DataAgentBench/pull/94)</sub> |
-| <sub>17</sub> | <sub>AgenDA (Claude-Opus-4.8)</sub> | <sub></sub> | <sub>0.7244</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-07-10</sub> | <sub>[#68](https://github.com/ucbepic/DataAgentBench/pull/68)</sub> |
-| <sub>18</sub> | <sub>Qwen3.8-Flash-Next</sub> | <sub></sub> | <sub>0.7087</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-09-12</sub> | <sub>[#99](https://github.com/ucbepic/DataAgentBench/pull/99)</sub> |
-| <sub>19</sub> | <sub>fabric-rlm (GPT-5.6-Luna-Max) ⁵</sub> | <sub></sub> | <sub>0.6956</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-07-31</sub> | <sub>[#76](https://github.com/ucbepic/DataAgentBench/pull/76)</sub> |
-| <sub>20</sub> | <sub>Altimate Code (Claude-Sonnet-4.6)</sub> | <sub></sub> | <sub>0.6822</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-05-10</sub> | <sub>[#44](https://github.com/ucbepic/DataAgentBench/pull/44)</sub> |
-| <sub>21</sub> | <sub>Spacedock (Recce) (Claude-Opus-4.8)</sub> | <sub></sub> | <sub>0.6804</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-06-08</sub> | <sub>[#55](https://github.com/ucbepic/DataAgentBench/pull/55)</sub> |
-| <sub>22</sub> | <sub>MinusX (Claude Sonnet 4.6 + GPT5.5-mini + Claude Haiku 4.5)</sub> | <sub></sub> | <sub>0.6601</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-05-21</sub> | <sub>[#50](https://github.com/ucbepic/DataAgentBench/pull/50)</sub> |
-| <sub>23</sub> | <sub>DataBridge (GLM-5.2)</sub> | <sub>✓</sub> | <sub>0.6137</sub> | <sub>6</sub> | <sub>✓</sub> | <sub>2026-06-22</sub> | <sub>[#61](https://github.com/ucbepic/DataAgentBench/pull/61)</sub> |
-| <sub>24</sub> | <sub>Pi Coding Agent (Claude-Opus-4.6)</sub> | <sub></sub> | <sub>0.6103</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-04-21</sub> | <sub>[#31](https://github.com/ucbepic/DataAgentBench/pull/31)</sub> |
-| <sub>25</sub> | <sub>LabRat (Claude-Sonnet-4.6 + Cartographer)</sub> | <sub></sub> | <sub>0.6088</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-06-24</sub> | <sub>[#65](https://github.com/ucbepic/DataAgentBench/pull/65)</sub> |
-| <sub>26</sub> | <sub>PromptQL (Gemini-3.1-Pro)</sub> | <sub></sub> | <sub>0.6000</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-03-18</sub> | <sub>[#24](https://github.com/ucbepic/DataAgentBench/pull/24)</sub> |
-| <sub>27</sub> | <sub>PromptQL (Claude-Opus-4.6)</sub> | <sub></sub> | <sub>0.5933</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-03-02</sub> | <sub>[#23](https://github.com/ucbepic/DataAgentBench/pull/23)</sub> |
-| <sub>28</sub> | <sub>Spacedock (Recce) (Claude-Opus-4.6)</sub> | <sub></sub> | <sub>0.5828</sub> | <sub>5</sub> | <sub></sub> | <sub>2026-05-08</sub> | <sub>[#47](https://github.com/ucbepic/DataAgentBench/pull/47)</sub> |
-| <sub>29</sub> | <sub>Claude-Opus-4.6</sub> | <sub></sub> | <sub>0.5551</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-03-18</sub> | <sub>[#22](https://github.com/ucbepic/DataAgentBench/pull/22)</sub> |
-| <sub>30</sub> | <sub>LabRat (Claude-Sonnet-4.6) ²</sub> | <sub></sub> | <sub>0.5138</sub> | <sub>5</sub> | <sub></sub> | <sub>2026-06-01</sub> | <sub>[#54](https://github.com/ucbepic/DataAgentBench/pull/54)</sub> |
-| <sub>31</sub> | <sub>Oracle Forge — Team PaLM (Gemini-3.1-Pro-Preview) ³</sub> | <sub></sub> | <sub>0.4721</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-05-10</sub> | <sub>[#37](https://github.com/ucbepic/DataAgentBench/pull/37)</sub> |
-| <sub>32</sub> | <sub>Gemini-3-Pro</sub> | <sub></sub> | <sub>0.4663</sub> | <sub>50</sub> | <sub>✓</sub> | <sub>2026-03-02</sub> | <sub>—</sub> |
-| <sub>33</sub> | <sub>nQuery (gpt-oss-safeguard-120b) NGENUX SOLUTIONS PVT LTD</sub> | <sub></sub> | <sub>0.4547</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-07-02</sub> | <sub>[#56](https://github.com/ucbepic/DataAgentBench/pull/56)</sub> |
-| <sub>34</sub> | <sub>Oracle Forge — Tenacious Intelligence (Claude-Sonnet-4.6) ⁴</sub> | <sub></sub> | <sub>0.4464</sub> | <sub>5–7</sub> | <sub></sub> | <sub>2026-04-21</sub> | <sub>[#32](https://github.com/ucbepic/DataAgentBench/pull/32)</sub> |
-| <sub>35</sub> | <sub>GPT-5-mini</sub> | <sub></sub> | <sub>0.3663</sub> | <sub>50</sub> | <sub>✓</sub> | <sub>2026-03-02</sub> | <sub>—</sub> |
-| <sub>36</sub> | <sub>GPT-5.2</sub> | <sub></sub> | <sub>0.2991</sub> | <sub>50</sub> | <sub>✓</sub> | <sub>2026-03-02</sub> | <sub>—</sub> |
-| <sub>37</sub> | <sub>Kimi-K2</sub> | <sub></sub> | <sub>0.2925</sub> | <sub>50</sub> | <sub>✓</sub> | <sub>2026-03-02</sub> | <sub>—</sub> |
-| <sub>38</sub> | <sub>Oracle Forge — Team Cohere (Gemini-2.0-Flash)</sub> | <sub></sub> | <sub>0.1671</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-04-21</sub> | <sub>[#38](https://github.com/ucbepic/DataAgentBench/pull/38)</sub> |
-| <sub>39</sub> | <sub>Gemini-2.5-Flash</sub> | <sub></sub> | <sub>0.1049</sub> | <sub>50</sub> | <sub>✓</sub> | <sub>2026-03-02</sub> | <sub>—</sub> |
+| <sub>10</sub> | <sub>Stela (DeepSeek-V4.1-Flash, max effort)</sub> | <sub>✓</sub> | <sub>0.8114</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-09-13</sub> | <sub>[#103](https://github.com/ucbepic/DataAgentBench/pull/103)</sub> |
+| <sub>11</sub> | <sub>Alkera (Claude-Opus-4.8)</sub> | <sub>✓</sub> | <sub>0.8044</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-07-15</sub> | <sub>[#69](https://github.com/ucbepic/DataAgentBench/pull/69)</sub> |
+| <sub>12</sub> | <sub>LabRat (Claude-Opus-5 + Cartographer) ⁶</sub> | <sub>✓</sub> | <sub>0.8018</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-08-03</sub> | <sub>[#84](https://github.com/ucbepic/DataAgentBench/pull/84)</sub> |
+| <sub>13</sub> | <sub>Spacedock (Recce) (GPT-5.5)</sub> | <sub></sub> | <sub>0.7850</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-06-23</sub> | <sub>[#63](https://github.com/ucbepic/DataAgentBench/pull/63)</sub> |
+| <sub>14</sub> | <sub>Sarvam Code v0.35 (GLM-5.2)</sub> | <sub>✓</sub> | <sub>0.7812</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-07-27</sub> | <sub>[#74](https://github.com/ucbepic/DataAgentBench/pull/74)</sub> |
+| <sub>15</sub> | <sub>LabRat (GPT-5.6-Luna-Max + Cartographer)</sub> | <sub></sub> | <sub>0.7751</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-07-16</sub> | <sub>[#72](https://github.com/ucbepic/DataAgentBench/pull/72)</sub> |
+| <sub>16</sub> | <sub>Altimate Code (GPT-5.5 + Claude Sonnet 4.6)</sub> | <sub></sub> | <sub>0.7588</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-06-01</sub> | <sub>[#53](https://github.com/ucbepic/DataAgentBench/pull/53)</sub> |
+| <sub>17</sub> | <sub>Phoenix-CLI (Claude-Opus-5)</sub> | <sub></sub> | <sub>0.7556</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-09-04</sub> | <sub>[#94](https://github.com/ucbepic/DataAgentBench/pull/94)</sub> |
+| <sub>18</sub> | <sub>AgenDA (Claude-Opus-4.8)</sub> | <sub></sub> | <sub>0.7244</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-07-10</sub> | <sub>[#68](https://github.com/ucbepic/DataAgentBench/pull/68)</sub> |
+| <sub>19</sub> | <sub>Qwen3.8-Flash-Next</sub> | <sub></sub> | <sub>0.7087</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-09-12</sub> | <sub>[#99](https://github.com/ucbepic/DataAgentBench/pull/99)</sub> |
+| <sub>20</sub> | <sub>fabric-rlm (GPT-5.6-Luna-Max) ⁵</sub> | <sub></sub> | <sub>0.6956</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-07-31</sub> | <sub>[#76](https://github.com/ucbepic/DataAgentBench/pull/76)</sub> |
+| <sub>21</sub> | <sub>Altimate Code (Claude-Sonnet-4.6)</sub> | <sub></sub> | <sub>0.6822</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-05-10</sub> | <sub>[#44](https://github.com/ucbepic/DataAgentBench/pull/44)</sub> |
+| <sub>22</sub> | <sub>Spacedock (Recce) (Claude-Opus-4.8)</sub> | <sub></sub> | <sub>0.6804</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-06-08</sub> | <sub>[#55](https://github.com/ucbepic/DataAgentBench/pull/55)</sub> |
+| <sub>23</sub> | <sub>MinusX (Claude Sonnet 4.6 + GPT5.5-mini + Claude Haiku 4.5)</sub> | <sub></sub> | <sub>0.6601</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-05-21</sub> | <sub>[#50](https://github.com/ucbepic/DataAgentBench/pull/50)</sub> |
+| <sub>24</sub> | <sub>DataBridge (GLM-5.2)</sub> | <sub>✓</sub> | <sub>0.6137</sub> | <sub>6</sub> | <sub>✓</sub> | <sub>2026-06-22</sub> | <sub>[#61](https://github.com/ucbepic/DataAgentBench/pull/61)</sub> |
+| <sub>25</sub> | <sub>Pi Coding Agent (Claude-Opus-4.6)</sub> | <sub></sub> | <sub>0.6103</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-04-21</sub> | <sub>[#31](https://github.com/ucbepic/DataAgentBench/pull/31)</sub> |
+| <sub>26</sub> | <sub>LabRat (Claude-Sonnet-4.6 + Cartographer)</sub> | <sub></sub> | <sub>0.6088</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-06-24</sub> | <sub>[#65](https://github.com/ucbepic/DataAgentBench/pull/65)</sub> |
+| <sub>27</sub> | <sub>PromptQL (Gemini-3.1-Pro)</sub> | <sub></sub> | <sub>0.6000</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-03-18</sub> | <sub>[#24](https://github.com/ucbepic/DataAgentBench/pull/24)</sub> |
+| <sub>28</sub> | <sub>PromptQL (Claude-Opus-4.6)</sub> | <sub></sub> | <sub>0.5933</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-03-02</sub> | <sub>[#23](https://github.com/ucbepic/DataAgentBench/pull/23)</sub> |
+| <sub>29</sub> | <sub>Spacedock (Recce) (Claude-Opus-4.6)</sub> | <sub></sub> | <sub>0.5828</sub> | <sub>5</sub> | <sub></sub> | <sub>2026-05-08</sub> | <sub>[#47](https://github.com/ucbepic/DataAgentBench/pull/47)</sub> |
+| <sub>30</sub> | <sub>Claude-Opus-4.6</sub> | <sub></sub> | <sub>0.5551</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-03-18</sub> | <sub>[#22](https://github.com/ucbepic/DataAgentBench/pull/22)</sub> |
+| <sub>31</sub> | <sub>LabRat (Claude-Sonnet-4.6) ²</sub> | <sub></sub> | <sub>0.5138</sub> | <sub>5</sub> | <sub></sub> | <sub>2026-06-01</sub> | <sub>[#54](https://github.com/ucbepic/DataAgentBench/pull/54)</sub> |
+| <sub>32</sub> | <sub>Oracle Forge — Team PaLM (Gemini-3.1-Pro-Preview) ³</sub> | <sub></sub> | <sub>0.4721</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-05-10</sub> | <sub>[#37](https://github.com/ucbepic/DataAgentBench/pull/37)</sub> |
+| <sub>33</sub> | <sub>Gemini-3-Pro</sub> | <sub></sub> | <sub>0.4663</sub> | <sub>50</sub> | <sub>✓</sub> | <sub>2026-03-02</sub> | <sub>—</sub> |
+| <sub>34</sub> | <sub>nQuery (gpt-oss-safeguard-120b) NGENUX SOLUTIONS PVT LTD</sub> | <sub></sub> | <sub>0.4547</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-07-02</sub> | <sub>[#56](https://github.com/ucbepic/DataAgentBench/pull/56)</sub> |
+| <sub>35</sub> | <sub>Oracle Forge — Tenacious Intelligence (Claude-Sonnet-4.6) ⁴</sub> | <sub></sub> | <sub>0.4464</sub> | <sub>5–7</sub> | <sub></sub> | <sub>2026-04-21</sub> | <sub>[#32](https://github.com/ucbepic/DataAgentBench/pull/32)</sub> |
+| <sub>36</sub> | <sub>GPT-5-mini</sub> | <sub></sub> | <sub>0.3663</sub> | <sub>50</sub> | <sub>✓</sub> | <sub>2026-03-02</sub> | <sub>—</sub> |
+| <sub>37</sub> | <sub>GPT-5.2</sub> | <sub></sub> | <sub>0.2991</sub> | <sub>50</sub> | <sub>✓</sub> | <sub>2026-03-02</sub> | <sub>—</sub> |
+| <sub>38</sub> | <sub>Kimi-K2</sub> | <sub></sub> | <sub>0.2925</sub> | <sub>50</sub> | <sub>✓</sub> | <sub>2026-03-02</sub> | <sub>—</sub> |
+| <sub>39</sub> | <sub>Oracle Forge — Team Cohere (Gemini-2.0-Flash)</sub> | <sub></sub> | <sub>0.1671</sub> | <sub>5</sub> | <sub>✓</sub> | <sub>2026-04-21</sub> | <sub>[#38](https://github.com/ucbepic/DataAgentBench/pull/38)</sub> |
+| <sub>40</sub> | <sub>Gemini-2.5-Flash</sub> | <sub></sub> | <sub>0.1049</sub> | <sub>50</sub> | <sub>✓</sub> | <sub>2026-03-02</sub> | <sub>—</sub> |
 
 <sub>**¹ Methodology.** DEPS_DEV_V1 query 1 re-scored on 2026-08-18 by re-running its `validate.py` against a revised validator (accepting any of the 95 packages tied at fifth place on 57779 stars rather than the single tied package recorded in `ground_truth.csv`, see issue #86), from the same submission JSONs, with no other query changed. All Pass@1 scores recomputed on 2026-06-12 by re-running each query's `validate.py` against the current validators (including the regenerated PATENTS ground truths), from the submission JSONs stored in this repository (`submissions/`, `leaderboard_submissions/`) or in the corresponding submission PR branches (`refs/pull/<N>/head`). Pass@1 is the mean over datasets of each dataset's average per-query pass rate.</sub>