Issues

• cvdp_agentic_arithmetic_progression_generator_0001: zero-length output-width requirement exists only in the harness

  NVlabs/cvdp_benchmark#61 · Filter by author malikakarsh opened on Oct 5, 2026

• Four cid003 harnesses pass designs that ignore their inputs (factorial, complex_multiplier, dbi, fibonacci_series)

  NVlabs/cvdp_benchmark#60 · Filter by author adithayyil opened on Oct 4, 2026

• cvdp_agentic_fixed_arbiter_0001: golden uses async reset (spec requires sync); Test Case 8 samples before NBA updates are visible to cocotb, causing standard nonblocking synchronous-reset designs to fail.

  NVlabs/cvdp_benchmark#59 · Filter by author malikakarsh opened on Sep 26, 2026

• Heavy agentic tasks omit referenced docs/ files from the agent workspace

  NVlabs/cvdp_benchmark#58 · Filter by author Hinataee opened on Sep 18, 2026

• static_branch_predict formal interface omits register_addr_i required by harness

  NVlabs/cvdp_benchmark#57 · Filter by author ZeeMo-PKU opened on Sep 2, 2026

• CVDP testbenches have inconsistent DUT parameter assumptions and failure reporting

  NVlabs/cvdp_benchmark#55 · Filter by author lihaozhang01 opened on Aug 21, 2026

• cid14: system prompt asks for assertions only, but the response replaces the whole RTL file — model ranking is decided by format compliance, not assertion quality

  bug
  Bug

  NVlabs/cvdp_benchmark#53 · Filter by author wh31607 opened on Aug 8, 2026
  1

  

• Academic request for withheld reference solutions (golden RTL as coverage DUTs)

  NVlabs/cvdp_benchmark#52 · Filter by author n-i-c-k-s opened on Jul 19, 2026
  1

• cid016 potential missing files

  dataset
  NVlabs/cvdp_benchmark#44 · Filter by author npfet opened on Mar 17, 2026

• Example agentic dataset prompt is wrong

  dataset
  NVlabs/cvdp_benchmark#42 · Filter by author ibnelwalid opened on Mar 14, 2026

• Typo in system prompt when running local export --> "You are a helpful assistance."

  dataset
  NVlabs/cvdp_benchmark#40 · Filter by author arti4nvj opened on Feb 23, 2026

• Improvement to Problem Formulation CID005

  dataset
  NVlabs/cvdp_benchmark#37 · Filter by author jan-o-e opened on Jan 23, 2026

• CLI agents fail due to missing TTY allocation in Docker containers

  NVlabs/cvdp_benchmark#34 · Filter by author Surya-Gunukula opened on Dec 19, 2025
  2

• Docs: Clarify what "issue_id" means

  dataset
  NVlabs/cvdp_benchmark#27 · Filter by author parker-research opened on Oct 27, 2025
  1

• Request: Run run ruff autoformatter and linter on the codebase

  dataset
  NVlabs/cvdp_benchmark#26 · Filter by author parker-research opened on Oct 27, 2025
  2

• Add support for other simulators beyond Xcelium

  enhancement
  Feature

  NVlabs/cvdp_benchmark#19 · Filter by author npfet opened on Sep 16, 2025
  4

  

• Add memory quotas to Docker runs

  enhancement
  Feature

  NVlabs/cvdp_benchmark#18 · Filter by author npfet opened on Sep 16, 2025
  4

  

• Problem runing the local non-agentic non-comercial benchmark

  NVlabs/cvdp_benchmark#15 · Filter by author jezabel-garcia opened on Sep 2, 2025
  2

• Potential grading issue in cvdp_agentic_async_fifo_compute_ram_application_0004 due to additonal Xcelium config

  dataset
  NVlabs/cvdp_benchmark#11 · Filter by author KiBk opened on Aug 8, 2025
  4

• Fix --answers flag

  Task

  NVlabs/cvdp_benchmark#8 · Filter by author npfet opened on Aug 1, 2025