Skip to content

docs: doc-claim drift detected on 2026-06-29 - #16

Open
NickCrew wants to merge 1 commit into
mainfrom
docs/drift-2026-06-29
Open

docs: doc-claim drift detected on 2026-06-29#16
NickCrew wants to merge 1 commit into
mainfrom
docs/drift-2026-06-29

Conversation

@NickCrew

Copy link
Copy Markdown
Collaborator

Summary

Automated doc-drift audit (2026-06-29) found 21 verifiable claim failures across 10 of the 12 audited doc files.

Severity Count Description
P0 1 User-facing factual error (README DEMO_MODE default)
P1 16 Dev-doc errors that would mislead contributors or break workflows
P2 4 Minor staleness / internal inconsistencies

Highlights

  • P0 — README.md:47: DEMO_MODE default documented as strict; actual default in app/config.py is full. Running without DEMO_MODE set activates all vulnerabilities contrary to what the published README states.
  • DEMO_MODE default wrong in 5 files: README.md, docs/architecture.md, docs/developer-guide.md, apps/vuln-api/AGENTS.md, apps/vuln-api/API-DOCUMENTATION.md — all claim strict or true; code says full.
  • Nginx proxy claim in 2 AGENTS.md files: Both root and apps/vuln-api/AGENTS.md claim nginx handles the production proxy; the Starlette app serves the SPA directly with no nginx.
  • security.py referenced as Starlette gating (apps/vuln-api/AGENTS.md:94-98): that file is Flask-era (from flask import jsonify, request) and unused by the Starlette app.
  • 6 broken/nonexistent references in apps/vuln-api/tests/README.md: nonexistent tests/vulnerability/ directory, run_tests.sh, pytest.ini, wrong coverage thresholds, wrong pytest marker, and stale conftest fixture list.
  • Dead recipe just docs-drift cited in docs/endpoints-catalog.md; correct recipe is just -f apps/vuln-api/justfile docs-check.

Backlog Task

All 21 findings with exact file locations, quoted claims, code evidence, and proposed fixes are tracked in:

backlog/tasks/task-17 - Doc-drift-detected-2026-06-29.md

This PR adds only the task file. No doc files were modified — fixes are left to a human reviewer per the drift-detector protocol.


Generated by Claude Code

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant