🧹 Add robots.txt to prevent indexing of log/todo files

[fusion94]

Description

Files like server.log, todo.md, and any other internal files should not be indexed by search engines. A robots.txt file should either already exist and disallow these, or be created.

Recommended robots.txt

User-agent: *
Disallow: /server.log
Disallow: /todo.md
Disallow: /CLAUDE.md
Allow: /

Sitemap: https://collectorsplaybook.com/sitemap.xml

Acceptance Criteria

• robots.txt exists at site root
• Internal files disallowed from indexing
• Sitemap URL referenced