Implement Bot Detection Avoidance

[myinusa]

Description

Implement mechanisms to avoid bot detection when fetching titles from websites.

Tasks

• Research common bot detection mechanisms
• Implement browser-like request headers
• Add user agent rotation
• Create delay mechanism between requests
• Implement session handling for sites requiring cookies
• Add specific handling for Cloudflare protection

Acceptance Criteria

• Extension can fetch titles from sites with basic bot detection
• Browser-like request headers are properly implemented
• User agent rotation works correctly
• Delay mechanism prevents rate limiting
• Session handling works for sites requiring cookies
• Cloudflare-protected sites can be accessed

Estimated Effort

4 days