fix(demo): cleanup and fix some features of ShiftIQ demo

[tylerhutcherson]

Note

Medium Risk
Touches Redis Streams SSE handling and the data import pipeline (batching + optional Redis key deletion), which could affect demo runtime behavior and data integrity if misconfigured.

Overview
Improves the ShiftIQ finance-researcher demo’s live update flow by adding an internal tool, recent_watchlist_events, that reads the newest Redis Stream entries and normalizes legacy event fields (payload JSON, company_id, document_id, and importance_score). The finance-researcher prompt/docs are updated to route “what’s new” questions through this stream-backed tool, and the random event publisher now emits compatible IDs and (for SEC filings) links to the latest loaded ResearchDocument.

Hardens backend streaming and loading: SSE event streaming now uses a shorter DOMAIN_EVENT_BLOCK_MS and explicitly handles Redis timeouts with keepalive comments, and scripts/load_data.py now supports configurable import batching plus an optional --clear-existing mode to delete domain-owned Redis keys before reimport. The Makefile threads through LOAD_DATA_ARGS and sets DEMO_DOMAIN=$(DOMAIN) when running the backend.

^{Reviewed by Cursor Bugbot for commit 607e622. Bugbot is set up for automated code reviews on this repo. Configure here.}

[jit-ci]

🛡️ Jit Security Scan Results

✅ No security findings were detected in this PR

---

^{Security scan by Jit}