The gateway/dashboard.html fetches data from endpoints like GET /api/jobs and renders it all at once using Vanilla JS. As the scraper runs over time and accumulates hundreds or thousands of jobs and contacts, rendering all of them simultaneously will cause severe browser lag and slow down the API response times.
Proposed Fix:
- Implement pagination logic in the backend (using offset and limit query parameters with asyncpg).
- Update dashboard.html to include simple "Next / Previous" buttons or an "x-y of total" display to load data incrementally.
I would like to work on this issue if assigned.
The gateway/dashboard.html fetches data from endpoints like GET /api/jobs and renders it all at once using Vanilla JS. As the scraper runs over time and accumulates hundreds or thousands of jobs and contacts, rendering all of them simultaneously will cause severe browser lag and slow down the API response times.
Proposed Fix:
I would like to work on this issue if assigned.