An AI-powered enhancement to the e-Panchayat complaint management system that combines Natural Language Processing (NLP) and Computer Vision for intelligent complaint categorization.
The system analyzes both text descriptions and uploaded images of public issues to improve classification accuracy. The NLP module processes user complaints to predict categories and priorities, while a YOLO-based computer vision model analyzes images to identify visual indicators of problems such as road damage, garbage accumulation, drainage issues, water supply problems, and electricity-related faults.
A multimodal fusion approach combines predictions from both models using confidence scores to generate the final complaint category. This reduces manual classification effort and helps authorities efficiently monitor, prioritize, and resolve public grievances.
- 📝 NLP-based complaint category and priority prediction
- 📷 Image-based issue detection using YOLO
- 🔗 Multimodal fusion of text and image predictions
- 📊 AI confidence-based classification
- 🏛️ Smart complaint management dashboard
- 🗺️ Integration with ward and location-based complaint tracking
User Complaint (Text + Image)