Open
Conversation
… script, devtools, options, popup, and new tab functionalities - Added background script to handle messages from popup - Implemented content script with basic logging - Created devtools page with a link to the repository - Developed options page to sync and display count from popup - Built popup with increment and decrement functionality for count - Designed new tab page displaying the current time with a background image - Established side panel to show synchronized count from popup - Configured manifest for Chrome extension with necessary permissions and pages - Set up Vite configuration for building the extension - Included TypeScript configuration for type safety - Added CSS styles for various components to enhance UI
…live logs Co-authored-by: Sathursan-S <84266926+Sathursan-S@users.noreply.github.com>
Co-authored-by: Sathursan-S <84266926+Sathursan-S@users.noreply.github.com>
…e extension Co-authored-by: Sathursan-S <84266926+Sathursan-S@users.noreply.github.com>
Co-authored-by: Sathursan-S <84266926+Sathursan-S@users.noreply.github.com>
…ference Co-authored-by: Sathursan-S <84266926+Sathursan-S@users.noreply.github.com>
- Implemented a WebSocket server to facilitate communication between the Chrome extension and Browser.AI using the Chrome DevTools Protocol (CDP). - Created CDPBrowserContextManager to manage browser contexts and commands for each tab. - Added event handling for attaching and detaching tabs, sending CDP commands, and starting tasks. - Defined WebSocket events for client-server communication, including connection acknowledgment and task status updates. - Included detailed logging and error handling for better debugging and monitoring. - Documented the WebSocket server architecture, usage examples, and command formats in the README.
… handling - Implemented notification HTML structure and CSS styles. - Created Notification component to display messages based on URL parameters or background script messages. - Added loading spinner and dynamic notification types (user interaction, task complete, error). - Developed index file to render Notification component. - Introduced ChatInput component for user message input with send functionality. - Created ControlButtons component for task control (start, pause, resume, stop). - Implemented ExecutionLog component to display logs with different levels and metadata. - Added TaskStatus component to show current task status with visual indicators.
- Created LOG_STREAMING_FIX.md to document the problem and solution for log streaming issues between the Browser.AI server and Chrome extension. - Unified LogEvent dataclass definitions in event_adapter.py and protocol.py to ensure compatibility and consistency in data types. - Updated websocket_server.py to simplify event broadcasting and remove redundant serialization methods. - Enhanced PROTOCOL.md with detailed WebSocket communication protocol, including data structures and event definitions. - Summarized protocol implementation changes in PROTOCOL_IMPLEMENTATION_SUMMARY.md, highlighting updates to TypeScript and Python protocol files. - Added type-safe protocol definitions in protocol.ts for TypeScript and protocol.py for Python, ensuring type safety and consistency. - Developed verify_log_streaming_fix.py to validate the compatibility of LogEvent objects with the protocol and ensure proper serialization.
…Chrome APIs Co-authored-by: Sathursan-S <84266926+Sathursan-S@users.noreply.github.com>
Co-authored-by: Sathursan-S <84266926+Sathursan-S@users.noreply.github.com>
Co-authored-by: Sathursan-S <84266926+Sathursan-S@users.noreply.github.com>
Co-authored-by: Sathursan-S <84266926+Sathursan-S@users.noreply.github.com>
Co-authored-by: Sathursan-S <84266926+Sathursan-S@users.noreply.github.com>
Co-authored-by: Sathursan-S <84266926+Sathursan-S@users.noreply.github.com>
Co-authored-by: Sathursan-S <84266926+Sathursan-S@users.noreply.github.com>
…actor WebSocket server error handling and testing
…enhance event emission and error handling in websocket server
…rowser.AI Chrome extension - Added detailed documentation on state management and persistence in STATE_MANAGEMENT.md - Summarized state management changes and benefits in STATE_MANAGEMENT_SUMMARY.md - Introduced modern UI features and components in UI_FEATURES.md - Created a visual guide for the extension's UI in UI_GUIDE.md - Enhanced user experience with a professional settings page in UX_IMPROVEMENTS.md - Improved chat interface and execution log formatting for better clarity - Integrated Chrome API for settings management and real-time updates - Optimized rendering and memory management for better performance
…d-b0a6-3dd7274a776d Add Chrome Extension with Side Panel UI, Settings Page, User-Friendly Messages, Global State Persistence, and WebSocket Control for Browser Automation
… script, devtools, options, popup, and new tab functionalities - Added background script to handle messages from popup - Implemented content script with basic logging - Created devtools page with a link to the repository - Developed options page to sync and display count from popup - Built popup with increment and decrement functionality for count - Designed new tab page displaying the current time with a background image - Established side panel to show synchronized count from popup - Configured manifest for Chrome extension with necessary permissions and pages - Set up Vite configuration for building the extension - Included TypeScript configuration for type safety - Added CSS styles for various components to enhance UI
…live logs Co-authored-by: Sathursan-S <84266926+Sathursan-S@users.noreply.github.com>
Co-authored-by: Sathursan-S <84266926+Sathursan-S@users.noreply.github.com>
…e extension Co-authored-by: Sathursan-S <84266926+Sathursan-S@users.noreply.github.com>
Co-authored-by: Sathursan-S <84266926+Sathursan-S@users.noreply.github.com>
…ference Co-authored-by: Sathursan-S <84266926+Sathursan-S@users.noreply.github.com>
- Implemented a WebSocket server to facilitate communication between the Chrome extension and Browser.AI using the Chrome DevTools Protocol (CDP). - Created CDPBrowserContextManager to manage browser contexts and commands for each tab. - Added event handling for attaching and detaching tabs, sending CDP commands, and starting tasks. - Defined WebSocket events for client-server communication, including connection acknowledgment and task status updates. - Included detailed logging and error handling for better debugging and monitoring. - Documented the WebSocket server architecture, usage examples, and command formats in the README.
…neration support and improve e-commerce search functionality
…t/extension-with-chatbot-and-voice
- Implemented `search_google_with_ai` action to enhance search capabilities using AI-generated queries. - Updated `SystemPrompt` class with new search strategies and important rules for shopping tasks. - Added `SearchGoogleWithAiAction` model to support AI-driven search queries.
…arch-oriented tasks and updating Google search action descriptions for improved clarity.
- Added Stuck Detection Engine in `stuck_detector.py` to identify when the agent is stuck based on various triggers (repeating actions, step timeout, no progress, consecutive failures). - Modified `websocket_server.py` to integrate the Stuck Detector with WebSocket events for real-time user assistance requests. - Updated `ConversationMode.tsx` to handle user help requests and responses in the chat interface. - Created detailed documentation in `STUCK_DETECTION_IMPLEMENTATION_SUMMARY.md` and `STUCK_DETECTION_VISUAL_GUIDE.md` outlining the feature, its components, and user interaction flows. - Enhanced user experience by providing clear communication when the agent is stuck and allowing users to guide the agent effectively.
- Added detailed configuration interfaces for LLM, Browser, Agent, and GUI settings in Options.tsx. - Implemented loading and saving of server configuration with error handling in Options.tsx. - Updated the configuration management in config.py to include new parameters for LLM, Browser, and Agent settings. - Enhanced the WebApp class to reflect the updated configuration structure and ensure compatibility with new settings. - Introduced a test script (test_config_fix.py) to verify the functionality of the configuration API and prevent AttributeErrors.
…unctionality; integrate Tailwind CSS for styling; add custom scrollbar component; implement SamplePrompts and ChatMessages components; enhance Badge and Button UI elements; update global styles and PostCSS configuration.
- Added VoiceConversationService to manage continuous voice interactions. - Integrated voice recognition and text-to-speech functionalities. - Implemented automatic turn-taking, silence detection, and message handling. - Enhanced UI with Live Voice Mode, including status indicators and live transcript display. - Updated ConversationMode component to support live voice interactions. - Removed deprecated VoiceInput and VoiceSettings components. - Updated CSS styles for new live voice features. - Modified agent configuration to use the latest planner model and added planner interval setting.
…b.com/Sathursan-S/Browser.AI into feat/extension-with-chatbot-and-voice
- Created comprehensive documentation for Live Voice Mode including guides, quick start, and implementation details. - Added state diagrams and user journey visualizations to enhance understanding of the Live Voice Mode workflow. - Introduced a new service `VoiceConversation.ts` to manage the voice interaction flow. - Enhanced UI components to support Live Voice Mode with real-time transcript display and animated status indicators. - Implemented error handling and configuration options for a better user experience.
…composing and sending
…b.com/Sathursan-S/Browser.AI into feat/extension-with-chatbot-and-voice
…with-chatbot-and-voice
- Removed deprecated styles and components related to conversation header and buttons. - Introduced new input field structure with integrated voice and send buttons. - Enhanced voice button functionality to handle live and manual voice input modes. - Updated button states and titles for better user experience. - Improved styling for input fields, buttons, and live voice status to ensure consistency and clarity.
…b.com/Sathursan-S/Browser.AI into feat/extension-with-chatbot-and-voice
… ChatInput components; remove unused ConversationView files
- Introduced new PNG icons in various sizes (16x16, 32x32, 48x48, 128x128) for the browser AI extension. - Icons are added to the public icons and img directories to enhance the visual representation of the extension.
…b.com/Sathursan-S/Browser.AI into feat/extension-with-chatbot-and-voice
…nd visual guides - Added Voice Input (Speech-to-Text) and Speech Output (Text-to-Speech) services - Integrated UI components for microphone and speech toggle functionality - Enhanced styling for a professional appearance and smooth user experience - Created comprehensive documentation including implementation details, usage examples, and error handling - Developed visual guides and workflow diagrams for user interactions and troubleshooting - Established a memory tracking pattern for intelligent website selection workflows
- Unify Chat and Agent modes into a single seamless interface. - Implement "Smart Steps" visualization to group technical logs into high-level task steps. - Add Light/Dark mode theming with a clean "Copilot-like" default. - Inject a floating status overlay into the active web page. - Update Tailwind configuration and React components to support the new design.
… cross-platform compatibility
- Unify Chat and Agent modes into a single seamless interface. - Implement "Smart Steps" visualization to group technical logs into high-level task steps. - Add Light/Dark mode theming with a clean "Copilot-like" default. - Inject a floating status overlay into the active web page. - Add "Concentration Mode" with Jarvis-style voice visualization. - Add Sticky Task Status header that expands on completion. - Update Tailwind configuration and React components to support the new design.
- Removed unused ChatMessage component. - Updated ConversationMode.css for improved styling and added visual effects. - Enhanced ConversationMode.tsx to include audio visualization logic using Web Audio API. - Modified TaskStatusHeader to remove auto-expand functionality and improve user control. - Introduced VoiceVisualizer component for dynamic audio level visualization during voice interactions. - Added task and chat history management functions in state.ts for persistent storage.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.