Skip to content

[DEV] Implement Visual Agent Cues (Cursor Scaling & Click Ripples)#50

Description

@JasonMun7

馃敤 The Task

We need to add visual feedback mechanisms to the Fractal Desktop agent during workflow execution. This involves dynamically scaling the system cursor and injecting a visual "ripple" or "halo" effect at the precise coordinates of every action. We should also think about making the cursor different icons depending on each action.

馃 Goal

To improve Agent Observability for the general user. Currently, when Fractal takes control, it can be hard to track what the agent is doing. Making the cursor larger and adding a visual "click" indicator makes the automation feel intentional, user-friendly, and much easier to debug.

馃摑 Implementation Details

  • Cursor Scaling: Implement logic to increase the system cursor size by 2x-3x specifically when a Fractal workflow is in the RUNNING state.
  • Click Visualization: Create a lightweight overlay (using a transparent Electron window or a native overlay) that renders a "ripple" effect at the (x, y) coordinates whenever a click event is fired.
  • State Sync: Ensure these visual cues only trigger during active execution and revert to standard system settings immediately upon SUCCESS or FAILURE.
  • Toggle Setting: Add a "Show Agent Actions" toggle in the Fractal settings menu for users who want a "stealth" execution mode.
  • Cursor Icon Change Per Action: Change the icon depending on the type of action. For example if it's a scroll then we shoul make the cursor a scrolling icon.

鈿狅笍 Risk Level

Low - This is primarily a visual layer and should not interfere with the underlying coordinate-based click logic.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions