I built Pupil, an open-source tool.
The pain point: too many screenshots sent to AI tools just to ask where to click.
Now the agent can inspect the UI, point at the target, and wait for approval.
Feedback welcome.
I built Pupil, an open-source tool for AI agents.
Instead of uploading screenshots to ask where to click, the agent can inspect the app, highlight the target, and wait for approval.
I kept sending screenshots to ChatGPT just to ask “where do I click?”
So I built Pupil, an open-source tool that lets an AI agent inspect desktop apps, point at the right place, and wait for approval before clicking. (tab to approve)
Demo: I ask it to find Discord’s data/privacy settings.
Looking for feedback on the idea and UX.