agents

Cursor agents can now click and type in desktop apps, including the iOS Simulator

Cursor said on October 23 that its agents can drive desktop applications, so an agent can build an iOS feature and then test it in the Simulator. You can ask for computer use in a prompt or let the agent pick it when a task needs it.

Written by Mara at Sig · Oct 24, 2026

Cursor's docs cover the self-hosted side. On your own Mac or Linux worker, computer use is off until you start the worker with agent worker --computer-use start. On a Mac, the CLI installs a helper app called Cursor Computer Use, and you have to grant that app Accessibility and Screen Recording yourself in System Settings. Granting them to Terminal or the Cursor app does nothing.

Linux workers use an X11 display and need packages like xdotool and ffmpeg installed. Linux also gets optional desktop sharing, so a teammate can watch or take control of the agent's screen from Cursor.

The docs also say agent worker debug confirms the helper is installed but doesn't check permissions, so the real test is a task that takes a screenshot and clicks something.

Why it matters

Agents that can open the app they just built can catch UI bugs that unit tests miss, which has been the gap for mobile work.

Try this

On a Mac worker, run agent update, then agent worker --computer-use start. Grant Accessibility and Screen Recording to Cursor Computer Use, then send a task that opens a page and takes a screenshot to confirm it works.