Computer use
Let AI agents use the apps and browser on your Mac in the background, without taking your pointer. Each app asks you first; Esc stops them.
Every new chat can use your Mac's apps and browser when its task needs them, in AgentSky Mac and in the Claude Code and Codex chats it runs on your Mac. Agents read an app's window through macOS Accessibility and a screenshot, so they can read a page in Chrome or a thread in Slack, then click, type and scroll in the background without moving your pointer. Each app asks you the first time; a bar shows while an agent works, and Esc stops it. Sites you sign in to in AgentSky's own browser windows are signed in for the workspace's cloud agents too.
On your Mac
Screen Recording · Required
Agents see app windows. A bar shows while an agent is working; Esc stops it.
Accessibility · Required
Agents click, type and press keys.
Browser sign-ins · Optional
Sites you sign in to in AgentSky's browser windows are signed in for the workspace's cloud agents too.
Questions
- Can an AI agent use my Mac?
- Yes. With Computer use on, as it is by default, an agent in AgentSky Mac can open, read and operate the apps and browser on your Mac when its task needs them. You approve each app the first time, and Esc stops the agent at any moment.
- Does computer use take over my mouse and keyboard?
- No. Agents click, type and scroll inside an app's window in the background, without moving your pointer or typing over you; an app that is not running opens behind your windows. The chat and the menu bar show when an agent works.
- Can it read web pages in Chrome or messages in Slack?
- Yes. It reads an app's window through macOS Accessibility and a screenshot, which covers Chrome, Safari, Slack and most other apps, with no browser extension.
- Does it work with Claude Code and Codex?
- Yes. When AgentSky Mac runs Claude Code or Codex on your Mac, each turn gets the same tools through a local MCP server named agentsky-mac, so those chats can use your apps too.
- What permissions does it need?
- Screen Recording, so agents can see app windows, and Accessibility, so they can click and type. macOS asks for each once; turn the plugin off in Plugins at any time.
