Claude can now use your computer
TL;DR Highlight
Anthropic added direct computer control to Claude. It can now open apps, browse the web, and fill out spreadsheets — handling real desktop tasks on your behalf.
Who Should Read
Developers or professionals looking to automate repetitive computer tasks. Especially useful if you're on the Claude Pro/Max plan and working on macOS.
Core Mechanics
- It's currently in Research Preview — you can enable direct computer control in Claude Cowork and Claude Code. Since it's an early release rather than GA, it may not be perfect, and complex tasks might need a retry.
- Claude first tries to use existing app integrations like Slack and Calendar. It only asks for permission to directly control your screen when there's no connector available. In other words, it operates on a permission-based model rather than having free rein.
- You can use 'Dispatch' mode — give instructions from your phone, walk away, and your desktop handles the work. Come back and the results are ready.
- Recurring tasks like morning email scans or Friday report generation can be set up once and Claude handles them on schedule. Conversation context persists, so you don't need to re-explain every time.
- Currently available only on Pro and Max plans, macOS only. You need to update the desktop app and pair it with the mobile app.
Evidence
- Anthropic explicitly stated 'It won't always work perfectly, and complex tasks could need a second try.' They're officially acknowledging imperfections and releasing early to gather user feedback.
- The current scope covers general desktop tasks like opening apps, web browsing, and filling spreadsheets. No specific success rates or benchmark numbers have been published.
- A scenario was demonstrated where you dispatch work from mobile and find completed tasks when you return to your computer, integrated with the Claude Cowork feature.
How to Apply
- Automated recurring reports: Set up something like 'Every Friday at 5 PM, summarize this week's Slack messages into Google Sheets' and it runs automatically each week. Requires Pro/Max plan + macOS + latest desktop app.
- Delegate work while away: Dispatch from your phone's Claude app — 'Research meeting materials and draft a PPT' — and come back to find results on your desktop. (Complex tasks may need verification since it's Research Preview.)
- Automate legacy apps without connectors: Even internal tools or legacy apps without official Slack/Calendar-style integrations can be controlled via direct screen manipulation. Note that user permission is required before execution, so it's better suited for semi-automation than fully unattended scenarios.
Terminology
Related Papers
Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper
마케팅 웹사이트를 자동 생성하는 프로덕션 AI 에이전트를 Claude Opus 4.8에서 GPT-5.6 Sol로 전환한 실전 경험담으로, 단순 모델 교체가 아니라 eval 하네스, 툴 스키마, 캐싱, 추론 리플레이까지 손봐야 했던 과정을 구체적인 수치와 함께 정리했다.
What xAI's Grok build CLI sends to xAI: A wire-level analysis
xAI의 공식 코딩 CLI 도구 Grok Build가 사용자 동의 없이 전체 Git 저장소와 .env 시크릿 파일을 xAI 서버로 업로드한다는 사실이 네트워크 트래픽 분석으로 밝혀졌다.
Remember When It Matters: Proactive Memory Agent for Long-Horizon Agents
LLM 에이전트가 긴 작업 중 중요한 정보를 잊어버리는 문제를 별도의 메모리 에이전트가 '적절한 타이밍에' 끼어들어 해결하는 방법
WebSwarm: Recursive Multi-Agent Orchestration for Deep-and-Wide Web Search
복잡한 웹 검색을 재귀적으로 분해하고 각 노드에 적합한 검색 모드를 동적으로 할당하는 멀티에이전트 프레임워크
Show HN: Reverse-engineering web apps into agent tools
로그인된 웹 앱의 API 호출을 브라우저에서 감시해 자동으로 MCP 도구로 변환하는 에이전트를 만들었다. 소스 코드나 공식 API 문서 없이도 Jira, Spotify 같은 서비스에 AI 어시스턴트를 붙일 수 있다.
Show HN: FableCut – A browser video editor AI agents can drive (zero deps)
타임라인 전체를 JSON 파일 하나로 표현하고 MCP/REST로 AI 에이전트가 직접 편집할 수 있는 브라우저 비디오 에디터로, Claude 같은 AI가 프롬프트 하나로 영상을 자동 컷편집하고 결과를 실시간으로 UI에 반영해준다.