Claude can now use your computer
TL;DR Highlight
Anthropic added direct computer control to Claude. It can now open apps, browse the web, and fill out spreadsheets — handling real desktop tasks on your behalf.
Who Should Read
Developers or professionals looking to automate repetitive computer tasks. Especially useful if you're on the Claude Pro/Max plan and working on macOS.
Core Mechanics
- It's currently in Research Preview — you can enable direct computer control in Claude Cowork and Claude Code. Since it's an early release rather than GA, it may not be perfect, and complex tasks might need a retry.
- Claude first tries to use existing app integrations like Slack and Calendar. It only asks for permission to directly control your screen when there's no connector available. In other words, it operates on a permission-based model rather than having free rein.
- You can use 'Dispatch' mode — give instructions from your phone, walk away, and your desktop handles the work. Come back and the results are ready.
- Recurring tasks like morning email scans or Friday report generation can be set up once and Claude handles them on schedule. Conversation context persists, so you don't need to re-explain every time.
- Currently available only on Pro and Max plans, macOS only. You need to update the desktop app and pair it with the mobile app.
Evidence
- Anthropic explicitly stated 'It won't always work perfectly, and complex tasks could need a second try.' They're officially acknowledging imperfections and releasing early to gather user feedback.
- The current scope covers general desktop tasks like opening apps, web browsing, and filling spreadsheets. No specific success rates or benchmark numbers have been published.
- A scenario was demonstrated where you dispatch work from mobile and find completed tasks when you return to your computer, integrated with the Claude Cowork feature.
How to Apply
- Automated recurring reports: Set up something like 'Every Friday at 5 PM, summarize this week's Slack messages into Google Sheets' and it runs automatically each week. Requires Pro/Max plan + macOS + latest desktop app.
- Delegate work while away: Dispatch from your phone's Claude app — 'Research meeting materials and draft a PPT' — and come back to find results on your desktop. (Complex tasks may need verification since it's Research Preview.)
- Automate legacy apps without connectors: Even internal tools or legacy apps without official Slack/Calendar-style integrations can be controlled via direct screen manipulation. Note that user permission is required before execution, so it's better suited for semi-automation than fully unattended scenarios.
Terminology
Related Papers
Show HN: ctx – Search the coding agent history already on your machine
Claude Code, Cursor, Codex 등 코딩 에이전트가 이전 세션의 논의·결정·실패 시도를 잊지 않도록 SQLite로 인덱싱해 재사용할 수 있게 해주는 오픈소스 CLI 도구다.
Micro-Agent: Beat Frontier Models with Collaboration Inside Model API
vLLM 팀이 단일 모델 API 호출 뒤에서 여러 모델이 협업하는 'Micro-Agent' 개념을 공개했습니다. 별도의 에이전트 코드 없이 라우터 레이어에서 모델 조합을 실행해 GPT-4급 결과를 더 저렴하게 낼 수 있다는 아이디어입니다.
Ornith-1.0: self-improving open-source models for agentic coding
Gemma 4와 Qwen 3.5를 기반으로 파인튜닝한 코딩 특화 오픈소스 모델로, RL(강화학습)을 통해 스캐폴드(에이전트 실행 구조)까지 함께 최적화하는 방식을 주장하지만, 커뮤니티에서는 벤치마크 과최적화에 불과하다는 의심을 받고 있다.
Entity Binding Failures in Tool-Augmented Agents
AI 에이전트가 올바른 도구를 선택해도 잘못된 대상에 실행하는 'Entity Binding 실패' 문제를 정의하고, 이를 막는 실행 정책을 평가한 논문.
Herdr: Agent multiplexer that lives in your terminal
여러 AI 코딩 에이전트(Claude, Codex 등)를 하나의 터미널에서 동시에 실행·관리할 수 있는 Rust 기반 오픈소스 툴로, tmux처럼 세션이 유지되고 SSH로 원격 접속도 가능해 멀티 에이전트 워크플로우를 크게 단순화해준다.
Ornith-1.0: Self-scaffolding LLMs for agentic coding
모델이 문제 풀이 전략(scaffold)을 직접 생성하고 개선하는 자기강화 학습 프레임워크를 적용한 오픈소스 코딩 특화 LLM으로, 9B 소형 모델부터 397B 대형 모델까지 라인업을 갖추고 SWE-Bench 등 주요 벤치마크에서 Claude Opus 4.7을 능가하는 성능을 보여줬다.