Enough AI copilots, we need AI HUDs
TL;DR Highlight
Instead of designing AI as a 'virtual coworker' you chat with (Copilot style), design it as a HUD that extends human cognitive capabilities. A piece that forces you to rethink AI interface design fundamentals.
Who Should Read
Product designers and frontend/fullstack developers figuring out how to integrate AI into products. People looking for AI UX patterns beyond chatbots and agents.
Core Mechanics
- Ubiquitous computing researcher Mark Weiser already critiqued the 'Copilot' metaphor back in 1992. His core argument: AI shouldn't be a 'virtual human you talk to' but an 'invisible computer' that naturally helps users perceive more.
- The airplane HUD (Head-Up Display) is a great analogy — it doesn't talk to the pilot but overlays critical info onto their field of view, reducing cognitive load rather than adding conversational overhead.
- Cursor's tab autocomplete is already a good HUD example — after a first variable rename, it auto-suggests the rest. This counters the claim that pure Copilot approaches like Claude Code are always superior.
- The key design principle: reduce information access cost to near-zero rather than adding a conversation partner.
Evidence
- Cursor's tab autocomplete was widely cited as a good HUD example — auto-suggesting remaining renames after the first edit fits the HUD definition perfectly, countering the claim that pure Copilot approaches are always better.
- A suggestion that AI running tests in real-time and showing red/green dots on the relevant code lines would be a HUD for code correctness.
- Memory allocation/deallocation visualization during debugging was proposed as another HUD-style AI application.
How to Apply
- When adding AI features to a product, don't default to 'chatbot/agent' — first consider HUD patterns that overlay information on existing UI. Examples: highlighting anomalies in dashboards, showing quality heatmaps in code editors.
- For debugging, instead of asking an AI agent to 'fix the bug', have AI build a debugger UI that visualizes memory allocation/deallocation paths on the relevant code — HUD-style augmentation rather than delegation.
- Evaluate AI features by whether they reduce the user's information access cost toward zero, not by how good the conversation is.
Terminology
HUDHead-Up Display. A device that projects info (speed, altitude) onto a fighter pilot's visor so they don't need to look down. Here it means an AI UI pattern that overlays information on the existing interface without requiring separate conversations.
CopilotAI acting as a virtual coworker that helps through chat-style conversation. GitHub Copilot, ChatGPT — conversational interfaces are the typical example.