Click any tag below to further narrow down your results
Links
The author built a voice-driven web runtime where a local daemon bridges a live Gemini model to the browser and the OS, letting them run sandboxed mini-apps, edit project files, and hand tasks to other agent harnesses. It's a working prototype of what an AI-first operating system might look like, with the prompt-injection risks left unsolved.
- Voice is faster than typing for loading context into an LLM, so the author built a voice harness that listens while they keep working and can be interrupted mid-response.
- Architecture: a browser page captures mic and screen, a local node daemon holds the API key and runs tools, and file writes route to OPFS, a picked folder, or disk depending on where the project lives.
- Mini-apps are model-written HTML in two nested iframes with a locked-down sandbox, and extensions are JSON descriptors over six primitives so the model never sees API keys.
- The author has no safeguards yet against prompt injection; anything on a shared screen or web page can reach the model and trigger tool calls to email and system settings.
@sytaylor on X
The author, Stephen Taylor, argues that Instinct, a personal AI agent you control by text or voice note with no app to learn, is the first agent that feels like a finished product rather than a hobbyist project. He thinks this shifts consumer interaction from people using apps and websites to people sending their own agents to use businesses' systems, and that companies who block or ignore those agents will lose out.
- Instinct remembers personal context and completes real tasks like booking a pub lunch, moving the booking, booking cycling lessons, and negotiating a Comcast bill, which the author says makes hours of admin disappear.
- The hard part of personal agents has been building memory and context, and Instinct packages that into a consumer experience, while earlier setups required a separate Mac Mini and weekends of configuration.
- Businesses need to expose reliable actions to customers' agents, using approaches like WebMCP, and Stripe's Link wallet lets an agent pay with a one-time card authorized per purchase without seeing the user's card details.
- Websites that block bots risk treating legitimate customer agents as crawlers, so the author advises companies to test trusted agents on their own services now.