Rio
A voice-first desktop agent. Speak once and Rio plans the task, acts on your screen and in Google Workspace, checks the result and reports back by voice.
Every AI assistant today is still a text box with better autocomplete. You still have to run the multi-step task yourself.
One spoken sentence, four stages
Listen
Live voice in and out, with barge-in so you can interrupt. Push-to-talk, voice activity detection and the wake word “Hey Rio”.
See
Screen capture and OCR, with Gemini Computer Use for clicks that land on the right pixel.
Act
Browser control through Playwright. Gmail, Drive, Calendar, Sheets and Docs. Files, shell, windows and clipboard on the local machine.
Check and report
Rio verifies the result of each step and tells you what happened, by voice.
What is inside
- Tools
- 58
- Tools the live voice model calls directly
- 20
- Sub-agents
- 4: code, creative, research, task executor
- Relay rate limit
- 30 requests a minute, 4 degradation levels
- Loop cap
- 50 iterations
- Releases on PyPI
- v0.9.0 to v0.9.16
Decisions I would defend in an interview
Local hands, cloud brain
The tools run in a local asyncio runtime. A Cloud Run relay carries audio and screen frames over a binary WebSocket protocol, and a per-session bridge sends tool calls back to your machine.
Route by difficulty
Gemini 3 Flash orchestrates. Requests that need analysis or planning go to Gemini 3.1 Pro. Voice runs on Gemini 2.5 Flash Native Audio, with a fallback chain behind it.
Degrade instead of failing
A token bucket holds the relay to 30 requests a minute and steps down through four service levels under pressure.
Rails for software that can type
A shell blocklist, a backup before every file write, and a hard cap of 50 iterations per task.
Built with
- Runtime
- Python 3.11, FastAPI, Google ADK, google-genai, Vertex AI
- Models
- Gemini 2.5 Flash Native Audio, Gemini 3 Flash, Gemini 3.1 Pro, Gemini 2.5 Pro
- Automation
- Playwright, RapidOCR, Gemini Computer Use
- Memory
- ChromaDB, SQLite
- Infrastructure
- Docker, Cloud Run, Secret Manager