
Phone Harness connects an AI agent to a real iPhone or Android so it can use apps through their screens. It's for developers who want Claude Code, Codex, or another agent to carry out phone tasks without a dedicated app API. The software is open source under the MIT license, and it doesn't require a jailbreak or an app installed on the phone.
With your own device, the harness runs on your computer. iPhone control uses the Mac's iPhone Mirroring window and can work in the background. Android control works from macOS, Linux or Windows through adb, over USB or Wi-Fi, without a mirrored window. You bring your own agent; the harness supplies phone interaction rather than an AI model.
The agent can tap, type, swipe and inspect the result. On iPhone, Apple's Vision framework reads screen text; on Android, the phone's accessibility tree supplies it. Both platforms use the same control helpers. For unlabeled icons and controls, the agent needs a screenshot and a vision-capable model because text recognition alone won't identify them.
You can connect your own phone or rent a hosted iPhone or Android through Phone Harness Cloud. Rented devices run remotely; control of your own device uses the connected phone and computer.
Some tasks still need you. Unlocking an iPhone pauses mirroring, and a PIN-locked Android needs user input. The harness doesn't support multi-touch, camera or Face ID flows, and DRM-protected video appears black.
Claim this page with an email at phone-harness.com. Phone Harness gets the verified badge, and you can upgrade the listing to be featured on localhosted. Proud to be listed? Put our badge on your site.
Want more people to find Phone Harness?Promote it
Something wrong or outdated on this page?
12.4KUpdated 4 weeks agoApache-2.0
macOS · Windows · Linux#Code execution#Multimodal input#Tool calling
Agent S is an open-source AI agent framework that controls ordinary desktop and web applications through the screen, mouse and keyboard. It runs on macOS, Windows and Linux and is aimed at developers, computer-use researchers and people building automation for their own desktops. You describe the task in natural language; the agent clicks, types and scrolls without requiring an API integration or a separate script for each application.
886Updated 2 weeks agoMIT
macOS · Windows · Linux · Docker · Web#Agent Skills#Code execution#Guardrails
43.4KUpdated 1 week agoApache-2.0
macOS · Windows · Linux#Guardrails#Tool calling
27.3KUpdated 20 hours agoMIT
macOS · Windows · Linux#Code execution#MCP#Tool calling
4.4KUpdated 19 hours agoMIT
macOS · Windows · Linux · Web · JetBrains#Agent Client Protocol#Code execution#Git integration
17.5KUpdated 1 day agoMIT
macOS · Windows · Linux · Web#Persistent memory#Tool calling
Leon is a self-hosted personal AI assistant for Linux, macOS and Windows. The project focuses on the 2.0 Developer Preview on its develop branch. Its MIT-licensed runtime combines tools, context and memory with a local web interface.
PocketPaw is a self-hosted AI agent for people who want a personal assistant that can work with files, write code and use a browser on their own computer or server. It runs on macOS, Windows and Linux, with a web dashboard and access through messaging apps. It is open source under the MIT license.
agent-browser gives AI agents a compact text view of a browser page, with references that identify the exact elements they can interact with. It's for developers who want coding assistants or other agents to use websites without filling their context with a full page's HTML. The open source tool runs locally on macOS, Linux and Windows under the Apache 2.0 license.
Cua gives AI agents access to computers they can inspect and operate, with tools for desktop automation, local virtual machines, and hosted fleets. It's for developers building agents that work across native apps and browsers, or evaluating how well those agents complete computer tasks. You bring the agent and model.
gptme is a self-hosted AI agent that works directly in your terminal, with access to your files and installed tools. It's for developers who want a coding assistant in their own environment, and people who want an agent for data analysis or other knowledge work. The software is free under the MIT license and doesn't require a gptme account.