Agent S
An open-source computer-use AI agent framework for macOS, Windows and Linux, with cloud model providers and vLLM support under Apache 2.0.
Agent S is an open-source AI agent framework that controls ordinary desktop and web applications through the screen, mouse and keyboard. It runs on macOS, Windows and Linux and is aimed at developers, computer-use researchers and people building automation for their own desktops. You describe the task in natural language; the agent clicks, types and scrolls without requiring an API integration or a separate script for each application.
The Python framework separates the model that reasons about a task from the grounding model that identifies where to act on screen. It supports OpenAI, Azure OpenAI, Anthropic, Gemini and OpenRouter, along with vLLM inference for open-weight models. UI-TARS-1.5-7B is the recommended grounding model. Desktop control runs on your computer, while cloud model providers require an internet connection. The agent is designed for a single monitor.
An optional local coding environment lets the agent execute Python and Bash for work that's better handled in code, such as processing spreadsheets, organizing files or editing documents. That code runs on your machine with your user permissions. Agent S uses the Apache 2.0 license, so developers can inspect and adapt the framework.
