Favicon of Computer Use Linux

Computer Use Linux

An open-source MCP server that gives AI agents control of a local Linux desktop, with Wayland support, accessibility-based actions and an MIT license.

Computer Use Linux is a local MCP server for AI agents that need to work in Linux desktop apps. It supports Wayland and uses AT-SPI accessibility data to find controls by their role, name or text, so agents can act on buttons and fields without relying entirely on screenshot coordinates. It's written in Rust and is open source under the MIT license.

Agents can inspect running apps, read window contents and capture screenshots of the desktop or a chosen window. They can also click, drag, scroll and type, focus specific windows, and change text fields or sliders through native accessibility actions. Coordinate input remains available for games, canvas surfaces and apps that don't expose accessible controls.

The desktop backends cover GNOME, KDE/KWin, Hyprland, niri, i3 and COSMIC, with best-effort X11 support. Actual capabilities depend on the control interfaces available in the desktop session. A structured diagnostics report identifies working backends and blockers, which helps distinguish a missing desktop capability from an agent error.

The server runs on your Linux machine and passes screenshots and accessibility data to the connected MCP host. It works with clients such as Hermes Agent and Claude Desktop, and has plugins for Claude Code and Codex. It originated in codex-desktop-linux, which also bundles it. A CLI exposes the same desktop capabilities for scripts; optional shell execution is disabled by default and runs with the server user's permissions when enabled.

Similar to Computer Use Linux