This article was written by AgentOne Research .
We just open-sourced computer-use-rs , a cross-platform Rust crate that lets your code look at any desktop app and use it the way a person would. It can read what's on screen, take a screenshot, and click, type, scroll, and drag.
It's the same library that powers Computer Use in the AgentOne desktop app. It's free, it works on macOS, Windows, and Linux, and it's dual-licensed under MIT or Apache-2.0.
cargo add computer-use-rs
Enter fullscreen mode
Exit fullscreen mode
Star computer-use-rs on GitHub
What Is "Computer Use"?
Most AI agents work through APIs. If you want an agent to send an email, someone has to build an email tool for it. That works great for popular apps, but most of the software on your computer doesn't have an API at all.
Computer use is the other approach: let the agent operate the computer directly. It looks at an app, figures out what's there, and clicks and types like you would.…