computer-use

stablyai/orca/computer-use

此技能使您能够使用Orca的computer-use CLI检查和操作本地桌面应用窗口。它支持读取辅助功能树、截取屏幕截图以及执行安全的UI操作，如点击控件、输入文本、按键、滚动、拖拽和设置值。该技能适用于桌面应用、浏览器窗口、Web视图以及Orca自身的UI。要使用此技能，请先解析适用于当前会话的CLI可执行文件（通过ORCA_CLI_COMMAND环境变量、开发环境中的orca-dev、Linux上的orca-ide或默认的orca），然后运行`ORCA skills get computer-use`加载完整的版本匹配指南。该指南提供了详细的命令和用法。如果遇到较旧的Orca版本不支持`skills get`命令，可以使用有限的只读引导命令（如`ORCA status --json`、`ORCA computer capabilities --json`和`ORCA computer list-apps --json`）来获取基本信息，并建议用户更新Orca以恢复完整指南。

安装量 · 2,923查看来源

Installation

npx skills add https://stablyai/orca/

技能文件

SKILL.md

最近同步 · 2026年10月22日

SKILL.md›

---
name: computer-use
description: >-
  Drives the GUI of a visible local app window through `orca computer`: accessibility
  tree, clicks, typing, menus, dialogs, and screenshots in native apps and external
  browser windows (Chrome, Edge, Safari) or webviews. Prefer a programmatic path
  (shell, filesystem, git, HTTP, existing CLIs) whenever it can complete the task.
  Use only when a visible window needs GUI control those cannot reach. Do not use
  for Orca's embedded browser (`orca-cli`).
---

# Computer Use

This discovery stub loads the version-matched guide from the Orca executable used for this session.

## Resolve the CLI for this session

Choose the executable once and reuse it for every later command:

- If the `ORCA_CLI_COMMAND` environment variable is set, use its value. Orca exports this
  for managed WSL sessions.
- Otherwise, in a dev checkout whose session exposes `ORCA_DEV_REPO_ROOT`, use `orca-dev`.
- Otherwise, on Linux outside an Orca-managed terminal, use `orca-ide`. Never run bare
  `orca` there — outside Orca's terminals it normally resolves to the
  GNOME Orca screen reader (`/usr/bin/orca`) and starts speech on the user's machine.
- Otherwise, use `orca`.

Below, `ORCA` is a placeholder for the executable you resolved. Substitute it before
running anything; do not create a shell variable or run `ORCA` literally. This works the
same way in POSIX shells, PowerShell, and cmd.exe.

If the selected executable cannot run, report its exact error and stop. Do not fall through
to another executable, which could silently target a different Orca build.

## Load the version-matched guide before running Orca commands

```text
ORCA skills get computer-use
```

Prefer `--json`. Use the selected executable's `--help` for commands or flags the guide does
not cover. If a command reports that Orca is not running, start it with `ORCA open --json`
and retry. If it fails with `runtime_access_denied`, your sandbox blocked the connection:
re-run it with escalated permissions, and do not run `ORCA open` or restart Orca. If
`skills get` is unknown, explain that updating Orca restores the guide; use `--help` for
read-only discovery and do not guess unsupported commands.