Ready to supercharge your AI agents?

Install any skill in seconds. Free to start, no credit card required.

Desktop Find Element — measured AI agent skill | DecimalAI

openakita/desktop-find-element

NewSkillScoreMaintained

Find desktop UI elements using UIAutomation (fast, accurate) or vision recognition (fallback). When you need to locate buttons/menus/icons, get element positions before clicking, or verify UI state. For browser webpage elements, use browser_* tools instead.

agent-toolingby openakita

Links this skill to your agents and keeps it current with the author’s updates.

Automatic

QA & Test Engineering pack

decimalai skills pull openakita-desktop-find-element

Get this skill — curl · raw file

curl -fsSL https://app.decimal.ai/s/openakita-desktop-find-element/SKILL.md

Raw file: /s/openakita-desktop-find-element/SKILL.md ↗ · machine-readable summary at /s/openakita-desktop-find-element.json ↗

In productionGlobal

how this skill behaves on real traffic · last 30 days

No production data for this skill yet — usage numbers appear here once agents start running it.

Anonymized aggregate across every org using this skill — proof from real production use, not a demo.

Does this skill help? · Benchmark: with vs. withoutsign in to run this on your agents

22 test cases from the publisher’s eval.yaml · each run twice on gemini-3.6-flash — with the skill injected, then without · last run 2h ago

Yes — +50% lift-61% tokens0% turns91% of whole cases pass with skill (20/22)

Test case	Without → With	Effect	Δ tokens	Δ turns
case-01	✗→✓	▲ Improved	-66%	0%
case-02	✗→✓	▲ Improved	-66%	0%
case-22	✗→✓	▲ Improved	-58%	0%
case-10	✗→✓	▲ Improved	-63%	0%
case-08	✗→✓	▲ Improved	-63%	0%

Showing 5 of 22 cases

SkillSafety

✓ 3 of 3 passed

Code scan15 of 15 checks clean

0 critical · 0 warning · 0 info — scanner v4 — 8/3/2026

live_secretremote_code_executionreverse_shelldata_exfiltrationssrf_metadataagent_snoopinganti_refusaldestructive_commandsobfuscated_unicodeunicode_homoglyphopaque_blobsuspicious_urltool_overreachtrigger_abuseprompt_injection_phrasing

IntentSafe

LLM judge · does the skill do what it claims

ContentClean

LLM judge · policy & harmful-content review

Source

Imported

openakita / openakita

skills/system/desktop-find-element/SKILL.md

View on GitHub ↗

License AGPL-3.0Imported 8/3/2026Version v1

Skill contents

SKILL.md

Desktop Find Element

查找桌面 UI 元素。优先使用 UIAutomation（快速准确），失败时用视觉识别（通用）。

Parameters

| 参数 | 类型 | 必填 | 说明 | |------|------|------|------| | target | string | 是 | 元素描述，如 '保存按钮'、'name:文件'、'id:btn_ok' | | window_title | string | 否 | 限定在某个窗口内查找 | | method | string | 否 | 查找方法：auto（默认）、uia、vision |

Supported Target Formats

自然语言："保存按钮"、"红色图标"
按名称："name:保存"
按 ID："id:btn_save"
按类型："type:Button"

Find Methods

auto: 自动选择（推荐）
uia: 只用 UIAutomation
vision: 只用视觉识别

Returns

元素位置（x, y）
元素大小
元素属性

Warning

如果操作的是浏览器内的网页元素，请使用 browser_* 工具。

Related Skills

desktop-click: 点击找到的元素
desktop-inspect: 查看元素树结构

Want to see if openakita/desktop-find-element would activate on your phrasing? Try it before you install — no LLM call, no signup.

Other measured skills in the registry, with their headline benchmark lift.