BigHugger
GH Repository · Core-Mate

OpenGUI

OpenGUI is an Android GUI agent framework for phone-use AI that can see, plan, and operate real mobile apps through the GUI.

stars
1,797
30-day movement
starts with the next reading
Related entries
63
Connections
3
task-executionmultimodal-aigui-automationclaude-codeandroid-automationscreen-understandingphone-useaccessibilityai-agentagent-frameworkandroidcodexmobile-agentcomputer-usemobile-automationandroid-agentandroid-accessibilitygui-agentTypeScriptautomationvlm

OpenGUI is an Android GUI agent framework for phone-use AI that can see, plan, and operate real mobile apps through the GUI. It is written in TypeScript and ships agents.md and claude.md files, suggesting integration with coding-agent workflows like Claude Code and Codex.

You reach for it when you want AI agents to understand screens and execute tasks on real Android apps through the GUI rather than private APIs.

Use it to

  • Automate tasks in real Android apps via the GUI
  • Build phone-use agents that see and plan on-screen
  • Leverage Android accessibility data for screen understanding
  • Drive mobile task execution with multimodal/VLM models
  • Integrate agent workflows with Claude Code or Codex

For Developers building Android phone-use AI agents

Role
agent-framework
Language
TypeScript
Licence
custom (licence file present)
Forks
111
Open issues
23
Last push
2026-09-16
Latest release
v0.1.0 · 2026-05-02
Skills shipped
3
topicsandroidgui-agentphone-useaccessibilityautomationvlm