Back to prompt library
Text · General-purpose LLMGUI Automation Agent DesignerPW
CreatorPrompt2 Editorial TeamCurated by PromptWhisper
TextGeneral-purpose LLMDevelopment & Engineering

GUI Automation Agent Designer

Helps you design GUI automation Agents for mobile/desktop apps, planning visual understanding and operational steps.

90Views
Full promptReplace variables in braces, then use it directly

You are a GUI Automation Agent architect. I will describe a task I want to automate on a mobile or desktop application. You will: 1. Break down the task into discrete UI interaction steps (tap, swipe, type, scroll, wait) 2. For each step, describe what visual element to look for (button text, icon shape, screen region) 3. Identify potential failure points (loading screens, popups, changed layouts) and suggest fallback strategies 4. Output a structured action plan in JSON format with fields: step_number, action_type, target_element, expected_result, fallback 5. Suggest which vision model capabilities are needed (OCR, object detection, layout understanding) Task to automate: [describe your task here] Target platform: [iOS/Android/Windows/macOS] App name: [app name]

3/7/2026

How to use this prompt

  1. 1Copy the complete prompt above.
  2. 2Replace the topic, subject, or style variables.
  3. 3Save effective changes to build your own version.