Abstract: Graphical user interfaces (GUIs) play a crucial role in facilitating user-computer interactions, making them an essential focus of research. However, current automated GUI agents face ...

This desktop app is a companion to the esp-pulser. It can be used to view component status, update version and more, assuming it is connected to the same local network. It also is responsible to ...

GUI grounding, which maps natural-language instructions to actionable UI elements, is a core capability of GUI agents. Prior works largely treats instructions as a static proxy for user intent, ...