AI agents with vision capabilities use multimodal language models to interpret and interact with graphic user interfaces (GUIs) like human users. They scrutinize program elements and perform human ...