Do GUI Agents Believe Their Eyes? Diagnosing State-Belief Reliance on Pixels versus Structure
DGX agentarXiv:2607.04334v1 Announce Type: new Abstract: Multimodal GUI agents read an interface through two redundant channels: the rendered pixels of a screenshot and a serialized structure such as a DOM or