Do Transformers Use their Depth Adaptively? Evidence from a Relational Reasoning Task
DGX agentarXiv:2604.12426v1 Announce Type: cross Abstract: We investigate whether transformers use their depth adaptively across tasks of increasing difficulty. Using a controlled multi-hop relational reasonin