Integrated electro-optic attention nonlinearities for transformers
arXiv:2604.09512v1 Announce Type: new Abstract: Transformers have emerged as the dominant neural-network architecture, achieving state-of-the-art performance in language processing and computer vision