Learning to Extrapolate in Depth with Looped Transformers
arXiv:2610.14456v1 Announce Type: new Abstract: Looped transformers reuse a single block across iterations, raising a natural question: how far can a block trained at one depth be safely extrapolated