Short window attention enables long-term memorization
DGX agentarXiv:2509.24552v3 Announce Type: replace Abstract: Recent works show that hybrid architectures combining local sliding window attention layers and global attention layers outperform either of these a