Paper: https://arxiv.org/abs/2605.06554 Code: https://github.com/ighoshsubho/lighthouse-attention HF: https://huggingface.co/papers/2605.065…
Lighthouse Attention is a novel attention mechanism that improves efficiency in transformer models by selectively focusing computation on the most relevant tokens, similar to how a lighthouse beam ill