Data-Adaptive Mahalanobis Metric Learning for Cross-Head Attention in Transformers
arXiv:2610.13261v1 Announce Type: new Abstract: In this paper, we propose Data-Adaptive Mahalanobis Cross-Head Attention (DAMCHA), a simple and effective attention mechanism that generalizes Multi-Hea