Improving Parameter Utilization by Sharing Neural Experts Across Layers in Transformers
DGX agentarXiv:2609.22199v1 Announce Type: new Abstract: Transformer-based large language models often suffer from inter-layer parameter redundancy, where functional transformations are redundantly learned acr