TLXML: Task-Level Explanation of Meta-Learning via Influence Functions

arXiv:2501.14271v4 Announce Type: replace Abstract: Meta-learning enables models to rapidly adapt to new tasks by leveraging prior experience, but its adaptation mechanisms remain opaque, especially regarding how past training tasks influence future predictions. We introduce TLXML (Task-Level eXplanation of Meta-Learning), a novel framework that extends influence functions to meta-learning settings and provides task-level explanations of adaptation and inference. By reformulating influence functions for the bi-level structure of meta-learning, we quantify the contribution of each meta-training task to the adapted model's behaviour. To ensure scalability, we propose a Gauss-Newton-based approximation that significantly reduces computational complexity from O(pq^2) to O(pq), where p and q denote the numbers of model and meta parameters, respectively. Moreover, we propose generalized influence functions defined using pseudo-inverse Hessian, which are applicable even when the loss landscape has flat directions. Results demonstrate that TLXML effectively ranks training tasks by their influence on downstream performance, offering concise, intuitive explanations aligned with user-level abstraction. This work provides a critical step toward interpretable and trustworthy meta-learning systems.

Related

• Binomial Gradient-Based Meta-Learning for Enhanced Meta-Gradient Estimation
• Asymptotic Behavior of Multi--Task Learning: Implicit Regularization and Double Descent Effects
• Toward Efficient Influence Function: Dropout as a Compression Tool

Source: arXiv cs.LG | 2026-08-26