Research
Evolving Multi-Channel Confidence-Aware Activation Functions for Missing Data with Channel Propagation
arXiv:2602.13864v2 Announce Type: replace-cross Abstract: Learning in the presence of missing data can result in biased predictions and poor generalizability, among other difficulties, which data impu
arXiv:2602.13864v2 Announce Type: replace-cross Abstract: Learning in the presence of missing data can result in biased predictions and poor generalizability, among other difficulties, which data imputation methods only partially address. In neural networks, activation functions significantly affect performance yet typical options (e.g., ReLU, Swish) operate only on feature values and do not account for missingness indicators or confidence scores. We propose Three-Channel Evolved Activations (3C-EA), which we evolve using Genetic Programming to produce multivariate activation functions f(x, m, c) in the form of trees that take (i) the feature value x, (ii) a missingness indicator m, and (iii) an imputation confidence score c. To make these activations useful beyond the input layer, we introduce ChannelProp, an algorithm that deterministically propagates missingness and confidence values via linear layers based on weight magnitudes, retaining reliability signals throughout the network. We evaluate 3C-EA and ChannelProp on datasets with natural and injected (MCAR/MAR/MNAR) missingness at multiple rates under identical preprocessing and splits. Results indicate that integrating missingness and confidence inputs into the activation search improves classification performance under missingness.
Related
- DNNs, Dataset Statistics, and Correlation Functions
- Random Matrix Theory for Deep Learning: Beyond Eigenvalues of Linear Models
- Adaptive Multi-task Learning for Multi-sector Portfolio Optimization
- On the Theory of Continual Learning with Gradient Descent for Neural Networks
Source: arXiv cs.LG | 2026-04-29