research

Holographic functions and neural networks

arXiv:2605.22666v1 Announce Type: cross Abstract: A fuzzy Boolean function is a map f:ube^no [0,1], where ninmathbb N. We introduce and compare three ways of saying that such a function has bounded co

How Many Different Outputs Can a Transformer Generate?

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

arXiv:2605.22223v1 Announce Type: new Abstract: We study how we can leverage only a handful of characteristics of a transformer's architecture to closely predict the number of different sequences it c

researcharxiv-cs-lg

23 May 2026

How Sparsity Allocation Shapes Label-Free Post-Pruning Recoverability

arXiv:2605.21972v1 Announce Type: new Abstract: Unstructured magnitude pruning at high sparsity can reduce neural network accuracy to near-random performance, while labeled retraining may be unavailab

If Trump kicking the Tech Right in the nuts doesn't put an end to the Tech Right, I don't know what would

If Trump kicking the Tech Right in the nuts doesn't put an end to the Tech Right, I don't know what would Feeling robbed of my path to citizenship right now after grinding a PhD and contributing to fo

researchyann-lecun--x

“If we erase January 6th, it didn’t happen” “If we don’t release certain inflation data, there’s no inflation” “If we don’t measure food ins…

“If we erase January 6th, it didn’t happen” “If we don’t release certain inflation data, there’s no inflation” “If we don’t measure food insecurity, no one’s hungry” “If we delete research on right-wi

researchyann-lecun--x

Implicit Regularization of Mini-Batch Training in Graph Neural Networks

arXiv:2605.22480v1 Announce Type: new Abstract: Mini-batch training of Graph Neural Networks (GNNs) is fundamentally different from training on i.i.d. data: sampling a subgraph alters the topology and

Innovations in Cardless Artificial Intelligence Banking: A Comprehensive Framework for Cyber Secure and Fraud Mitigation using Machine Learning Algorithms

arXiv:2605.22604v1 Announce Type: cross Abstract: The advent of cardless artificial intelligence (AI) banking heralds a paradigm shift in the financial landscape, offering users unprecedented security

Interpreting and Steering State-Space Models via Activation Subspace Bottlenecks

arXiv:2602.22719v2 Announce Type: replace Abstract: State-space models (SSMs) have emerged as an efficient strategy for building powerful language models, avoiding the quadratic complexity of computin

Large-scale Score-based Variational Posterior Inference for Bayesian Deep Neural Networks

arXiv:2602.05873v2 Announce Type: replace Abstract: Bayesian (deep) neural networks (BNN) are often more attractive than the vanilla point-estimate deep learning in various aspects including uncertain

Learning Mixture Models via Efficient High-dimensional Sparse Fourier Transforms

arXiv:2601.05157v2 Announce Type: replace-cross Abstract: In this work, we give a {rm poly}(d,k) time and sample algorithm for efficiently learning the parameters of a mixture of k spherical distribut

LEMUR: Learned Multi-Vector Retrieval

arXiv:2601.21853v2 Announce Type: replace-cross Abstract: Multi-vector representations generated by late interaction models, such as ColBERT, enable superior retrieval quality compared to single-vecto

Leveraging Self-Paced Curriculum Learning for Enhanced Modality Balance in Multimodal Conversational Emotion Recognition

arXiv:2605.21565v1 Announce Type: new Abstract: Multimodal Emotion Recognition in Conversations (MERC) is a crucial task for understanding human interactions, where multimodal approaches integrating l

Little by Little: Continual Learning via Incremental Mixture of Rank-1 Associative Memory Experts

arXiv:2506.21035v5 Announce Type: replace Abstract: Continual learning (CL) with large pre-trained models aims to incrementally acquire knowledge without catastrophic forgetting. Existing LoRA-based M

Machine learning prediction of obstructive coronary artery disease using opportunistic coronary calcium and epicardial fat assessments from CT calcium scoring scans

arXiv:2605.21762v1 Announce Type: new Abstract: Non-contrast computed tomography calcium scoring (CTCS) is a cost-effective imaging modality widely used to detect coronary artery calcifications. This

MMD-Balls as Credal Sets: A PAC-Bayesian Framework for Epistemic Uncertainty in Test-Time Adaptation

arXiv:2605.21783v1 Announce Type: new Abstract: Test-time adaptation (TTA) methods improve model performance under distribution shift but lack formal guarantees connecting shift magnitude to predictio

Multi-Modal Machine Learning for Population- and Subject-Specific lncRNA-Type 2 Diabetes Association Analysis

arXiv:2605.20747v1 Announce Type: cross Abstract: Long non-coding RNAs (lncRNAs) are emerging regulatory molecules implicated in chronic disease pathogenesis, including Type 2 Diabetes Mellitus (T2D).

Multiple Neural Operators Achieve Near-Optimal Rates for Multi-Task Learning

arXiv:2605.22724v1 Announce Type: new Abstract: We study the approximation and statistical complexity of learning collections of operators in a shared multi-task setting, with a focus on the Multiple

Near-Optimal Convergence of Accelerated Gradient Methods under Generalized and (L_0, L_1)-Smoothness

arXiv:2508.06884v2 Announce Type: replace-cross Abstract: We study first-order methods for convex optimization problems with functions f satisfying the recently proposed ell-smoothness condition ||nab

Neural Acceleration for Graph Partitioning

arXiv:2605.21519v1 Announce Type: cross Abstract: Graph Partitioning is a critical problem in numerous scientific and engineering domains including social network analysis, VLSI design, and many more.

Neural Flow Operators can Approximate any Operator: Abstract Frameworks and Universal Approcimations

arXiv:2605.22557v1 Announce Type: new Abstract: We introduce an abstract neural flow framework for neural networks and neural operators. The framework contains two continuous-depth models, namely neur

Neuro-Symbolic AI for Analytical Solutions of Differential Equations

arXiv:2502.01476v4 Announce Type: replace Abstract: Analytical solutions to differential equations offer exact, interpretable insight but are rarely available because discovering them requires expert

Noise Schedule Design for Diffusion Models: An Optimal Control Perspective

arXiv:2605.21911v1 Announce Type: new Abstract: We develop a principled framework for analyzing and designing noise schedules in diffusion models. We show that one can recast this design problem as an

On Statistical Estimation of Edge-Reinforced Random Walks

arXiv:2503.06115v2 Announce Type: replace-cross Abstract: Reinforced random walks (RRWs), including vertex-reinforced random walks (VRRWs) and edge-reinforced random walks (ERRWs), model random walks

Optimal Guarantees for Auditing Renyi Differentially Private Machine Learning

arXiv:2605.21938v1 Announce Type: new Abstract: We study black-box auditing for machine learning algorithms that claim R 'enyi differential privacy (RDP) guarantees. We introduce an auditing framework

Optimization over the intersection of manifolds

arXiv:2605.22736v1 Announce Type: cross Abstract: Optimization over the intersection of two manifolds arises in a broad range of applications, but is hindered by the coupled geometry of the feasible r

Partial Fusion of Neural Networks: Efficient Tradeoffs Between Ensembles and Weight Aggregation

arXiv:2605.22350v1 Announce Type: new Abstract: Ensembles of neural networks typically outperform individual networks but incur large computational costs, whereas weight aggregation produces less cost

PeakFocus: Bridging Peak Localization and Intensity Regression via a Unified Multi-Scale Framework for Electricity Load Forecasting

arXiv:2605.21550v1 Announce Type: new Abstract: Electricity load peak forecasting (ELPF), simultaneously predicting peak timing and intensity, is a prerequisite for effective grid scheduling and risk

Physics Priors Offer Useful Accuracy-Carbon Trade-Offs in Spatio-Temporal Forecasting

arXiv:2509.24517v2 Announce Type: replace Abstract: Development of modern deep learning methods has been driven primarily by the push for improving model efficacy (accuracy metrics). This sole focus o

Predicting Performance of Symbolic and Prompt Programs with Examples

arXiv:2605.21515v1 Announce Type: new Abstract: LLM prompting is widely used for naturally stated tasks, yet it is unreliable it may succeed on a few test cases but fail at deployment time. We study p

Prior shift estimation for positive unlabeled data through the lens of kernel embedding

arXiv:2502.21194v3 Announce Type: replace-cross Abstract: We study estimation of a class prior for unlabeled target samples which possibly differs from that of source population. Moreover, it is assum

Prototype-Guided Classification Sub-Task Decoupling Framework: Enhancing Generalization and Interpretability for Multivariate Time Series

arXiv:2605.22055v1 Announce Type: new Abstract: Time Series Classification (TSC) is a long-standing research problem that has gained increasing attention in recent years with the rapid growth of large

Provably Protecting Fine-Tuned LLMs from Training Data Extraction while Preserving Utility

arXiv:2602.00688v2 Announce Type: replace Abstract: Fine-tuning large language models (LLMs) on sensitive datasets raises privacy concerns, as training data extraction (TDE) attacks can expose highly

Q-PhotoNAS: Hybrid Quantum Neural Architecture Search Framework on Photonic Devices

arXiv:2605.22097v1 Announce Type: cross Abstract: Photonic quantum computing is a promising platform for scalable quantum machine learning, but designing effective hybrid architectures remains challen

Quantitative coronary calcification analysis for prediction of myocardial ischemia using non-contrast CT calcium scoring

arXiv:2605.21745v1 Announce Type: new Abstract: Non-contrast computed tomography calcium scoring (CTCS) is widely recognized as an effective tool for cardiovascular risk stratification. This study aim

RADAR: Defending RAG Dynamically against Retrieval Corruption

arXiv:2605.22041v1 Announce Type: cross Abstract: While RAG systems are increasingly deployed in dynamic web search, temporal volatility amplifies their vulnerability to adversarial attacks. Existing

Regret-Based (epsilon,elta)-optimal Stopping Criteria for Bayesian Optimization

arXiv:2605.22561v1 Announce Type: new Abstract: Bayesian optimization (BO) is a widely used iterative black-box optimization method that utilizes Gaussian process (GP) surrogate models. In practice, B

Reinforced Graph of Thoughts: RL-Driven Adaptive Prompting for LLMs

arXiv:2605.22195v1 Announce Type: new Abstract: Graph of Thoughts (GoT), a generalized form of recent prompting paradigms for large language models (LLMs), has been shown to be useful for elaborate pr

Reinforcement learning for ion shuttling on trapped-ion quantum computers

arXiv:2605.22463v1 Announce Type: cross Abstract: Scalable trapped-ion quantum computing is commonly realized with modular chips that feature distinct zones with specific functionalities, such as stor

Relational Linear Properties in Language Models: An Empirical Investigation

arXiv:2605.22532v1 Announce Type: new Abstract: Linear properties are ubiquitous in the representations of language models; however, testing them experimentally remains a challenging task. This work f

Richer Bayesian Last Layers with Subsampled NTK Features

arXiv:2602.01279v2 Announce Type: replace Abstract: Bayesian Last Layers (BLLs) provide a convenient and computationally efficient way to estimate uncertainty in neural networks. However, they underes

Same Architecture, Different Capacity: Optimizer-Induced Spectral Scaling Laws

arXiv:2605.21803v1 Announce Type: new Abstract: Scaling laws have made language-model performance predictable from model size, data, and compute, but they typically treat the optimizer as a fixed trai

SCI-Defense: Defending Manipulation Attacks from Generative Engine Optimization

arXiv:2605.21948v1 Announce Type: new Abstract: LLM-based ranking systems are vulnerable to Generative Engine Optimization (GEO) attacks, where adversaries inject semantic signals into product descrip

SDPM: Survival Diffusion Probabilistic Model for Continuous-Time Survival Analysis

arXiv:2605.22776v1 Announce Type: new Abstract: Survival analysis aims to estimate a time-to-event distribution from data with censored observations. Many existing methods either impose structural ass

Self-orthogonalizing attractor neural networks emerging from the free energy principle

arXiv:2505.22749v2 Announce Type: replace-cross Abstract: Attractor dynamics are a hallmark of many complex systems, including the brain. Understanding how such self-organizing dynamics emerge from fi

SepsisAI Orchestrator: A Containerized and Scalable Platform for Deploying AI Models and Real-Time Monitoring in Early Sepsis Detection

arXiv:2605.22331v1 Announce Type: new Abstract: Despite strong predictive results in the clinical machine learning literature, the translation of these models into bedside use remains limited by syste

Soft Bayesian Context Tree Models for Real-Valued Time Series

arXiv:2601.11079v2 Announce Type: replace Abstract: This paper proposes the soft Bayesian context tree model (Soft-BCT), which is a novel BCT model for real-valued time series. The Soft-BCT considers

Sparse Orthogonal Parameters Tuning for Continual Learning

arXiv:2411.02813v3 Announce Type: replace Abstract: Continual learning methods based on pre-trained models (PTM) have recently gained attention which adapt to successive downstream tasks without catas

SWE-MiniSandbox: Container-Free Reinforcement Learning for Building Software Engineering Agents

arXiv:2602.11210v4 Announce Type: replace-cross Abstract: Reinforcement learning (RL) has become a key paradigm for training software engineering (SWE) agents, but existing pipelines typically rely on