Search: “arxiv-cs-lg”

SLE-FNO: Single-Layer Extensions for Task-Agnostic Continual Learning in Fourier Neural Operators

arXiv:2603.20410v2 Announce Type: replace Abstract: Scientific machine learning is increasingly used to build surrogate models, yet most models are trained under a restrictive assumption in which futu

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Softpick: No Attention Sink, No Massive Activations with Rectified Softmax

DGX agent

arXiv:2504.20966v4 Announce Type: replace Abstract: We introduce softpick, a rectified, not sum-to-one, drop-in replacement for softmax in transformer attention mechanisms that eliminates attention si

model-releasesarxiv-cs-lg

20 Apr 2026

Solving Inverse Parametrized Problems via Finite Elements and Extreme Learning Networks

arXiv:2602.14757v2 Announce Type: replace-cross Abstract: We develop an interpolation-based modeling framework for parameter-dependent partial differential equations arising in control, inverse proble

Local Ai

Spira: Exploiting Voxel Data Structural Properties for Efficient Sparse Convolution in Point Cloud Networks

arXiv:2511.20834v2 Announce Type: replace-cross Abstract: Sparse Convolution (SpC) powers 3D point cloud networks widely used in autonomous driving and augmented/virtual reality. SpC builds a kernel m

local-aiarxiv-cs-lg

Stargazer: A Scalable Model-Fitting Benchmark Environment for AI Agents under Astrophysical Constraints

arXiv:2604.15664v1 Announce Type: new Abstract: The rise of autonomous AI agents suggests that dynamic benchmark environments with built-in feedback on scientifically grounded tasks are needed to eval

Applications

Tabular foundation models for in-context prediction of molecular properties

arXiv:2604.16123v1 Announce Type: new Abstract: Accurate molecular property prediction is central to drug discovery, catalysis, and process design, yet real-world applications are often limited by sma

applicationsarxiv-cs-lg

Teaching Language Models Mechanistic Explainability Through MechSMILES

arXiv:2512.05722v2 Announce Type: replace Abstract: Chemical reaction mechanisms are the foundation of how chemists evaluate reactivity and feasibility, yet current Computer-Assisted Synthesis Plannin

The Harder Path: Last Iterate Convergence for Uncoupled Learning in Zero-Sum Games with Bandit Feedback

arXiv:2604.16087v1 Announce Type: new Abstract: We study the problem of learning in zero-sum matrix games with repeated play and bandit feedback. Specifically, we focus on developing uncoupled algorit

The Machine Learning Approach to Moment Closure Relations for Plasma: A Review

arXiv:2511.22486v2 Announce Type: replace-cross Abstract: The requirement for large-scale global simulations of plasma is an ongoing challenge in both space and laboratory plasma physics. Any simulati

The Spectral Geometry of Thought: Phase Transitions, Instruction Reversal, Token-Level Dynamics, and Perfect Correctness Prediction in How Transformers Reason

arXiv:2604.15350v1 Announce Type: new Abstract: We discover that large language models exhibit spectral phase transitions in their hidden activation spaces when engaging in reasoning versus factual re

Tutorials

TopFeaRe: Locating Critical State of Adversarial Resilience for Graphs Regarding Topology-Feature Entanglement

arXiv:2604.15370v1 Announce Type: cross Abstract: Graph adversarial attacks are usually produced from the two perspectives of topology/structure and node feature, both of them represent the paramount

tutorialsarxiv-cs-lg

Towards Robust Endogenous Reasoning: Unifying Drift Adaptation in Non-Stationary Tuning

arXiv:2604.15705v1 Announce Type: new Abstract: Reinforcement Fine-Tuning (RFT) has established itself as a critical paradigm for the alignment of Multi-modal Large Language Models (MLLMs) with comple

Towards Universal Convergence of Backward Error in Linear System Solvers

arXiv:2604.16075v1 Announce Type: cross Abstract: The quest for an algorithm that solves an nimes n linear system in O(n^2) time complexity, or O(n^2 ext{poly}(1/epsilon)) when solving up to epsilon r

Truncated Kernel Stochastic Gradient Descent with General Losses and Spherical Radial Basis Functions

arXiv:2510.04237v5 Announce Type: replace Abstract: In this paper, we propose a novel kernel stochastic gradient descent (SGD) algorithm for large-scale supervised learning with general losses. Compar

TwinTrack: Post-hoc Multi-Rater Calibration for Medical Image Segmentation

arXiv:2604.15950v1 Announce Type: new Abstract: Pancreatic ductal adenocarcinoma (PDAC) segmentation on contrast-enhanced CT is inherently ambiguous: inter-rater disagreement among experts reflects ge

Two-Dimensional Deep ReLU CNN Approximation for Korobov Functions: A Constructive Approach

arXiv:2503.07976v2 Announce Type: replace-cross Abstract: This paper investigates approximation capabilities of two-dimensional (2D) deep convolutional neural networks (CNNs), with Korobov functions s

Univariate Channel Fusion for Multivariate Time Series Classification

arXiv:2604.16119v1 Announce Type: new Abstract: Multivariate time series classification (MTSC) plays a crucial role in various domains, including biomedical signal analysis and motion monitoring. Howe

Unsupervised domain adaptation for radioisotope identification in gamma spectroscopy

arXiv:2603.05719v2 Announce Type: replace Abstract: Training machine learning models for radioisotope identification using gamma spectroscopy remains an elusive challenge for many practical applicatio

Verification Modulo Tested Library Contracts

arXiv:2604.15533v1 Announce Type: cross Abstract: We consider the problem of verification modulo tested library contracts as a step towards automating the verification of client programs that use comp

(Weighted) Adaptive Radius Near Neighbor Search: Evaluation for WiFi Fingerprint-based Positioning

arXiv:2604.15940v1 Announce Type: new Abstract: Fixed Radius Near Neighbor (FRNN) search is an alternative to the widely used k Nearest Neighbors (kNN) search. Unlike kNN, FRNN determines a label or a

What Makes LLMs Effective Sequential Recommenders? A Study on Preference Intensity and Temporal Context

arXiv:2506.02261v3 Announce Type: replace-cross Abstract: What enables large language models (LLMs) to effectively model user preferences in sequential recommendation? Our investigation reveals that e

Why Colors Make Clustering Harder:Global Integrality Gaps, the Price of Fairness, and Color-Coupled Algorithms in Chromatic Correlation Clustering

arXiv:2604.15738v1 Announce Type: new Abstract: Chromatic Correlation Clustering (CCC) extends Correlation Clustering by assigning semantic colors to edges and requiring each cluster to receive a sing

Zero-Shot Scalable Resilience in UAV Swarms: A Decentralized Imitation Learning Framework with Physics-Informed Graph Interactions

arXiv:2604.15762v1 Announce Type: new Abstract: Large-scale Unmanned Aerial Vehicle (UAV) failures can split an unmanned aerial vehicle swarm network into disconnected sub-networks, making decentraliz

A Mechanistic Account of Attention Sinks in GPT-2: One Circuit, Broader Implications for Mitigation

arXiv:2604.14722v1 Announce Type: new Abstract: Transformers commonly exhibit an attention sink: disproportionately high attention to the first position. We study this behavior in GPT-2-style models w

A Nonlinear Separation Principle: Applications to Neural Networks, Control and Learning

arXiv:2604.15238v1 Announce Type: cross Abstract: This paper investigates continuous-time and discrete-time firing-rate and Hopfield recurrent neural networks (RNNs), with applications in nonlinear co

A Synonymous Variational Perspective on the Rate-Distortion-Perception Tradeoff

arXiv:2604.14603v1 Announce Type: cross Abstract: The fundamental limit of natural signal compression has traditionally been characterized by classical rate-distortion (RD) theory through the tradeoff

Active Learning with Selective Time-Step Acquisition for PDEs

arXiv:2511.18107v2 Announce Type: replace Abstract: Accurately solving partial differential equations (PDEs) is critical to understanding complex scientific and engineering phenomena, yet traditional

Adaptive Canonicalization with Application to Invariant Anisotropic Geometric Networks

arXiv:2509.24886v3 Announce Type: replace Abstract: Canonicalization is a widely used strategy in equivariant machine learning, enforcing symmetry in neural networks by mapping each input to a standar

Adaptive Test-Time Compute Allocation for Reasoning LLMs via Constrained Policy Optimization

arXiv:2604.14853v1 Announce Type: new Abstract: Test-time compute scaling, the practice of spending extra computation during inference via repeated sampling, search, or extended reasoning, has become

AgentGA: Evolving Code Solutions in Agent-Seed Space

arXiv:2604.14655v1 Announce Type: cross Abstract: We present AgentGA, a framework that evolves autonomous code-generation runs by optimizing the agent seed: the task prompt plus optional parent archiv

Local Ai

AIPC: Agent-Based Automation for AI Model Deployment with Qualcomm AI Runtime

arXiv:2604.14661v1 Announce Type: cross Abstract: Edge AI model deployment is a multi-stage engineering process involving model conversion, operator compatibility handling, quantization calibration, r

local-aiarxiv-cs-lg

Amortized Optimal Transport from Sliced Potentials

arXiv:2604.15114v1 Announce Type: cross Abstract: We propose a novel amortized optimization method for predicting optimal transport (OT) plans across multiple pairs of measures by leveraging Kantorovi

Agents

An Intelligent Robotic and Bio-Digestor Framework for Smart Waste Management

arXiv:2604.14882v1 Announce Type: cross Abstract: Rapid urbanization and continuous population growth have made municipal solid waste management increasingly challenging. These challenges highlight th

agentsarxiv-cs-lg

An unsupervised decision-support framework for multivariate biomarker analysis in athlete monitoring

arXiv:2604.14534v1 Announce Type: new Abstract: Purpose. Athlete monitoring is constrained by small cohorts, heterogeneous biomarker scales, limited feasibility of repeated sampling, and the lack of r

Anomaly Detection in IEC-61850 GOOSE Networks: Evaluating Unsupervised and Temporal Learning for Real-Time Intrusion Detection

arXiv:2604.14233v1 Announce Type: cross Abstract: The IEC-61850 GOOSE protocol underpins time-critical communication in modern digital substations but lacks native security mechanisms, leaving it vuln

Assessing the Performance-Efficiency Trade-off of Foundation Models in Probabilistic Electricity Price Forecasting

arXiv:2604.14739v1 Announce Type: new Abstract: Large-scale renewable energy deployment introduces pronounced volatility into the electricity system, turning grid operation into a complex stochastic o

Assessing the Potential of Masked Autoencoder Foundation Models in Predicting Downhole Metrics from Surface Drilling Data

arXiv:2604.15169v1 Announce Type: new Abstract: Oil and gas drilling operations generate extensive time-series data from surface sensors, yet accurate real-time prediction of critical downhole metrics

Asynchronous Probability Ensembling for Federated Disaster Detection

arXiv:2604.14450v1 Announce Type: new Abstract: Quick and accurate emergency handling in Disaster Decision Support Systems (DDSS) is often hampered by network latency and suboptimal application accura

Local Ai

Atropos: Improving Cost-Benefit Trade-off of LLM-based Agents under Self-Consistency with Early Termination and Model Hotswap

arXiv:2604.15075v1 Announce Type: cross Abstract: Open-weight Small Language Models(SLMs) can provide faster local inference at lower financial cost, but may not achieve the same performance level as

local-aiarxiv-cs-lg

AutoRAN: Automated Hijacking of Safety Reasoning in Large Reasoning Models

arXiv:2505.10846v3 Announce Type: replace Abstract: This paper presents AutoRAN, the first framework to automate the hijacking of internal safety reasoning in large reasoning models (LRMs). At its cor

Auxiliary Finite-Difference Residual-Gradient Regularization for PINNs

arXiv:2604.14472v1 Announce Type: new Abstract: Physics-informed neural networks (PINNs) are often selected by a single scalar loss even when the quantity of interest is more specific. We study a hybr

Awakening Dormant Experts:Counterfactual Routing to Mitigate MoE Hallucinations

arXiv:2604.14246v1 Announce Type: new Abstract: Sparse Mixture-of-Experts (MoE) models have achieved remarkable scalability, yet they remain vulnerable to hallucinations, particularly when processing

Applications

Bayesian Optimization with Gaussian Processes to Accelerate Stationary Point Searches

arXiv:2603.10992v3 Announce Type: replace-cross Abstract: Building local surrogates to accelerate stationary point searches on potential energy surfaces spans decades of effort. Done correctly, surrog

applicationsarxiv-cs-lg

Benchmarking Optimizers for MLPs in Tabular Deep Learning

arXiv:2604.15297v1 Announce Type: new Abstract: MLP is a heavily used backbone in modern deep learning (DL) architectures for supervised learning on tabular data, and AdamW is the go-to optimizer used

Best of both worlds: Stochastic & adversarial best-arm identification

arXiv:2604.14860v1 Announce Type: cross Abstract: We study bandit best-arm identification with arbitrary and potentially adversarial rewards. A simple random uniform learner obtains the optimal rate o

Beyond Importance Sampling: Rejection-Gated Policy Optimization

arXiv:2604.14895v1 Announce Type: new Abstract: We propose a new perspective on policy optimization: rather than reweighting all samples by their importance ratios, an optimizer should select which sa

Beyond the Laplacian: Doubly Stochastic Matrices for Graph Neural Networks

arXiv:2604.15069v1 Announce Type: new Abstract: Graph Neural Networks (GNNs) conventionally rely on standard Laplacian or adjacency matrices for structural message passing. In this work, we substitute

Bias in Surface Electromyography Features across a Demographically Diverse Cohort

arXiv:2604.14460v1 Announce Type: cross Abstract: Neuromotor decoding from upper-limb electromyography (sEMG) can enhance human-machine interfaces and offer a more natural means of controlling prosthe