Search: “research”

Critical Windows of Complexity Control: When Transformers Decide to Reason or Memorize

arXiv:2605.04396v1 Announce Type: new Abstract: Recent work has shown that Transformers' compositional generalization is governed by complexity control, initialization scale and weight decay, which st

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Cross-Tokenizer Likelihood Scoring Algorithms for Language Model Distillation

DGX agent

arXiv:2512.14954v2 Announce Type: replace Abstract: Computing next-token likelihood ratios between two language models (LMs) is a standard task in training paradigms such as knowledge distillation. Si

researcharxiv-cs-cl

7 May 2026

Dataset-Driven Channel Masks in Transformers for Multivariate Time Series

arXiv:2410.23222v3 Announce Type: replace Abstract: Recent advancements in foundation models have been successfully extended to the time series (TS) domain, facilitated by the emergence of large-scale

Deco: Extending Personal Physical Objects into Pervasive AI Companion through a Dual-Embodiment Framework

arXiv:2605.03882v1 Announce Type: cross Abstract: Individuals frequently form deep attachments to physical objects (e.g., plush toys) that usually cannot sense or respond to their emotions. While AI c

Deepfake Audio Detection Using Self-supervised Fusion Representations

arXiv:2605.03420v1 Announce Type: cross Abstract: This paper describes a submission to the Environment-Aware Speech and Sound Deepfake Detection Challenge (ESDD2) 2026, which addresses component-level

DeFed-GMM-DaDiL: A Decentralized Federated Framework for Domain Adaptation

arXiv:2605.04324v1 Announce Type: new Abstract: Decentralized multi-source domain adaptation seeks to transfer knowledge from multiple heterogeneous and related source domains to an unlabeled target d

Demystifying Manifold Constraints in LLM Pre-training

arXiv:2605.04418v1 Announce Type: new Abstract: The empirical success of large language model (LLM) pre-training relies heavily on heuristic stabilization techniques, such as explicit normalization la

Denoising Particle Filters: Learning State Estimation with Single-Step Objectives

arXiv:2602.19651v2 Announce Type: replace-cross Abstract: Learning-based methods commonly treat state estimation in robotics as a sequence modeling problem. While this paradigm can be effective at max

Densification and forecasting of Sentinel-2 time series from multimodal SAR and Optical satellite data using deep generative models

arXiv:2605.04239v1 Announce Type: new Abstract: Optical satellite image time series are extensively used in many Earth observation applications, including agriculture, climate monitoring, and land sur

Detecting Deepfakes via Hamiltonian Dynamics

arXiv:2605.04405v1 Announce Type: new Abstract: Driven by the rapid development of generative AI models, deepfake detectors are compelled to undergo periodic recalibration to capture newly developed s

Detecting Hallucinations in Large Language Models via Internal Attention Divergence Signals

arXiv:2605.05025v1 Announce Type: new Abstract: We propose a lightweight and single-pass uncertainty quantification method for detecting hallucinations in Large Language Models. The method uses attent

DIAL: Direct Iterative Adversarial Learning for Realistic Multi-Turn Dialogue Simulation

arXiv:2512.20773v4 Announce Type: replace Abstract: Realistic user simulation is crucial for training and evaluating multi-turn dialogue systems, yet creating simulators that accurately replicate huma

Diffusion-Based Feature Denoising with NNMF for Robust handwritten digit multi-class classification

arXiv:2603.29917v2 Announce Type: replace Abstract: This work presents a robust multi-class classification framework for handwritten digits that combines diffusion-driven feature denoising with a hybr

Diffusion for generating/editing ASTs? [D]

researchr-machinelearning

Recent advances in diffusion-based language models enable controllable sequence generation, but applying them to structured code remains challenging, prompting exploration of syntax-aware diffusion fr

Disentangled Learning Improves Implicit Neural Representations for Medical Reconstruction

arXiv:2605.04234v1 Announce Type: new Abstract: Implicit neural representations (INRs) have emerged as a powerful paradigm for medical imaging via physics-informed unsupervised learning. Classical INR

DistributedEstimator: Distributed Training of Quantum Neural Networks via Circuit Cutting

arXiv:2602.16233v2 Announce Type: replace-cross Abstract: Circuit cutting decomposes a large quantum circuit into smaller subcircuits whose outputs are classically reconstructed to recover original ex

Distributional Principal Autoencoders

arXiv:2404.13649v2 Announce Type: replace-cross Abstract: Dimension reduction techniques usually lose information in the sense that reconstructed data are not identical to the original data. However,

DPD-Cancer: Explainable Graph-Based Deep Learning for Small Molecule Anti-Cancer Activity Prediction

arXiv:2603.26114v2 Announce Type: replace Abstract: DPD-Cancer is a graph-attention deep learning framework for predicting small-molecule DPD-Cancer is a graph-attention deep learning framework for pr

DyWPE: Signal-Aware Dynamic Wavelet Positional Encoding for Time Series Transformers

arXiv:2509.14640v2 Announce Type: replace Abstract: Existing positional encoding methods in transformers are fundamentally signal-agnostic, deriving positional information solely from sequence indices

EdgeRazor: A Lightweight Framework for Large Language Models via Mixed-Precision Quantization-Aware Distillation

arXiv:2605.04062v1 Announce Type: new Abstract: Recent years have witnessed an increasing interest in deploying LLMs on resource-constrained devices, among which quantization has emerged as a promisin

Efficient Handwriting-Based Alzheimer,s Disease Diagnosis Using a Low-Rank Mixture of Experts Deep Learning Framework

arXiv:2605.04079v1 Announce Type: new Abstract: Early and reliable detection of Alzheimer's disease (AD) is crucial for timely clinical intervention and improved patient management. It also supports t

Enabling Real-Time Training of a Wildfire-to-Smoke Map with Multilinear Operators

arXiv:2605.04164v1 Announce Type: new Abstract: Wildfires are a major producer of fine particulate matter, impacting human health and the electrical grid. Accurately forecasting smoke impacts over lon

Ensuring Reliability in Programming Knowledge Tracing: A Re-evaluation of Attention-augmented Models and Experimental Protocols

arXiv:2605.04727v1 Announce Type: new Abstract: Programming Knowledge Tracing (PKT) has recently advanced through hybrid approaches that integrate attention-based feature modeling for code representat

Entropic Riemannian Neural Optimal Transport

arXiv:2605.04255v1 Announce Type: cross Abstract: Many machine learning problems involve data supported on curved spaces such as spheres, rotation groups, hyperbolic spaces, and general Riemannian man

Evaluating Prompting and Execution-Based Methods for Deterministic Computation in LLMs

arXiv:2605.03227v1 Announce Type: new Abstract: Large Language Models (LLMs) have demonstrated strong capabilities in natural language understanding and reasoning. However, their ability to perform ex

Evidence-based anomaly detection in clinical domains

arXiv:2605.04664v1 Announce Type: new Abstract: Anomaly detection methods can be very useful in identifying interesting or concerning events. In this work, we develop and examine new probabilistic ano

External Validation of Deep Learning Models for BI-RADS Breast Density Prediction from Ultrasound Images

arXiv:2605.05082v1 Announce Type: cross Abstract: We externally validated three deep learning models (DenseNet121, ViT-B/32, and ResNet50) for predicting mammographic breast density from breast ultras

FAAST: Forward-Only Associative Learning via Closed-Form Fast Weights for Test-Time Supervised Adaptation

arXiv:2605.04651v1 Announce Type: cross Abstract: Adapting pretrained models typically involves a trade-off between the high training costs of backpropagation and the heavy inference overhead of memor

FaithfulFaces: Pose-Faithful Facial Identity Preservation for Text-to-Video Generation

arXiv:2605.04702v1 Announce Type: new Abstract: Identity-preserving text-to-video generation (IPT2V) empowers users to produce diverse and imaginative videos with consistent human facial identity. Des

Feature importance analysis for patient management decisions

arXiv:2605.04666v1 Announce Type: new Abstract: The objective of this paper is to understand what characteristics and features of clinical data influence physician's decision about ordering laboratory

Federated Learning for Early Prediction of EV Charging Demand

arXiv:2605.04993v1 Announce Type: new Abstract: Accurate forecasting of electric vehicle (EV) charging demand is critical for grid stability, infrastructure planning, and real-time charging optimizati

FMI_SU_Yotkova_Kastreva at SemEval-2026 Task 13: Lightweight Detection of LLM-Generated Code via Stylometric Signals

arXiv:2605.04157v1 Announce Type: new Abstract: SemEval-2026 Task 13 investigates machine-generated code detection across multiple programming languages and application scenarios, asking participating

Agents

From Knowledge to Action: Outcomes of the 2025 Large Language Model (LLM) Hackathon for Applications in Materials Science and Chemistry

arXiv:2605.03205v1 Announce Type: cross Abstract: Large language models (LLMs) are rapidly changing how researchers in materials science and chemistry discover, organize, and act on scientific knowled

agentsarxiv-cs-ai

From Passive Feeds to Guided Discovery: AI-Initiated Interaction for Vague Intent in Content Exploration

arXiv:2605.02902v1 Announce Type: cross Abstract: Recommendation feeds work well when people are simply browsing, and search works well when they can formulate a query. Between these two cases is a co

From Pixels to Tokens: A Systematic Study of Latent Action Supervision for Vision-Language-Action Models

arXiv:2605.04678v1 Announce Type: cross Abstract: Latent actions serve as an intermediate representation that enables consistent modeling of vision-language-action (VLA) models across heterogeneous da

From Priors to Perception: Grounding Video-LLMs in Physical Reality

arXiv:2605.04515v1 Announce Type: new Abstract: While Video Large Language Models (Video-LLMs) excel in general understanding, they exhibit systematic deficits in fine-grained physical reasoning. Exis

From Video-to-PDE: Data-Driven Discovery of Nonlinear Dye Plume Dynamics

arXiv:2605.04535v1 Announce Type: new Abstract: Inferring continuum models directly from video is hampered by two facts: the recorded field is uncalibrated image intensity rather than a physical state

Full-chip CMP modelling based on Fully Convolutional Network leveraging White Light Interferometry

arXiv:2605.05062v1 Announce Type: new Abstract: As time-to-market is crucial in the Integrated Circuit (IC) industry, speeding up layout manufacturability verifi-cation is essential. Chemical-Mechanic

Fully Guided Neural Schrodinger bridge for Brain MR image synthesis

arXiv:2501.14171v3 Announce Type: replace-cross Abstract: Multi-modal brain MRI provides essential complementary information for clinical diagnosis. However, acquiring all modalities in practice is of

Geometric Entropy and Retrieval Phase Transitions in Continuous Thermal Dense Associative Memory

arXiv:2604.07401v2 Announce Type: replace-cross Abstract: We study the thermodynamic memory capacity of modern Hopfield networks (Dense Associative Memory models) with continuous states under geometri

Geometry-Aware Neural Optimizer for Shape Optimization and Inversion

arXiv:2605.04474v1 Announce Type: new Abstract: Geometry is central to PDE-governed systems, motivating shape optimization and inversion. Classical pipelines conduct costly forward simulation with geo

GTF: Omnidirectional EPI Transformer for Light Field Super-Resolution

arXiv:2605.04581v1 Announce Type: new Abstract: Light field (LF) image super-resolution benefits from Epipolar Plane Images (EPIs), whose line slopes explicitly encode disparity. However, existing Tra

Gyan: An Explainable Neuro-Symbolic Language Model

arXiv:2605.04759v1 Announce Type: new Abstract: Transformer based pre-trained large language models have become ubiquitous. There is increasing evidence to suggest that even with large scale pre-train

How Long Does Infinite Width Last? Signal Propagation in Long-Range Linear Recurrences

arXiv:2605.05113v1 Announce Type: new Abstract: We study signal propagation in linear recurrent models at finite width. While existing signal propagation theory relies predominantly on the infinite-wi

Applications

Human-AI Co-Mentorship in Project-Based Learning: A Case Study in Financial Forecasting

arXiv:2605.05144v1 Announce Type: new Abstract: This paper reflects on a AI research project carried out by a team of high-school and early-undergraduate students under the mentorship of graduate rese

applicationsarxiv-cs-lg

Hybrid Iterative Neural Low-Regularity Integrator for Nonlinear Dispersive Equations

arXiv:2605.04853v1 Announce Type: new Abstract: We propose HIN-LRI, a hybrid framework that augments a classical numerical solver with a neural operator trained to correct the solver's structured trun

Ilov3Splat: Instance-Level Open-Vocabulary 3D Scene Understanding in Gaussian Splatting

arXiv:2605.04506v1 Announce Type: new Abstract: We introduce Ilov3Splat, a novel framework for instance-level open-vocabulary 3D scene understanding built on 3D Gaussian Splatting (3D-GS). Most prior

Implicit Representations of Grammaticality in Language Models

arXiv:2605.05197v1 Announce Type: new Abstract: Grammaticality and likelihood are distinct notions in human language. Pretrained language models (LMs), which are probabilistic models of language fitte