Search: “multimodal”

Atom-JEPA: Joint-Embedding Predictive Architecture for 3D Atomistic Systems

arXiv:2610.08400v1 Announce Type: cross Abstract: Large-scale self-supervised pretraining has reshaped modern machine learning, substantially advancing the ability of language and vision models to gen

researcharxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Beyond Scalar IoU: Structured Verification from Rollout Groups for Video Temporal Grounding

DGX agent

arXiv:2610.07601v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) provides a natural framework for adapting pretrained models to video temporal grounding, where gen

safetyarxiv-cs-ai

7 Oct 2026

CCDF: A Benchmark Dataset for Deepfake Detection in Real-World Surveillance Footage

arXiv:2610.07939v1 Announce Type: new Abstract: Due to rapid advances in Generative AI, commercial video generation tools can be used to produce fabricated surveillance footage that can fool both huma

Conversation Is a Two-Body Problem: Dyadic Evaluation of Full-Duplex Dialogue Models

arXiv:2610.08125v1 Announce Type: cross Abstract: Full-duplex spoken dialogue models listen and speak at the same time, enabling voice agents to have natural, low-latency interactions that turn-based

researcharxiv-cs-cl

Disentangling Dual Image References in Frequency Aware Diffusion Models for Personalized Generation

arXiv:2610.07684v1 Announce Type: cross Abstract: Personalized image generation aims to synthesize text-driven images conditioned on reference images, while mainly casting the generation as image cust

researcharxiv-cs-ai

Emoception: Selective Affective Layer Fine-Tuning of Video Vision Transformers for Player Arousal Change Recognition From Gameplay Footage

arXiv:2610.07603v1 Announce Type: cross Abstract: This article proposes Selective Affective Layer Fine-Tuning (SALFT), an efficient adaptation framework for Video Vision Transformers in player arousal

researcharxiv-cs-ai

Local Ai

Exact Unlearning via Quantized Sufficient Statistics

arXiv:2610.07197v1 Announce Type: new Abstract: Exact unlearning requires a deployed predictor to match one rebuilt without the information named by a deletion request. Existing general-purpose exact

local-aiarxiv-cs-lg

How Well Do LLMs Reason with Noisy Evidence? An Active Visual Reasoning Benchmark

arXiv:2610.07751v1 Announce Type: new Abstract: Real-world reasoning rarely reduces to static question answering: agents must actively gather information from tools and sensors that are often noisy an

InterCorrect: Intersection-Aware Correction of Demographic Model Merging for Fair ASR

arXiv:2610.08604v1 Announce Type: new Abstract: Automatic Speech Recognition (ASR) systems often show uneven performance across demographic groups, and errors can be especially difficult to address fo

researcharxiv-cs-cl

Less Is More: A Leakage-Controlled Study of Dermoscopic Preprocessing for Joint Skin Lesion Classification and Segmentation with YOLO26

arXiv:2610.08570v1 Announce Type: cross Abstract: Handcrafted preprocessing is widely employed in automated dermoscopic analysis to suppress imaging artifacts and enhance lesion visibility. Neverthele

MS-ECG-FM: Towards a More Universal Electrocardiogram Foundation Model for Health Monitoring using Multi-source Contrastive Learning

arXiv:2610.07662v1 Announce Type: new Abstract: Electrocardiography (ECG) records the electrical activity of the heart, aiding diagnosis by detecting abnormalities in cardiac function. ECG foundation

safetyarxiv-cs-lg

Natural Language Questions as an Interface for Knowledge Graphs: QRAKEN Graph Distillation and Semantic Self-Healing

arXiv:2610.08095v1 Announce Type: new Abstract: Natural-language access to RDF knowledge graphs is a core Semantic Web ambition. Large language models (LLMs) have advanced Text-to-SPARQL, yet on unfam

OTel: Open Telco AI Datasets, Benchmarks, and Models

arXiv:2610.07766v1 Announce Type: new Abstract: We present Open Telco (OTel), an open telecom AI resource that releases derived telecom datasets for retrieval, reranking, instruction tuning, and safet

Revisiting Numerical Forecasting Models for Language-Based Trajectory Prediction

arXiv:2610.07954v1 Announce Type: new Abstract: Language-based trajectory predictors represent coordinates as discrete tokens and learn auxiliary tasks such as destination and group reasoning. This fo

Reward-Driven Learning under Prompt-Level Differential Privacy

model-releasesarxiv-cs-lg

arXiv:2610.07212v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) trains a language model on problems that may themselves be confidential, and the trained model can

Local Ai

SAGE: Semantic Anchor-Guided Evolution for Grounded Medical QA Data Synthesis

arXiv:2610.08093v1 Announce Type: cross Abstract: Developing reliable models for clinical tasks, such as Medical Question Answering (QA), is severely constrained by the limited availability of high-qu

local-aiarxiv-cs-ai

ShanLiangRen: A Nutrition Agent for Personalized Daily Meal Planning

arXiv:2610.07886v1 Announce Type: new Abstract: Dietary nutrition planning plays an important role in chronic disease management and maintaining a healthy body. In applications, it must simultaneously

The Failure Is in the Readout: Fine-Grained Emotion Recognition Benchmarks Measure Elicitation, Not Perception

model-releasesarxiv-cs-cl

arXiv:2610.08162v1 Announce Type: cross Abstract: Fine-grained emotion recognition supports therapy tools and social robots, but it needs facial data, which raises privacy and data-protection concerns

Adaptive Bregman Alternating Projections for Feasible Gromov-Wasserstein Learning

arXiv:2610.04264v1 Announce Type: new Abstract: The Gromov-Wasserstein (GW) problem compares structured distributions without requiring a shared feature space or known correspondences, but its nonconv

safetyarxiv-cs-lg

Applications

Bridging the EHR Divide: Asymmetric Contrastive Learning for Cross-National Medical Representation Transfer

arXiv:2610.04946v1 Announce Type: new Abstract: Cross-system transfer of longitudinal Electronic Health Record (EHR) representations is challenging because clinical coding, patient populations, and he

applicationsarxiv-cs-lg

CoDG-Net: Structure-Guided Style Diffusion and Collaborative Learning to Mitigate Catastrophic Forgetting in Medical Image Domain Generalization

arXiv:2610.05053v1 Announce Type: new Abstract: Domain Generalization (DG) for medical image segmentation is both highly challenging and critically important. However, existing medical DG methods larg

Continual Action Quality Assessment via Adaptive Manifold-Aligned Graph Regularization

arXiv:2510.06842v2 Announce Type: replace Abstract: Action Quality Assessment (AQA) quantifies human actions in videos, supporting applications in sports scoring, rehabilitation, and skill evaluation.

De-occluding broadband metalens

arXiv:2601.19403v2 Announce Type: replace-cross Abstract: Obstructions such as raindrops, fences, or dust degrade captured images, especially when mechanical cleaning is infeasible. Conventional solut

Detecting Defects that Matter: An Application-Driven Benchmark for Anomaly Detection in Manufacturing and Retail Logistics (VAND 4.0 Challenge)

arXiv:2610.04392v1 Announce Type: new Abstract: Existing Anomaly Detection benchmarks are saturated and often unrealistic. As part of the VAND 4.0 Challenge, we introduce a hidden-test, application-dr

Encoded but Not in Control: Revealing the Grounding Gap in Vision-Language Robot Policies

arXiv:2610.06235v1 Announce Type: cross Abstract: Instruction following is central to language-conditioned robot policies: language should determine what to do when the same scene permits multiple val

safetyarxiv-cs-lg

Enhancing Long-Video VLM Embeddings with Query-Aware Streaming Latent Reasoning

arXiv:2610.04864v1 Announce Type: new Abstract: Long-video embedding requires capturing sparse query-relevant evidence under a limited visual-token budget. Uniform sampling can miss brief events in vi

Environmental sensor readings in two crop disease image datasets identify the session in which each image was taken

arXiv:2610.06369v1 Announce Type: new Abstract: Integrating environmental sensor data with leaf imagery is widely reported to boost crop disease classification accuracy. In this work, we reveal that t

Extending Dynamic World Surface Water Mapping to Sentinel-1 with AlphaEarth Embeddings

arXiv:2610.06704v1 Announce Type: new Abstract: Dynamic World (DW) maps land use and land cover globally at 10 m from Sentinel-2 (S2) imagery, but only for cloud-free observations, which limits where

FoleyGenEx: Unified Video-to-Audio Generation with Multi-Modal Control, Temporal Alignment, and Semantic Precision

arXiv:2606.14049v2 Announce Type: replace-cross Abstract: We present FoleyGenEx, a unified video-to-audio (VTA) framework integrating multi-modal control, frame-level temporal alignment, and fine-grai

Fractal Cross Product: Theory, Differentiable Implementation and Application to Medical Image Analysis

arXiv:2610.03755v1 Announce Type: new Abstract: The magnitude of the generalized Euclidean cross product is a Gram volume whose degree under common scaling is fixed by the integer dimension of the spa

Agents

From Social Reasoning to Embodied Interaction: An Agentic Framework for Social Robots

arXiv:2610.05964v1 Announce Type: new Abstract: Natural face-to-face human--robot interaction requires a robot to understand an evolving social situation, decide when to engage, and express its intent

agentsarxiv-cs-ro

GNN-CB: A Graph Neural Network Competition Benchmark for Human and LLM Evaluation

model-releasesarxiv-cs-lg

arXiv:2610.05387v1 Announce Type: new Abstract: Large language models (LLMs) have demonstrated strong performance on coding and reasoning benchmarks; however, their ability to solve graph-structured m

Infant simulator with an embodied caregiver: Generating infant-perspective touch and vision during social interaction

arXiv:2610.05997v1 Announce Type: new Abstract: Early development unfolds in caregiver-infant dyads, where infants' sensorimotor streams are shaped by physical contact and face-to-face interaction. Ye

researcharxiv-cs-ro

InterMimicGen: Scaling Humanoid Loco-Manipulation through Self-Evolving Motion Imitation

arXiv:2610.06850v1 Announce Type: cross Abstract: Captured human-object interactions provide rich supervision for humanoid loco-manipulation, but they are sparse, heterogeneous, and not directly execu

LD-EnFF: Latent-Dynamics Ensemble Flow Filtering for Data Assimilation with Sparse Observations

arXiv:2610.04034v1 Announce Type: new Abstract: Data assimilation combines model forecasts with noisy, incomplete observations to estimate the evolving state of a dynamical system. Existing methods fa

researcharxiv-cs-lg

LeAVJEPA: A Minimalist Architecture for Audio-Visual Self-Supervised Learning

arXiv:2610.06226v1 Announce Type: cross Abstract: Prior audio-visual self-supervised learning methods rely on mechanisms such as EMA target encoders, prediction heads, reconstruction decoders, and con

Local Ai

Lens3D: Target-Conditioned Visual Foveation for Fine-Grained 3D Understanding

arXiv:2610.06611v1 Announce Type: new Abstract: Existing 3D large language models often overlook fine-grained attributes and less visually salient objects and parts, even when relevant evidence is pre

local-aiarxiv-cs-cv

M^2-Occ: Resilient 3D Semantic Occupancy Prediction for Autonomous Driving with Incomplete Camera Inputs

arXiv:2603.09737v2 Announce Type: replace Abstract: Semantic occupancy prediction enables dense 3D geometric and semantic understanding for autonomous driving. However, existing camera-based approache

MTRACE: Multilingual Retrieval-Augmented Generation for Temporally Diverse Text Corpora

arXiv:2512.12694v2 Announce Type: replace-cross Abstract: Large multilingual knowledge bases expose temporally diverse information, yet retrieval quality remains sensitive to lexical variation and cro

ReFRM3D: A Radiomics-enhanced Fused Residual Multiparametric 3D Network with Multi-Scale Feature Fusion for Glioma Characterization

arXiv:2512.22570v2 Announce Type: replace Abstract: Gliomas are among the most aggressive cancers, with complex diagnostic processes. Existing glioma segmentation methods often struggle with high vari

Repeated-Measure Leakage, Distribution Shift, and Reliability under Partial Observation in Patient World Models

arXiv:2610.04778v1 Announce Type: new Abstract: Patient world models are increasingly proposed for longitudinal prediction, intervention-aware reasoning, and clinical-trial simulation. Causal or clini

researcharxiv-cs-lg

Robust 2D Traversability Mapping for Construction AMRs via Failure-Mode-Aware Fusion of LiDAR Geometry and Monocular Semantics

arXiv:2610.05505v1 Announce Type: cross Abstract: Autonomous Mobile Robots (AMRs) on active construction sites face severe navigational challenges: geometry-based traversability mapping (e.g., LiDAR)

RSure-Agent: Reliable Use of Tool Observations for Remote Sensing Agents

arXiv:2610.04836v1 Announce Type: new Abstract: Remote sensing agents rely on perception, measurement, and raster analysis tools to solve Earth observation tasks. We refer to their judgments and quant

Streaming Multi-Track Timeline Control for 3D Human Motion Generation

arXiv:2610.03873v1 Announce Type: new Abstract: Text-driven human motion generation has advanced substantially, yet most methods assume instructions are available before synthesis. Interactive applica

Applications

Synthetic-to-Real ViT-Based Pose Estimation of a Noncooperative UAV

arXiv:2610.04335v1 Announce Type: new Abstract: Remote pose estimation of noncooperative Unmanned Aerial Vehicles (UAVs) from imagery is critical, as they cannot be influenced or instrumented in advan

applicationsarxiv-cs-cv

Applications

TRACER: Texture-Robust Affordance Chain-of-Thought for Deformable-Object Region Grounding

arXiv:2601.20208v2 Announce Type: replace-cross Abstract: The central challenge in robotic manipulation of deformable objects lies in aligning high-level semantic instructions with physical interactio

applicationsarxiv-cs-cv

Trust the View That Sees the Target: Mining Cross-View Conflicts for Reliability-Gated Disaster Damage Assessment

arXiv:2610.04327v1 Announce Type: new Abstract: After a disaster, building damage is assessed from overhead tiles and ground-level photographs, and most methods fuse the two views symmetrically, trust

Watermarks and Fingerprints as Soft Bindings for Content Provenance: An Open-Licence Benchmark for Images, Audio and Video

arXiv:2610.04151v1 Announce Type: new Abstract: Content-provenance standards such as C2PA let a platform recover a stripped manifest through a soft binding: an invisible watermark read from the conten