Search: “multimodal”

Quantifying privacy risks in foundation model representations of brain MRI

arXiv:2610.20494v1 Announce Type: new Abstract: Pretrained representations are increasingly used to share and reuse information from medical images without exposing the original scans, but it is uncle

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Recognizing Dialogue Ambiguity via Candidate Set Visual Grounding

DGX agent

arXiv:2610.19723v1 Announce Type: new Abstract: Interpreting an ambiguous utterance in real-world interactions often requires context beyond a single utterance. When the utterance refers to objects in

model-releasesarxiv-cs-cl

15 Oct 2026

RoTA-Bench: Evaluating 3D Spatial Reasoning through Interactive Projection Alignment

model-releasesarxiv-cs-ai

arXiv:2610.17665v2 Announce Type: new Abstract: Can vision-language models turn 2D observations into 3D understanding that supports precise action? This requires inferring object geometry, anticipatin

ScholarQuest: A Taxonomy-Guided Benchmark for Agentic Academic Paper Search in Open Literature Environments

model-releasesarxiv-cs-ai

arXiv:2606.20235v2 Announce Type: replace-cross Abstract: Academic paper search is a core step in scientific research, and LLM-based search agents are emerging as a promising paradigm for iterative, i

Semantics as a Shield: Label Disguise Defense (LDD) against Prompt Injection in LLM Sentiment Classification

arXiv:2511.21752v3 Announce Type: replace-cross Abstract: Prompt injection can cause large language models (LLMs) to deviate from their intended tasks by following instructions embedded in untrusted i

applicationsarxiv-cs-ai

SimInter: Evidence-Grounded User Simulation with Interview-Based Profile Enrichment for Conversational Recommender Systems

arXiv:2610.18308v1 Announce Type: cross Abstract: Conversational Recommender Systems (CRSs) require reliable user simulators for cost-effective evaluation. LLM-based simulators have made realistic sim

agentsarxiv-cs-ai

Spectral World Renderer: Unified 3D Hyperspectral Unmixing

arXiv:2610.19520v1 Announce Type: new Abstract: Cameras and the foundation models built on them recognize what a 3D scene contains, but not what it is made of: surfaces of the same colour can be diffe

TacClaw-Infinity: A Large-Scale Vision-Tactile-Language-Action Dataset for Dexterous Manipulation

arXiv:2610.20320v1 Announce Type: new Abstract: Large-scale robot learning increasingly relies on diverse human demonstrations, yet tactile manipulation data remain difficult to scale, and existing mu

researcharxiv-cs-ro

Vela: User Behavior as Supervision Sparks LLM Intelligence

arXiv:2610.14709v1 Announce Type: cross Abstract: Large language models are increasingly deployed in applications that act on users' long-term behavior histories, from personal assistants to recommend

applicationsarxiv-cs-ai

W-JEPA: Wavelet Joint-Embedding Predictive Architecture for Wearable Activity Recognition

arXiv:2610.19411v1 Announce Type: new Abstract: A major challenge in wearable device activity recognition is the heterogeneity across datasets in sensor placement, channel count, sampling rate and sub

researcharxiv-cs-lg

What Is a Clarification? Estimating Model-Dependent Input Ambiguity

arXiv:2610.20052v1 Announce Type: new Abstract: Ambiguous inputs can admit multiple interpretations, each potentially yielding a different answer. Existing work largely treats this ambiguity as a prop

researcharxiv-cs-cl

What Makes a Social Agent's Interactions Effective? Learning from Verifiable Outcomes in Paired Worlds

model-releasesarxiv-cs-cl

arXiv:2610.20195v1 Announce Type: new Abstract: Effective social interaction requires more than fluent responses: agents must reach plans that fit the participants' needs and circumstances. Existing e

What the Model Cannot See: Covert and Provable Text Invisibility in LLMs

model-releasesarxiv-cs-ai

arXiv:2610.15883v1 Announce Type: cross Abstract: Text wrapped in a trigger can be made behaviorally invisible to a language model: omitted from summaries and quotations, ignored in question answering

A Concept-informed Interpretable Artificial Intelligence Framework for Breast Ultrasound Diagnosis

arXiv:2610.16128v1 Announce Type: new Abstract: Most existing artificial intelligence systems for breast ultrasound rely primarily on image-driven prediction, with limited incorporation of the knowled

A Multi-Task Deep Learning Framework for Pose-Invariant Face Recognition and Facial Landmark Localization

arXiv:2610.16849v1 Announce Type: new Abstract: Face recognition systems often experience performance degradation under large pose variations due to changes in facial appearance and visibility of disc

AffectWorld: Benchmarking Emotion-Driven Future World Prediction

arXiv:2610.18305v1 Announce Type: new Abstract: The world encompasses both physical environments and human actors. Predicting its evolution requires understanding both physical laws and how emotions s

Local Ai

Anomaly-Guided Observation and Two-Level Semantic Feedback for Training-Free Video Anomaly Analysis

arXiv:2610.16324v1 Announce Type: new Abstract: Training-free language-based video anomaly detection (VAD) uses frozen vision--language models (VLMs) and large language models (LLMs) to localize abnor

local-aiarxiv-cs-cv

Answer It or Not? Towards Prompt-Adapted Adversarial Images on Vision Language Models

arXiv:2610.16622v1 Announce Type: new Abstract: With the advancement in language modeling, research on adversarial images has recently shifted from image classifiers to vision-language models (VLMs).

APT: Feedback-Driven Agentic Post-Training for Text-to-Image Generation

arXiv:2610.18097v1 Announce Type: new Abstract: Post-training is crucial for improving text-to-image models, yet existing pipelines typically rely on manually curated training data and fixed training

Beyond a Better Score: Long-Horizon Agentic ML Development and Evaluation Protocol for Physics Time Series

model-releasesarxiv-cs-lg

arXiv:2610.14024v1 Announce Type: new Abstract: Physics time-series data are central to fundamental discoveries involving dark matter, neutrinos, and gravitational waves. Machine learning has shown st

BrainAid: Efficient Brain Tumor Detection Using Lightweight CNNs and Explainable AI for Resource-Constrained Environments

arXiv:2610.15077v1 Announce Type: new Abstract: A brain tumor is an unusual growth of cells in the brain that can be cancerous or not, affecting normal brain function and causing serious risk to healt

applicationsarxiv-cs-cv

CAPTOR: a vision-language foundation model for Chest-Abdomen-Pelvis Oncologic CT

arXiv:2610.14226v1 Announce Type: new Abstract: Purpose : To develop and evaluate CAPTOR, a deep-learning vision-language foundation model for oncologic chest-abdomen-pelvis (CAP) CT interpretation. M

CFG-Policy: Unified Diffusion Policy Learning Framework via Classifier-free Guidance

arXiv:2610.14936v1 Announce Type: cross Abstract: Diffusion policies are increasingly used in robotic control and manipulation, vision-language-action models, and world-model-based agents. Their abili

safetyarxiv-cs-lg

Cross-Material Magnetic Core Loss Prediction via Operating-Condition Matching and Partial Optimal Transport

arXiv:2610.14964v1 Announce Type: new Abstract: Cross-material magnetic core loss prediction requires adapting to new material responses with limited measurements. Global feature alignment overlooks d

safetyarxiv-cs-lg

DDVR-Net: Degradation-Aware Decoupling and Visibility-Guided Restoration for Historical Document Recognition

arXiv:2610.16956v1 Announce Type: new Abstract: Historical document analysis is crucial for cultural heritage preservation and low-resource language digitization. However, real historical documents of

DEFT: Disentanglement-Enhanced Fine-Tuning for EEG Foundation Models

arXiv:2610.14497v1 Announce Type: new Abstract: EEG foundation models (EFMs) have improved EEG representation learning by transferring knowledge from large-scale multi-subject pretraining to downstrea

researcharxiv-cs-lg

DreamWorld: Unified World Modeling in Video Generation

arXiv:2603.00466v2 Announce Type: replace Abstract: Despite impressive progress in video generation, existing models remain limited to surface-level plausibility, lacking a coherent and unified unders

EarthAlign: Learning Language-Aligned Representations of Earth System Data

arXiv:2610.14624v1 Announce Type: new Abstract: Interpreting Earth system conditions is central to understanding environmental risks and informing decisions across weather- and climate-sensitive secto

EviStress: Evidence Stress Learning for Generalizable Face Forgery Detection with Textual Explanations

arXiv:2610.16879v1 Announce Type: new Abstract: The rapid spread of face forgeries on the Web challenges the credibility of visual content. In practical Web environments, manipulated media originate f

Tutorials

FrameFold: Response-Guided KV Cache Consolidation for Autoregressive Long Video Generation

arXiv:2610.14568v1 Announce Type: new Abstract: In autoregressive video generation, retaining all historical key-value (KV) states increases memory usage and per-step attention costs as videos grow lo

tutorialsarxiv-cs-cv

From Simulated Fluids to Living Tissue: Zero-Shot Foundation Model Transfer to Perturbed Embryos

arXiv:2610.16236v1 Announce Type: new Abstract: Morphogenesis is driven by the interplay of genetic regulation and tissue mechanics. In vivo video data is limited, particularly under genetic mutations

researcharxiv-cs-lg

Generalizable Model Editing Could Be More Than Direct Generalization

arXiv:2610.15707v1 Announce Type: new Abstract: A central desideratum in model editing is generalization to complex tasks, which prior work formalizes under a direct generalization paradigm: treating

applicationsarxiv-cs-lg

Getting Space Right: Agentic Rewards for Image Generation

arXiv:2610.14852v1 Announce Type: new Abstract: Reinforcement learning (RL) is promising for spatial text-to-image generation, but existing work largely focuses on policy optimization, assuming accura

Global Disaster Risk Assessment Using World Risk Index Data: A Geospatial and Visual Analytics Approach

arXiv:2610.15064v1 Announce Type: new Abstract: The world has seen several threats that include resource depletion, food security, poverty and inequality, difficulties associated with urbanization, mi

Local Ai

HairFlow: Modeling 3D Hair Strands with Multi-Modal Conditioned Diffusion

arXiv:2610.17348v1 Announce Type: new Abstract: Modeling 3D hair strands is challenging due to complex hairstyle geometry, scarce high-quality training data, and incomplete or noisy input observations

local-aiarxiv-cs-cv

HiPAD: A Unified Gait, Audio-Visual, and Personality Fusion Network for Depression Detection, with a Hierarchical Personality Ablation and the Calibration Limits of Domain-Adapted LLMs

arXiv:2610.14961v1 Announce Type: cross Abstract: We present HiPAD, a single fusion network submitted to all six sub-tracks of the MPDD-AVG 2026 depression-detection challenge, covering the Elder and

HyBRA-EEG: Hyperbolic Global-Local Brain-Region Aggregation for Self-Supervised EEG Representation Learning

model-releasesarxiv-cs-lg

arXiv:2610.16589v1 Announce Type: new Abstract: Electroencephalography (EEG) representation learning is challenged by noisy signals, inter-subject variability, and heterogeneous electrode montages in

Tutorials

LeHami: Symplectic Latent Dynamics for World Models

arXiv:2610.15267v1 Announce Type: new Abstract: Joint-embedding predictive architectures (JEPAs) learn world models directly in latent space, but unconstrained autoregressive predictors may contract t

tutorialsarxiv-cs-lg

Less is More: Label-Guided Efficient Summarization of Procedural and Instructional Videos

arXiv:2601.12243v3 Announce Type: replace Abstract: Video summarization transforms long videos into concise representations that are easier to document and analyze, especially in high-stakes domains s

Meta-Video: Efficient Standardized Evaluation for Video Understanding

arXiv:2610.18535v1 Announce Type: new Abstract: Video understanding benchmarks are the primary yardstick for measuring progress in video-language modeling, and a growing body of work relies on them to

METIS: Multi-Source Egocentric Training for Integrated Dexterous Vision-Language-Action Model

arXiv:2511.17366v2 Announce Type: replace-cross Abstract: Building a generalist robot that can perceive, reason, and act across diverse tasks remains an open challenge, especially for dexterous manipu

applicationsarxiv-cs-cv

Multi-modal Representation Fusion for Long-term Microsurgical Anastomosis Trajectory Anticipation

arXiv:2610.14492v1 Announce Type: cross Abstract: Microsurgical anastomosis is one of the most challenging and sophisticated procedures for surgical robotics, requiring accurate manipulation of surgic

Not All Challenges Are Equal: Evaluating Interactive Liveness Detection Against Real-Time Face Swaps

arXiv:2610.16417v1 Announce Type: new Abstract: Remote identity verification assumes that a camera stream shows a live person, yet public real-time face-swap tools can replace that person before the s

OpenMobile-2: Building Versatile Mobile Agents with Scalable Environments and App-Native Tools

arXiv:2610.14157v1 Announce Type: cross Abstract: We introduce OpenMobile-2, a near-frontier mobile agent with fully open training environments and recipes. We make three key advances: (1) Diverse env

Physics-Aware Deepfake Detection via Distance-Speech Consistency

arXiv:2610.18485v1 Announce Type: new Abstract: Recent progress in generative models has made talking-head deepfakes highly realistic and easy to create, jeopardizing public trust. However, most audio

PlanPath: Exploration-Guided Orchestration for Patient-Level Pathology Reasoning

arXiv:2610.18664v1 Announce Type: new Abstract: A patient's pathology case spans tens of slides from distinct specimens and anatomical sites, each carrying non-redundant, site-specific evidence. Formi

RAIN: Robotic Task Generalization with Region-Aware Interaction Networks

arXiv:2610.14039v1 Announce Type: cross Abstract: Existing vision-language-action (VLA) models benefit from large-scale vision-language pretraining, but tend to memorize training trajectories, limitin

RealityBench: Simulated Environments to Evaluate a Vision Language Model's Ability to Document Human Physical Work

arXiv:2610.14397v1 Announce Type: new Abstract: Augmenting worker capabilities in the physical world through guidance has been a decades-long goal for AI agents. One key supporting capability is to un