Search: “multimodal”

Exploiting Completeness Perception with Diffusion Transformer for Unified 3D MRI Synthesis

arXiv:2602.18400v3 Announce Type: replace-cross Abstract: Missing data problems, such as missing modalities in multi-modal brain MRI and missing slices in cardiac MRI, pose significant challenges in c

tutorialsarxiv-cs-cv

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Far from the Crowd: Scalable Self-Supervised Learning via Geographic Isolation

DGX agent

arXiv:2608.19766v1 Announce Type: new Abstract: Self-supervised pretraining on remote sensing imagery typically treats all samples as equally informative, despite large variability in geographic and v

researcharxiv-cs-cv

21 Aug 2026

FermatSyn: SAM2-Enhanced Bidirectional Mamba with Isotropic Spiral Scanning for Multi-Modal Medical Image Synthesis

arXiv:2505.07687v4 Announce Type: replace-cross Abstract: Multi-modal medical image synthesis is pivotal for alleviating clinical data scarcity, yet existing methods fail to reconcile global anatomica

safetyarxiv-cs-cv

Fine-Tuning VLAs with Self-Demonstrated Generative Control for Multi-Task Manipulation

model-releasesarxiv-cs-cv

arXiv:2608.19490v1 Announce Type: cross Abstract: State-of-the-art vision-language-action (VLA) models such as pi_{0.5} exhibit strong semantic understanding, instruction following and task behavior.

G-MARK: Grounded Multi-Agent Reasoning for Cooperative Driving via Knowledge Graphs

arXiv:2608.19964v1 Announce Type: new Abstract: Autonomous driving systems must operate under partial observability, where safety-critical objects may be occluded or visible only to neighboring connec

safetyarxiv-cs-lg

Information on trajectories: martingales and random times

arXiv:2608.20337v1 Announce Type: cross Abstract: Accounting for information flow on the path space of trajectories of a nonnegative martingale yields exact variational identities for it, even at arbi

Interaction valence reveals contrasting social networks in dairy cattle

arXiv:2608.19222v1 Announce Type: new Abstract: Social relationships shape access to resources, exposure to conflict and group stability, yet automated livestock monitoring typically treats behaviour

Robust Cross-Modal Foundation Model Perception for Underwater Robots under Degraded Visual Conditions

arXiv:2608.19710v1 Announce Type: cross Abstract: Reliable underwater robotic perception remains difficult because optical imagery degrades under turbidity, wavelength-dependent attenuation, low illum

UAV-Based Infrastructure Inspections: A Literature Review and Proposed Framework for AEC+FM

arXiv:2601.11665v3 Announce Type: replace Abstract: Unmanned Aerial Vehicles (UAVs) are transforming infrastructure inspections in the Architecture, Engineering, Construction, and Facility Management

tutorialsarxiv-cs-cv

Video Evidence to Reasoning Efficient Video Understanding via Explicit Evidence Grounding

arXiv:2601.07761v2 Announce Type: replace Abstract: Large Vision-Language Models (LVLMs) face a fundamental dilemma in video reasoning: they are caught between the prohibitive computational costs of v

safetyarxiv-cs-cv

What You Can't See Is What You Learn: Restricted Evidence Visibility Favors Compositional Generalization in Shared-Genome Language-Model Societies

arXiv:2608.20054v1 Announce Type: new Abstract: Multi-module systems often expose every module to the full input. We test whether restricting evidence visibility changes which solutions gradient-based

tutorialsarxiv-cs-ai

When Saying No Makes Better Videos: Designing Dual Gatekeeping for Pedagogically Grounded AI Content Creation

arXiv:2608.19812v1 Announce Type: new Abstract: To prevent the adoption of aesthetically polished but pedagogically flawed AI content, we study a video authoring pipeline featuring two layers of struc

A Critical Synthesis of Uncertainty Quantification and Foundation Models for Semantic Segmentation

arXiv:2608.18709v1 Announce Type: cross Abstract: Foundation models are increasingly breaking what seemed to be impossible not long ago by enabling unprecedented accuracy and cross-domain generalizati

A Framework and Prototype for a Navigable Map of Datasets in Engineering Design and Systems Engineering

arXiv:2603.15722v3 Announce Type: replace-cross Abstract: The proliferation of data across the system lifecycle presents both a significant opportunity and a challenge for Engineering Design and Syste

Acquisition Geometry-Assisted Whole-Group Localization of X-ray Fluorescence Maps in Optical Microscopy Images

arXiv:2608.18305v1 Announce Type: new Abstract: X-ray fluorescence (XRF) microscopy maps elemental distributions, while optical microscopy can provide complementary morphological context. Localizing X

applicationsarxiv-cs-cv

Backdoor Learning in Language Models and Vision-Language Models

arXiv:2608.18095v1 Announce Type: cross Abstract: Recent advances in deep learning have significantly enhanced the capabilities of Natural Language Processing (NLP) and Vision-Language Models (VLMs).

Cross-Modal MRI Ovary Segmentation in Endometriosis Using Unpaired TVUS Prototype Priors

arXiv:2608.18515v1 Announce Type: new Abstract: Transvaginal ultrasound (TVUS) and magnetic resonance imaging (MRI) provide complementary information for endometriosis image analysis, yet existing stu

researcharxiv-cs-cv

Diffusion Models for High-Dimensional Clustered Data: Intrinsic-Dimension Adaptivity via Bayesian Classification

arXiv:2608.19067v1 Announce Type: cross Abstract: The empirical success of diffusion models in generative modelling has motivated theoretical work, including quantitative error bounds and qualitative

Fair Multi-View Determinantal Coresets via Adaptive NEPv

arXiv:2608.18181v1 Announce Type: cross Abstract: Selecting a small, diverse subset from a large candidate pool often means balancing several incompatible notions of diversity. In trademark curation,

FD-CanKD: Frequency-Decoupled Cross-Attention Distillation as a Refinement Prior for Compact Object Detectors

arXiv:2608.18590v1 Announce Type: new Abstract: Compact object detectors are suitable for resource-constrained visual perception, but their limited representation capacity creates an accuracy gap rela

safetyarxiv-cs-cv

Grouping the Stochastic Machine: Precision, Not Capability, as the Frontier Metric for AI Systems

arXiv:2608.19140v1 Announce Type: new Abstract: Frontier language models are compared, marketed, and benchmarked on capability -- what their best or average output can achieve. I argue this measures t

Human-Centric Intelligence in the Era of Foundation Models: A Survey

arXiv:2608.18184v1 Announce Type: new Abstract: Human-centric intelligence is evolving in the foundation-model era, with growing emphasis on scale, transferability, and general-purpose modeling. Yet i

researcharxiv-cs-cv

Image-Guided Pavement Defect Recognition in GPR Data with novel 3D Deep Learning Architecture

arXiv:2608.19177v1 Announce Type: new Abstract: Ground Penetrating Radar (GPR) is a widely adopted non-destructive sensing technology for subsurface inspection in civil and transportation engineering.

applicationsarxiv-cs-cv

Solving Is Not Drawing: A Benchmark for Diagrammatic Reasoning in Olympiad Geometry

arXiv:2608.18111v1 Announce Type: new Abstract: Foundation models such as GPT and Claude now solve olympiad-level mathematics with remarkable proficiency, so much so that geometry problem solving has

The Lifecycle of LLM-as-a-Judge for Large-Scale Recommendation Explanations

arXiv:2608.18300v1 Announce Type: new Abstract: LLM-as-a-Judge, which leverages a large language model to evaluate natural language generated by another AI application or model, has become a standard,

Transforming Heart Disease Prediction with Advanced Machine Learning Techniques

arXiv:2608.18687v1 Announce Type: new Abstract: Heart disease remains the leading cause of mortality globally, necessitating early and accurate detection to improve patient outcomes. This research foc

Hardware

Whole-Piece Training for Symbolic Music Language Models via Full-Horizon Compressed Recurrence

arXiv:2602.19816v3 Announce Type: replace-cross Abstract: For computational efficiency, modern language models are typically trained on independently sampled fixed-length sequences. Symbolic music lan

hardwarearxiv-cs-ai

Co-RL: Unsupervised Reasoning Emerges from Diverse Cohort in Multi-agent RL

arXiv:2608.17253v1 Announce Type: cross Abstract: Reinforcement learning (RL) has emerged as a powerful approach for improving reasoning in language and vision-language models, yet its strongest succe

agentsarxiv-cs-ai

DeAR: Decentralized Agentic Reasoning via Capability Grounding and Collaborative Thought Navigation

arXiv:2608.17282v1 Announce Type: new Abstract: Existing agentic reasoning systems typically rely on centralized protocols. This design introduces routing bottlenecks and static role allocations that

agentsarxiv-cs-ai

Delta2Gamma: Band-Wise Adaptive Contrastive Learning of EEG for Alzheimer's Disease Detection

arXiv:2608.17231v1 Announce Type: cross Abstract: Low-cost, scalable screening for dementia remains an open problem. Imaging-based diagnosis is costly and hard to deploy widely. Electroencephalography

applicationsarxiv-cs-ai

DEPT: Document Embedding Preservation Tuning for Unified Query Expansion and Retrieval

arXiv:2608.17632v1 Announce Type: cross Abstract: Large language models (LLMs) can both expand underspecified queries and encode text as dense representations, suggesting a unified model for query exp

Harnessing Magnitude-Only and Complex Measurements for Improved Dynamic MRI Reconstruction with Learned Priors

arXiv:2608.18036v1 Announce Type: cross Abstract: MRI reconstruction methods for undersampled k-space data naturally utilize complex-valued measurements. Parallel developments in sparse phase retrieva

Hybrid ML for Lightweight Pre-Route Delay Estimation in Open-Source IC Design

arXiv:2608.17914v1 Announce Type: new Abstract: Static Timing Analysis (STA) is a critical step in the design flow of digital integrated circuits, however, obtaining accurate delay estimations can rep

Learning What Not to Learn: Adversarial Disentangled Prompt Tuning for Robust Vision-Language Models

arXiv:2608.17306v1 Announce Type: cross Abstract: While adversarial prompt tuning can enhance robustness of vision-language models efficiently, we find that existing methods aggravate robust generaliz

tutorialsarxiv-cs-ai

Leveraging generative hallucination and biophysics-informed modeling for unified biomolecular sequence-structure co-design

arXiv:2608.17381v1 Announce Type: cross Abstract: Biomolecular design underpins applications from molecular recognition to therapeutics and synthetic biology, yet de novo interaction design remains ch

MobileWorldSafety: Benchmarking GUI Agent Safety Against Environmental Injection Attacks in Android Apps

arXiv:2608.17659v1 Announce Type: cross Abstract: LLM-powered GUI agents that autonomously operate smartphones are rapidly transitioning from research prototypes to early real-world deployment. Howeve

TabularQGAN: A quantum generative model for tabular data synthesis

arXiv:2505.22533v2 Announce Type: replace-cross Abstract: In this paper, we introduce a novel quantum generative model for synthesizing tabular data. Synthetic data is valuable in scenarios where real

applicationsarxiv-cs-ai

Visual Prompting for Robotic Manipulation with Annotation-Guided Pick-and-Place Using ACT

arXiv:2508.08748v2 Announce Type: replace-cross Abstract: Robotic pick-and-place tasks in convenience stores pose challenges due to dense object arrangements, occlusions, and variations in object prop

tutorialsarxiv-cs-ai

Does the Heart Show Your Pain? Tackling the X-ITE Pain Challenge with Self-Supervised ECG Representation Learning

arXiv:2608.14662v1 Announce Type: cross Abstract: Accurate recognition of pain using physiological signals remains a challenging problem due to pain's subjective nature and high inter-individual varia

ForceU-VLA: A Force-Aware Vision-Language-Action Model for Embodied Ultrasound Scanning

arXiv:2608.15009v1 Announce Type: cross Abstract: Embodied intelligent ultrasound scanning enables the automation and standardization of the ultrasound examination process by integrating perception, d

agentsarxiv-cs-cv

Making two action heads agree: coordination mechanisms and a runtime collapse certificate for flow-matching policies

arXiv:2608.15748v1 Announce Type: new Abstract: A dual-representation flow-matching policy decodes each predicted motion into joint and end-effector spaces, and the residual between the two kinematica

safetyarxiv-cs-ro

Quantum Models with Multi-Stage Training for Compositional Concept Generalization

arXiv:2608.15601v1 Announce Type: new Abstract: Compositional Concept Generalization (CoCoGen), the ability to systematically recombine learned primitives in novel contexts, is a key challenge for mul

Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluation

arXiv:2608.16843v1 Announce Type: new Abstract: Foundation models are increasingly used for perception, reasoning, planning, and action generation in embodied agents, creating security risks that can

agentsarxiv-cs-ro

Can Language Models Understand mmWave Data? Benchmarking Large Language Models for mmWave Radar-Based Human Understanding

arXiv:2608.14179v1 Announce Type: new Abstract: Large language models (LLMs) have shown remarkable reasoning and generative capabilities, motivating their use as universal reasoning engines for percep

CMCNet: Aligning Ultrasound Image Embeddings with Textual TI-RADS Representations for Fine-Grained Thyroid Classification

arXiv:2608.13939v1 Announce Type: cross Abstract: Ultrasound is the primary imaging modality for assessing thyroid nodules, and the ACR TI-RADS framework standardizes diagnosis through five ultrasound

safetyarxiv-cs-ai

Debiasing Text-to-Image Evaluation via Implicit Cultural Alignment Reward Modeling

arXiv:2607.15740v2 Announce Type: replace-cross Abstract: As Text-to-Image (T2I) systems rapidly advance, evaluating the cultural authenticity of synthesized content has become increasingly important

Decoding Student Minds: Leveraging Conversational Agents for Psychological and Learning Analysis

arXiv:2512.10441v2 Announce Type: replace Abstract: This paper presents a psychologically-aware conversational agent designed to enhance both learning performance and emotional well-being in education

agentsarxiv-cs-cl

Designing Sustainable Federated Learning as a Service using Neural Architecture Search

arXiv:2608.14359v1 Announce Type: new Abstract: The sustainability constraints of FLaaS consumers pose significant challenges to maintaining carbon-feasible federated training in FLaaS environments. T

applicationsarxiv-cs-ai