Search: “multimodal”

Control Your Queries: Heterogeneous Query Interaction for Camera-Radar Fusion

arXiv:2604.25574v1 Announce Type: new Abstract: In autonomous driving, camera-radar fusion offers complementary sensing and low deployment cost. Existing methods perform fusion through input mixing, f

agentsarxiv-cs-cv

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

CRC-SAM: SAM-Based Multi-Modal Segmentation and Quantification of Colorectal Cancer in CT, Colonoscopy, and Histology Images

DGX agent

arXiv:2604.24793v1 Announce Type: cross Abstract: We present CRC-SAM, a unified framework for colorectal cancer segmentation across colonoscopy, CT, and histopathology images. Unlike prior single-moda

researcharxiv-cs-cv

29 Apr 2026

FGDM: Reasoning Aware Multi-Agentic Framework for Software Bug Detection using Chain of Thought and Tree of Thought Prompting

arXiv:2604.24831v1 Announce Type: cross Abstract: Deep Learning methods are becoming prominent in automated software bug detection; however, they lack the global understanding of the given code. Conse

agentsarxiv-cs-lg

Images Amplify Misinformation Sharing in Vision-Language Models

model-releasesarxiv-cs-cl

arXiv:2505.13302v2 Announce Type: replace Abstract: As language and vision-language models (VLMs) become central to information access and online interaction, concerns grow about their potential to am

Learning from Noisy Preferences: A Semi-Supervised Learning Approach to Direct Preference Optimization

arXiv:2604.24952v1 Announce Type: new Abstract: Human visual preferences are inherently multi-dimensional, encompassing aesthetics, detail fidelity, and semantic alignment. However, existing datasets

MiMo-Embodied: X-Embodied Foundation Model Technical Report

arXiv:2511.16518v2 Announce Type: replace-cross Abstract: We open-source MiMo-Embodied, the first cross-embodied foundation model to successfully integrate and achieve state-of-the-art performance in

agentsarxiv-cs-cl

SlicerRoboTMS: An Open-Source 3D Slicer Extension for Robot-Assisted Transcranial Magnetic Stimulation

arXiv:2604.25661v1 Announce Type: new Abstract: Robot-assisted Transcranial Magnetic Stimulation (Robo-TMS) is an image-guided robotic intervention that enhances the accuracy and reproducibility of co

researcharxiv-cs-ro

Local Ai

2nd of the 5th PVUW MeViS-Audio Track: ASR-SaSaSa2VA

arXiv:2604.23935v1 Announce Type: new Abstract: Audio-based video object segmentation aims to locate and segment objects in videos conditioned on audio cues, requiring precise understanding of both ap

local-aiarxiv-cs-cv

Local Ai

A Dynamic Learning Observatory Reveals the Rapid Salinization of Satkhira, Bangladesh

arXiv:2604.23127v1 Announce Type: cross Abstract: Soil salinity is a major environmental challenge in coastal Bangladesh, threatening agricultural productivity and local livelihoods. This study develo

local-aiarxiv-cs-lg

A Heterogeneous Two-Stream Framework for Video Action Recognition with Comparative Fusion Analysis

arXiv:2604.23415v1 Announce Type: new Abstract: Most two-stream action recognition networks apply the same convolutional backbone to both RGB and optical flow streams, ignoring the fact that the two m

Applications

A Hierarchical Ensemble Inference Pipeline for Robust White Blood Cell Classification Under Domain Shifts

arXiv:2604.23271v1 Announce Type: new Abstract: Automated white blood cell (WBC) classification is essential for scalable leukaemia screening. However, real-world deployment is challenged by domain sh

applicationsarxiv-cs-cv

Accelerating New Product Introduction for Visual Quality Inspection via Few-Shot Diffusion-Based Defect Synthesis

arXiv:2604.22850v1 Announce Type: new Abstract: Industrial visual inspection systems often suffer from a severe scarcity of labeled defect data, particularly during the early stages of New Product Int

AdaComp: Extractive Context Compression with Adaptive Predictor for Retrieval-Augmented Large Language Models

arXiv:2409.01579v2 Announce Type: replace-cross Abstract: Retrieved documents containing noise will hinder RAG from detecting answer clues and make the inference process slow and expensive. Therefore,

Advancing Remote Medical Palpation through Cognition and Emotion

arXiv:2407.05595v3 Announce Type: replace Abstract: Medical palpation is more than force transmission. It is a bidirectional cognitive and emotional exchange between doctor and patient. We model two c

researcharxiv-cs-ro

BrickNet: Graph-Backed Generative Brick Assembly

arXiv:2604.22984v1 Announce Type: new Abstract: We train a language model to generate LEGO-brick build sequences. While prior work has been restricted to discrete, voxel-like towers, we consider a muc

DVPO: Distributional Value Modeling-based Policy Optimization for LLM Post-Training

arXiv:2512.03847v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) has shown strong performance in LLM post-training, but real-world deployment often involves noisy or incomplete su

safetyarxiv-cs-ai

Enabling Transparent Cyber Threat Intelligence Combining Large Language Models and Domain Ontologies

arXiv:2509.00081v2 Announce Type: replace-cross Abstract: Effective Cyber Threat Intelligence (CTI) relies upon accurately structured and semantically enriched information extracted from cybersecurity

agentsarxiv-cs-ai

Exploring Audio Hallucination in Egocentric Video Understanding

arXiv:2604.23860v1 Announce Type: cross Abstract: Egocentric videos provide a distinctive setting in which sound serves as crucial cues to understand user activities and surroundings, particularly whe

Focus on What Matters: Two-Stage ROI-Aware Refinement for Anatomy-Preserving Fetal Ultrasound Reconstruction

arXiv:2604.23839v1 Announce Type: cross Abstract: Measurement-critical ultrasound tasks often depend on a small anatomical region, making global reconstruction metrics an unreliable proxy for clinical

GA2-CLIP: Generic Attribute Anchor for Efficient Prompt Tuningin Video-Language Models

arXiv:2511.22125v2 Announce Type: replace Abstract: Visual and textual soft prompt tuning can effectively improve the adaptability of Vision-Language Models (VLMs) in downstream tasks. However, fine-t

Hard to See, Hard to Label: Generative and Symbolic Acquisition for Subtle Visual Phenomena

arXiv:2604.22990v1 Announce Type: cross Abstract: Subtle visual anomalies such as hairline cracks, sub-millimeter voids, and low-contrast inclusions are structurally atypical yet visually ambiguous, m

Identity-Decoupled Anonymization for Visual Evidence in Multi-modal Retrieval-Augmented Generation

arXiv:2604.23584v1 Announce Type: new Abstract: Multi-modal retrieval-augmented generation (MRAG) systems retrieve visual evidence from large image corpora to ground the responses of large multi-modal

In-depth Analysis of Graph-based RAG in a Unified Framework

arXiv:2503.04338v2 Announce Type: replace-cross Abstract: Graph-based Retrieval-Augmented Generation (RAG) has proven effective in integrating external knowledge into large language models (LLMs), imp

researcharxiv-cs-cl

Applications

Into the Omniverse: Manufacturing’s Simulation-First Era Has Arrived

Manufacturing is shifting from relying solely on real-world testing, as high-fidelity simulation now produces synthetic training data accurate enough for production-grade AI. NVIDIA Omniverse librarie

applicationsnvidia-blog

K-SENSE: A Knowledge-Guided Self-Augmented Encoder for Neuro-Semantic Evaluation of Mental Health Conditions on Social Media

arXiv:2604.23493v1 Announce Type: cross Abstract: Early detection of mental health conditions, particularly stress and depression, from social media text remains a challenging open problem in computat

KARL: Mitigating Hallucinations in LLMs via Knowledge-Boundary-Aware Reinforcement Learning

arXiv:2604.22779v1 Announce Type: cross Abstract: Enabling large language models (LLMs) to appropriately abstain from answering questions beyond their knowledge is crucial for mitigating hallucination

agentsarxiv-cs-ai

Knee-xRAI: An Explainable AI Framework for Automatic Kellgren-Lawrence Grading of Knee Osteoarthritis

arXiv:2604.23435v1 Announce Type: cross Abstract: Radiographic grading of knee osteoarthritis (KOA) with the Kellgren-Lawrence (KL) system is limited by inter-reader variability and the opacity of cur

LAVA: Layered Audio-Visual Anti-tampering Watermarking for Robust Deepfake Detection and Localization

arXiv:2604.23957v1 Announce Type: new Abstract: Proactive watermarking offers a promising approach for deepfake tamper detection and localization in short-form videos. However, existing methods often

Learning to Identify Out-of-Distribution Objects for 3D LiDAR Anomaly Segmentation

arXiv:2604.23604v1 Announce Type: new Abstract: Understanding the surrounding environment is fundamental in autonomous driving and robotic perception. Distinguishing between known classes and previous

agentsarxiv-cs-cv

Lightweight and Production-Ready PDF Visual Element Parsing

model-releasesarxiv-cs-ai

arXiv:2604.23276v1 Announce Type: cross Abstract: PDF documents contain critical visual elements such as figures, tables, and forms whose accurate extraction is essential for document understanding an

MAE-Based Self-Supervised Pretraining for Data-Efficient Medical Image Segmentation Using nnFormer

arXiv:2604.22854v1 Announce Type: cross Abstract: Transformer architectures, including nnFormer,have demonstrated promising results in volumetric medical image segmentation by being able to capture lo

Majorization-Guided Test-Time Adaptation for Vision-Language Models under Modality-Specific Shift

model-releasesarxiv-cs-cv

arXiv:2604.24602v1 Announce Type: new Abstract: Vision-language models transfer well in zero-shot settings, but at deployment the visual and textual branches often shift asymmetrically. Under this con

Mammographic Lesion Segmentation with Lightweight Models: A Comparative Study

arXiv:2604.23899v1 Announce Type: new Abstract: Breast cancer is a leading cause of cancer-related mortality among women worldwide, with mammography as the primary screening tool. While deep learning

Applications

MetaEarth3D: Unlocking World-scale 3D Generation with Spatially Scalable Generative Modeling

arXiv:2604.22828v1 Announce Type: cross Abstract: Recent generative AI models have achieved remarkable breakthroughs in language and visual understanding. However, although these models can generate r

applicationsarxiv-cs-ai

Micro-Expression-Aware Avatar Fingerprinting via Inter-Frame Feature Differencing

arXiv:2604.23247v1 Announce Type: new Abstract: Avatar fingerprinting, i.e., verifying who drives a synthetic talking-head video rather than whether it is real, is a critical safeguard for authorized

Omni-o3: Deep Nested Omnimodal Deduction for Deliberative Audio-Visual Reasoning

arXiv:2604.24191v1 Announce Type: new Abstract: Omnimodal understanding entails a massive, highly redundant search space of cross-modal interactions, demanding focused and deliberative reasoning. Curr

ParkingScenes: A Structured Dataset for End-to-End Autonomous Parking in Simulation Scenes

model-releasesarxiv-cs-ai

arXiv:2604.22835v1 Announce Type: cross Abstract: Autonomous parking remains a critical yet challenging task in intelligent driving systems, particularly within constrained urban environments where ma

PathMoG: A Pathway-Centric Modular Graph Neural Network for Multi-Omics Survival Prediction

arXiv:2604.24371v1 Announce Type: cross Abstract: Cancer survival prediction from multi-omics data remains challenging because prognostic signals are high-dimensional, heterogeneous, and distributed a

POCA: Pareto-Optimal Curriculum Alignment for Visual Text Generation

arXiv:2604.24171v1 Announce Type: new Abstract: Current visual text generation models struggle with the trade-off between text accuracy and overall image coherence. We find that achieving high text ac

Preserving Long-Tailed Expert Information in Mixture-of-Experts Tuning

arXiv:2604.23036v1 Announce Type: cross Abstract: Despite MoE models leading many benchmarks, supervised fine-tuning (SFT) for the MoE architectures remains difficult because its router layers are fra

safetyarxiv-cs-cl

Probing Visual Planning in Image Editing Models

arXiv:2604.22868v1 Announce Type: cross Abstract: Visual planning represents a crucial facet of human intelligence, especially in tasks that require complex spatial reasoning and navigation. Yet, in m

Question-Adaptive Graph Learning for Multi-hop Retrieval Augmented Generation

arXiv:2510.11541v2 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) has demonstrated its ability to enhance Large Language Models (LLMs) by integrating external knowledge so

ReFinE: Streamlining UI Mockup Iteration with Research Findings

arXiv:2604.04353v2 Announce Type: replace-cross Abstract: Although HCI research papers offer valuable design insights, designers often struggle to apply them in design workflows due to difficulties in

Revisiting Greedy Decoding for Visual Question Answering: A Calibration Perspective

arXiv:2604.23443v1 Announce Type: new Abstract: Stochastic sampling strategies are widely adopted in large language models (LLMs) to balance output coherence and diversity. These heuristics are often

researcharxiv-cs-cl

Seer: Language Instructed Video Prediction with Latent Diffusion Models

arXiv:2303.14897v4 Announce Type: replace Abstract: Imagining the future trajectory is the key for robots to make sound planning and successfully reach their goals. Therefore, text-conditioned video p

ShowFlow: From Robust Single Concept to Condition-Free Multi-Concept Generation

arXiv:2506.18493v2 Announce Type: replace Abstract: Customizing image generation remains a core challenge in controllable image synthesis. For single-concept generation, maintaining both identity pres

STAND: Semantic Anchoring Constraint with Dual-Granularity Disambiguation for Remote Sensing Image Change Captioning

arXiv:2604.23309v1 Announce Type: new Abstract: Remote sensing image change captioning (RSICC) aims to describe the difference between two remote sensing images. While recent methods have explored vid

StoryTR: Narrative-Centric Video Temporal Retrieval with Theory of Mind Reasoning

model-releasesarxiv-cs-ai

arXiv:2604.23198v1 Announce Type: new Abstract: Current video moment retrieval excels at action-centric tasks but struggles with narrative content. Models can see extit{what is happening} but fail to