Search: “multimodal”

Knee-xRAI: An Explainable AI Framework for Automatic Kellgren-Lawrence Grading of Knee Osteoarthritis

arXiv:2604.23435v1 Announce Type: cross Abstract: Radiographic grading of knee osteoarthritis (KOA) with the Kellgren-Lawrence (KL) system is limited by inter-reader variability and the opacity of cur

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

LAVA: Layered Audio-Visual Anti-tampering Watermarking for Robust Deepfake Detection and Localization

DGX agent

arXiv:2604.23957v1 Announce Type: new Abstract: Proactive watermarking offers a promising approach for deepfake tamper detection and localization in short-form videos. However, existing methods often

safetyarxiv-cs-cv

28 Apr 2026

Agents

Learning to Identify Out-of-Distribution Objects for 3D LiDAR Anomaly Segmentation

arXiv:2604.23604v1 Announce Type: new Abstract: Understanding the surrounding environment is fundamental in autonomous driving and robotic perception. Distinguishing between known classes and previous

agentsarxiv-cs-cv

Lightweight and Production-Ready PDF Visual Element Parsing

model-releasesarxiv-cs-ai

arXiv:2604.23276v1 Announce Type: cross Abstract: PDF documents contain critical visual elements such as figures, tables, and forms whose accurate extraction is essential for document understanding an

MAE-Based Self-Supervised Pretraining for Data-Efficient Medical Image Segmentation Using nnFormer

arXiv:2604.22854v1 Announce Type: cross Abstract: Transformer architectures, including nnFormer,have demonstrated promising results in volumetric medical image segmentation by being able to capture lo

Majorization-Guided Test-Time Adaptation for Vision-Language Models under Modality-Specific Shift

model-releasesarxiv-cs-cv

arXiv:2604.24602v1 Announce Type: new Abstract: Vision-language models transfer well in zero-shot settings, but at deployment the visual and textual branches often shift asymmetrically. Under this con

Mammographic Lesion Segmentation with Lightweight Models: A Comparative Study

arXiv:2604.23899v1 Announce Type: new Abstract: Breast cancer is a leading cause of cancer-related mortality among women worldwide, with mammography as the primary screening tool. While deep learning

MetaEarth3D: Unlocking World-scale 3D Generation with Spatially Scalable Generative Modeling

arXiv:2604.22828v1 Announce Type: cross Abstract: Recent generative AI models have achieved remarkable breakthroughs in language and visual understanding. However, although these models can generate r

applicationsarxiv-cs-ai

Micro-Expression-Aware Avatar Fingerprinting via Inter-Frame Feature Differencing

arXiv:2604.23247v1 Announce Type: new Abstract: Avatar fingerprinting, i.e., verifying who drives a synthetic talking-head video rather than whether it is real, is a critical safeguard for authorized

Omni-o3: Deep Nested Omnimodal Deduction for Deliberative Audio-Visual Reasoning

arXiv:2604.24191v1 Announce Type: new Abstract: Omnimodal understanding entails a massive, highly redundant search space of cross-modal interactions, demanding focused and deliberative reasoning. Curr

ParkingScenes: A Structured Dataset for End-to-End Autonomous Parking in Simulation Scenes

model-releasesarxiv-cs-ai

arXiv:2604.22835v1 Announce Type: cross Abstract: Autonomous parking remains a critical yet challenging task in intelligent driving systems, particularly within constrained urban environments where ma

PathMoG: A Pathway-Centric Modular Graph Neural Network for Multi-Omics Survival Prediction

arXiv:2604.24371v1 Announce Type: cross Abstract: Cancer survival prediction from multi-omics data remains challenging because prognostic signals are high-dimensional, heterogeneous, and distributed a

POCA: Pareto-Optimal Curriculum Alignment for Visual Text Generation

arXiv:2604.24171v1 Announce Type: new Abstract: Current visual text generation models struggle with the trade-off between text accuracy and overall image coherence. We find that achieving high text ac

Preserving Long-Tailed Expert Information in Mixture-of-Experts Tuning

arXiv:2604.23036v1 Announce Type: cross Abstract: Despite MoE models leading many benchmarks, supervised fine-tuning (SFT) for the MoE architectures remains difficult because its router layers are fra

safetyarxiv-cs-cl

Probing Visual Planning in Image Editing Models

arXiv:2604.22868v1 Announce Type: cross Abstract: Visual planning represents a crucial facet of human intelligence, especially in tasks that require complex spatial reasoning and navigation. Yet, in m

Question-Adaptive Graph Learning for Multi-hop Retrieval Augmented Generation

arXiv:2510.11541v2 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) has demonstrated its ability to enhance Large Language Models (LLMs) by integrating external knowledge so

ReFinE: Streamlining UI Mockup Iteration with Research Findings

arXiv:2604.04353v2 Announce Type: replace-cross Abstract: Although HCI research papers offer valuable design insights, designers often struggle to apply them in design workflows due to difficulties in

Revisiting Greedy Decoding for Visual Question Answering: A Calibration Perspective

arXiv:2604.23443v1 Announce Type: new Abstract: Stochastic sampling strategies are widely adopted in large language models (LLMs) to balance output coherence and diversity. These heuristics are often

researcharxiv-cs-cl

Seer: Language Instructed Video Prediction with Latent Diffusion Models

arXiv:2303.14897v4 Announce Type: replace Abstract: Imagining the future trajectory is the key for robots to make sound planning and successfully reach their goals. Therefore, text-conditioned video p

ShowFlow: From Robust Single Concept to Condition-Free Multi-Concept Generation

arXiv:2506.18493v2 Announce Type: replace Abstract: Customizing image generation remains a core challenge in controllable image synthesis. For single-concept generation, maintaining both identity pres

STAND: Semantic Anchoring Constraint with Dual-Granularity Disambiguation for Remote Sensing Image Change Captioning

arXiv:2604.23309v1 Announce Type: new Abstract: Remote sensing image change captioning (RSICC) aims to describe the difference between two remote sensing images. While recent methods have explored vid

StoryTR: Narrative-Centric Video Temporal Retrieval with Theory of Mind Reasoning

model-releasesarxiv-cs-ai

arXiv:2604.23198v1 Announce Type: new Abstract: Current video moment retrieval excels at action-centric tasks but struggles with narrative content. Models can see extit{what is happening} but fail to

Text Tells the Cost: Predicting and Analyzing Repayment Effort of Self-Admitted Technical Debt

arXiv:2309.06020v3 Announce Type: replace-cross Abstract: Technical debt refers to the consequences of sub-optimal decisions made during software development that prioritize short-term benefits over l

Towards Any-Quality Image Segmentation via Generative and Adaptive Latent Space Enhancement

arXiv:2601.02018v2 Announce Type: replace Abstract: Segment Anything Models (SAMs), known for their exceptional zero-shot segmentation performance, have garnered significant attention in the research

UNSEEN: A Cross-Stack LLM Unlearning Defense against AR-LLM Social Engineering Attacks

arXiv:2604.23141v1 Announce Type: cross Abstract: Emerging AR-LLM-based Social Engineering attack (e.g., SEAR) is at the edge of posing great threats to real-world social life. In such AR-LLM-SE attac

safetyarxiv-cs-ai

When AI reviews science: Can we trust the referee?

arXiv:2604.23593v1 Announce Type: new Abstract: The volume of scientific submissions continues to climb, outpacing the capacity of qualified human referees and stretching editorial timelines. At the s

When Silence Matters: The Impact of Irrelevant Audio on Text Reasoning in Large Audio-Language Models

arXiv:2510.00626v3 Announce Type: replace-cross Abstract: Large audio-language models (LALMs) unify speech and text processing, but their robustness in noisy real-world settings remains underexplored.

applicationsarxiv-cs-cl

Local Ai

Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond

arXiv:2604.22748v1 Announce Type: new Abstract: As AI systems move from generating text to accomplishing goals through sustained interaction, the ability to model environment dynamics becomes a centra

local-aiarxiv-cs-ai

Chain-of-Memory: Lightweight Memory Construction with Dynamic Evolution for LLM Agents

arXiv:2601.14287v2 Announce Type: replace Abstract: External memory systems are pivotal for enabling Large Language Model (LLM) agents to maintain persistent knowledge and perform long-horizon decisio

researcharxiv-cs-lg

Context-Sensitive Abstractions for Reinforcement Learning with Parameterized Actions

arXiv:2512.20831v2 Announce Type: replace Abstract: Real-world sequential decision-making often involves parameterized action spaces that require both, decisions regarding discrete actions and decisio

Contrastive Semantic Projection: Faithful Neuron Labeling with Contrastive Examples

arXiv:2604.22477v1 Announce Type: new Abstract: Neuron labeling assigns textual descriptions to internal units of deep networks. Existing approaches typically rely on highly activating examples, often

applicationsarxiv-cs-cv

DocPrune:Efficient Document Question Answering via Background, Question, and Comprehension-aware Token Pruning

arXiv:2604.22281v1 Announce Type: new Abstract: Recent advances in vision-language models have demonstrated remarkable performance across diverse multi-modal tasks, including document question answeri

From Words to Amino Acids: Does the Curse of Depth Persist?

arXiv:2602.21750v2 Announce Type: replace Abstract: Protein language models (PLMs) have become widely adopted as general-purpose models, demonstrating strong performance in protein engineering and de

researcharxiv-cs-lg

GCImOpt: Learning efficient goal-conditioned policies by imitating optimal trajectories

arXiv:2604.22724v1 Announce Type: new Abstract: Imitation learning is a well-established approach for machine-learning-based control. However, its applicability depends on having access to demonstrati

tutorialsarxiv-cs-ro

How Many Visual Levers Drive Urban Perception? Interventional Counterfactuals via Multiple Localised Edits

arXiv:2604.22103v1 Announce Type: cross Abstract: Street-view perception models predict subjective attributes such as safety at scale, but remain correlational: they do not identify which localized vi

LeHome: A Simulation Environment for Deformable Object Manipulation in Household Scenarios

arXiv:2604.22363v1 Announce Type: cross Abstract: Household environments present one of the most common, impactful yet challenging application domains for robotics. Within household scenarios, manipul

applicationsarxiv-cs-ai

SSG: Logit-Balanced Vocabulary Partitioning for LLM Watermarking

arXiv:2604.22438v1 Announce Type: cross Abstract: Watermarking has emerged as a promising technique for tracing the authorship of content generated by large language models (LLMs). Among existing appr

STEM: Structure-Tracing Evidence Mining for Knowledge Graphs-Driven Retrieval-Augmented Generation

arXiv:2604.22282v1 Announce Type: new Abstract: Knowledge Graph-based Question Answering (KGQA) plays a pivotal role in complex reasoning tasks but remains constrained by two persistent challenges: th

researcharxiv-cs-cl

Agents

A Bayesian Reasoning Framework for Robotic Systems in Autonomous Casualty Triage

arXiv:2604.21568v1 Announce Type: new Abstract: Autonomous robots deployed in mass casualty incidents (MCI) face the challenge of making critical decisions based on incomplete and noisy perceptual dat

agentsarxiv-cs-ro

Adaptive Instruction Composition for Automated LLM Red-Teaming

arXiv:2604.21159v1 Announce Type: cross Abstract: Many approaches to LLM red-teaming leverage an attacker LLM to discover jailbreaks against a target. Several of them task the attacker with identifyin

Attention-based multiple instance learning for predominant growth pattern prediction in lung adenocarcinoma wsi using foundation models

arXiv:2604.21530v1 Announce Type: cross Abstract: Lung adenocarcinoma (LUAD) grading depends on accurately identifying growth patterns, which are indicators of prognosis and can influence treatment de

Clinical Evaluation of a Tongue-Controlled Wrist Abduction-Adduction Assistance in a 6-DoF Upper-Limb Exoskeleton for Individuals with ALS and SCI

arXiv:2604.20967v1 Announce Type: new Abstract: Upper-limb exoskeletons (ULEs) have the potential to restore functional independence in individuals with severe motor impairments; however, the clinical

researcharxiv-cs-ro

Agents

Clinically Interpretable Sepsis Early Warning via LLM-Guided Simulation of Temporal Physiological Dynamics

arXiv:2604.20924v1 Announce Type: new Abstract: Timely and interpretable early warning of sepsis remains a major clinical challenge due to the complex temporal dynamics of physiological deterioration.

agentsarxiv-cs-lg

Conjecture and Inquiry: Quantifying Software Performance Requirements via Interactive Retrieval-Augmented Preference Elicitation

arXiv:2604.21380v1 Announce Type: cross Abstract: Since software performance requirements are documented in natural language, quantifying them into mathematical forms is essential for software enginee

applicationsarxiv-cs-ai

Do MLLMs Understand Pointing? Benchmarking and Enhancing Referential Reasoning in Egocentric Vision

model-releasesarxiv-cs-cv

arXiv:2604.21461v1 Announce Type: new Abstract: Egocentric AI agents, such as smart glasses, rely on pointing gestures to resolve referential ambiguities in natural language commands. However, despite

Escaping the Agreement Trap: Defensibility Signals for Evaluating Rule-Governed AI

arXiv:2604.20972v1 Announce Type: new Abstract: Content moderation systems are typically evaluated by measuring agreement with human labels. In rule-governed environments this assumption fails: multip

safetyarxiv-cs-ai

EVENT5Ws: A Large Dataset for Open-Domain Event Extraction from Documents

model-releasesarxiv-cs-cl

arXiv:2604.21890v1 Announce Type: new Abstract: Event extraction identifies the central aspects of events from text. It supports event understanding and analysis, which is crucial for tasks such as in

Expanding the extreme-k dielectric materials space through physics-validated generative reasoning

arXiv:2604.21068v1 Announce Type: cross Abstract: The most technologically consequential materials are often the rarest: they occupy narrow regions of chemical space, obey competing physical constrain