Search: “multimodal”

Forecasting the Past: Gradient-Based Distribution Shift Detection in Trajectory Prediction

arXiv:2604.12425v1 Announce Type: new Abstract: Trajectory prediction models often fail in real-world automated driving due to distributional shifts between training and test conditions. Such distribu

applicationsarxiv-cs-lg

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

GAM: Hierarchical Graph-based Agentic Memory for LLM Agents

DGX agent

arXiv:2604.12285v1 Announce Type: new Abstract: To sustain coherent long-term interactions, Large Language Model (LLM) agents must navigate the tension between acquiring new information and retaining

agentsarxiv-cs-ai

15 Apr 2026

Generative Modeling Enables Molecular Structure Retrieval from Coulomb Explosion Imaging

arXiv:2511.00179v2 Announce Type: replace-cross Abstract: Capturing the structural changes that molecules undergo during chemical reactions in real space and time is a long-standing dream and an essen

GTPBD-MM: A Global Terraced Parcel and Boundary Dataset with Multi-Modality

model-releasesarxiv-cs-cv

arXiv:2604.12315v1 Announce Type: new Abstract: Agricultural parcel extraction plays an important role in remote sensing-based agricultural monitoring, supporting parcel surveying, precision managemen

Iterative Compositional Data Generation for Robot Control

arXiv:2512.10891v4 Announce Type: replace-cross Abstract: Collecting robotic manipulation data is expensive, making it impractical to acquire demonstrations for the combinatorially large space of task

tutorialsarxiv-cs-lg

JanusCoder: Towards a Foundational Visual-Programmatic Interface for Code Intelligence

arXiv:2510.23538v2 Announce Type: replace Abstract: The scope of neural code intelligence is rapidly expanding beyond text-based source code to encompass the rich visual outputs that programs generate

LLM-Guided Semantic Bootstrapping for Interpretable Text Classification with Tsetlin Machines

arXiv:2604.12223v1 Announce Type: cross Abstract: Pretrained language models (PLMs) like BERT provide strong semantic representations but are costly and opaque, while symbolic models such as the Tsetl

Agents

NaviRAG: Towards Active Knowledge Navigation for Retrieval-Augmented Generation

arXiv:2604.12766v1 Announce Type: new Abstract: Retrieval-augmented generation (RAG) typically relies on a flat retrieval paradigm that maps queries directly to static, isolated text segments. This ap

agentsarxiv-cs-cl

PAL: Personal Adaptive Learner

arXiv:2604.13017v1 Announce Type: new Abstract: AI-driven education platforms have made some progress in personalisation, yet most remain constrained to static adaptation--predefined quizzes, uniform

applicationsarxiv-cs-ai

QMC-Net: Data-Aware Quantum Representations for Remote Sensing Image Classification

arXiv:2604.11817v1 Announce Type: cross Abstract: Hybrid quantum-classical models offer a promising route for learning from complex data; however, their application to multi-band remote sensing imager

researcharxiv-cs-cv

Relaxing Anchor-Frame Dominance for Mitigating Hallucinations in Video Large Language Models

arXiv:2604.12582v1 Announce Type: new Abstract: Recent Video Large Language Models (Video-LLMs) have demonstrated strong capability in video understanding, yet they still suffer from hallucinations. E

safetyarxiv-cs-cv

ResBM: Residual Bottleneck Models for Low-Bandwidth Pipeline Parallelism

arXiv:2604.11947v1 Announce Type: cross Abstract: Unlocking large-scale low-bandwidth decentralized training has the potential to utilize otherwise untapped compute resources. In centralized settings,

Risk-Calibrated Learning: Minimizing Fatal Errors in Medical AI

arXiv:2604.12693v1 Announce Type: new Abstract: Deep learning models often achieve expert-level accuracy in medical image classification but suffer from a critical flaw: semantic incoherence. These hi

safetyarxiv-cs-cv

Social Learning Strategies for Evolved Virtual Soft Robots

arXiv:2604.12482v1 Announce Type: cross Abstract: Optimizing the body and brain of a robot is a coupled challenge: the morphology determines what control strategies are effective, while the control pa

Unveiling the Surprising Efficacy of Navigation Understanding in End-to-End Autonomous Driving

arXiv:2604.12208v1 Announce Type: cross Abstract: Global navigation information and local scene understanding are two crucial components of autonomous driving systems. However, our experimental result

ViLL-E: Video LLM Embeddings for Retrieval

arXiv:2604.12148v1 Announce Type: new Abstract: Video Large Language Models (VideoLLMs) excel at video understanding tasks where outputs are textual, such as Video Question Answering and Video Caption

local-aiarxiv-cs-cv

VPTracker: Global Vision-Language Tracking via Visual Prompt

arXiv:2512.22799v2 Announce Type: replace Abstract: Vision-Language Tracking aims to continuously localize objects described by a visual template and a language description. Existing methods, however,

local-aiarxiv-cs-cv

A Diffusion-Contrastive Graph Neural Network with Virtual Nodes for Wind Nowcasting in Unobserved Regions

arXiv:2604.10328v1 Announce Type: cross Abstract: Accurate weather nowcasting remains one of the central challenges in atmospheric science, with critical implications for climate resilience, energy se

A Multiparty Homomorphic Encryption Approach to Confidential Federated Kaplan Meier Survival Analysis

arXiv:2412.20495v2 Announce Type: replace-cross Abstract: The proliferation of real-world health data enables multi-institutional survival studies, yet privacy constraints preclude centralizing sensit

applicationsarxiv-cs-ai

A Progressive Training Strategy for Vision-Language Models to Counteract Spatio-Temporal Hallucinations in Embodied Reasoning

arXiv:2604.10506v1 Announce Type: new Abstract: Vision-Language Models (VLMs) have made significant strides in static image understanding but continue to face critical hurdles in spatiotemporal reason

A Survey of Inductive Reasoning for Large Language Models

arXiv:2510.10182v2 Announce Type: replace-cross Abstract: Reasoning is an important task for large language models (LLMs). Among all the reasoning paradigms, inductive reasoning is one of the fundamen

A Temporally Augmented Graph Attention Network for Affordance Classification

arXiv:2604.10149v1 Announce Type: cross Abstract: Graph attention networks (GATs) provide one of the best frameworks for learning node representations in relational data; but, existing variants such a

ActDistill: General Action-Guided Self-Derived Distillation for Efficient Vision-Language-Action Models

arXiv:2511.18082v3 Announce Type: replace Abstract: Recent Vision-Language-Action (VLA) models have shown impressive flexibility and generalization, yet their deployment in robotic manipulation remain

tutorialsarxiv-cs-cv

AdvDINO: Domain-Adversarial Self-Supervised Representation Learning for Spatial Proteomics

arXiv:2508.04955v2 Announce Type: replace-cross Abstract: Self-supervised learning (SSL) has emerged as a powerful approach for learning visual representations without manual annotations. However, the

Agentic Aggregation for Parallel Scaling of Long-Horizon Agentic Tasks

model-releasesarxiv-cs-cl

arXiv:2604.11753v1 Announce Type: new Abstract: We study parallel test-time scaling for long-horizon agentic tasks such as agentic search and deep research, where multiple rollouts are generated in pa

AtlasKV: Augmenting LLMs with Billion-Scale Knowledge Graphs in 20GB VRAM

arXiv:2510.17934v2 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) has shown some success in augmenting large language models (LLMs) with external knowledge. However, as a

Attention-Guided Flow-Matching for Sparse 3D Geological Generation

arXiv:2604.09700v1 Announce Type: cross Abstract: Constructing high-resolution 3D geological models from sparse 1D borehole and 2D surface data is a highly ill-posed inverse problem. Traditional heuri

Belief-Aware VLM Model for Human-like Reasoning

arXiv:2604.09686v1 Announce Type: new Abstract: Traditional neural network models for intent inference rely heavily on observable states and struggle to generalize across diverse tasks and dynamic env

BEM: Training-Free Background Embedding Memory for False-Positive Suppression in Real-Time Fixed-Background Camera

arXiv:2604.11714v1 Announce Type: new Abstract: Pretrained detectors perform well on benchmarks but often suffer performance degradation in real-world deployments due to distribution gaps between trai

applicationsarxiv-cs-cv

Agents

Beyond RAG for Agent Memory: Retrieval by Decoupling and Aggregation

arXiv:2602.02007v3 Announce Type: replace-cross Abstract: Agent memory systems often adopt the standard Retrieval-Augmented Generation (RAG) pipeline, yet its underlying assumptions differ in this set

agentsarxiv-cs-ai

Agents

Beyond RAG for Cyber Threat Intelligence: A Systematic Evaluation of Graph-Based and Agentic Retrieval

arXiv:2604.11419v1 Announce Type: new Abstract: Cyber threat intelligence (CTI) analysts must answer complex questions over large collections of narrative security reports. Retrieval-augmented generat

agentsarxiv-cs-ai

Beyond Theory of Mind in Robotics

arXiv:2604.09612v1 Announce Type: new Abstract: Theory of Mind, the capacity to explain and predict behavior by inferring hidden mental states, has become the dominant paradigm for social interaction

Can Multi-Modal LLMs Provide Live Step-by-Step Task Guidance?

model-releasesarxiv-cs-cv

arXiv:2511.21998v2 Announce Type: replace Abstract: Multi-modal Large Language Models (LLM) have advanced conversational abilities but struggle with providing live, interactive step-by-step guidance,

CArtBench: Evaluating Vision-Language Models on Chinese Art Understanding, Interpretation, and Authenticity

model-releasesarxiv-cs-cl

arXiv:2604.11632v1 Announce Type: new Abstract: We introduce CARTBENCH, a museum-grounded benchmark for evaluating vision-language models (VLMs) on Chinese artworks beyond short-form recognition and Q

CircuitSynth: Reliable Synthetic Data Generation

arXiv:2604.10114v1 Announce Type: cross Abstract: The generation of high-fidelity synthetic data is a cornerstone of modern machine learning, yet Large Language Models (LLMs) frequently suffer from ha

CLASP: Closed-loop Asynchronous Spatial Perception for Open-vocabulary Desktop Object Grasping

arXiv:2604.11320v1 Announce Type: new Abstract: Robot grasping of desktop object is widely used in intelligent manufacturing, logistics, and agriculture.Although vision-language models (VLMs) show str

applicationsarxiv-cs-ro

CoRe-ECG: Advancing Self-Supervised Representation Learning for 12-Lead ECG via Contrastive and Reconstructive Synergy

arXiv:2604.11359v1 Announce Type: new Abstract: Accurate interpretation of electrocardiogram (ECG) remains challenging due to the scarcity of labeled data and the high cost of expert annotation. Self-

Cross-Cultural Value Awareness in Large Vision-Language Models

arXiv:2604.09945v1 Announce Type: cross Abstract: The rapid adoption of large vision-language models (LVLMs) in recent years has been accompanied by growing fairness concerns due to their propensity t

Decoupled Similarity for Task-Aware Token Pruning in Large Vision-Language Models

arXiv:2604.11240v1 Announce Type: new Abstract: Token pruning has emerged as an effective approach to reduce the substantial computational overhead of Large Vision-Language Models (LVLMs) by discardin

researcharxiv-cs-cv

Deliberative Alignment is Deep, but Uncertainty Remains: Inference time safety improvement in reasoning via attribution of unsafe behavior to base model

arXiv:2604.09665v1 Announce Type: cross Abstract: While the wide adoption of refusal training in large language models (LLMs) has showcased improvements in model safety, recent works have highlighted

Disco-RAG: Discourse-Aware Retrieval-Augmented Generation

arXiv:2601.04377v4 Announce Type: replace-cross Abstract: Retrieval-Augmented Generation (RAG) has emerged as an important means of enhancing the performance of large language models (LLMs) in knowled

DoSReMC: Domain Shift Resilient Mammography Classification using Batch Normalization Adaptation

arXiv:2508.15452v3 Announce Type: replace-cross Abstract: Numerous deep learning-based solutions have been developed for the automatic recognition of breast cancer using mammography images. However, t

applicationsarxiv-cs-cv

Eevee: Towards Close-up High-resolution Video-based Virtual Try-on

model-releasesarxiv-cs-cv

arXiv:2511.18957v2 Announce Type: replace Abstract: Video virtual try-on technology provides a cost-effective solution for creating marketing videos in fashion e-commerce. However, its practical adopt

End-to-end Contrastive Language-Speech Pretraining Model For Long-form Spoken Question Answering

arXiv:2511.09282v3 Announce Type: replace-cross Abstract: Significant progress has been made in spoken question answering (SQA) in recent years. However, many existing methods, including large audio l

safetyarxiv-cs-cl

Enhancing Geo-localization for Crowdsourced Flood Imagery via LLM-Guided Attention

arXiv:2512.11811v3 Announce Type: replace-cross Abstract: Crowdsourced social media imagery provides real-time visual evidence of urban flooding but often lacks reliable geographic metadata for emerge

Evolutionary Profiles for Protein Fitness Prediction

arXiv:2510.07286v3 Announce Type: replace-cross Abstract: Predicting the fitness impact of mutations is central to protein engineering but constrained by limited assays relative to the size of sequenc

FACT-E: Causality-Inspired Evaluation for Trustworthy Chain-of-Thought Reasoning

arXiv:2604.10693v1 Announce Type: new Abstract: Chain-of-Thought (CoT) prompting has improved LLM reasoning, but models often generate explanations that appear coherent while containing unfaithful int

Fake-HR1: Rethinking Reasoning of Vision Language Model for Synthetic Image Detection

arXiv:2602.10042v3 Announce Type: replace-cross Abstract: Recent studies have demonstrated that incorporating Chain-of-Thought (CoT) reasoning into the detection process can enhance a model's ability