Search: “multimodal”

CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Prediction

arXiv:2609.00242v1 Announce Type: cross Abstract: Long-tail autonomous driving failures are often framed as rare-object recognition errors. We argue that this view is incomplete: the decision-critical

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

CrossFeat: Bridging Imaging Modalities in Feature Descriptor Space

DGX agent

arXiv:2609.00272v1 Announce Type: new Abstract: Most advances in keypoint descriptions address monomodal settings, where image variations arise from viewpoint, illumination, or contrast changes. Multi

researcharxiv-cs-cv

2 Sept 2026

Ctrl-F-Resist. Practices, Challenges, and Technical Needs of Civil Society Organizations Monitoring the Far-Right Online

arXiv:2609.00808v1 Announce Type: cross Abstract: As far-right actors increasingly exploit online platforms to disseminate ideology and mobilize supporters, civil society organizations (CSOs) play a v

EGT-KG: Evidence-Grounded Typed KG Retrieval for Practical Scientific QA with Small Language Models

arXiv:2609.00479v1 Announce Type: new Abstract: For emerging scientific research domains, local Small Language Models (SLMs) are becoming more attractive, as they offer stronger privacy control and mo

From Legible to Inscrutable Trajectories: (Il)legible Motion Planning Accounting for Multiple Observers

arXiv:2602.09227v2 Announce Type: replace Abstract: In cooperative environments, such as in factories or assistive scenarios, it is important for a robot to communicate its intentions to observers, wh

agentsarxiv-cs-ro

Human-robot conversation with multiple participants in noisy public spaces

arXiv:2609.00648v1 Announce Type: new Abstract: For noisy real-world environments such as those in open public spaces, spoken dialogue systems for both autonomous robots and avatars should be carefull

agentsarxiv-cs-ro

Hypotheses-Guided Self Distillation for Continual Personalization

arXiv:2609.00251v1 Announce Type: new Abstract: As people increasingly interact with LLM assistants in daily life, continually adapting to individual preferences has become essential for effective lon

researcharxiv-cs-ai

In-Context Neurofeedback: Can LLMs Control Their Internal Representations through Privileged Access?

arXiv:2609.00904v1 Announce Type: new Abstract: Whether large language models (LLMs) can control their own internal representations matters for both machine metacognition and AI safety. A recent study

MemeBridge: A Dataset for Benchmarking and Mitigating the Bidirectional Cultural Gap in Meme Interpretation

arXiv:2609.00491v1 Announce Type: new Abstract: Communicating across cultures is inherently challenging, especially through culturally dense and ambiguous formats like memes. While people expect large

MobileOcc: A Human-Aware Semantic Occupancy Dataset for Mobile Robots

arXiv:2511.16949v2 Announce Type: replace-cross Abstract: Dense 3D semantic occupancy perception is critical for mobile robots operating in pedestrian-rich environments, yet it remains underexplored c

On the Design Fundamentals of Pixel Text Representation Learning

arXiv:2609.01147v1 Announce Type: cross Abstract: Text-rich visual inputs require models that can read, retrieve, and compress language directly in pixel space, yet existing pixel-text encoders strugg

safetyarxiv-cs-cl

Phrase-Localized Language-Contrastive Guidance: Training-Free Localized Accent Control for Code-Switching Text-to-Speech

arXiv:2609.01016v1 Announce Type: new Abstract: Current speech synthesis struggles with code-switching, which mixes a foreign language phrase into a primary language utterance, causing the phrase to b

local-aiarxiv-cs-cl

Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Driving

arXiv:2609.00111v1 Announce Type: new Abstract: We present Qwen-Drive-1.0, an initial step towards a vision-language foundation model for autonomous driving. Qwen-Drive-1.0 retains the architecture of

RadMatch: Auditable Radiology Report Evaluation via Finding-Level Matching

arXiv:2609.01470v1 Announce Type: new Abstract: As AI systems are increasingly used to draft radiology reports, reliably evaluating their clinical quality remains a critical challenge. Large language

safetyarxiv-cs-cv

Reliability Challenges in Diffusion Vision-Language Models

arXiv:2609.01318v1 Announce Type: cross Abstract: Diffusion-based Large Vision-Language Models (dLVLMs) have recently emerged as a compelling alternative to autoregressive (AR) LVLMs, offering advanta

safetyarxiv-cs-cl

Socrates went Nuclear: Comparing Interaction Strategies for AI systems in a Learning Context using Brain Sensing

arXiv:2609.00584v1 Announce Type: new Abstract: Does unrestricted AI access bypass the cognitive effort required for learning, or does it streamline knowledge acquisition? This paper reports on a stud

SpatialGuard: Harness-Guided Verifiable Spatial Reasoning for Text-to-Image Generation

arXiv:2609.01582v1 Announce Type: new Abstract: Complex 3D spatial text to image generation requires models to convert natural language into stable visual geometry, not merely semantic appearance. Exi

safetyarxiv-cs-cv

TEIDAN: A Multilingual Multiparty Dialogue Corpus

arXiv:2609.00802v1 Announce Type: new Abstract: Multi-party interaction is a central setting for human communication and a necessary target for human-agent interaction systems that must participate in

agentsarxiv-cs-cl

You Cannot Photograph the Same Street Twice: Reliability Limits in Vision-Language Measurement of Urban Change

arXiv:2609.00649v1 Announce Type: new Abstract: Vision-language models are increasingly used to measure urban change from repeated street-level imagery, but their longitudinal reliability is not well

A Composition-Aware Pretraining Framework for Geospatial Foundation Models

arXiv:2608.30817v1 Announce Type: cross Abstract: Geospatial foundation models have emerged as state-of-the-art methods for downstream Earth observation tasks. However, existing pretraining methodolog

Agent2UCB: Agentic System for Generative Engine Optimization

arXiv:2608.29063v1 Announce Type: new Abstract: Large language model driven search engines such as Google AI Overviews and Perplexity have created new opportunities for Generative Engine Optimization

Agents in the Large: Perception-Centered Architecture for Persistent Agents

arXiv:2608.30478v1 Announce Type: new Abstract: Cognitive language agents have achieved substantial progress by equipping language models with memory, tools, and decision-making procedures, enabling a

agentsarxiv-cs-cl

AlgoWorlds: Benchmarking Tool Use for Global Optimization in Algorithmic Worlds

arXiv:2608.29397v1 Announce Type: new Abstract: Tool-use benchmarks generally evaluate whether an agent completes a workflow using appropriate tools and valid arguments. However, feasibility alone is

Answer Bubbles: Information Exposure in AI-Mediated Search

arXiv:2603.16138v2 Announce Type: replace-cross Abstract: Generative search systems are increasingly replacing link-based retrieval with AI-generated summaries, yet little is known about how these sys

researcharxiv-cs-cl

Asymmetric Within-Document Predictive Learning for Scientific Document Representation

arXiv:2608.28625v1 Announce Type: cross Abstract: We study predictive pretraining for scientific document representation using the discourse structure of papers. We propose SciJEPA, a citation-free fr

Automated pipeline for herbarium label digitization

arXiv:2608.28676v1 Announce Type: new Abstract: Digitized herbarium collections, now comprising over 100 million freely accessible specimen images, have become a critical resource for addressing funda

local-aiarxiv-cs-cv

Beyond Uncertainty: Multi-Solver Disagreement Rewards for Self-Evolving Reasoning Curricula

arXiv:2608.30035v1 Announce Type: new Abstract: Self-evolving reasoning frameworks train a Challenger to generate questions exposing a Solver's weaknesses, creating adaptive curricula without human da

researcharxiv-cs-ai

CHASE: How Content Ecosystems Are Reshaped When Ranking Is the Only Target

arXiv:2608.30466v1 Announce Type: new Abstract: Generative Engine Optimization (GEO) is increasingly used to improve content visibility in LLM-based retrieval systems, yet its population-level effects

CheXGround: Anatomical Region Tokens for Grounded Longitudinal Chest X-ray Interpretation

arXiv:2608.30758v1 Announce Type: new Abstract: Recent radiology multi-modal language models have made substantial progress in chest X-ray report generation, visual question answering, and temporal re

local-aiarxiv-cs-cv

Context-Aware Interpretable Representations for Retrieval and Graph Convolutional Network Classification

arXiv:2608.29004v1 Announce Type: cross Abstract: The advances in visual information modeling and representation during the last decades are remarkable, mainly supported by Convolutional Neural Networ

safetyarxiv-cs-cv

CoVA-SFT: A Large-Scale Dataset for Chain of Visual Abstractions

arXiv:2608.28958v1 Announce Type: new Abstract: Chain-of-thought (CoT) reasoning has dramatically improved large language models (LLMs) by allowing them to decompose problems into intermediate steps.

DARP: A Calibrated Dual-Arm RGB-D-IR Dataset for Multi-View Robotic Perception

arXiv:2608.31002v1 Announce Type: cross Abstract: Robotic perception from a single viewpoint is often limited by self-occlusion and incomplete surface visibility. This paper presents DARP(Dual-Arm Rob

DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolution

arXiv:2608.31106v1 Announce Type: new Abstract: Recent video generators often omit audio or synthesize it in a separate stage, limiting reciprocal modeling of visual dynamics and acoustic events. We p

ECGQuest: Benchmarking and Fine-Tuning Language Models for Electrocardiography

arXiv:2608.30893v1 Announce Type: new Abstract: Electrocardiogram (ECG) interpretation requires knowledge of cardiology, electrophysiology, clinical diagnosis, ECG waveforms, signal acquisition, and i

Effective Graph and Rank-based Contextual Embeddings for Textual and Multimedia Data

arXiv:2608.29001v1 Announce Type: cross Abstract: In a data-driven world, efficiently organizing and mapping relationships between objects is crucial. Graphs are powerful tools for modeling these conn

GAFT: Geo-Anchored Fine-Tuning for Hazard Identification from Rare Failures

arXiv:2608.30858v1 Announce Type: cross Abstract: Off-road navigation can fail when physical structures induce irrecoverable states such as high-centering or entrapment, requiring human interventions.

Growing a Stand, Not a Tree: Joint Canopy Generation Reproduces Crown Shyness

arXiv:2608.28692v1 Announce Type: new Abstract: In closed forests, neighboring tree crowns often stop short of touching, leaving a network of narrow gaps known as crown shyness. The pattern belongs to

InfraOcc: An Infrastructure Occupancy Benchmark with Static-to-Dynamic Reasoning

arXiv:2608.30657v1 Announce Type: new Abstract: Fixed-viewpoint infrastructure sensors repeatedly observe the same traffic space, making roadside 3D occupancy structurally different from ego-vehicle p

Jigsaw-CRL: Recovering Global Latent Causal Order from Fragmented Multi-Client Interventions

arXiv:2608.28991v1 Announce Type: cross Abstract: Causal representation learning (CRL) aims to recover latent causal variables and their structural relations from high-dimensional observations. Existi

researcharxiv-cs-lg

Leveraging Turn-taking Dynamics for Intent Recognition in Multi-party Conversations

arXiv:2608.28926v1 Announce Type: new Abstract: We propose a multi-task learning approach for multi-party dialogue intent recognition that leverages an auxiliary task that models turn-taking dynamics.

researcharxiv-cs-cl

Memory-First Fact-Checking: A Knowledge-Graph-Grounded Multi-Agent System for Misinformation Detection

arXiv:2608.29617v1 Announce Type: cross Abstract: This paper introduces a hybrid fact-checking framework that integrates Knowledge Graph-based semantic memory with adversarial multi-agent reasoning fo

mmIR: Frequency-Space Inverse Rendering for 3D Millimeter-Wave Radar ADC Synthesis

arXiv:2608.28913v1 Announce Type: new Abstract: High-resolution 3D radar data is scarce. Commodity mmWave sensors use small antenna arrays that limit angular resolution to several degrees, and existin

MobileDreamer: Generative Sketch World Model for GUI Agent

arXiv:2601.04035v2 Announce Type: replace Abstract: Mobile GUI agents have shown strong potential in real-world automation and practical applications. However, most existing agents remain reactive, ma

agentsarxiv-cs-ai

MUDDLE: Measuring Understanding of Documents under Distractor and Length Effects

arXiv:2608.29477v1 Announce Type: cross Abstract: Document question-answering systems increasingly answer questions over collections of retrieved documents rather than one clean source, so robustness

Oculi: A Conversational Agentic Platform for Automated Credit Risk Analysis

arXiv:2608.28944v1 Announce Type: new Abstract: Credit risk analysis in financial institutions traditionally requires analysts to manually write SQL queries, run statistical computations, and build vi

agentsarxiv-cs-ai

PAUSE: Editable Strategy Artifacts for Long-Form Cultural Story Adaptation

arXiv:2608.28633v1 Announce Type: cross Abstract: Generative AI systems increasingly mediate cultural adaptation, but their cultural decisions are often hidden inside prompts, transient model plans, o

local-aiarxiv-cs-ai

PermitGPT: A Unified Generative-AI Pipeline for Construction Hazard Forecasting, Permit Prediction, and Community Impact

arXiv:2608.28728v1 Announce Type: new Abstract: Urban construction governance requires early decisions that connect workplace safety, permitting requirements, and community impact, yet the relevant ev

Preference Shapes Relevance: Cross-component Hierarchical Semantic Alignment for Personalized Generative Retrieval

arXiv:2608.30553v1 Announce Type: cross Abstract: Generative Retrieval (GR) has emerged as a promising paradigm by mapping queries directly to Semantic IDs (SIDs) with powerful representation capabili