Search: “multimodal”

Neuro-Geospatial Modelling of EEG Affective States Using Literature-Informed Environmental Context

arXiv:2608.20807v1 Announce Type: new Abstract: Environmental exposures such as air pollution and greenness have been associated with affective and cognitive outcomes, but EEG and environmental datase

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Tutorials

OccluRank: Controllable Occlusion-Aware Layout-to-Image Generation by Adding Just an Ordinal Rank

DGX agent

arXiv:2608.20932v1 Announce Type: new Abstract: Layout-to-image generation enables explicit spatial control through bounding-box layouts, yet bounding boxes specify only instance locations and cannot

tutorialsarxiv-cs-cv

24 Aug 2026

Routing Before Looking: Query-Adaptive Evidence Acquisition for Long-form Video Understanding

arXiv:2608.20805v1 Announce Type: new Abstract: Long-form video understanding remains challenging for video agents due to the mismatch between query demands and evidence acquisition strategies. Althou

SPARC: Single-Pass Scaling for Motion Forecasting with Conformal Bayesian Last Layers

arXiv:2608.20802v1 Announce Type: new Abstract: Human motion forecasters are increasingly accurate and fast, but reliable deployment requires uncertainty estimates that are structured, calibrated, and

TRACE: Agentic Catalog Enrichment with Multi-source Evidence Grounding

arXiv:2608.20844v1 Announce Type: new Abstract: Product catalogs underpin search, discovery, and recommendation in e-commerce, yet they are often attribute-sparse: the attributes shoppers and downstre

agentsarxiv-cs-ai

TRACE: Training-time Report-guided and Clinically Ordered Concept Editing

arXiv:2608.20809v1 Announce Type: cross Abstract: Breast ultrasound diagnosis relies on clinically meaningful semantic concepts, yet most deep learning methods adopt end-to-end image-to-label paradigm

ViTacPhys: Physical Property-Aware Grasping from Human Visual-Tactile Demonstrations

arXiv:2608.21355v1 Announce Type: new Abstract: Recent vision-based action models have demonstrated strong capabilities in complex manipulation, but they rarely leverage explicit object physical prope

safetyarxiv-cs-ro

When Do LLMs Replace Fine-Tuned NLU? A Decision Framework for Intent Detection in Production Conversational Systems

arXiv:2608.20371v1 Announce Type: cross Abstract: A common claim is that zero-shot large language models (LLMs) can replace fine-tuned NLU classifiers for intent detection. We test this claim head-to-

Local Ai

An Agentic Approach for Active Data Collection, Travel Behavior Modeling, and Weather-Sensitive Demand Prediction

arXiv:2608.20320v1 Announce Type: new Abstract: Travel behavior research increasingly combines digital data collection with predictive modeling, yet these stages are often developed and evaluated sepa

local-aiarxiv-cs-ai

CacheRoute: Planned Prefix-Affinity Routing for Large-Scale LLM Serving

model-releasesarxiv-cs-lg

arXiv:2608.19677v1 Announce Type: cross Abstract: Prefix caching avoids prefill only when a repeated request returns to a server that still holds the prefix KV. Cache-blind balancing disperses that re

FleetSieve: Decision-Critical Profiling for SLO-Aware LLM Fleet Configuration

model-releasesarxiv-cs-lg

arXiv:2608.19659v1 Announce Type: new Abstract: Choosing tensor-parallel (TP) degrees and replica counts for an LLM serving fleet is difficult because performance is not monotonic in TP and the feasib

G-CARL: Grounded Checklist-Aligned Reward Learning for Patient-Oriented Medical Report Interpretation

arXiv:2608.20331v1 Announce Type: cross Abstract: Personalized interpretation of medical reports has emerged as an increasingly important need among patients. Addressing this need requires both eviden

HT-Bench: Benchmarking and Learning Dexterous Full-Hand Tactile Representations with Egocentric Vision

model-releasesarxiv-cs-ro

arXiv:2606.19161v2 Announce Type: replace Abstract: Establishing a universal benchmark for tactile representation learning in robotic manipulation remains challenging due to the diversity of tactile s

ID-VTG: Image-Disambiguated Video Temporal Grounding

arXiv:2608.20127v1 Announce Type: new Abstract: Video Temporal Grounding (VTG) faces significant challenges when natural language queries must distinguish between multiple events involving visually si

researcharxiv-cs-cv

Local Ai

MileGPO: Milestone Inference with Local Evidence for Graph-Based Policy Optimization of Long-Horizon LLM Agents

arXiv:2608.19803v1 Announce Type: cross Abstract: Credit assignment is challenging in long-horizon agentic reinforcement learning, where supervision often comes only from final rewards. Existing metho

local-aiarxiv-cs-ai

Mitigating GenAI-Powered Evidence Pollution for Out-Of-Context Misinformation Detection

model-releasesarxiv-cs-cl

arXiv:2501.14728v2 Announce Type: replace-cross Abstract: While generative artificial intelligence (GenAI) models have achieved significant success, their misuse for generating deceptive content raise

Multi-Agent Orchestration with the Common-Sense Reasoning Capabilities of LLMs for Autonomous Driving

arXiv:2608.20129v1 Announce Type: cross Abstract: Autonomous vehicles require robust perception and decision-making capabilities to operate in diverse and unseen scenarios. While reinforcement learnin

safetyarxiv-cs-cl

Applications

Multi-Modal Graph Interaction for Multi-Graph Convolution Network in Urban Spatiotemporal Forecasting

arXiv:1905.11395v2 Announce Type: replace Abstract: Graph convolution network based approaches have been recently used to model region-wise relationships in region-level prediction problems in urban c

applicationsarxiv-cs-lg

Reading Between the Pixels: An Inscriptive Jailbreak Attack on Text-to-Image Models

arXiv:2604.05853v3 Announce Type: replace Abstract: Modern text-to-image (T2I) models can now render legible, paragraph-length text, enabling a fundamentally new class of misuse. We identify and forma

ReCache: Efficient KV Cache Reuse and Compression for Tool-Augmented LLM Agents

model-releasesarxiv-cs-cl

arXiv:2608.19662v1 Announce Type: new Abstract: Agentic language models repeatedly encode tool and skill schemas that recur across requests in different combinations and orders, preventing standard pr

RecPFN: Prior-Fitted Networks for In-Context-Based Recommendations

arXiv:2608.19735v1 Announce Type: new Abstract: We introduce RecPFN, a prior-fitted network that brings in-context learning to sequential recommendation. RecPFN is pretrained entirely on synthetic cli

researcharxiv-cs-lg

Local Ai

Represented but Ignored: A Causal Account of Prosodic Underuse in Audio-Language Models

arXiv:2608.19211v1 Announce Type: cross Abstract: Human speech is richly expressive, with prosody carrying linguistic and emotional information beyond the lexical content. A capable large audio-langua

local-aiarxiv-cs-ai

ReynoldsFlow: Physics-Inspired Spatiotemporal Flow Representation for Video Understanding

arXiv:2503.04500v3 Announce Type: replace-cross Abstract: Video understanding has largely relied on deep spatiotemporal architectures, including 3D convolutional networks and optical flow (OF) based m

Swift-Image: Exploring the Performance Frontier of Compact Unified Image Generation Models

arXiv:2608.20334v1 Announce Type: new Abstract: We present Swift-Image, a compact unified model for text-to-image generation, single-image editing, and multi-image editing. Our goal is to explore how

Towards Audio Token Compression in Large Audio Language Models

arXiv:2511.20973v2 Announce Type: replace-cross Abstract: Large Audio Language Models (LALMs) deliver strong performance across speech and audio tasks, but their audio encoders generate high-rate toke

Tutorials

Towards general embodied intelligence: integrating large language models, knowledge bases, and reasoning capabilities to build the next generation of AI agents

arXiv:2608.19794v1 Announce Type: new Abstract: The convergence of large language models (LLMs), structured knowledge bases (KBs), and reasoning ability (RA) presents a promising trajectory toward gen

tutorialsarxiv-cs-ai

VGI-BENCH: Probing Visual Intelligence in Video Generation Models

arXiv:2608.19583v1 Announce Type: cross Abstract: Recent studies suggest that video generation models can exhibit certain forms of zero-shot visual reasoning through generated frames. Yet reliable eva

XDen-1K: A Density Field Dataset of Real-World Objects

model-releasesarxiv-cs-cv

arXiv:2512.10668v2 Announce Type: replace Abstract: A deep understanding of the physical world is essential for robotic manipulation and physically realistic simulation. While current methods, includi

A Comprehensive Review of Large Language Models for Nanophotonics: From Surrogate Modeling to Autonomous Design

arXiv:2608.18279v1 Announce Type: cross Abstract: Metasurfaces have revolutionized the development of photonic devices by enabling unprecedented precision in light manipulation. However, their design

agentsarxiv-cs-lg

A systematic review of machine learning techniques to address diagnosis and treatment of autism: challenges and opportunities

arXiv:2608.18188v1 Announce Type: cross Abstract: Autism spectrum disorder (ASD) is a developmental disability characterized by challenges in social interaction and communication. As the causes of ASD

Adaptive Multi-Agent Feature Selection for Personalized Fall Risk Prevention

arXiv:2608.18450v1 Announce Type: new Abstract: Falls among older adults represent a major public health challenge driven by complex, time-varying interactions across multiple risk domains. Effective

agentsarxiv-cs-lg

Aslema at NADI 2026: Augmentation through Fewshot for SLU

arXiv:2608.18689v1 Announce Type: cross Abstract: We present Aslema, our system for NADI 2026 Shared Task 5, which consists of two subtasks: intent recognition and slot filling. We evaluate four omni

Harness Continual Learning: Continual Adaptation Beyond Model Parameters

arXiv:2608.19013v1 Announce Type: cross Abstract: Continual learning has largely been model-centric, treating model parameters as the state that changes with sequential experience. Modern agents can a

agentsarxiv-cs-ai

Open-MOPD: Diagnosing and Fixing Capability Imbalance in Multi-Teacher On-Policy Distillation

arXiv:2608.19098v1 Announce Type: cross Abstract: Multi-teacher on-policy distillation (M-OPD) has emerged as a promising paradigm for consolidating domain-specialized reinforcement learning (RL) expe

PCQA-R1: Advancing Generalized 3D Point Cloud Quality Assessment with Reinforcement Learning

arXiv:2608.18627v1 Announce Type: new Abstract: No-reference point cloud quality assessment (PCQA) has been an active topic in recent years and is used to measure and optimize the visual experience of

Rethinking Privileged Information in On-Policy Self-Distillation

arXiv:2608.18271v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) trains a student on its own responses using token-level supervision from the same model conditioned on privileged ref

safetyarxiv-cs-lg

ReWEIGH the Evidence: Calibrating Token-Level Ordinal Visual Evidence to Mitigate Hallucinations in Large Vision-Language Models

arXiv:2608.19075v1 Announce Type: cross Abstract: Large vision-language models (LVLMs) often hallucinate, generating content that the input image does not support. Preventing such content during decod

SoftVTBench: A Deformation-Aware Visuo-Tactile Dataset and Benchmark for Deformable-Object Manipulation

model-releasesarxiv-cs-ro

arXiv:2608.18701v1 Announce Type: new Abstract: Physical interaction quality is central to deformable-object manipulation, yet most benchmarks evaluate task success alone. A policy may complete the ta

Tutorials

Teach a Molmo2Fish: Towards interactive fish tracking with natural language guidance

arXiv:2608.18602v1 Announce Type: new Abstract: Computer vision is increasingly used to automate recognition tasks in large ecological datasets, but more complex tasks such as multi-object tracking co

tutorialsarxiv-cs-cv

When Safety Overrides Vision: Exploring Dynamics between Vision Influence and Safety Alignment in Vision-Language Models

arXiv:2608.18628v1 Announce Type: cross Abstract: Aligned vision-language models (VLMs) are designed to balance grounded visual reasoning with safe generation behavior. However, we observe a striking

safetyarxiv-cs-cl

CHM-Net: Center Heatmap-driven Macro-Micro Modeling Network for MRI-based Microbial Density Stratification

arXiv:2607.09812v2 Announce Type: replace-cross Abstract: Microbial density is clinically important for tumor assessment and treatment decision-making, and recent advances in deep learning suggest tha

researcharxiv-cs-cv

Code as Representation: A Compilable Parsing Paradigm for Academic Documents

model-releasesarxiv-cs-cl

arXiv:2608.17550v1 Announce Type: cross Abstract: Academic papers are a primary carrier of scientific knowledge, yet most of this knowledge remains locked in PDFs that are optimized for human reading

From Adoption to Deployment: A Qualitative Study on AI Integration in Software Development Practice

arXiv:2607.16660v2 Announce Type: replace-cross Abstract: The increasing adoption of Large Language Models (LLMs) as AI components in modern software systems introduces distinct security risks to the

safetyarxiv-cs-ai

Tutorials

From Corpora to Co-Evolving Capabilities: Capability-Centric Data Design for Generalist Image Generation

arXiv:2608.18076v1 Announce Type: cross Abstract: Large-scale image generation has benefited from advances in data scale, quality, rebalancing, and recaptioning, yet conventional pipelines typically o

tutorialsarxiv-cs-ai

Applications

From Student Risk Prediction to SC2R: Semantics-Constrained Counterfactual Recourse for Educational Decision Support

arXiv:2608.17618v1 Announce Type: cross Abstract: Learning analytics models can identify students at risk of poor performance, but they do not directly indicate which interventions are feasible, actio

applicationsarxiv-cs-ai

Know3D: Prompting 3D Generation with Knowledge from Vision-Language Models

arXiv:2603.22782v2 Announce Type: replace Abstract: Recent advances in 3D generation have improved the fidelity and geometric details of synthesized 3D assets. However, due to the inherent ambiguity o

researcharxiv-cs-cv

Applications

NGS-Marker: Robust Native Watermarking for 3D Gaussian Splatting

arXiv:2608.17447v1 Announce Type: new Abstract: With the rapid development and adoption of 3D Gaussian Splatting (3DGS), the need for effective copyright protection has become increasingly critical. E

applicationsarxiv-cs-cv

Proactive Road Safety Intervention in Australia: Predicting Risky Driving Hotspots from Connected Vehicle Data

arXiv:2608.16913v1 Announce Type: new Abstract: Road safety monitoring has historically been reactive, relying on crash-record analysis after fatalities and injuries have already occurred. Proactive i

safetyarxiv-cs-lg