Search: “multimodal”

Human Cognitive Benchmarks Reveal Foundational Visual Gaps in MLLMs

arXiv:2502.16435v4 Announce Type: replace-cross Abstract: Humans develop perception through a bottom-up hierarchy: from basic primitives and Gestalt principles to high-level semantics. In contrast, cu

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

InfiltrNet: Dual-Branch CNN-Transformer Architecture for Brain Tumor Infiltration Risk Prediction

DGX agent

arXiv:2605.02230v1 Announce Type: new Abstract: Gliomas are aggressive brain tumors that infiltrate surrounding tissue beyond the visible tumor margins observed on Magnetic Resonance Imaging (MRI). Pr

researcharxiv-cs-cv

5 May 2026

LiteVLA-H: Dual-Rate Vision-Language-Action Inference for Onboard Aerial Guidance and Semantic Perception

arXiv:2605.00884v1 Announce Type: new Abstract: Vision-language-action (VLA) models have shown strong semantic grounding and task generalization in manipulation, but aerial deployment remains difficul

MemeLens: Multilingual Multitask VLMs for Memes

arXiv:2601.12539v3 Announce Type: replace-cross Abstract: Memes are a dominant medium for online communication and manipulation because meaning emerges from interactions between embedded text, imagery

researcharxiv-cs-cl

Hardware

MusicInfuser: Making Video Diffusion Listen and Dance

arXiv:2503.14505v3 Announce Type: replace Abstract: We introduce MusicInfuser, an approach that aligns pre-trained text-to-video diffusion models to generate high-quality dance videos synchronized wit

hardwarearxiv-cs-cv

NAKUL-Med: Spectral-Graph State Space Models with Dynamics Kernels for Medical Signals

arXiv:2605.00871v1 Announce Type: cross Abstract: State space models (SSMs) achieve linear-time complexity but struggle with multi-channel physiological signals due to three limitations: fixed kernels

Pretraining on Sleep Data Improves non-Sleep Biosignal Tasks

arXiv:2605.02500v1 Announce Type: new Abstract: Sleep foundation models have recently demonstrated strong performance on in-domain polysomnography tasks, including sleep staging, apnea detection, and

researcharxiv-cs-lg

ProPACT: A Proactive AI-Driven Adaptive Collaborative Tutor for Pair Programming

arXiv:2605.02703v1 Announce Type: cross Abstract: Effective pair programming depends on coordination of attention, cognitive effort, and joint regulation over time, yet most adaptive learning systems

safetyarxiv-cs-lg

Representation learning from OCT images

arXiv:2605.02589v1 Announce Type: new Abstract: Optical Coherence Tomography (OCT) has become one of the most used imaging modality in ophthalmology. It provides high-resolution, non-invasive visualiz

Retrieving Any Relevant Moments: Benchmark and Models for Generalized Moment Retrieval

arXiv:2605.02623v1 Announce Type: new Abstract: Video Moment Retrieval (VMR) aims to localize temporal segments in videos that correspond to a natural language query, but typically assumes only a sing

ScribbleEdit: Synthetic Data for Image Editing with Scribbles and Text

arXiv:2605.01135v1 Announce Type: new Abstract: Recent progress in generative models has significantly advanced image editing capabilities, yet precise and intuitive user control remains difficult. Sp

SF20K Competition 2025: Summary and findings

arXiv:2605.01496v1 Announce Type: new Abstract: This report presents the results and findings of the first edition of the Short-Films 20K (SF20K) Competition, held in conjunction with the SLoMO Worksh

STEP: Warm-Started Visuomotor Policies with Spatiotemporal Consistency Prediction

model-releasesarxiv-cs-ro

arXiv:2602.08245v2 Announce Type: replace Abstract: Diffusion policies have recently emerged as a powerful paradigm for visuomotor control in robotic manipulation due to their ability to model the dis

The 2026 ACII Dyadic Conversations (DaiKon) Workshop & Challenge

arXiv:2605.02672v1 Announce Type: cross Abstract: The 2026 ACII Dyadic Conversations (ACII-DaiKon) Workshop & Challenge introduces a benchmark for modeling interpersonal affect and social dynamics in

Toward Culturally Grounded Natural Language Processing

arXiv:2603.26013v2 Announce Type: replace Abstract: Multilingual NLP is often treated as a route to global inclusion, but linguistic coverage and cultural competence frequently diverge. This paper syn

TT4D: A Pipeline and Dataset for Table Tennis 4D Reconstruction From Monocular Videos

arXiv:2605.01234v1 Announce Type: new Abstract: We present TT4D, a large-scale, high-fidelity table tennis dataset. It provides 140+ hours of reconstructed singles and doubles gameplay from monocular

TUR-DPO: Topology- and Uncertainty-Aware Direct Preference Optimization

arXiv:2605.00224v1 Announce Type: new Abstract: Aligning large language models (LLMs) with human preferences is commonly done via reinforcement learning from human feedback (RLHF) with Proximal Policy

Unsupervised full-field Bayesian inference of orthotropic hyperelasticity from a single biaxial test: a myocardial case study

model-releasesarxiv-cs-lg

arXiv:2510.09498v3 Announce Type: replace-cross Abstract: Cardiac muscle tissue exhibits highly non-linear hyperelastic and orthotropic material behavior during passive deformation. Traditional consti

Validation of Whole-Slide Foundation Models for Image Retrieval in TCGA Data

arXiv:2605.00902v1 Announce Type: new Abstract: Foundation models are reshaping computational histopathology, yet their value for whole-slide image retrieval relative to strong patch-based and supervi

Virtual Scanning for NSCLC Histology: Investigating the Discriminatory Power of Synthetic PET

arXiv:2605.02746v1 Announce Type: new Abstract: Accurate histological differentiation between adenocarcinoma (ADC) and squamous cell carcinoma (SCC) is critical for personalized treatment in non-small

VoxAfford: Multi-Scale Voxel-Token Fusion for Open-Vocabulary 3D Affordance Detection

arXiv:2605.01365v1 Announce Type: new Abstract: Open-vocabulary 3D affordance detection requires localizing interaction regions on point clouds given novel affordance descriptions. Recent methods exte

BlenderRAG: High-Fidelity 3D Object Generation via Retrieval-Augmented Code Synthesis

arXiv:2605.00632v1 Announce Type: new Abstract: Automatic generation of executable Blender code from natural language remains challenging, with state-of-the-art LLMs producing frequent syntactic error

Deep Kernel Learning for Stratifying Glaucoma Trajectories

arXiv:2605.00708v1 Announce Type: new Abstract: Effectively stratifying patient risk in chronic diseases like glaucoma is a major clinical challenge. Clinicians need tools to identify patients at high

researcharxiv-cs-lg

Applications

FieryGS: In-the-Wild Fire Synthesis with Physics-Integrated Gaussian Splatting

arXiv:2605.00177v1 Announce Type: cross Abstract: We consider the problem of synthesizing photorealistic, physically plausible combustion effects in in-the-wild 3D scenes. Traditional CFD and graphics

applicationsarxiv-cs-cv

InterChart: Benchmarking Visual Reasoning Across Decomposed and Distributed Chart Information

arXiv:2508.07630v2 Announce Type: replace Abstract: We introduce InterChart, a diagnostic benchmark that evaluates how well vision-language models (VLMs) reason across multiple related charts, a task

Tutorials

Latent Generative Modeling of Random Fields from Limited Training Data

arXiv:2505.13007v2 Announce Type: replace Abstract: The ability to accurately model random fields plays a critical role in science and engineering for problems involving uncertain, spatially-varying q

tutorialsarxiv-cs-lg

Learning from Compressed CT: Feature Attention Style Transfer and Structured Factorized Projections for Resource-Efficient Medical Image Analysis

arXiv:2605.00448v1 Announce Type: new Abstract: The deployment of artificial intelligence in medical imaging is hindered by high computational complexity and resource-intensive processing of volumetri

Learning physically grounded traffic accident reconstruction from public accident reports

arXiv:2605.00050v1 Announce Type: cross Abstract: Traffic accidents are routinely documented in textual reports, yet physically grounded accident reconstruction remains difficult because detailed scen

LLM-Oriented Information Retrieval: A Denoising-First Perspective

arXiv:2605.00505v1 Announce Type: cross Abstract: Modern information retrieval (IR) is no longer consumed primarily by humans but increasingly by large language models (LLMs) via retrieval-augmented g

Modeling Subjective Urban Perception with Human Gaze

arXiv:2605.00764v1 Announce Type: new Abstract: Urban perception describes how people subjectively evaluate urban environments, shaping how cities are experienced and understood. Existing computationa

Online Self-Calibration Against Hallucination in Vision-Language Models

arXiv:2605.00323v1 Announce Type: new Abstract: Large Vision-Language Models (LVLMs) often suffer from hallucinations, generating descriptions that include visual details absent from the input image.

Local Ai

Polaris: Coupled Orbital Polar Embeddings for Hierarchical Concept Learning

arXiv:2605.00265v1 Announce Type: new Abstract: Real-world knowledge is often organized as hierarchies such as product taxonomies, medical ontologies, and label trees, yet learning hierarchical repres

local-aiarxiv-cs-lg

Prompt-Induced Score Variance in Zero-Shot Binary Vision-Language Safety Classification

arXiv:2605.00326v1 Announce Type: new Abstract: Single-prompt first-token probabilities from zero-shot vision-language model (VLM) safety classifiers are treated as decision scores, but we show they a

safetyarxiv-cs-cl

Local Ai

Thinking in Text and Images: Interleaved Vision--Language Reasoning Traces for Long-Horizon Robot Manipulation

arXiv:2605.00438v1 Announce Type: cross Abstract: Long-horizon robotic manipulation requires plans that are both logically coherent and geometrically grounded. Existing Vision-Language-Action policies

local-aiarxiv-cs-ro

WildfireVLM: AI-powered Analysis for Early Wildfire Detection and Risk Assessment Using Satellite Imagery

arXiv:2602.13305v2 Announce Type: replace Abstract: Wildfires are a growing threat to ecosystems, human lives, and infrastructure, with their frequency and intensity rising due to climate change and h

Automated Detection of Mutual Gaze and Joint Attention in Dual-Camera Settings via Dual-Stream Transformers

arXiv:2604.27105v1 Announce Type: new Abstract: Analyzing mutual gaze (MG) and joint attention (JA) is critical in developmental psychology but traditionally relies on labor-intensive manual coding. A

ClipTBP: Clip-Pair based Temporal Boundary Prediction with Boundary-Aware Learning for Moment Retrieval

arXiv:2604.27591v1 Announce Type: cross Abstract: Video moment retrieval is the task of retrieving specific segments of a video corresponding to a given text query. Recent studies have been conducted

Applications

Energy-Efficient Plant Monitoring via Knowledge Distillation

arXiv:2604.27178v1 Announce Type: new Abstract: Recent advances in large-scale visual representation learning have significantly improved performance in plant species and plant disease recognition tas

applicationsarxiv-cs-cv

Evaluating TabPFN for Mild Cognitive Impairment to Alzheimer's Disease Conversion in Data Limited Settings

arXiv:2604.27195v1 Announce Type: new Abstract: Accurate prediction of conversion from Mild Cognitive Impairment (MCI) to Alzheimers Diseases (AD) is essential for early intervention, however, develop

researcharxiv-cs-ai

From Test-taking to Cognitive Scaffolding: A Pedagogical Diagnostic Benchmark for LLMs on English Standardized Tests

model-releasesarxiv-cs-ai

arXiv:2505.17056v2 Announce Type: replace-cross Abstract: As large language models (LLMs) are increasingly integrated into educational tools, current evaluations on standardized tests predominantly fo

MSR:Hybrid Field Modeling for CT-MRI Rigid-Deformable Registration of the Cervical Spine with an Annotated Dataset

arXiv:2604.27654v1 Announce Type: new Abstract: Accurate CT-MRI registration of the cervical spine is essential for preoperative planning because this region is anatomically complex,highly variable,an

Applications

Mull-Tokens: Modality-Agnostic Latent Thinking

arXiv:2512.10941v2 Announce Type: replace-cross Abstract: Reasoning goes beyond language; the real world requires reasoning about space, time, affordances, and much more that words alone cannot convey

applicationsarxiv-cs-ai

Simulating Validity: Modal Decoupling in MLLM Generated Feedback on Science Drawings

model-releasesarxiv-cs-ai

arXiv:2604.26957v1 Announce Type: cross Abstract: In science education, students frequently construct hand-drawn visual models of scientific phenomena. These drawings rely on a visual structure where

Stable Behavior, Limited Variation: Persona Validity in LLM Agents for Urban Sentiment Perception

arXiv:2604.28048v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly used as proxies for human perception in urban analysis, yet it remains unclear whether persona prompting p

safetyarxiv-cs-cl

Step-level Optimization for Efficient Computer-use Agents

model-releasesarxiv-cs-ai

arXiv:2604.27151v1 Announce Type: new Abstract: Computer-use agents provide a promising path toward general software automation because they can interact directly with arbitrary graphical user interfa

A Multistage Extraction Pipeline for Long Scanned Financial Documents: An Empirical Study in Industrial KYC Workflows

arXiv:2604.26462v1 Announce Type: new Abstract: Structured information extraction from long, multilingual scanned financial documents is a core requirement in industrial KYC and compliance workflows.

30 Apr 2026

A Survey of Process Reward Models: From Outcome Signals to Process Supervisions for Large Language Models

arXiv:2510.08049v3 Announce Type: replace-cross Abstract: Although Large Language Models (LLMs) exhibit advanced reasoning ability, conventional alignment remains largely dominated by outcome reward m

30 Apr 2026

A Survey on the Safety and Security Threats of Computer-Using Agents: JARVIS or Ultron?

arXiv:2505.10924v4 Announce Type: replace-cross Abstract: Recently, AI-driven interactions with computing devices have advanced from basic prototype tools to sophisticated, LLM-based systems that emul