Search: “multimodal”

Countdown-Code: A Testbed for Studying The Emergence and Generalization of Reward Hacking in RLVR

arXiv:2603.07084v2 Announce Type: replace-cross Abstract: Reward hacking is a form of misalignment in which models overoptimize proxy rewards without genuinely solving the underlying task. Precisely m

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Counterfactual Modeling with Fine-Tuned LLMs for Health Intervention Design and Sensor Data Augmentation

DGX agent

arXiv:2601.14590v2 Announce Type: replace Abstract: Counterfactual explanations (CFEs) provide human-centric interpretability by identifying the minimal, actionable changes required to alter a machine

model-releasesarxiv-cs-lg

21 Apr 2026

Dual-Anchoring: Addressing State Drift in Vision-Language Navigation

arXiv:2604.17473v1 Announce Type: new Abstract: Vision-Language Navigation(VLN) requires an agent to navigate through 3D environments by following natural language instructions. While recent Video Lar

EasyVideoR1: Easier RL for Video Understanding

model-releasesarxiv-cs-cv

arXiv:2604.16893v1 Announce Type: new Abstract: Reinforcement learning from verifiable rewards (RLVR) has demonstrated remarkable effectiveness in improving the reasoning capabilities of large languag

Enabling Stroke-Level Structural Analysis of Hieroglyphic Scripts without Language-Specific Priors

arXiv:2601.05508v2 Announce Type: replace-cross Abstract: Hieroglyphs, as logographic writing systems, encode rich semantic and cultural information within their internal structural composition. Yet,

FlowC2S: Flowing from Current to Succeeding Frames for Fast and Memory-Efficient Video Continuation

arXiv:2604.17625v1 Announce Type: new Abstract: This paper introduces a novel methodology for generating fast and memory-efficient video continuations. Our method, dubbed FlowC2S, fine-tunes a pre-tra

Foundation Model for Cardiac Time Series via Masked Latent Attention

arXiv:2603.26475v2 Announce Type: replace Abstract: Electrocardiograms (ECGs) are among the most widely available clinical signals and play a central role in cardiovascular diagnosis. While recent fou

Frequency-Decomposed INR for NIR-Assisted Low-Light RGB Image Denoising

arXiv:2604.16800v1 Announce Type: new Abstract: Addressing the issues of severe noise and high frequency structural degradation in visible images under low-light conditions, this paper proposes a Near

From Heads to Neurons: Causal Attribution and Steering in Multi-Task Vision-Language Models

arXiv:2604.17941v1 Announce Type: cross Abstract: Recent work has increasingly explored neuron-level interpretation in vision-language models (VLMs) to identify neurons critical to final predictions.

Generative midtended cognition and Artificial Intelligence. Thinging with thinging things

arXiv:2411.06812v2 Announce Type: replace-cross Abstract: This paper introduces the concept of ``generative midtended cognition'', exploring the integration of generative AI with human cognition. The

agentsarxiv-cs-lg

Local Ai

GraSP: Graph-Structured Skill Compositions for LLM Agents

arXiv:2604.17870v1 Announce Type: new Abstract: Skill ecosystems for LLM agents have matured rapidly, yet recent benchmarks show that providing agents with more skills does not monotonically improve p

local-aiarxiv-cs-cl

Human Cognition in Machines: A Unified Perspective of World Models

arXiv:2604.16592v1 Announce Type: cross Abstract: This comprehensive report distinguishes prior works by the cognitive functions they innovate. Many works claim an almost 'human-like' cognitive capabi

Improving Radio Interferometry Imaging by Explicitly Modeling Cross-Domain Consistency in Reconstruction

arXiv:2604.16794v1 Announce Type: new Abstract: Radio astronomy plays a crucial role in understanding the universe, particularly within the realm of non-thermal astrophysics. Images of celestial objec

Inter-Agent Relative Representations for Multi-Agent Option Discovery

arXiv:2512.24827v3 Announce Type: replace Abstract: Temporally extended actions improve the ability to explore and plan in single-agent settings. In multi-agent settings, the exponential growth of the

Knowledge without Wisdom: Measuring Misalignment between LLMs and Intended Impact

model-releasesarxiv-cs-lg

arXiv:2603.00883v2 Announce Type: replace Abstract: LLMs increasingly excel on AI benchmarks, but doing so does not guarantee validity for downstream tasks. This study contrasts LLM alignment on bench

Leveraging Large Language Models for Sarcastic Speech Annotation in Sarcasm Detection

arXiv:2506.00955v2 Announce Type: replace Abstract: Sarcasm fundamentally alters meaning through tone and context, yet detecting it in speech remains a challenge due to data scarcity. In addition, exi

LLM-Extracted Covariates for Clinical Causal Inference: Rethinking Integration Strategies

arXiv:2604.16763v1 Announce Type: new Abstract: Causal inference from electronic health records (EHR) is fundamentally limited by unmeasured confounding: critical clinical states such as frailty, goal

LookasideVLN: Direction-Aware Aerial Vision-and-Language Navigation

arXiv:2604.17190v1 Announce Type: new Abstract: Aerial Vision-and-Language Navigation (Aerial VLN) enables unmanned aerial vehicles (UAVs) to follow natural language instructions and navigate complex

LVLMs and Humans Ground Differently in Referential Communication

arXiv:2601.19792v3 Announce Type: replace Abstract: For generative AI agents to partner effectively with human users, the ability to accurately predict human intent is critical. But this ability to co

Measuring Social Bias in Vision-Language Models with Face-Only Counterfactuals from Real Photos

arXiv:2601.06931v2 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) are increasingly deployed in socially consequential settings, raising concerns about social bias driven by demog

Medical thinking with multiple images

arXiv:2604.16506v1 Announce Type: cross Abstract: Large language models perform well on many medical QA benchmarks, but real clinical reasoning often requires integrating evidence across multiple imag

Missing Pattern Tree based Decision Grouping and Ensemble for Enhancing Pair Utilization in Deep Incomplete Multi-View Clustering

model-releasesarxiv-cs-cv

arXiv:2512.21510v2 Announce Type: replace-cross Abstract: Real-world multi-view data often exhibit highly inconsistent missing patterns, posing significant challenges for incomplete multi-view cluster

mlr3torch: A Deep Learning Framework in R based on mlr3 and torch

arXiv:2604.18152v1 Announce Type: cross Abstract: Deep learning (DL) has become a cornerstone of modern machine learning (ML) praxis. We introduce the R package mlr3torch, which is an extensible DL fr

tutorialsarxiv-cs-lg

MODEST: Multi-Optics Depth-of-Field Stereo Dataset

arXiv:2511.20853v3 Announce Type: replace Abstract: Reliable depth estimation under real optical conditions remains a core challenge for camera vision in systems such as autonomous robotics and augmen

Noise Injection: Improving Out-of-Distribution Generalization for Limited Size Datasets

arXiv:2511.03855v2 Announce Type: replace Abstract: Deep learned (DL) models for image recognition have been shown to fail to generalize to data from different devices, populations, etc. COVID-19 dete

OC-Distill: Ontology-aware Contrastive Learning with Cross-Modal Distillation for ICU Risk Prediction

arXiv:2604.16878v1 Announce Type: new Abstract: Early prediction of severe clinical deterioration and remaining length of stay can enable timely intervention and better resource allocation in high-acu

tutorialsarxiv-cs-lg

OmniVLA-RL: A Vision-Language-Action Model with Spatial Understanding and Online RL

arXiv:2604.17706v1 Announce Type: new Abstract: Visual-Language-Action (VLA) models represent a paradigm shift in embodied AI, yet existing frameworks often struggle with imprecise spatial perception,

safetyarxiv-cs-ro

On the Importance of Tactile Sensing for Imitation Learning: A Case Study on Robotic Match Lighting

arXiv:2504.13618v4 Announce Type: replace Abstract: The field of robotic manipulation has advanced significantly in recent years. At the sensing level, several novel tactile sensors have been develope

safetyarxiv-cs-ro

Optimally Bridging Semantics and Data: Generative Semantic Communication via Schrodinger Bridge

arXiv:2604.17802v1 Announce Type: cross Abstract: Generative Semantic Communication (GSC) is a promising solution for image transmission over narrow-band and high-noise channels. However, existing GSC

OVOD-Agent: A Markov-Bandit Framework for Proactive Visual Reasoning and Self-Evolving Detection

arXiv:2511.21064v2 Announce Type: replace-cross Abstract: Open-Vocabulary Object Detection (OVOD) aims to enable detectors to generalize across categories by leveraging semantic information. Although

safetyarxiv-cs-cv

Parkinson's Disease Detection via Self-Supervised Dual-Channel Cross-Attention on Bilateral Wrist-Worn IMU Signals

arXiv:2604.18372v1 Announce Type: new Abstract: Parkinson's disease (PD) is a chronic neurodegenerative disease. It shows multiple motor symptoms such as tremor, bradykinesia, postural instability, fr

researcharxiv-cs-lg

PersonalHomeBench: Evaluating Agents in Personalized Smart Homes

arXiv:2604.16813v1 Announce Type: cross Abstract: Agentic AI systems are rapidly advancing toward real-world applications, yet their readiness in complex and personalized environments remains insuffic

PowerCLIP: Powerset Alignment for Contrastive Pre-Training

arXiv:2511.23170v5 Announce Type: replace Abstract: Contrastive vision-language pre-training frameworks such as CLIP have demonstrated impressive zero-shot performance across a range of vision-languag

safetyarxiv-cs-cv

Predictive Modeling of Natural Medicinal Compounds for Alzheimer Disease Using Cheminformatics

arXiv:2604.18316v1 Announce Type: cross Abstract: The most common cause of dementia is Alzheimer disease, a progressive neurodegenerative disorder affecting older adults that gradually impairs memory,

researcharxiv-cs-lg

Local Ai

Q-DeepSight: Incentivizing Thinking with Images for Image Quality Assessment and Refinement

arXiv:2604.16858v1 Announce Type: new Abstract: Image Quality Assessment (IQA) models are increasingly deployed as perceptual critics to guide generative models and image restoration. This role demand

local-aiarxiv-cs-cv

Rethinking Cross-Modal Fine-Tuning: Optimizing the Interaction Between Feature Alignment and Target Fitting

model-releasesarxiv-cs-lg

arXiv:2601.18231v4 Announce Type: replace Abstract: Adapting pre-trained models to unseen feature modalities has become increasingly important due to the growing need for cross-disciplinary knowledge

S-GRPO: Unified Post-Training for Large Vision-Language Models

arXiv:2604.16557v1 Announce Type: cross Abstract: Current post-training methodologies for adapting Large Vision-Language Models (LVLMs) generally fall into two paradigms: Supervised Fine-Tuning (SFT)

safetyarxiv-cs-cl

Scalable Neighborhood-Based Multi-Agent Actor-Critic

arXiv:2604.18190v1 Announce Type: new Abstract: We propose MADDPG-K, a scalable extension to Multi-Agent Deep Deterministic Policy Gradient (MADDPG) that addresses the computational limitations of cen

ScenarioControl: Vision-Language Controllable Vectorized Latent Scenario Generation

arXiv:2604.17147v1 Announce Type: new Abstract: We introduce ScenarioControl, the first vision-language control mechanism for learned driving scenario generation. Given a text prompt or an input image

Sculpting the Vector Space: Towards Efficient Multi-Vector Visual Document Retrieval via Prune-then-Merge Framework

arXiv:2602.19549v2 Announce Type: replace Abstract: Visual Document Retrieval (VDR), which aims to retrieve relevant pages within vast corpora of visually-rich documents, is of significance in current

Self-Reasoning Agentic Framework for Narrative Product Grid-Collage Generation

arXiv:2604.16958v1 Announce Type: new Abstract: Narrative-driven product photography has become a prevalent paradigm in modern marketing, as coherent visual storytelling helps convey product value and

SentiAvatar: Towards Expressive and Interactive Digital Humans

arXiv:2604.02908v2 Announce Type: replace Abstract: We present SentiAvatar, a framework for building expressive interactive 3D digital humans, and use it to create SuSu, a virtual character that speak

Source-Free Domain Adaptation with Vision-Language Prior

arXiv:2604.17748v1 Announce Type: new Abstract: Source-Free Domain Adaptation (SFDA) seeks to adapt a source model, which is pre-trained on a supervised source domain, for a target domain, with only a

safetyarxiv-cs-cv

Local Ai

SpatialStack: Layered Geometry-Language Fusion for 3D VLM Spatial Reasoning

arXiv:2603.27437v2 Announce Type: replace Abstract: Large vision-language models (VLMs) still struggle with reliable 3D spatial reasoning, a core capability for embodied and physical AI systems. This

local-aiarxiv-cs-cv

Spec-o3: A Tool-Augmented Vision-Language Agent for Rare Celestial Object Candidate Vetting via Automated Spectral Inspection

arXiv:2601.06498v2 Announce Type: replace Abstract: Due to the limited generalization and interpretability of deep learning classifiers, The final vetting of rare celestial object candidates still rel

SpeechMedAssist: Efficiently and Effectively Adapting Speech Language Models for Medical Consultation

arXiv:2601.04638v2 Announce Type: replace Abstract: Medical consultations are intrinsically speech-centric. However, most prior works focus on long-text-based interactions, which are cumbersome and pa

Test-Time Perturbation Learning with Delayed Feedback for Vision-Language-Action Models

arXiv:2604.18107v1 Announce Type: new Abstract: Vision-Language-Action models (VLAs) achieve remarkable performance in sequential decision-making but remain fragile to subtle environmental shifts, suc

Towards Trustworthy Depression Estimation via Disentangled Evidential Learning

arXiv:2604.16579v1 Announce Type: new Abstract: Automated depression estimation is highly vulnerable to signal corruption and ambient noise in real-world deployment. Prevailing deterministic methods p