Search: “multimodal”

Indian Wedding System Optimization (IWSO): A Novel Socially Inspired Metaheuristic with Operational Design and Analysis

model-releasesarxiv-cs-lg

arXiv:2605.13871v1 Announce Type: cross Abstract: This paper presents a novel population-based metaheuristic, Indian Wedding System Optimization (IWSO), inspired by the socio-cultural dynamics of trad

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

IsoNet: Spatially-aware audio-visual target speech extraction in complex acoustic environments

DGX agent

arXiv:2605.14736v1 Announce Type: cross Abstract: Target speech extraction remains difficult for compact devices because monaural neural models lack spatial evidence and classical beamformers lose res

researcharxiv-cs-lg

15 May 2026

LLMs Know When They Know, but Do Not Act on It: A Metacognitive Harness for Test-time Scaling

model-releasesarxiv-cs-lg

arXiv:2605.14186v1 Announce Type: new Abstract: Large language models (LLMs) often expose useful signals of self-monitoring: before solving a problem, they can estimate whether they are likely to succ

Mitigating Mask Prior Drift and Positional Attention Collapse in Large Diffusion Vision-Language Models

arXiv:2605.14530v1 Announce Type: new Abstract: Large diffusion vision-language models (LDVLMs) have recently emerged as a promising alternative to autoregressive models, enabling parallel decoding fo

MoZoo:Unleashing Video Diffusion power in animal fur and muscle simulation

arXiv:2605.13857v1 Announce Type: cross Abstract: The creation of cinematic-quality animal effects necessitates the precise modeling of muscle and fur dynamics, a process that remains both labor-inten

Neural Signals Generate Clinical Notes in the Wild

arXiv:2601.22197v3 Announce Type: replace-cross Abstract: Generating clinical reports that summarize abnormal patterns, diagnostic findings, and clinical interpretations from long-term EEG recordings

Not only chat Generate images, search x, image to video All with just normal grok subscription!

Grok, through a standard subscription, now offers multiple AI capabilities beyond text chat, including image generation, web search via X, and image-to-video conversion. This represents an expansion o

agentsnous-research--x

On the Cultural Anachronism and Temporal Reasoning in Vision Language Models

arXiv:2605.15071v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) are increasingly applied to cultural heritage materials, from digital archives to educational platforms. This work ident

TOPOS: High-Fidelity and Efficient Industry-Grade 3D Head Generation

arXiv:2605.14594v1 Announce Type: new Abstract: High-fidelity 3D head generation plays a crucial role in the film, animation and video game industries. In industrial pipelines, studios typically enfor

applicationsarxiv-cs-cv

UMo: Unified Sparse Motion Modeling for Real-Time Co-Speech Avatars

arXiv:2605.14731v1 Announce Type: cross Abstract: Speech-driven gestures and facial animations are fundamental to expressive digital avatars in games, virtual production, and interactive media. Howeve

Unified Pix Token And Word Token Generative Language Model

arXiv:2605.14028v1 Announce Type: new Abstract: Since the emergence of Vision Transformer (ViT), it has been widely used in generative language model and generative visual model. Especially in the cur

Unlocking Complex Visual Generation via Closed-Loop Verified Reasoning

arXiv:2605.14876v1 Announce Type: cross Abstract: Despite rapid advancements, current text-to-image (T2I) models predominantly rely on a single-step generation paradigm, which struggles with complex s

ViMU: Benchmarking Video Metaphorical Understanding

arXiv:2605.14607v1 Announce Type: new Abstract: Any new medium, once it emerges, is used for more than the transmission of overt content alone. The information it carries typically operates on two lev

Vision-Core Guided Contrastive Learning for Balanced Multi-modal Prognosis Prediction of Stroke

arXiv:2605.14710v1 Announce Type: cross Abstract: Deep learning and multi-modal fusion have demonstrated transformative potential in medical diagnosis by integrating diverse data sources. However, acc

safetyarxiv-cs-ai

When Robots Do the Chores: A Benchmark and Agent for Long-Horizon Household Task Execution

arXiv:2605.14504v1 Announce Type: new Abstract: Long-horizon household tasks demand robust high-level planning and sustained reasoning capabilities, which are largely overlooked by existing embodied A

XR-1: Towards Versatile Vision-Language-Action Models via Learning Unified Vision-Motion Representations

arXiv:2511.02776v2 Announce Type: replace Abstract: Recent progress in large-scale robotic datasets and vision-language models (VLMs) has advanced research on vision-language-action (VLA) models. Howe

safetyarxiv-cs-ro

BrainAnytime: Anatomy-Aware Cross-Modal Pretraining for Brain Image Analysis with Arbitrary Modality Availability

arXiv:2605.13059v1 Announce Type: new Abstract: Clinical diagnostic workups typically follow a modality escalation pathway: after initial clinical evaluation, clinicians begin with routine structural

researcharxiv-cs-cv

Collaborative Parameter Learning: Mitigating Forgetting via Parameter-Level Gradient Analysis

model-releasesarxiv-cs-lg

arXiv:2601.21577v2 Announce Type: replace Abstract: Catastrophic forgetting during knowledge injection impairs the ability of large language models to acquire new knowledge without overwriting previou

Coordinating Multiple Conditions for Trajectory-Controlled Human Motion Generation

arXiv:2605.13729v1 Announce Type: cross Abstract: Trajectory-controlled human motion generation aims to synthesize realistic human motions conditioned on both textual descriptions and spatial trajecto

researcharxiv-cs-ai

Coreset-Induced Conditional Velocity Flow Matching

arXiv:2605.12951v1 Announce Type: cross Abstract: We propose Coreset-Induced Conditional Velocity Flow Matching (CCVFM), a generative model that augments hierarchical rectified flow with a data-inform

researcharxiv-cs-lg

CRAFT: Clinical Reward-Aligned Finetuning for Medical Image Synthesis

arXiv:2605.12650v1 Announce Type: new Abstract: Foundation diffusion models can generate photorealistic natural images, but adapting them to medical imaging remains challenging. In medical adaptation,

CROP: Expert-Aligned Image Cropping via Compositional Reasoning and Optimizing Preference

arXiv:2605.12545v1 Announce Type: cross Abstract: Aesthetic image cropping aims to enhance the aesthetic quality of an image by improving its composition through spatial cropping. Previous methods oft

safetyarxiv-cs-ai

Diffusion Model's Generalization Can Be Characterized by Inductive Biases toward a Data-Dependent Ridge Manifold

arXiv:2602.06021v2 Announce Type: replace-cross Abstract: We study a data-dependent notion of diffusion-model generalization: when a model does not memorize the training set, where do its generated sa

safetyarxiv-cs-lg

Discrete Diffusion for Complex and Congested Multi-Agent Path Finding with Sparse Social Attention

arXiv:2605.13296v1 Announce Type: new Abstract: Multi-Agent Path Finding (MAPF) is a coordination problem that requires computing globally consistent, collision-free trajectories from individual start

agentsarxiv-cs-ai

Dual-Pathway Circuits of Object Hallucination in Vision-Language Models

arXiv:2605.13156v1 Announce Type: new Abstract: Vision-language models (VLMs) have demonstrated remarkable capabilities in bridging visual perception and natural language understanding, enabling a wid

researcharxiv-cs-cv

FIKA-Bench: From Fine-grained Recognition to Fine-Grained Knowledge Acquisition

arXiv:2605.13193v1 Announce Type: new Abstract: Fine-grained recognition in everyday life is often not a closed-book classification problem: when encountering unfamiliar objects, humans actively searc

agentsarxiv-cs-cv

Tutorials

GraphThinker: Reinforcing Temporally Grounded Video Reasoning with Event Graph Thinking

arXiv:2602.17555v3 Announce Type: replace Abstract: Video reasoning requires a fine-grained understanding of the temporal dependencies and event-level relations between objects and events in videos. C

tutorialsarxiv-cs-cv

Local Ai

GRIP-VLM: Group-Relative Importance Pruning for Efficient Vision-Language Models

arXiv:2605.13375v1 Announce Type: cross Abstract: In Vision-Language Models (VLMs), processing a massive number of visual tokens incurs prohibitive computational overhead. While recent training-aware

local-aiarxiv-cs-ai

Guide, Think, Act: Interactive Embodied Reasoning in Vision-Language-Action Models

arXiv:2605.13632v1 Announce Type: cross Abstract: In this paper, we propose GTA-VLA(Guide, Think, Act), an interactive Vision-Language-Action (VLA) framework that enables spatially steerable embodied

Local Ai

JEDI: Joint Embedding Diffusion World Model for Online Model-Based Reinforcement Learning

arXiv:2605.13013v1 Announce Type: new Abstract: Diffusion world models have recently become competitive for online model-based reinforcement learning, but current approaches expose a tension: pixel di

local-aiarxiv-cs-lg

Physics-informed neural particle flow for the Bayesian update step

arXiv:2602.23089v2 Announce Type: replace Abstract: The Bayesian update step poses significant computational challenges in high-dimensional nonlinear estimation. While log-homotopy particle flow filte

researcharxiv-cs-lg

Preconditioned Flow Matching

arXiv:2603.02337v2 Announce Type: replace-cross Abstract: Flow matching (FM) learns vector fields by regressing stochastic velocity targets along intermediate distributions p_t. We identify a geometri

researcharxiv-cs-ai

QuickLAP: Quick Language-Action Preference Learning for Semi-Autonomous Systems

arXiv:2511.17855v2 Announce Type: replace Abstract: Robots must learn from both what people do and what they say, but either modality alone is often incomplete: physical corrections are grounded but a

agentsarxiv-cs-ai

Reasoning to Edit: Hypothetical Instruction-Based Image Editing with Visual Reasoning

arXiv:2507.01908v3 Announce Type: replace Abstract: Instruction-based image editing (IIE) has advanced rapidly with the success of diffusion models. However, existing efforts primarily focus on simple

Reducing Bias and Variance: Generative Semantic Guidance and Bi-Layer Ensemble for Image Clustering

arXiv:2605.12961v1 Announce Type: new Abstract: Image clustering aims to partition unlabeled image datasets into distinct groups. A core aspect of this task is constructing and leveraging prior knowle

Tutorials

Retrieval-Augmented Tutoring for Algorithm Tracing and Problem-Solving in AI Education

arXiv:2605.12988v1 Announce Type: new Abstract: Students learning algorithms often need support as they interpret traces, debug reasoning errors, and apply procedures across unfamiliar problem instanc

tutorialsarxiv-cs-ai

Senses Wide Shut: A Representation-Action Gap in Omnimodal LLMs

arXiv:2605.13737v1 Announce Type: new Abstract: When an omnimodal large language model accepts a question whose textual premise contradicts what it actually sees or hears, does the failure lie in perc

StreamGaze: Gaze-Guided Temporal Reasoning and Proactive Understanding in Streaming Videos

arXiv:2512.01707v3 Announce Type: replace-cross Abstract: Streaming video understanding requires models not only to process temporally incoming frames, but also to anticipate user intention for realis

Towards Unified Surgical Scene Understanding:Bridging Reasoning and Grounding via MLLMs

arXiv:2605.13530v1 Announce Type: cross Abstract: Surgical scene understanding is a cornerstone of computer-assisted intervention. While recent advances, particularly in surgical image segmentation, h

applicationsarxiv-cs-ai

Training Long-Context Vision-Language Models Effectively with Generalization Beyond 128K Context

arXiv:2605.13831v1 Announce Type: new Abstract: Long-context modeling is becoming a core capability of modern large vision-language models (LVLMs), enabling sustained context management across long-do

agentsarxiv-cs-cv

When Backdoors Meet Partial Observability: Attacking Real-World Reinforcement Learning

arXiv:2601.14104v2 Announce Type: replace-cross Abstract: Backdoor attacks can cause reinforcement learning (RL) policies to behave normally under clean inputs while executing malicious behaviors when

Aligning Flow Map Policies with Optimal Q-Guidance

arXiv:2605.12416v1 Announce Type: new Abstract: Generative policies based on expressive model classes, such as diffusion and flow matching, are well-suited to complex control problems with highly mult

safetyarxiv-cs-lg

Allegory of the Cave: Measurement-Grounded Vision-Language Learning

model-releasesarxiv-cs-cl

arXiv:2605.11727v1 Announce Type: cross Abstract: Vision-language models typically reason over post-ISP RGB images, although RGB rendering can clip, suppress, or quantize sensor evidence before infere

B4DL: A Benchmark for 4D LiDAR LLM in Spatio-Temporal Understanding

arXiv:2508.05269v2 Announce Type: replace Abstract: Understanding dynamic outdoor environments requires capturing complex object interactions and their evolution over time. LiDAR-based 4D point clouds

Coevolutionary Continuous Discrete Diffusion: Make Your Diffusion Language Model a Latent Reasoner

arXiv:2510.03206v2 Announce Type: replace-cross Abstract: Diffusion language models, especially masked discrete diffusion models, have achieved great success recently. While there are some theoretical

applicationsarxiv-cs-cl

Design Your Ad: Personalized Advertising Image and Text Generation with Unified Autoregressive Models

arXiv:2605.12138v1 Announce Type: cross Abstract: Generating realistic and user-preferred advertisements is a key challenge in e-commerce. Existing approaches utilize multiple independent models drive

researcharxiv-cs-cl

Detecting In-Person Conversations in Noisy Real-World Environments with Smartwatch Audio and Motion Sensing

arXiv:2507.12002v2 Announce Type: replace Abstract: Social interactions play a crucial role in shaping human behavior, relationships, and societies. It encompasses various forms of communication, such

applicationsarxiv-cs-lg

GeoR-Bench: Evaluating Geoscience Visual Reasoning

arXiv:2605.11541v1 Announce Type: new Abstract: Geoscience intelligence is expected to understand, reason about, and predict earth system changes to support human decision-making in critical domains s