Search: “multimodal”

A Survey of Flow Matching in Reinforcement Learning

arXiv:2610.16275v1 Announce Type: new Abstract: Flow Matching (FM) has recently emerged as a principled and efficient generative modeling framework for reinforcement learning (RL), enabling expressive

safetyarxiv-cs-lg

AERR-Nav: Adaptive Exploration-Recovery-Reminiscing Strategy for Zero-Shot Object Navigation

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2603.17712v1 Announce Type: cross Abstract: Zero-Shot Object Navigation (ZSON) in unknown multi-floor environments presents a significant challenge. Recent methods, mostly based on semantic valu

researcharxiv-cs-lg

14 Oct 2026

Agentic Robot Creation through Generation, Verification, and Revision

arXiv:2610.17881v1 Announce Type: new Abstract: Can an AI agent turn high-level user intent into a functioning robot and teach it how to behave? We study this question from two complementary aspects:

safetyarxiv-cs-ro

AnolisVLA: Lightweight Vision-Language-Action Model with Deep State Space Models for Mobile Manipulation

model-releasesarxiv-cs-ro

arXiv:2603.15046v2 Announce Type: replace Abstract: In this study, we address the problem of language-guided robotic manipulation, where a robot is required to manipulate a wide range of objects based

Attribute-Centric Vision-Language Alignment for Fine-Grained Gait Understanding

arXiv:2610.14589v1 Announce Type: new Abstract: Walking sequences reveal human-interpretable attributes related to body structure, posture, and motion. Gait attribute recognition provides a concrete r

Axiom-0: Hierarchical Self-Refinement for Vision-Language-Action Policies

arXiv:2610.14155v1 Announce Type: cross Abstract: Reliable manipulation requires policies that generalize across tasks, layouts, and object interactions. Vision-language-action (VLA) models combine pr

safetyarxiv-cs-cv

Bayesian Nonparametric Thompson Sampling for Multi-Armed Bandits

arXiv:1808.02932v5 Announce Type: replace-cross Abstract: In stochastic multi-armed bandits, rewards are generated by an unknown distribution; the world's reward uncertainty induces the exploration-ex

researcharxiv-cs-lg

Bouncy particle sampler with infinite exchanging parallel tempering

arXiv:2509.02003v2 Announce Type: replace Abstract: Markov chain Monte Carlo is one of the most useful tools for obtaining samples from complex distributions, such as posterior distributions in Bayesi

researcharxiv-cs-lg

ChangeT^3: Evaluating Vision Test-Time Training for Remote Sensing Change Detection

arXiv:2610.15813v1 Announce Type: new Abstract: Bitemporal remote sensing change detection requires representations that preserve spatial detail while capturing contextual information relevant to chan

Local Ai

Contractor Filters

arXiv:2610.18040v1 Announce Type: new Abstract: We introduce Contractor Filters (CFs), a set-membership architecture for nonlinear continuous-time state estimation with bounded uncertainties and spora

local-aiarxiv-cs-ro

Applications

CowCare: A Unified Visual Framework for Viewpoint-Robust Cattle Tracking and Spatiotemporal Heat-Stress Analysis

arXiv:2610.15012v1 Announce Type: new Abstract: Reliable individual monitoring is essential for dairy cattle welfare and early heat stress detection in Precision Livestock Farming (PLF). However, tran

applicationsarxiv-cs-cv

dMRI-F: A Foundation Model for Generalizable Diffusion MRI Analysis from Sparse Acquisitions

arXiv:2610.17968v1 Announce Type: new Abstract: Diffusion MRI (dMRI) probes water diffusion within the brain, providing unique information about tissue microstructure and white matter connectivity. Hi

Does Seeing More Mean Knowing More? Mono-Anchored Advantage Normalization for Multi-Source Visual Reasoning

arXiv:2605.25437v2 Announce Type: replace Abstract: Visual reasoning through reinforcement learning with verifiable rewards (RLVR) has achieved remarkable progress. However, when dealing with multi-so

Agents

DRMOT: A Dataset and Framework for RGBD Referring Multi-Object Tracking

arXiv:2602.04692v3 Announce Type: replace Abstract: Referring Multi-Object Tracking (RMOT) aims to track specific targets based on language descriptions, playing a vital role in interactive AI systems

agentsarxiv-cs-cv

EgoExplorer: A Vision-Motion-Touch Observatory for Human Loco-Manipulation In Situ

arXiv:2610.18872v1 Announce Type: cross Abstract: Learning humanoid loco-manipulation from human demonstrations rests on observing how locomotion, posture, and object interaction evolve together as ta

EgoOmniWorld: Unifying Egocentric Understanding via Ego-Action-World Interactions

arXiv:2610.18499v1 Announce Type: new Abstract: Egocentric video understanding spans diverse capabilities, modalities, and evaluation formats, yet these are often studied in isolation despite their ti

Local Ai

EV-JEPA: Elastic V-JEPA for Any Device and Cross-Device Inference

arXiv:2610.14324v1 Announce Type: new Abstract: Foundation models like V-JEPA are increasingly deployed across a heterogeneous edge-cloud continuum spanning smart glasses, phones, robots, and servers.

local-aiarxiv-cs-cv

Exploring the Underwater World Segmentation without Extra Training

arXiv:2511.07923v3 Announce Type: replace Abstract: Accurate segmentation of marine organisms is vital for biodiversity monitoring and ecological assessment, yet existing datasets and models remain la

FETALFusion: Resolution-Aware State-Space Modeling for Multi-Domain Fetal Head Segmentation

arXiv:2610.17951v1 Announce Type: new Abstract: Head circumference (HC) measured from 2D ultrasound is a routine marker of fetal growth, and automating it needs segmentations whose boundaries hold up

From Classification to Cross-Modal Understanding: Leveraging Vision-Language Models for Fine-Grained Renal Pathology

arXiv:2511.11984v2 Announce Type: replace Abstract: Fine-grained glomerular subtyping is essential for kidney biopsy interpretation, yet it presents a harder setting than the broad organ- or disease-l

From Failure Prediction to Component Selection in Semantic Segmentation

arXiv:2610.16058v1 Announce Type: new Abstract: Reliable scene understanding requires deciding which predictions to trust, retain, or inspect. In semantic segmentation, component failure predictors su

From Token Correction to Claim Admission: Training-Free Hallucination Mitigation for Large Vision-Language Models

arXiv:2610.17706v1 Announce Type: new Abstract: Large vision-language models often exhibit object hallucination, generating claims that are not supported by the input image. To mitigate this issue, we

Generative Conformal Prediction with Optimized Coverage Allocation

arXiv:2410.13735v3 Announce Type: replace Abstract: Conformal prediction provides model-agnostic uncertainty quantification with guaranteed coverage, but conventional methods often yield overly conser

researcharxiv-cs-lg

Growing to See: Efficient Pretraining of Self-Supervised Vision Transformers

arXiv:2610.16817v1 Announce Type: new Abstract: Progressive depth growth builds large networks by starting with shallow models and inserting layers during training. Recent advances in large language m

Human Pose Estimation by Probabilistic Mixtures of Gaussian and Uniform Distributions

arXiv:2610.14093v1 Announce Type: new Abstract: Despite advancements in sub-pixel decoding, modern Human Pose Estimation (HPE) architectures remain constrained by deterministic coordinate extraction f

Improving dependability in robotized bolting operations

arXiv:2511.10448v2 Announce Type: replace Abstract: Bolting operations are critical in industrial assembly and in the maintenance of scientific facilities, requiring high precision and robustness to f

safetyarxiv-cs-ro

Latent World Action Model for GUI Agents

arXiv:2610.14228v1 Announce Type: new Abstract: Pixel-space world models have recently emerged as a promising approach for GUI agents, predicting future screens prior to execution and subsequently re-

Learning omega-Powered Conditional Distributions with Importance-Weighted Flow Matching

arXiv:2610.16419v1 Announce Type: cross Abstract: Classifier-Free Guidance (CFG) with guidance scale gamma is commonly motivated by the omega-powered conditional distribution obtained by setting omega

safetyarxiv-cs-cv

LLM2R: From Large Language Models to 3D Reassemblers

arXiv:2610.18604v1 Announce Type: new Abstract: 3D part assembly aims to reconstruct a complete shape from a set of unassembled parts by predicting a rigid SE(3) transformation for each part. Because

ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanation

arXiv:2511.14259v4 Announce Type: replace Abstract: With the rapid advancement of generative models, powerful image editing methods now enable diverse and highly realistic image manipulations that far

Agents

MemAct: Streaming Spatial Understanding with Memory and Active Exploration

arXiv:2610.17640v1 Announce Type: new Abstract: Spatial understanding is essential for embodied agents navigating and interacting with the physical world. As observations arrive incrementally, agents

agentsarxiv-cs-cv

Metric-Driven Reinforcement Learning for Object Hallucination Reduction in LVLM-Based Image Captioning

arXiv:2610.14976v1 Announce Type: new Abstract: Large Vision-Language Models (LVLMs) have excelled in joint visual and language understanding, particularly in image captioning. However, LVLMs remain p

MicroCLIP: Connecting Text and Microscopy Images via Contrastive Language--Image Pretraining

arXiv:2610.17866v1 Announce Type: new Abstract: Understanding fluorescence microscopy images is fundamental to automating biological research. However, existing methods typically learn predefined conc

safetyarxiv-cs-cv

Applications

MMG-Vid: Maximizing Marginal Gains at Segment-level and Token-level for Efficient Video LLMs

arXiv:2508.21044v2 Announce Type: replace Abstract: Video Large Language Models (VLLMs) excel in video understanding, but their excessive visual tokens pose a significant computational challenge for r

applicationsarxiv-cs-cv

Morphology-aware deep learning predicts colorectal cancer survival from whole-slide images

arXiv:2610.17603v1 Announce Type: new Abstract: Background: Five-year survival prediction from hematoxylin-and-eosin whole-slide images could support risk stratification, but the task is weakly superv

ObsSpec: Accelerating Agentic Reinforcement Learning with Observation Speculation

arXiv:2610.15246v1 Announce Type: new Abstract: Tool-using agents alternate between model generation and tool execution, waiting for each tool call to complete before starting the next generation. Thi

safetyarxiv-cs-lg

Tutorials

Omni-RS: Unifying Multi-Task Understanding and Generation in Remote Sensing

arXiv:2610.18323v1 Announce Type: new Abstract: Practical remote sensing applications often require both understanding and generation capabilities for the same geographic scene. However, most existing

tutorialsarxiv-cs-cv

One Size Does Not Fit All: Distribution-Guided Tensor-Wise Adaptive Sparsification for Model Merging

model-releasesarxiv-cs-lg

arXiv:2508.06163v2 Announce Type: replace-cross Abstract: Merging multiple task-specific fine-tuned checkpoints into a single multi-task model provides an attractive alternative to joint multi-task tr

Agents

Pixels or Code? Benchmarking Instruction-Guided Visual Artifact Operation

arXiv:2610.16444v1 Announce Type: new Abstract: Visual artifacts such as charts, technical diagrams, webpages, and document pages underpin scientific, commercial, and engineering workflows. Editing th

agentsarxiv-cs-cv

PrT-Flow: Probability-Tractable Flow Matching for Reinforcement Learning

arXiv:2610.17667v1 Announce Type: new Abstract: Diffusion models and Flow Matching can represent flexible distributions over robot actions, but many reinforcement learning algorithms also require the

safetyarxiv-cs-ro

PsyBer-Agent: A Psychology-Driven User Agent for Recommender Systems

model-releasesarxiv-cs-lg

arXiv:2610.13989v1 Announce Type: cross Abstract: Evaluating recommender systems before deployment requires simulators that remain realistic over long, closed-loop interaction cycles. Current LLM-base

PUGS: Physics-Guided Uncertainty Modeling for Underwater Dynamic 3D Gaussian Splatting

arXiv:2610.17936v1 Announce Type: new Abstract: Dynamic 3D Gaussian Splatting (3DGS) provides an efficient framework for dynamic scene reconstruction. Most existing approaches model scene dynamics wit

SEAR: Self-Evolving Agentic Robotics

model-releasesarxiv-cs-ro

arXiv:2610.18792v1 Announce Type: new Abstract: Frontier language-model agents can now improve robots on their own: they write control code, test it, and keep what works as skills and memories for the

Local Ai

Segment Where You Look: Attention as the Interface Between Language Models and Segmenters

arXiv:2610.18729v1 Announce Type: new Abstract: Vision-language models (VLMs) that segment from language must pass the location of the referent to a pixel decoder. The dominant interface compresses it

local-aiarxiv-cs-cv

Semantic Saliency from Multi-Modal Large Language Model Scene Understanding Maps

arXiv:2610.15467v1 Announce Type: new Abstract: Image-computable low-level image saliency has shaped perceptual psychology and computer science, but is limited by its inability to capture human high-l

Tutorials

Siam-ALS: An Explainable Siamese Deep Learning Framework for Early ALS Detection Using EEG and Eye-Tracking Signals

arXiv:2610.15351v1 Announce Type: new Abstract: Amyotrophic lateral sclerosis (ALS) diagnosis remains challenging due to heterogeneous symptoms and reliance on clinical assessment, underscoring the ne

tutorialsarxiv-cs-lg

SPARE: Shared Perception and Adaptive Retrieval of Evidence for Streaming Video Understanding

arXiv:2610.14671v1 Announce Type: new Abstract: Streaming video understanding requires answering questions from the observed video, with evidence drawn from recent observations or earlier events. Hist

Stein Variational Distributional Reinforcement Learning: Score-Guided Particles for Multivariate Return Distributions

arXiv:2610.17925v1 Announce Type: new Abstract: Decisions that weigh several reward signals against each other require the joint distribution of the return vector. Categorical critics scale exponentia

safetyarxiv-cs-lg