Search: “multimodal”

RAPID: A Reproducible Multi-Agent Pipeline for Interpretable Disaster Damage Assessment from Satellite and Street-View Imagery

arXiv:2606.21819v1 Announce Type: new Abstract: Due to the increasing frequency and intensity of extreme climate events, there is a clear demand for intelligent, scalable, and autonomous approaches to

agentsarxiv-cs-cv

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

RubricRL: Simple Generalizable Rewards for Text-to-Image Generation

arXiv:2511.20651v2 Announce Type: replace Abstract: Reinforcement learning (RL) has recently emerged as a promising approach for aligning text-to-image generative models with human preferences. A key

safetyarxiv-cs-cv

SignVLA: Real-Time Sign Language-Guided Robotic Manipulation via Attention LSTM and Vision-Language-Action Models

arXiv:2606.20857v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models enable robots to execute manipulation tasks from natural-language instructions grounded in visual observations. Ho

safetyarxiv-cs-lg

TaigiSpeech: A Low-Resource Real-World Speech Intent Dataset and Preliminary Results with Scalable Data Mining In-the-Wild

model-releasesarxiv-cs-lg

arXiv:2603.21478v2 Announce Type: replace-cross Abstract: Speech technologies have advanced rapidly and serve diverse populations worldwide. However, many languages remain underrepresented due to limi

Training Diffusion Policies via Prior-Mapping Co-Evolution

arXiv:2512.02581v3 Announce Type: replace Abstract: Reinforcement learning (RL) faces a persistent tension: policies that are stable to optimize (e.g., Gaussians) are often too simple to represent the

safetyarxiv-cs-lg

Training-Free Semantic Correction for Autoregressive Visual Models

arXiv:2606.22550v1 Announce Type: new Abstract: Autoregressive visual models (AVMs) based on next-scale prediction have emerged as a prominent paradigm for image and video synthesis. However, decompos

safetyarxiv-cs-cv

Two Layers of Instability in Causal Estimation

arXiv:2606.21185v1 Announce Type: cross Abstract: There is a precise sense in which drawing causal inferences from observational data is hard, even when identifiability is assumed. In particular, Robi

researcharxiv-cs-lg

UniverSat: Resolution- and Modality-Agnostic Transformers for Earth Observation

arXiv:2606.23503v1 Announce Type: new Abstract: Vision Transformers (ViT) dominate computer vision. However, their reliance on rigid patch projectors hinders transfer to Earth Observation (EO), where

researcharxiv-cs-cv

Local Ai

Vesta: A Generalist Embodied Reasoning Model

arXiv:2606.20905v1 Announce Type: new Abstract: Robots operating in open-world environments must seamlessly integrate localization, spatial reasoning, navigation, and long-horizon planning. While spec

local-aiarxiv-cs-ro

VideoAgent: All-in-One Framework for Video Understanding and Editing

model-releasesarxiv-cs-cv

arXiv:2606.23327v1 Announce Type: new Abstract: Video editing has become essential in digital media creation, yet existing automated systems are restricted to short segment processing and domain-speci

VQActFlow: Vector-Quantized Action Mode Steering for Multi-Task Robot Manipulation

arXiv:2606.21600v1 Announce Type: new Abstract: Multi-task robot manipulation policies are challenging to learn from demonstration because traditionally a single network must select among qualitativel

safetyarxiv-cs-ro

Syntheses

Wiki Lint Report — 2026-06-22

linthealth-checkautomated

Automated lint: 48 errors, 13 warnings, 3 info

22 Jun 2026

A Comprehensive Ecosystem for Open-Domain Customized Video Generation

model-releasesarxiv-cs-cv

arXiv:2606.11783v1 Announce Type: new Abstract: Recent progress in video generation has shown impressive visual synthesis capabilities. However, open-domain customized video generation remains limited

A Survey of Reasoning and Agentic Systems in Time Series with Large Language Models

arXiv:2509.11575v3 Announce Type: replace Abstract: Time series reasoning treats time as a first-class axis and incorporates intermediate evidence directly into the answer. This survey defines the pro

Benchmarking Cross-Domain Audio-Visual Deception Detection

model-releasesarxiv-cs-cv

arXiv:2405.06995v4 Announce Type: replace-cross Abstract: Automated deception detection is crucial for assisting humans in accurately assessing truthfulness and identifying deceptive behavior. Convent

Diffusing to Coordinate: Efficient Online Multi-Agent Diffusion Policies

arXiv:2602.18291v2 Announce Type: replace Abstract: Online Multi-Agent Reinforcement Learning (MARL) is a prominent framework for efficient agent coordination. Crucially, enhancing policy expressivene

Applications

DIRECT: When and Where Should You Allocate Test-Time Compute in Embodied Planners?

arXiv:2606.12402v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) are increasingly deployed as high-level planners for embodied agents, with an emerging strategy of scaling test-time com

applicationsarxiv-cs-ai

Fine-tuning Multi-modal LLMs with ART: Art-based Reinforcement Training

arXiv:2606.11854v1 Announce Type: cross Abstract: There are two main Parameter-Efficient Fine-Tuning (PEFT) techniques for Large Language Models (LLMs). While Low-Rank Adaptation (LoRA) introduces add

Human-Guided Co-Manipulation of Carbon Fiber Plies

arXiv:2606.11818v1 Announce Type: new Abstract: The handling of flexible materials is a difficult task to fully automate due to the challenges caused by the deformability of these types of objects. Me

researcharxiv-cs-ro

MoCA-Agent: A Market-of-Claims Code Agent for Financial and Numerical Reasoning

arXiv:2606.11537v1 Announce Type: new Abstract: Financial and tabular question answering requires more than fluent reasoning: answers must be grounded in the exact facts, formulas, units, signs, and s

Model-based Optimization of Anguilliform Swimming Gaits for Soft Robotic Applications

arXiv:2606.11278v1 Announce Type: new Abstract: In this paper, we introduce the Soft Lamprey-Inspired Dual Environment Robot (SLIDER) and a proper modeling and optimization procedure employed to desig

researcharxiv-cs-ro

OpenMedReason: Scientific Reasoning Supervision for Medical Vision-Language Models

arXiv:2606.12169v1 Announce Type: cross Abstract: High-stakes clinical use of large vision-language models (LVLMs) requires reasoning that is grounded in visual evidence and clinical knowledge, not ju

Physics-informed generative AI for semiconductor manufacturing: Enforcing hard physical constraints in generative models by construction

arXiv:2606.11247v1 Announce Type: cross Abstract: Generative models are increasingly used to propose designs, data, and control actions for physical systems, yet many such systems are governed by hard

ProcessThinker: Enhancing Multi-modal Large Language Models Reasoning via Rollout-based Process Reward

arXiv:2606.11209v1 Announce Type: cross Abstract: Visual question answering increasingly requires multi-step reasoning. Recent post-training with reinforcement learning under verifiable rewards (RLVR)

RAIL: Rethinking Auditory Intelligence in Large Audio-Language Models with a CHC-Grounded Benchmark

arXiv:2606.11260v1 Announce Type: cross Abstract: Humans process rich auditory environments through tightly integrated cognitive capabilities such as audio perception, audio reasoning, and memory. Des

The Periodic Table of LLM Reasoning: A Structured Survey of Reasoning Paradigms, Methods, and Failure Modes

arXiv:2606.11470v1 Announce Type: new Abstract: Large Language Models (LLMs) have achieved strong performance across natural language processing tasks, yet reliable reasoning remains an open challenge

agentsarxiv-cs-cl

Tutorials

Video made with Grok Imagine

Elon Musk shared a video demonstrating xAI's Grok Imagine, an AI image and video generation tool. The post showcases the capabilities of this newly developed feature within the Grok AI system. This re

tutorialselon-musk--x

Where Do Backdoors Live? A Component-Level Analysis of Backdoor Propagation in Speech Language Models

arXiv:2510.01157v4 Announce Type: replace Abstract: Speech language models (SLMs) are systems of systems: independent components that unite to achieve a common goal. Despite their heterogeneous nature

researcharxiv-cs-cl

A History-Aware Visually Grounded Critic for Computer Use Agents

arXiv:2606.11078v1 Announce Type: new Abstract: Various test-time interventions for Computer Use Agents (CUAs), including critic models, have been developed to improve performance through pre-executio

Applications

AllDayNav: Lifelong Navigation via Real-World Reinforcement Learning

arXiv:2606.10927v1 Announce Type: new Abstract: Lifelong embodied navigation in dynamic environments requires robots to form persistent scene understanding from fragmentary observations, which remains

applicationsarxiv-cs-ro

Anomaly Detection and Root Cause Analysis for Microservice Systems

arXiv:2606.09942v1 Announce Type: cross Abstract: Microservice systems are widely used to build cloud applications, yet their complexity makes failures inevitable, degrading user experience and causin

Cross-Modal Knowledge Distillation without Paired Data: Theoretical Foundation and Algorithm

arXiv:2606.10504v1 Announce Type: new Abstract: Cross-modal knowledge distillation (CMKD) studies how a (large) teacher model trained on one type of data (e.g., images) can guide a (smaller) student m

Everyone Operating At The Frontier Satya Nadella, Chairman & CEO, Microsoft, interviewed by @saranormous & @eladgil (No Priors) and @swyx (L…

Everyone Operating At The Frontier Satya Nadella, Chairman & CEO, Microsoft, interviewed by @saranormous & @eladgil (No Priors) and @swyx (Latent Space) Crossover special at Microsoft Build 2026. Summ

model-releasesswyx--x

Exploration of Foundation Model-Based Robots in Patient and Elderly Care

arXiv:2606.10208v1 Announce Type: cross Abstract: Demand for older-adult and patient care is growing rapidly as populations age worldwide. Foundation models are increasingly being integrated into robo

researcharxiv-cs-ai

Improving Adversarial Transferability on Vision-Language Pre-training Models via Surrogate-Specific Bias Correction

arXiv:2606.10571v1 Announce Type: cross Abstract: Adversarial examples reveal vulnerabilities in Vision-Language Pre-training (VLP) models and provide insights for improving robustness. A key property

LAFP: Preserving Latent Action Structure in Latent Policy Learning via Flow Matching

arXiv:2606.10517v1 Announce Type: new Abstract: Learning high-quality latent actions from large-scale unlabeled videos, coupled with limited real-world interaction data for training an action decoder,

safetyarxiv-cs-cv

Tutorials

Listen, Look, and Learn: Learning Without Forgetting through SAM-Audio

arXiv:2606.10887v1 Announce Type: new Abstract: Class-Incremental Learning (CIL) aims to continuously learn new classes without forgetting previously acquired knowledge. While recent CIL advances have

tutorialsarxiv-cs-cv

MetaPlate: Counterfactual-Guided RAG-LLM Tool for Personalized Food Recommendation and Hyperglycemia Prevention

arXiv:2606.10120v1 Announce Type: cross Abstract: Postprandial hyperglycemia is a key risk factor for metabolic disorders; however, existing dietary guidance is often static, impractical, and insuffic

researcharxiv-cs-ai

Local Ai

MinhwaNet: Faithful but Insufficient Object Grounding in Korean Folk Painting

arXiv:2606.09855v1 Announce Type: cross Abstract: Korean folk painting (minhwa) is built from a small vocabulary of auspicious symbols, a tiger for protection, a pair of birds for marital harmony, a p

local-aiarxiv-cs-cv

Mitigating Manifold Departure: Uncertainty-Aware Subspace Rectification for Trustworthy MLLM Decoding

arXiv:2606.09859v1 Announce Type: cross Abstract: MLLMs frequently hallucinate objects inconsistent with visual inputs. This issue is typically attributed to the over-reliance on language priors, whic

Rotate2Think: Geometric Priming via Orthogonal Rotation to Improve Language Model Reasoning

arXiv:2606.09873v1 Announce Type: cross Abstract: Reasoning models achieve strong performance on challenging tasks by generating explicit intermediate reasoning traces before producing a final answer.

SD-GRPO: Verifiable Segment Decomposition for Long-Form Vision-Language Generation

arXiv:2606.09871v1 Announce Type: cross Abstract: Group Relative Policy Optimization (GRPO) and its variants, originally developed for Large Language Models (LLMs), have recently been applied to Multi

Tutorials

Spatiotemporal Graph Transformer for 3D Neighborhood Interaction and Quality Prediction in Metal Additive Manufacturing

arXiv:2606.10227v1 Announce Type: new Abstract: Metal additive manufacturing enables the fabrication of complex parts, but achieving consistent build quality remains challenging due to interactions in

tutorialsarxiv-cs-lg

A generalizable 3D framework and model for self-supervised learning in medical imaging

arXiv:2501.11755v2 Announce Type: replace-cross Abstract: Current self-supervised learning methods for 3D medical imaging rely on simple pretext formulations and organ- or modality-specific datasets,

researcharxiv-cs-cv

A multi-agent system for spine MRI report generation from multi-sequence imaging

arXiv:2606.08897v1 Announce Type: cross Abstract: Spinal pathology is a leading cause of pain and disability worldwide. Spine MRI is central to clinical evaluation, yet its interpretation remains comp

A Resilience-as-a-Service assessment framework for coordinated disruption response in interdependent urban transit systems

arXiv:2606.08849v1 Announce Type: new Abstract: Urban public transport disruptions require rapid response strategies, yet existing studies rarely provide a decision support framework to compare altern

ACTIVE-o3: Empowering MLLMs with Active Perception via Pure Reinforcement Learning

arXiv:2505.21457v2 Announce Type: replace-cross Abstract: Active vision, also known as active perception, refers to actively selecting where and how to look in order to gather task-relevant informatio