Search: “multimodal”

Hi-GaTA: Hierarchical Gated Temporal Aggregation Adapter for Surgical Video Report Generation

arXiv:2605.11208v1 Announce Type: new Abstract: Automated, clinician-grade assessment reports for surgical procedures could reduce documentation burden and provide objective feedback, yet remain chall

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Applications

Hide to See: Reasoning-prefix Masking for Visual-anchored Thinking in VLM Distillation

DGX agent

arXiv:2605.11651v1 Announce Type: cross Abstract: Recent think-answer approaches in VLMs, such as Qwen3-VL-Thinking, boost reasoning performance by leveraging intermediate thinking steps before the fi

applicationsarxiv-cs-cl

13 May 2026

Large-Small Model Collaboration for Farmland Semantic Change Detection

arXiv:2605.12282v1 Announce Type: new Abstract: Farmland Semantic Change Detection (SCD) is essential for cultivated land protection, yet existing benchmarks and models remain insufficient for fine-gr

MambaNetBurst: Direct Byte-level Network Traffic Classification without Tokenization or Pretraining

arXiv:2605.11034v1 Announce Type: cross Abstract: We present MambaNetBurst, a compact tokenizer-free byte-level sequence classifier for network burst classification based on a Mamba-2 backbone. In con

researcharxiv-cs-lg

OmniNFT: Modality-wise Omni Diffusion Reinforcement for Joint Audio-Video Generation

arXiv:2605.12480v1 Announce Type: new Abstract: Recent advances in joint audio-video generation have been remarkable, yet real-world applications demand strong per-modality fidelity, cross-modal align

ReasonEdit: Editing Vision-Language Models using Human Reasoning

arXiv:2602.02408v4 Announce Type: replace Abstract: Model editing aims to correct errors in large, pretrained models without altering unrelated behaviors. While some recent works have edited vision-la

researcharxiv-cs-cv

Reconstructing Sepsis Trajectories from Clinical Case Reports using LLMs: the Textual Time Series Corpus for Sepsis

model-releasesarxiv-cs-cl

arXiv:2504.12326v3 Announce Type: replace Abstract: Clinical case reports and discharge summaries may be the most complete and accurate summarization of patient encounters, yet they are finalized, i.e

REFNet++: Multi-Task Efficient Fusion of Camera and Radar Sensor Data in Bird's-Eye Polar View

arXiv:2605.11824v1 Announce Type: new Abstract: A realistic view of the vehicle's surroundings is generally offered by camera sensors, which is crucial for environmental perception. Affordable radar s

ReVision: Scaling Computer-Use Agents via Temporal Visual Redundancy Reduction

arXiv:2605.11212v1 Announce Type: new Abstract: Computer-use agents~(CUAs) rely on visual observations of graphical user interfaces, where each screenshot is encoded into a large number of visual toke

researcharxiv-cs-cl

ShapeCodeBench: A Renewable Benchmark for Perception-to-Program Reconstruction of Synthetic Shape Scenes

arXiv:2605.11680v1 Announce Type: new Abstract: We introduce ShapeCodeBench, a synthetic benchmark for perception-to-program reconstruction: given a rendered raster image, a model must emit an executa

The power of LLMs on your data, more than two orders of magnitude faster and cheaper

model-releasesgoogle-cloud-ai

Databases have introduced new AI-powered SQL functions which take natural language instructions as input and are evaluated using LLMs. They leverage the power of LLMs to answer new kinds of queries: W

Think, then Score: Decoupled Reasoning and Scoring for Video Reward Modeling

arXiv:2605.05922v2 Announce Type: replace Abstract: Recent advances in generative video models are increasingly driven by post-training and test-time scaling, both of which critically depend on the qu

researcharxiv-cs-cv

Transformer-Based Autonomous Driving Models and Deployment-Oriented Compression: A Survey

arXiv:2304.10891v2 Announce Type: replace-cross Abstract: Transformer-based models are becoming a central paradigm in autonomous driving because they can capture long-range spatial dependencies, multi

Urban Risk-Aware Navigation via VQA-Based Event Maps for People with Low Vision

arXiv:2605.11782v1 Announce Type: new Abstract: Visual impairment affects hundreds of millions of people worldwide, severely limiting their ability to navigate urban environments safely and independen

A Visuo-Tactile Data Collection System with Haptic Feedback for Coarse-to-Fine Imitation Learning

arXiv:2605.08757v1 Announce Type: new Abstract: We present a visuo-tactile data-collection system that generates temporally structured, contact-rich demonstrations for imitation learning. Conventional

researcharxiv-cs-ro

Active Testing of Large Language Models via Approximate Neyman Allocation

arXiv:2605.10075v1 Announce Type: new Abstract: Large language models (LLMs) require reliable evaluation from pre-training to test-time scaling, making evaluation a recurring rather than one-off cost.

AllocMV: Optimal Resource Allocation for Music Video Generation via Structured Persistent State

arXiv:2605.10723v1 Announce Type: cross Abstract: Generating long-horizon music videos (MVs) is frequently constrained by prohibitive computational costs and difficulty maintaining cross-shot consiste

Attention Grounded Enhancement for Visual Document Retrieval

model-releasesarxiv-cs-cl

arXiv:2511.13415v2 Announce Type: replace-cross Abstract: Visual document retrieval requires understanding heterogeneous and multi-modal content to satisfy implicit information needs. Recent advances

BabelDOC: Better Layout-Preserving PDF Translation via Intermediate Representation

model-releasesarxiv-cs-cl

arXiv:2605.10845v1 Announce Type: cross Abstract: As global cross-lingual communication intensifies, language barriers in visually rich documents such as PDFs remain a practical bottleneck. Existing d

Local Ai

Beyond Bag-of-Patches: Learning Global Layout via Textual Supervision for Late-Interaction Visual Document Retrieval

arXiv:2605.08421v1 Announce Type: new Abstract: Visual Document Retrieval (VDR) models mostly rely on late interaction architectures, in which documents are represented by a set of local patch embeddi

local-aiarxiv-cs-cv

Break the Brake, Not the Wheel: Untargeted Jailbreak via Entropy Maximization

arXiv:2605.10764v1 Announce Type: cross Abstract: Recent studies show that gradient-based universal image jailbreaks on vision-language models (VLMs) exhibit little or no cross-model transferability,

safetyarxiv-cs-ai

Built Environment Reasoning from Remote Sensing Imagery Using Large Vision--Language Models

arXiv:2605.08404v1 Announce Type: cross Abstract: This work investigates the use of large language models (LLMs) for tasks in smart cities. The core idea is to leverage remote sensing imagery to chara

Capacity-Aware Inference: Mitigating the Straggler Effect in Mixture of Experts

arXiv:2503.05066v5 Announce Type: replace-cross Abstract: The Mixture of Experts (MoE) is an effective architecture for scaling large language models by leveraging sparse expert activation to balance

CoLA-Flow Policy: Temporally Coherent Imitation Learning via Continuous Latent Action Flow Matching for Robotic Manipulation

arXiv:2601.23087v3 Announce Type: replace Abstract: Learning long-horizon robotic manipulation requires jointly achieving expressive behavior modeling, real-time inference, and stable execution, which

safetyarxiv-cs-ro

Count Anything at Any Granularity

arXiv:2605.10887v1 Announce Type: new Abstract: Open-world object counting remains brittle: despite rapid advances in vision-language models (VLMs), reliably counting the objects a user intends is far

applicationsarxiv-cs-cv

Agents

Cross-Modal RGB-D Fusion Transformer for 6D Pose Estimation of Non-Cooperative Spacecraft with Stereo-Derived Depth

arXiv:2605.08592v1 Announce Type: new Abstract: On-orbit servicing and active debris removal involving non-cooperative spacecraft require reliable pose estimation to supply accurate position and orien

agentsarxiv-cs-cv

CrossVL: Complexity-Aware Feature Routing and Paired Curriculum for Cross-View Vision-Language Detection

arXiv:2605.09802v1 Announce Type: cross Abstract: Vision-language models (VLMs) enable text-guided object detection but degrade severely under cross-view scenarios where ground and aerial viewpoints d

Data-driven transport modelling without overfit

arXiv:2605.08801v1 Announce Type: new Abstract: Macroscopic transport modelling aims to predict traffic flows after proposed public policy interventions, such as a new road or railway section or a tem

safetyarxiv-cs-lg

EgoMemReason: A Memory-Driven Reasoning Benchmark for Long-Horizon Egocentric Video Understanding

arXiv:2605.09874v1 Announce Type: cross Abstract: Next-generation visual assistants, such as smart glasses, embodied agents, and always-on life-logging systems, must reason over an entire day or more

Energy-based models for diagnostic reconstruction and analysis in a laboratory plasma device

arXiv:2605.08645v1 Announce Type: cross Abstract: Energy-based models (EBMs) provide a powerful and flexible way of learning a joint probability distribution over data by constructing an energy surfac

researcharxiv-cs-lg

ERASE: Eliminating Redundant Visual Tokens via Adaptive Two-Stage Token Pruning

arXiv:2605.09982v1 Announce Type: new Abstract: Recent advancements in Vision-Language Models (VLMs) enable large language models (LLMs) to process high-resolution images, significantly improving real

applicationsarxiv-cs-cv

Local Ai

Event Fields: Learning Latent Event Structure for Waveform Foundation Models

arXiv:2605.08685v1 Announce Type: cross Abstract: We propose a new class of waveform foundation models that departs from conventional sequence based representations by modeling physiological time seri

local-aiarxiv-cs-ai

EventTSF: Event-Aware Non-Stationary Time Series Forecasting

arXiv:2508.13434v2 Announce Type: replace-cross Abstract: Time series forecasting is vital in diverse sectors such as energy and transportation, where non-stationary dynamics are deeply intertwined wi

applicationsarxiv-cs-ai

From Historical Tabular Image to Knowledge Graphs: A Provenance-Aware Modular Pipeline

arXiv:2605.08222v1 Announce Type: cross Abstract: Handwritten archival tables contain rich historical information, yet transforming them into structured representations, such as Knowledge Graphs, requ

applicationsarxiv-cs-ai

Generative Actor-Critic with Soft Bridge Policies

model-releasesarxiv-cs-lg

arXiv:2605.08733v1 Announce Type: new Abstract: Expressive generative policies such as diffusion and flow models are appealing for MaxEnt online reinforcement learning because of their ability to mode

Tutorials

Generative Experiences for Digital Mental Health Interventions: Evidence from a Randomized Study

arXiv:2604.07558v2 Announce Type: replace-cross Abstract: Digital mental health (DMH) tools have extensively explored personalization of interventions to users' needs and contexts. However, this perso

tutorialsarxiv-cs-ai

Agents

GLM models are now live on @tensorix_ai We’re partnering to bring cost-efficient frontier AI models to developers, startups, and enterprises…

GLM models are now live on @tensorix_ai We’re partnering to bring cost-efficient frontier AI models to developers, startups, and enterprises across Europe and beyond — and to back the Sovereign AI eco

agentszhipu-ai--x

Grounding the Score: Explicit Visual Premise Verification for Reliable Vision-Language Process Reward Models

arXiv:2603.16253v2 Announce Type: replace-cross Abstract: Vision-language process reward models (VL-PRMs) are increasingly used to score intermediate reasoning steps and rerank candidates under test-t

How Mobile World Model Guides GUI Agents?

arXiv:2605.10347v1 Announce Type: new Abstract: Recent advances in vision-language models have enabled mobile GUI agents to perceive visual interfaces and execute user instructions, but reliable predi

How Much is Brain Data Worth for Machine Learning?

arXiv:2605.09243v1 Announce Type: new Abstract: If a person can solve a task, can measuring their brain make it easier to train a model to solve that task too? Recent NeuroAI work suggests that supple

safetyarxiv-cs-ai

Hyperbolic Distillation: Geometry-Guided Cross-Modal Transfer for Robust 3D Object Detection

arXiv:2605.09899v1 Announce Type: cross Abstract: Cross-modal knowledge distillation has emerged as an effective strategy for integrating point cloud and image features in 3D perception tasks. However

JODA: Composable Joint Dynamics for Articulated Objects

arXiv:2605.09954v1 Announce Type: cross Abstract: Articulated objects used in simulation and embodied AI are typically specified by geometry and kinematic structure, but lack the fine-grained dynamica

KeyframeFace: Language-Driven Facial Animation via Semantic Keyframes

arXiv:2512.11321v3 Announce Type: replace Abstract: Facial animation is a core component for creating digital characters in Computer Graphics (CG) industry. A typical production workflow relies on spa

Lakestream: A Consistent and Brokerless Data Plane for Large Foundation Model Training

arXiv:2605.09994v1 Announce Type: cross Abstract: Modern Large Foundation Model (LFM) training has transformed the data pipeline from a static ingestion layer into a dynamic component that must co-evo

researcharxiv-cs-lg

Learning More from Less: Exploiting Counterfactuals for Data-Efficient Chart Understanding

arXiv:2605.10855v1 Announce Type: new Abstract: Vision-Language Models (VLMs) have demonstrated remarkable progress in chart understanding, largely driven by supervised fine-tuning (SFT) on increasing

researcharxiv-cs-cl

LoopVLA: Learning Sufficiency in Recurrent Refinement for Vision-Language-Action Models

arXiv:2605.09948v1 Announce Type: new Abstract: Current Vision-Language-Action (VLA) models typically treat the deepest representation of a vision-language backbone as universally optimal for action p

safetyarxiv-cs-ai

MaD Physics: Evaluating information seeking under constraints in physical environments

arXiv:2605.10820v1 Announce Type: new Abstract: Scientific discovery is fundamentally a resource-constrained process that requires navigating complex trade-offs between the quality and quantity of mea

MemQ: Integrating Q-Learning into Self-Evolving Memory Agents over Provenance DAGs

arXiv:2605.08374v1 Announce Type: new Abstract: Episodic memory allows LLM agents to accumulate and retrieve experience, but current methods treat each memory independently, i.e., evaluating retrieval