Search: “multimodal”

RF-Informed Graph Neural Networks for Accurate and Data-Efficient Circuit Performance Prediction

arXiv:2508.16403v3 Announce Type: replace Abstract: Accurately predicting the performance of active radio frequency (RF) circuits is essential for modern wireless systems but remains challenging due t

16 Jul 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

ScanFocus: A Coarse-to-Fine Framework for Spatio-Temporal Video Grounding

DGX agent

arXiv:2607.13421v1 Announce Type: cross Abstract: Spatio-Temporal Video Grounding (STVG) aims to retrieve the visual trajectory of a specific object from a video stream as described by a natural langu

model-releasesarxiv-cs-ai

16 Jul 2026

Towards Spatial Supersensing in the Wild

arXiv:2607.13681v1 Announce Type: new Abstract: Humans can efficiently parse continuous sensory streams, from hours to years, scaffolding an internal world model that grounds spatial reasoning and pre

16 Jul 2026

UESF-Bench: Benchmarking and Probing for Unified Embodied Seeking and Following

arXiv:2607.13621v1 Announce Type: new Abstract: Language-guided human following is an important capability for embodied agents, but existing benchmarks typically assume that the target person is visib

16 Jul 2026

1D-Bench: A Benchmark for Iterative UI Code Generation with Visual Feedback in Real-World

arXiv:2602.18548v2 Announce Type: replace-cross Abstract: Design-to-code translates high-fidelity UI designs into executable front-end implementations, but progress remains hard to compare due to inco

ANGLE: Angular Neural Generative Learning via Engression

arXiv:2607.12833v1 Announce Type: cross Abstract: Circular data, representing angles or directions, are frequently encountered in computer vision, biology, geology, and meteorology. Traditional regres

agentsarxiv-cs-lg

AVQ-Attention: Adaptive Vector-Quantized Attention

arXiv:2607.12789v1 Announce Type: cross Abstract: The O(N^2) complexity of attention over N tokens remains a computational bottleneck in transformer models. Vector-Quantized (VQ) attention reduces thi

AVSCap: Orchestrating Audio-Visual Synergy for Omni-modal Video Captioning

arXiv:2607.12820v1 Announce Type: new Abstract: Omni-modal video captioning is not merely combining visual captioning with audio transcription: a useful caption must describe how visual actions, speec

Benchmarking Sensor Robustness in Plasma Diagnostic Models: A Systematic Evaluation on TokaMark

model-releasesarxiv-cs-lg

arXiv:2607.11915v1 Announce Type: cross Abstract: Plasma diagnostic models for tokamak fusion devices are almost universally evaluated on clean, complete sensor data. In practice, fusion diagnostics f

Beyond Logit Adjustment: A Residual Decomposition Framework for Long-Tailed Reranking

arXiv:2604.01506v2 Announce Type: replace Abstract: Long-tailed classification, where a small number of frequent classes dominate many rare ones, remains challenging because models systematically favo

CGRL: Concept-Guided Pruning and Representation Learning for Whole-Slide Image Classification

arXiv:2607.12556v1 Announce Type: new Abstract: Weakly supervised whole-slide image (WSI) classification is widely used in computational pathology because slide-level labels are easier to obtain than

safetyarxiv-cs-cv

Controllable Generation of Diverse Dermatological Imagery for Fair and Efficient Malignancy Classification

arXiv:2607.12987v1 Announce Type: new Abstract: Accurate dermatological diagnosis naturally necessitates equitable performance across diverse populations, yet a systematic lack of expertly annotated i

CoRe: A Comprehensive Framework for Cross-Image Comparative Reasoning in Vision-Language Models

arXiv:2607.12786v1 Announce Type: new Abstract: Cross-image comparative reasoning remains challenging for vision-language models (VLMs), especially when correct prediction requires fine-grained attrib

Tutorials

DM-KG: A Novel Method for Boosting Spatial Cognition of Vision-Language Models in Street View Imagery

arXiv:2607.12319v1 Announce Type: new Abstract: As vision-language models (VLMs) are increasingly deployed in geospatial question answering and visual scene understanding, improving their spatial cogn

tutorialsarxiv-cs-cv

Domain-Incremental Remote Sensing Change Detection via Difference-Guided Adaptation and Frequency-Decoupled Distillation

arXiv:2607.12934v1 Announce Type: new Abstract: Remote sensing change detection (RSCD) models are prone to catastrophic forgetting when incrementally adapted to new domains. Existing domain-incrementa

DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMs

arXiv:2607.12503v1 Announce Type: new Abstract: 4D spatio-temporal reasoning, jointly modeling 3D spatial structure and temporal evolution, is essential for understanding dynamic worlds and enabling e

Egocentric Bias in Vision-Language Models

arXiv:2602.15892v2 Announce Type: replace-cross Abstract: Visual perspective taking--inferring how the world appears from another's viewpoint--is foundational to social cognition. We introduce FlipSet

Ensemble Controlled-Flow Filtering for Implicit Data Assimilation

arXiv:2607.12975v1 Announce Type: cross Abstract: Data assimilation estimates the state of a dynamical system from model forecasts and incoming observations. Many observation mechanisms, however, are

Hallo4D: Multi-Modal Hallucination Mitigation for Consistent Spatio-Temporal Generation

arXiv:2607.12752v1 Announce Type: cross Abstract: While recent advances in 3D generation have enabled impressive visual synthesis, existing methods often rely on 2D diffusion supervision without expli

HPC-Enabled Video-based Coastal Wave Parameter Estimation Using V-JEPA and Deep Spatiotemporal Learning

arXiv:2607.11998v1 Announce Type: cross Abstract: High deployment cost, poor spatial coverage and susceptibility to storm conditions are all challenges faced by traditional in-situ methods. This paper

HSEmotion Team at the 11th ABAW Challenge: Multi-Task Learning and Ambivalence/Hesitancy Video Recognition

arXiv:2607.12774v1 Announce Type: cross Abstract: This article presents our results for the 11th Affective Behavior Analysis in-the-Wild (ABAW) competition. For multi-task learning with simultaneous p

Hybrid Continual Learning for Low-Resource Australian Aboriginal Language Identification

arXiv:2607.11946v1 Announce Type: new Abstract: Language identification is an important step toward integrating endangered Australian Aboriginal languages (AALs) into speech technologies supporting la

researcharxiv-cs-cl

LakeQuest: A Three-Domain Benchmark for Grounded Question Answering across Data Lakes

arXiv:2607.12310v1 Announce Type: cross Abstract: While modern question answering (QA) systems excel on clean, schema-aligned corpora, real-world knowledge is rarely so neatly packaged. Answering ques

Look, Focus, Act: Efficient and Robust Robot Learning via Human Gaze and Foveated Vision Transformers

arXiv:2507.15833v3 Announce Type: replace-cross Abstract: Human vision is a highly active process driven by gaze, which directs attention to task-relevant regions through foveation, dramatically reduc

NeSy-Route: A Neuro-Symbolic Benchmark for Constrained Route Planning in Remote Sensing

arXiv:2603.16307v2 Announce Type: replace Abstract: Remote sensing underpins crucial applications such as disaster relief and ecological field surveys, where systems must understand complex scenes and

Applications

Proximity Features: Privacy-Compliant Cold-Start Personalization at Airbnb

arXiv:2607.12246v1 Announce Type: new Abstract: Personalization in two-sided marketplaces relies heavily on user-level features, yet for platforms with infrequent, high-consideration purchases, a larg

applicationsarxiv-cs-lg

RoboDesign1M: A Large-scale Dataset for Robot Design Understanding

model-releasesarxiv-cs-ro

arXiv:2503.06796v2 Announce Type: replace Abstract: Robot design is a complex and time-consuming process that requires specialized expertise. Gaining a deeper understanding of robot design data can en

Spectral Diffusion Processes

arXiv:2209.14125v3 Announce Type: replace-cross Abstract: Diffusion models have proven to be a flexible and effective framework for modelling probability distributions on finite-dimensional spaces. Ho

Towards Vision-Free CIR: Attribute-Augmented Scoring and LLM-Based Reranking for Zero-Shot Composed Image Retrieval

arXiv:2607.12621v1 Announce Type: new Abstract: Recent work has shown that 'Vision-Free'' approaches (representing images as text) can be effective for standard image retrieval tasks. However, it rema

VISA: VLM-Guided Instance Semantic Auditing for 3D Occupancy World Models

arXiv:2606.13460v2 Announce Type: replace Abstract: Semantic 3D occupancy provides a voxelized world state for autonomous driving and robot decision making, but object and rare-class errors can affect

agentsarxiv-cs-cv

Applications

Xray-Visual Models: Scaling Vision models on Industry Scale Data

arXiv:2602.16918v2 Announce Type: replace-cross Abstract: We present Xray-Visual, a unified vision model architecture for large-scale image and video understanding trained on industry-scale social med

applicationsarxiv-cs-ai

A Vision Toward Energy-Efficient Domain-Specific Artificial Intelligence Models and Agents

arXiv:2510.22052v2 Announce Type: replace Abstract: The field of artificial intelligence (AI) has taken a tight hold on broad aspects of society, industry, business, and governance in ways that dictat

Expressivity and Statistical Trade-offs in Diffusion Policy Learning

arXiv:2607.07967v1 Announce Type: cross Abstract: Diffusion-based policies have recently emerged as powerful policy parameterizations for reinforcement learning, representing state-conditioned action

safetyarxiv-cs-lg

FSD-VLN: Fast-Slow Dual-System Modeling for Aerial Long-Horizon Vision-Language Navigation

arXiv:2607.08359v1 Announce Type: cross Abstract: Vision-Language Navigation (VLN) enables UAV autonomous navigation in unknown environments by mapping language instructions to real-time visual inputs

agentsarxiv-cs-ai

Generative Action Tell-Tales: Assessing Human Motion in Synthesized Videos

arXiv:2512.01803v3 Announce Type: replace Abstract: Despite rapid advances in video generative models, robust metrics for evaluating visual and temporal correctness of complex human actions remain elu

HumanForge: A Human-Centric Deepfake Video Benchmark with Multi-Agent Forgery Rationales

arXiv:2607.08705v1 Announce Type: new Abstract: Rapid advancements in video diffusion models and temporal editing tools have enabled the generation of highly realistic human-centric videos, posing unp

PIT-SUN: A Deployable Empirical Marginal Transform Framework with Expectation-Consistent Recovery for Regression in Recommender Systems

arXiv:2607.08202v1 Announce Type: new Abstract: Estimating original-space conditional expectations is central to value-driven recommender systems, including dwell time, GMV, and LTV forecasting. Stand

Scalable and Trustworthy Earth Observation Foundation Models

model-releasesarxiv-cs-lg

arXiv:2607.07758v1 Announce Type: new Abstract: Foundation models (FMs) have transformed machine learning from isolated task-specific model development toward general-purpose models pretrained on broa

SeFA-Policy: Fast and Accurate Visuomotor Policy Learning with Selective Flow Alignment

arXiv:2511.08583v2 Announce Type: replace-cross Abstract: Developing efficient and accurate visuomotor policies poses a central challenge in robotic imitation learning. While recent rectified flow app

safetyarxiv-cs-lg

When Structured Sparse Autoencoders Learn Consistent Concepts Across Modalities

arXiv:2607.08605v1 Announce Type: cross Abstract: Sparse autoencoders (SAEs) have emerged as a promising technique for mechanistic interpretability by learning a set of sparse latent features in large

Accurate, Interdisciplinary and Transparent Structure-property Understanding with Deep Native Structural Reasoning

arXiv:2607.07708v1 Announce Type: cross Abstract: Structure-property relationships are foundational to biology, chemistry and materials science, where function, reactivity and physical response emerge

researcharxiv-cs-ai

Local Ai

AnchorPrune: Relevance-Anchored Contextual Expansion for Visual Token Pruning

arXiv:2607.07033v1 Announce Type: cross Abstract: Large vision-language models incur substantial inference costs because high-resolution inputs introduce thousands of visual tokens, many of which are

local-aiarxiv-cs-ai

Behavior Foundations for Quadruped Robots: ABot-C0 Technical Report

arXiv:2607.07370v1 Announce Type: cross Abstract: In embodied intelligence systems, the motion controller serves as the critical bridge between semantic reasoning and physical execution. Humanoid cont

CILC: Cryptographically-secure Inter-agent Loop Closure Candidate Detection for Multi-Agent Collaborative SLAM

arXiv:2607.06700v1 Announce Type: new Abstract: Multi-agent Simultaneous Localization and Mapping (SLAM) and collaborative SLAM (CSLAM) require robots to continuously exchange global descriptors (GDs)

agentsarxiv-cs-ro

Creativity from Friction: Human-AI Interaction for Exploratory Structural Design

arXiv:2607.07521v1 Announce Type: cross Abstract: AI agents that generate final answers based on user input often do not meet the needs of creative fields. Fields such as structural design and archite

researcharxiv-cs-ai

Does AI Understand Imaging? A Systematic Benchmark of Agentic AI for Computational Imaging Tasks

arXiv:2607.07189v1 Announce Type: new Abstract: Vision-language models (VLMs) and agentic AI have shown strong performance on semantic visual tasks, but it remains unclear whether they can handle the

Tutorials

Ensemble Deep Learning Approaches for AI-Altered Video Detection

arXiv:2607.06872v1 Announce Type: new Abstract: The increasing accessibility of artificial intelligence has led to a rapid rise in AI-generated videos, making it more difficult to distinguish between

tutorialsarxiv-cs-cv

Heat-Kernel Entropy Profiles and Geometric Effective Sample Size for Weighted Measures on Manifolds

arXiv:2607.06696v1 Announce Type: cross Abstract: Weighted empirical measures on compact manifolds arise in importance sampling, particle approximations, posterior summaries, quadrature, and represent