Search: “multimodal”

ContactDP: Contact-Guided Diffusion Policy for Tight Insertion Tasks

arXiv:2609.23800v1 Announce Type: new Abstract: High-precision connector insertion remains challenging for robotic systems due to tight mechanical tolerances, partial observability during contact, and

safetyarxiv-cs-ro

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DeCo: Efficient Decouple-to-Couple Learning for Multi-Task Visual Grounding

DGX agent

arXiv:2609.24409v1 Announce Type: new Abstract: Multi-task visual grounding requires models to jointly understand linguistic semantics and perform accurate visual localization and segmentation. Despit

researcharxiv-cs-cv

22 Sept 2026

MambaX: Image Super-Resolution with State Predictive Control

arXiv:2511.18028v2 Announce Type: replace Abstract: Image super-resolution (SR) is a critical technology for overcoming the inherent hardware limitations of sensors. However, existing approaches mainl

researcharxiv-cs-cv

MAROON: A Dataset for the Joint Characterization of Near-Field High-Resolution Radio-Frequency and Optical Depth Imaging Techniques

arXiv:2411.00527v5 Announce Type: replace-cross Abstract: Utilizing the complementary strengths of wavelength-specific range or depth sensors is crucial for robust computer-assisted tasks such as auto

agentsarxiv-cs-cv

Open Source: Ming-Image-0.1-Design family: Ming-Image-0.1-Design, 6B & Ming-Image-0.1-Design-Layer, 6B

model-releasesr-stablediffusion

Ming-Image-0.1-Design creates complete UIs, dashboards, infographics, and posters from structured prompts of up to 8K tokens, with consistent layouts, typography, colors, and imagery. It can also nati

PADiff: Predictive and Adaptive Diffusion Policies for Ad Hoc Teamwork

arXiv:2511.07260v3 Announce Type: replace-cross Abstract: Ad hoc teamwork (AHT) requires agents to collaborate with previously unseen teammates, which is crucial for many real-world applications. The

safetyarxiv-cs-lg

Vision-Wireless Fusion for Multi-User Localization: A Cross-Modal Transformer Approach

arXiv:2609.23372v1 Announce Type: new Abstract: Accurate multi-user localization is challenging in complex urban environments, where wireless measurements can become ambiguous under noise, blockage, a

local-aiarxiv-cs-cv

AgentVidBench: A Multi-Hop Video Question Answering Benchmark for Evaluating MLLM Agents

arXiv:2609.21386v1 Announce Type: cross Abstract: Comprehensive video understanding is crucial for advancing artificial intelligence toward the intricate dynamics of the physical world. While recent a

ECG Mirage: Revealing and Mitigating the Underutilisation of ECGs in Vision-Language Models for Clinical Prediction

arXiv:2609.21755v1 Announce Type: new Abstract: Emergency department (ED) decision-making relies on heterogeneous clinical information, including patient history, vital signs, laboratory results, and

One hope for Tinker is that it can handle all the ML infra for posttraining for (approximately) everyone. So, curious, what prevents you fro…

researchsoumith-chintala--x

One hope for Tinker is that it can handle all the ML infra for posttraining for (approximately) everyone. So, curious, what prevents you from using Tinker for all your posttraining needs? Speed? Cost?

PSR: Predictive Sensorimotor Representation Learning for Contact-Rich Manipulation

arXiv:2609.21753v1 Announce Type: new Abstract: Contact-rich manipulation requires policies to generate precise actions by reasoning over contact forces, robot configurations, and interaction historie

safetyarxiv-cs-ro

Touvigation: Embodied Adaptive Object Acquisition for Blind and Low-Vision Users in Unfamiliar Indoor Environments

arXiv:2609.21828v1 Announce Type: cross Abstract: Blind and low-vision users often face challenges when locating and physically acquiring objects in unfamiliar indoor environments. Existing vision-lan

local-aiarxiv-cs-ai

Affective Shared Autonomy: Temporal Affect Dynamics and Subjective Evaluation in Bimanual Teleoperation Tasks

model-releasesarxiv-cs-ro

arXiv:2609.19802v1 Announce Type: new Abstract: Physical teleoperation integrates human cognitive flexibility with robotic precision, yet demanding manipulation tasks frequently induce severe cognitiv

Agile-WAM: An Agile Tactile World Action Model for Contact-Rich Robot Control

arXiv:2609.20761v1 Announce Type: cross Abstract: World Action Models (WAMs) advance beyond conventional visuomotor policies by jointly predicting future world states and robot actions, enabling the p

safetyarxiv-cs-lg

Announcing Native BM25 Ranking in AlloyDB and Cloud SQL

Vector search is a critical component of generative AI, retrieval-augmented generation (RAG), and data agent architectures, but sometimes vector search alone isn't enough. While vector embeddings are

agentsgoogle-cloud-ai

BINDER: A Latent Variable Model for Probabilistic Medical Image Registration

arXiv:2609.19875v1 Announce Type: new Abstract: We propose a new probabilistic model for general-purpose medical image registration that builds upon the mutual information registration criterion. It c

researcharxiv-cs-cv

Tutorials

FlipToSee: A Probabilistic Stable Placement Prior for Active Visual Exploration via Regrasping

arXiv:2609.20078v1 Announce Type: new Abstract: Active visual exploration of tabletop objects often requires reorienting an unknown resting object onto a different stable support face to expose occlud

tutorialsarxiv-cs-ro

Grounded Product Understanding in Livestream Videos

model-releasesarxiv-cs-cv

arXiv:2609.20508v1 Announce Type: new Abstract: E-commerce livestreams have emerged as an important channel for presenting products to online consumers, containing multiple products whose information

Hardware

Modality Discrepancy Transformer for Ambivalence and Hesitancy Recognition

arXiv:2609.19148v1 Announce Type: new Abstract: Ambivalence and hesitancy (A/H) are affective states in which individuals express contradictory signals across facial, vocal, and linguistic channels. A

hardwarearxiv-cs-cl

Banger release from NVIDIA. They just published a report on NeMo Data Designer, their open-source synthetic data tool. It's a declarative co…

Banger release from NVIDIA. They just published a report on NeMo Data Designer, their open-source synthetic data tool. It's a declarative config which makes a synthetic data pipeline easy to review, s

model-releasesdair-ai--x

CoAtNet-DeepMoE: A Convolution-Attention Hybrid with DeepSeek Mixture-of-Experts for Parameter-Efficient Tomato Disease Classification

model-releasesarxiv-cs-cv

arXiv:2609.18038v1 Announce Type: new Abstract: The world population is growing rapidly, and technology is improving in parallel. Meeting the huge demand for food for these 7 billion people not only d

Correlation-Guided Encoder Selection for Multi-Encoder Large Audio-Language Models

arXiv:2609.18041v1 Announce Type: cross Abstract: Multi-encoder fusion extends Large Audio-Language Models (LALMs) beyond speech-centric recognition, but selecting encoders via intuition or exhaustive

Disentangling Long-Term Memory via Latent Neuro-Symbolic Reasoning

arXiv:2609.18461v1 Announce Type: new Abstract: Personalized agents are required to reason over long-term history interactions to infer both explicit preferences and implicit behavioral evidence. Whil

Tutorials

Dreaming the Sound of Contact: Leveraging Video and Audio Generation for Zero-Shot Force-Aware Manipulation and Data Generation

arXiv:2609.19137v1 Announce Type: cross Abstract: Recent advances in video generation allow robots to learn manipulation trajectories from generated videos. However, these approaches produce purely ki

tutorialsarxiv-cs-ai

GazeDiT: Gaze-Accurate Diffusion Image Generation for Eye Tracking via Spatial Conditioning

arXiv:2609.17814v1 Announce Type: new Abstract: Diffusion models are increasingly used to generate synthetic training data, but precise label control remains difficult when the conditioning signal is

local-aiarxiv-cs-cv

HearInContext: A Benchmark for Implicit Context in Speech Recognition

arXiv:2609.18680v1 Announce Type: new Abstract: Contextual ASR can benefit from semantic cues or from target words explicitly provided in the context. We introduce HearInContext, a Mandarin--English b

Hardware

Lecture notes on Physics Informed Neural Networks, Neural Operators, and their applications

arXiv:2609.17638v1 Announce Type: cross Abstract: This is the set of lecture notes for the PhD course href{https://www.unibz.it/en/faculties/engineering/phd-computer-science/study-course-offering/2025

hardwarearxiv-cs-ai

Planning or Improvisation? Stress-Testing the Poetry Planning Site on Open Models and Open Cross-Layer Transcoders

arXiv:2609.18440v1 Announce Type: new Abstract: Lindsey et al. (2025) report that Claude 3.5 Haiku plans rhymes: features for candidate rhyme words are active on the newline before a line is written,

Probabilistic Linear Explanations

arXiv:2609.19077v1 Announce Type: cross Abstract: Formal explainability provides mathematically grounded justifications for individual predictions. However, abductive explanations often exceed human c

Reasoning through Evolution: Automatic Meta-path Discovery for LLM-based Fake News Detection

arXiv:2609.18597v1 Announce Type: new Abstract: Propagation structures provide crucial evidence for fake news detection, yet existing approaches primarily rely on supervised GNN-based models, which re

agentsarxiv-cs-ai

REPAIR: Resolving Long-Tail Confusion in Scientific Retrievers via Fact-Verified Iterative Refinement

arXiv:2609.18262v1 Announce Type: new Abstract: Precise retrieval of scientific information is fundamentally constrained by long-tailed concepts and high fact-sensitivity of scientific corpora. These

Robust and Efficient AI Frameworks for Scalable Material Design and Property Prediction

arXiv:2609.17646v1 Announce Type: cross Abstract: This thesis develops robust and efficient AI frameworks for accelerating crystalline materials discovery by addressing both major stages of the materi

researcharxiv-cs-lg

ShotFinder: Imagination-Driven Open-Domain Video Shot Retrieval via Web Search

arXiv:2601.23232v4 Announce Type: replace-cross Abstract: In recent years, large language models (LLMs) have made rapid progress in information retrieval, yet existing research has mainly focused on t

T-SANDHI: Tone Sandhi-aware Adaptive Network with Decoupled Hybrid Injection for Low-resource Taiwanese Hokkien Speech Recognition

arXiv:2609.18194v1 Announce Type: new Abstract: In Taiwanese Hokkien automatic speech recognition (ASR), prior studies often treat tone sandhi as a major challenge under the assumption that models fai

Towards Generalizable Deepfake Detection via Real Distribution Bias Correction

arXiv:2603.14005v2 Announce Type: replace Abstract: To generalize deepfake detectors to future unseen forgeries, most existing methods attempt to simulate the dynamically evolving forgery types using

safetyarxiv-cs-cv

TRIPROBE: Probing Task Separability Beyond Classification for XAI

arXiv:2609.18525v1 Announce Type: new Abstract: Modern evaluation of learning pipelines often reduces to downstream accuracy, leaving open the question of why tasks succeed or fail. TriProbe addresses

AquiLLM: Evaluating Faithfulness in Open-Weight RAG-LLM Systems for Scientific Research

arXiv:2609.16519v1 Announce Type: new Abstract: Scientific research increasingly relies on large, heterogeneous data sources, motivating interest in retrieval-augmented generation (RAG) systems that p

CLASH: Counterfactual Auditing of Lexical and Prosodic Reliance in Spoken Sarcasm Detection

arXiv:2609.16582v1 Announce Type: cross Abstract: Spoken sarcasm detectors may exploit lexical content, prosody, or their interaction, yet conventional evaluation cannot reveal which cues drive their

researcharxiv-cs-cl

DiaWhisper-DPO: Role-Attributed Transcription of Clinical Interviews via Failure-Mined Preference Optimization

arXiv:2609.16661v1 Announce Type: new Abstract: Automated depression screening from clinical interviews requires attribution of utterances to the clinician or patient. We evaluate two datasets: DAIC-W

researcharxiv-cs-cl

From Momentary Emotion Inference to Sustained Emotion Support: Evaluating a Companion Agent in a Longitudinal Study

arXiv:2609.16344v1 Announce Type: cross Abstract: Sustained emotional support is a long-horizon interaction task closely tied to human well-being. Recent research demonstrates generative agents' capac

agentsarxiv-cs-ai

From Pixels to Images: A Structural Survey of Deep Learning Paradigms in Remote Sensing Image Semantic Segmentation

arXiv:2505.15147v3 Announce Type: replace Abstract: Remote sensing images (RSIs) capture both natural and human-induced changes on the Earth's surface. Semantic segmentation (SS) of RSIs enables the f

local-aiarxiv-cs-cv

I built a native Vulkan training backend for 143 modern Transformer architectures — no CUDA or PyTorch required

model-releasesr-localllama

I've been working on something that started as the training backend for my Hierarchos architecture, but it has grown into a much broader project: https://github.com/necat101/Hierarchos-Native Hierarch

Intelligent Interaction Techniques (IIxT) - Proposal

arXiv:2609.16295v1 Announce Type: cross Abstract: Interaction techniques (IxTs) are the low-level, reusable components out of which user interfaces are designed, including menus, scroll bars, text inp

Japanese Stroke LLM Evaluation: A Conversational Benchmark for Safe Stroke Care in Japanese Using Large Language Models

arXiv:2609.16739v1 Announce Type: new Abstract: Background: Large language models (LLMs) have achieved physician-comparable performance on multiple-choice medical knowledge examinations, but their cap

MLPerf Inference v6.1: pioneering agent, VLM benchmarks

MLPerf Inference v6.1 introduced the first agentic workload run on datacenter hardware and evaluated a model with more than one trillion parameters (Kimi K2), setting a new benchmark for scale. The te

agentslambda-labs

Neuro-Symbolic Hierarchical Intention Anticipation in Human Behavior

arXiv:2609.17064v1 Announce Type: new Abstract: Assistive autonomous systems must anticipate human goals before an observed behavior is complete. This article formulates anticipation as goal inference

Not Another Text Benchmark: Putting the 'Visual' Back in Visual Question Answering for Large Video Models

model-releasesarxiv-cs-cv

arXiv:2609.17112v1 Announce Type: new Abstract: Large video models have exhibited impressive performance on a wide range of visual question answering tasks, owing to the rise of powerful, pretrained t

Tutorials

PhysStream: Streaming Physics-Grounded Video Generation with Structured Scene Memory and Fine-Grained Motion Control

arXiv:2609.17521v1 Announce Type: cross Abstract: Interactive control for video generation is moving from coarse prompts toward fine-grained, physically meaningful manipulation of dynamic scenes. Yet

tutorialsarxiv-cs-ai