Search: “multimodal”

ChartJudgeBench: Evaluating LMM Judges for Chart-to-Code Generation

arXiv:2609.24210v1 Announce Type: new Abstract: Building strong chart-to-code systems increasingly relies on reinforcement learning, whose effectiveness depends critically on the quality of the reward

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

CLIP-Powered Domain Generalization and Domain Adaptation: A Comprehensive Survey

DGX agent

arXiv:2504.14280v2 Announce Type: replace Abstract: As machine learning evolves, domain generalization (DG) and domain adaptation (DA) have become crucial for improving model robustness across diverse

safetyarxiv-cs-cv

22 Sept 2026

Local Ai

Dissecting Agentic Forensics: The Role of Triage, Prompting, and Evidence Arbitration in Open-World Fake Image Detection

arXiv:2609.24359v1 Announce Type: new Abstract: Image forensics is increasingly an open-world problem: manipulations range from fully synthetic images to localized edits, splicing and swapping, while

local-aiarxiv-cs-cv

FeasibleFlow: One-Step Joint Transport of Configuration Feasibility and Trajectories for End-to-End Driving

model-releasesarxiv-cs-ro

arXiv:2609.23488v1 Announce Type: new Abstract: End-to-end autonomous driving maps current observations directly to future trajectories, yet those trajectories must remain valid as the scene evolves.

Financial Language Models as Applied Artificial Intelligence Systems for News-Based Trading under Market Frictions

arXiv:2609.23703v1 Announce Type: new Abstract: Financial language models can transform unstructured firm-specific news into structured decision signals, but financial AI research lacks an integrated

researcharxiv-cs-cl

From Content Generation to Learning Support: Pedagogy-Guided Generative Video Tutors for STEM Learning

arXiv:2609.24083v1 Announce Type: new Abstract: Generative AI enables scalable production of educational videos, but current systems largely focus on producing visually coherent content rather than su

tutorialsarxiv-cs-cl

Local Ai

ME-Brain-1.0: Memory, Cognition and Action for Evolving Embodied Intelligence

arXiv:2609.24271v1 Announce Type: new Abstract: Current embodied systems largely rely on pretrained capabilities that remain fixed after deployment, limiting their ability to learn from physical inter

local-aiarxiv-cs-ro

Mira-Scene: Pixel-Aligned Layouts for Generative 3D Scene

arXiv:2609.23796v1 Announce Type: new Abstract: Single-image 3D object generation can now produce high-fidelity assets, yet accurately placing them into a coherent scene layout remains an open challen

safetyarxiv-cs-cv

NAVIR: Neuromorphic Audio-Visual Speech Recognition for Robust Human-Robot Interaction on Edge Hardware

model-releasesarxiv-cs-lg

arXiv:2609.24391v1 Announce Type: new Abstract: Voice-controlled interaction in industrial settings is hampered by acoustic noise, which severely degrades audio-only speech recognition. Audio-visual s

NVIDIA Isaac ROS 5.0 Advances Agentic, Open Source Robotics Development

model-releasesnvidia-blog

To build and deploy sophisticated robotics applications that can perceive, reason and act in dynamic environments, developers need new physical AI models and tools. The ROS open framework is a project

Omni2Web: Benchmarking Audiovisual Website Development

arXiv:2609.23417v1 Announce Type: cross Abstract: Screen-recorded web editing requests contain weak deictic expressions such as ``this'' and ``there,'' whose referents depend on speech, cursor traject

PackLab: A Comprehensive Framework for Developing, Training, and Evaluating MLLMs in Robotic Bin Packing

model-releasesarxiv-cs-ro

arXiv:2609.23784v1 Announce Type: new Abstract: Robotic bin packing requires long-horizon sequential decision-making, as each object placement affects the available space for subsequent packing. Exist

QwenVLConnector: A Fast, Unified Medical VLM Chatbot for Fine-Grained Clinical Perception and Text Generation

arXiv:2609.23139v1 Announce Type: new Abstract: Most medical vision-language models (VLMs) excel at open-ended report generation and VQA but provide limited support for structured, fine-grained clinic

researcharxiv-cs-cv

Recommended if you work on agent memory. Retrieval is the hardest memory problem in most harnesses because agents keep pulling stale context…

Recommended if you work on agent memory. Retrieval is the hardest memory problem in most harnesses because agents keep pulling stale context. AML tests this with a coding track of 150 software tasks,

agentsdair-ai--x

Safe Learning for Contact-Rich Robot Tasks: A Survey from Classical Learning-Based Methods to Safe Foundation Models

arXiv:2512.11908v3 Announce Type: replace Abstract: Contact-rich tasks pose significant challenges for robotic systems due to inherent uncertainty, complex dynamics, and the high risk of damage during

SalQ-VLM: Fine-Grained Saliency-Guided Quantization for Vision-Language Models

model-releasesarxiv-cs-cl

arXiv:2508.03351v3 Announce Type: replace-cross Abstract: Large language models (LLMs) have demonstrated remarkable capabilities across diverse language tasks, motivating their extension to vision-lan

SALSA: Semi-Autonomous Literature Summarization Assistant

arXiv:2609.22210v1 Announce Type: new Abstract: SALSA (Semi-Autonomous Literature Summarization Assistant) is an open- source, human-in-the-loop platform for extracting structured scientific datasets

agentsarxiv-cs-cl

Structured World-State Reasoning for Agentic Robotic Search

arXiv:2609.23841v1 Announce Type: new Abstract: Long-horizon robotic search must resolve natural language against heterogeneous, incomplete, and often ambiguous evidence: textual information, prior ma

agentsarxiv-cs-ro

Task aware Dynamic Movement Primitives for failure detection and recovery in contact rich manipulation

arXiv:2609.23151v1 Announce Type: cross Abstract: Assembly remains a challenging robotic manipulation task in presence of tight tolerances and complex contact interactions. While Learning from Demonst

VideoGen-Agent: Reinforcing Video Generation Agents

arXiv:2609.24997v1 Announce Type: new Abstract: Recent advances in video generative models have enabled high-fidelity, temporally coherent video generation. However, these models often struggle to sat

What do VLM-Based Vision-Language Navigation Models Rely on: Interpreting and Steering Policy Behavior

arXiv:2609.24576v1 Announce Type: cross Abstract: Modern Vision-Language Navigation (VLN) models rely mostly on pre-trained large Vision-Language Models (VLMs) to predict navigation actions. While thi

safetyarxiv-cs-cv

WorldScape Policy 2.0: Empowering Steerable World Action Modeling with Reasoning-Augmented Memory and In-Context Learning

arXiv:2607.18840v2 Announce Type: replace Abstract: World Action Models (WAMs) offer a promising paradigm for robotic manipulation by jointly modeling visual state transitions and robot actions. Howev

A Generative Grammar Underlying the Voynich Manuscript, the Pastiche Hypothesis: Evidence from Large Language Models

arXiv:2609.20835v1 Announce Type: new Abstract: Background: The Voynich Manuscript is a fifteenth-century codex written in an unknown script whose content remains undeciphered. Previous studies sugges

safetyarxiv-cs-cl

AVT-Fabric: Active Visuo-Tactile Perception via Adaptive Evidence Selection for Efficient Robotic Fabric Comparison

arXiv:2609.21377v1 Announce Type: new Abstract: Robotic fabric comparison needs to actively combine visual appearance and tactile cues. Here, we present AVT-Fabric, an RGB-first framework that allocat

researcharxiv-cs-ro

Beyond Exact Match: Task-Aware GRPO for Cross-Domain PCBA Visual Question Answering

arXiv:2609.21276v1 Announce Type: cross Abstract: In automated Printed Circuit Board Assembly (PCBA) inspection, standards-guided decisions require systems to jointly reason over fine-grained visual c

safetyarxiv-cs-ai

DEXTERA: From a Single Image to Deployable Dexterous Manipulation via Real-to-Sim-to-Real

arXiv:2609.21045v1 Announce Type: new Abstract: Collecting real-world robot data for dexterous manipulation is costly and time-consuming. While high-fidelity physics simulators enable scalable data sy

ForeTac-VLA: A Forecasting-Based Tactile-Vision-Language-Action Model for Contact-Rich Robotic Manipulation

arXiv:2609.20980v1 Announce Type: new Abstract: Vision-language-action (VLA) models have demonstrated strong capabilities in robotic manipulation, yet their reliance on visual perception limits robust

tutorialsarxiv-cs-ro

From Retrieval to Recognition:How Vision--Language Models Become OCR Specialists

arXiv:2609.21543v1 Announce Type: new Abstract: Does a general vision--language model acquire specialized OCR ability by developing a new reading circuit or by reusing an existing mechanism? We addres

researcharxiv-cs-cv

KnowDemo: Knowledge-Guided Robot Demonstration Generation from Human Videos

arXiv:2609.21229v1 Announce Type: cross Abstract: Learning robot manipulation policies typically requires substantial demonstration data, which are costly to collect on real robots. Recent methods gen

safetyarxiv-cs-ai

LLM-Generated Feature Pools for Time Series Anomaly Detection

arXiv:2609.21801v1 Announce Type: new Abstract: We study how far a simple statistical pipeline can go on univariate time series anomaly detection under a strict selection protocol. The method extracts

researcharxiv-cs-ai

MemeTAG: Keyword-Driven Meme Classification through Tag Embedding Reconstruction

arXiv:2609.20962v1 Announce Type: new Abstract: The proliferation of harmful internet memes poses a significant societal threat, yet their automated classification remains a formidable algorithmic cha

tutorialsarxiv-cs-cv

MultiHU-TD: Multifeature Hyperspectral Unmixing Based on Tensor Decomposition

arXiv:2310.03860v1 Announce Type: cross Abstract: Hyperspectral unmixing allows representing mixed pixels as a set of pure materials weighted by their abundances. Spectral features alone are often ins

researcharxiv-cs-cv

OverThink: Slowdown Attacks on Reasoning LLMs

arXiv:2502.02542v5 Announce Type: replace Abstract: A reasoning language model (RLM) generates costly reasoning tokens, often hidden from the users, that help it excel at many tasks. Our Overthink att

safetyarxiv-cs-lg

ProTracer: Proprioception-Guided Failure Diagnosis in Robot Manipulation

arXiv:2609.21369v1 Announce Type: cross Abstract: This paper presents a comprehensive framework for robot manipulation failure analysis that includes binary failure detection, failure categorization,

Hardware

Simplifying Model Serving Across Multiple GPUs with NVIDIA TensorRT Multi-Device Integration in NVIDIA Dynamo-Triton

NVIDIA TensorRT’s multi‑device inference lets a single TensorRT network span multiple GPUs using NCCL‑backed collectives, preserving all standard optimizations and supported from TensorRT 11.0 onward.

hardwarenvidia-developer

SIRA: Reasoning-Aware Surgical Instrument Segmentation via Query-Anchored Alignment

arXiv:2609.21402v1 Announce Type: new Abstract: Surgical instrument segmentation (SIS) plays a critical role in robotic assistance and surgical workflow analysis. However, most existing SIS methods fo

When Should Robots Intervene? Balancing Engagement and Intrusiveness in Human-Robot Interaction

arXiv:2609.21734v1 Announce Type: new Abstract: Designing effective Human-Robot Interaction in task-oriented settings requires carefully balancing user engagement with socially acceptable levels of ro

tutorialsarxiv-cs-ro

I said 'auto-regressive LLMs, in and of themselves, will not lead human-level AI' That statement is still totally true. First, the reasoning…

I said 'auto-regressive LLMs, in and of themselves, will not lead human-level AI' That statement is still totally true. First, the reasoning abilities of current AI systems are based non-auto-regressi

tutorialsyann-lecun--x

20 Sept 2026

Yes, you can make up some of the difference by giving Claude API access but (1) most people will never do this, (2) it means additional expe…

model-releasesethan-mollick--x

Yes, you can make up some of the difference by giving Claude API access but (1) most people will never do this, (2) it means additional expense or difficulty, and (3) the real gain isn't from image ge

20 Sept 2026

Meet Qwen3.8-LiveTranslate, Qwen's next-generation real-time simultaneous interpretation model! 📢 Built on an Interleave architecture, it i…

Meet Qwen3.8-LiveTranslate, Qwen's next-generation real-time simultaneous interpretation model! 📢 Built on an Interleave architecture, it improves faithfulness, fluency, and conciseness while reducing

model-releasesqwen--x

19 Sept 2026

4D Radar Perception Algorithms for Autonomous Driving: A Review

arXiv:2609.19216v1 Announce Type: cross Abstract: Research on 4D millimeter-wave radar perception algorithms has flourished in recent years, extending from signal processing and object detection to se

agentsarxiv-cs-cv

6 billion tokens for $65 Is it as good as Astra and Fable at hard stuff? No of course not. But you don't always need a genius and can just c…

model-releasesemad-mostaque--x

6 billion tokens for $65 Is it as good as Astra and Fable at hard stuff? No of course not. But you don't always need a genius and can just call one for advice when you do. Extrapolate where this is go

AI Smart Glasses for Wearable Intelligence: From Egocentric Sensing to Agentic Personalization

arXiv:2609.19793v1 Announce Type: new Abstract: Recent advances in artificial intelligence (AI) are reshaping smart glasses from egocentric capture and display devices into platforms for wearable inte

agentsarxiv-cs-cv

AntiGrounding: Executable Robot Trajectories as Visual Prompts for VLM-Guided Manipulation

arXiv:2506.12374v3 Announce Type: replace-cross Abstract: Natural-language manipulation instructions specify the task goal but leave the underlying robot trajectory unspecified. We present AntiGroundi

safetyarxiv-cs-ai

Applications

AURA: Adaptive Uncertainty-Routed Analysis for Email Threat Detection

arXiv:2609.19873v1 Announce Type: new Abstract: Email spam and phishing attacks remain a critical security threat. Adversaries increasingly exploit large language models to craft contextually convinci

applicationsarxiv-cs-lg

Applications

BinoGen: Scaling egocentric binocular data for embodied visual perception and learning

arXiv:2609.19881v1 Announce Type: new Abstract: Embodied visual perception relies on temporally coherent visual experience accumulated through continuous engagement with the environment. However, coll

applicationsarxiv-cs-cv

CitySTAR: Structured and Topology-Aware Reasoning for Open-Vocabulary Urban 3D Grounding

arXiv:2609.19911v1 Announce Type: new Abstract: 3D grounding aims to localize target entities in complex scenes from natural language and plays a fundamental role in embodied perception and spatial re

DeliveryGym: An RL Environment for Long-Horizon Embodied Agent Planning with Adaptive Curriculum

arXiv:2609.19801v1 Announce Type: new Abstract: Executable environments enable LLM agents to learn from the consequences of their actions. For embodied agents, those consequences extend beyond whether

safetyarxiv-cs-lg