Search: “multimodal”

ADAPT: Audio-Depth Action Planning with Transition-Aware Rewards for Lights-Out Industrial Navigation

arXiv:2610.15956v1 Announce Type: new Abstract: Vision-language-action models for embodied navigation typically rely on RGB observations, limiting their applicability in lights-out industrial environm

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

AlignPoison: Conditional Targeted Poisoning of Generative Recommenders via Decoding-Aligned Prefixes

DGX agent

arXiv:2610.14487v1 Announce Type: new Abstract: Generative recommendation models based on autoregressive decoding have been adopted as alternatives to classical ranking-based systems. While their mode

safetyarxiv-cs-ai

15 Oct 2026

BFHD: Bidirectional Feature Harmonization Decomposition for Heterogeneous Clinical Assessments

arXiv:2610.19352v1 Announce Type: new Abstract: Clinical assessments are often collected using heterogeneous assessment systems across centers and time, leading to records that mix different but relat

researcharxiv-cs-lg

Can Learning to Answer Spatial Questions Improve Novel-View Generation?

arXiv:2610.20610v1 Announce Type: new Abstract: Generating novel views from limited observations requires preserving both the appearance and spatial structure of a scene. Although recent approaches ex

Cortex: Consolidating Context into Parametric Memory

arXiv:2610.20399v1 Announce Type: new Abstract: Context can improve large language model performance, but these gains may be lost after context removal. Inspired by biological systems consolidation, w

researcharxiv-cs-cl

Customers love choice! @AIatMeta Muse Spark Open and @nvidia Nemotron 3.5 Super VL are now available on the Dell Enterprise Hub with @huggin…

model-releasesclem-delangue--x

Customers love choice! @AIatMeta Muse Spark Open and @nvidia Nemotron 3.5 Super VL are now available on the Dell Enterprise Hub with @huggingface 🤗 https://dell.huggingface.co/updates/muse-spark-open-

DecisionRobust: Benchmarking Robustness for JEV Style Decision Models Across Text and Vision

model-releasesarxiv-cs-cl

arXiv:2610.19118v1 Announce Type: new Abstract: Emerging decision models such as JEV provide typed interfaces that map task instructions and observations directly to choices, judgments, and scores. As

Eigen-Agent: Adaptive Multi-Agent Scientific Reasoning with Monitor-Based RAG

arXiv:2509.21193v2 Announce Type: replace Abstract: Large language models (LLMs) have recently shown strong progress on scientific reasoning, yet two major bottlenecks remain. First, explicit retrieva

agentsarxiv-cs-cl

Empowering Edge Agents: A Systematic Analysis of Edge-Cloud Collaboration in LLM Agent Execution

arXiv:2610.17816v1 Announce Type: new Abstract: Edge-cloud collaboration combines the lower inference overhead and greater data locality of edge-side execution with the stronger capabilities of cloud-

EvoWeb: A Benchmark for Coding Agents on Evolving Web Applications

arXiv:2610.16402v1 Announce Type: new Abstract: Web application development often proceeds through successive requests that extend an existing implementation. Yet web-generation benchmarks primarily e

FLUX 3 Image Klein: Open weights image generation and editing

model-releasesr-stablediffusion

Black Forest Labs (BFL), the frontier AI research lab building visual intelligence, today announced the open weights release of FLUX 3 Image Klein, its most capable open weights image model to date. F

From Triage to Impact: A Multi-Hop Reasoning Benchmark for Explainable Persian Hate Speech

model-releasesarxiv-cs-cl

arXiv:2610.20370v1 Announce Type: new Abstract: Hate speech has become increasingly prevalent on social media, raising concerns about its detection, interpretation, and moderation. Persian, a relative

Safety

Geometric Alignment without Functional Equivalence: A Layer-wise Analysis of the Speech-Text Modality Gap

arXiv:2603.01502v2 Announce Type: replace Abstract: End-to-end speech large language models (LLMs) often answer the same question less accurately from speech than from text, even when the spoken conte

safetyarxiv-cs-cl

Applications

Geospatial Vector Geometry as a Native Spatial Modality for Vision-Language Models

arXiv:2610.16769v1 Announce Type: new Abstract: Geospatial reasoning links VLMs to real-world action and decision making. Reliable reasoning requires accurate spatial information and effective spatial

applicationsarxiv-cs-ai

Joint Discrete and SE(3) Diffusion for Protein Interface Design

arXiv:2610.14699v1 Announce Type: new Abstract: The design of high-affinity, target-specific protein binders is central to the development of modern therapeutics. However, existing protein-generation

Safety

Learning Adaptive Deliberation Control for Reliable Recognition with Multi-Agent Language Models

arXiv:2610.17840v1 Announce Type: new Abstract: Multi-agent deliberation can improve recognition by criticizing and revising candidate answers, but fixed controls cannot respond to changes in disagree

safetyarxiv-cs-ai

Tutorials

Learning How to Remember: Memory Modality Selection for GUI Agents

arXiv:2610.17928v1 Announce Type: new Abstract: Recent advances in vision-language models (VLMs) have substantially improved the capabilities of GUI agents, while memory augmentation has emerged as a

tutorialsarxiv-cs-ai

Long-Horizon-Terminal-Bench: Testing the Limits of Agents on Long-Horizon Terminal Tasks with Dense Reward-Based Grading

arXiv:2607.08964v3 Announce Type: replace Abstract: AI agents have become capable of autonomously completing short, well-specified tasks. However, existing terminal benchmarks largely focus on simple

LURE: a Phase-Labelled Synthetic Corpus of Online-Grooming Exchanges

arXiv:2610.15908v1 Announce Type: new Abstract: Phase-annotated conversational data is essential for studying the progression of online grooming of minors and for developing early warning tools. Howev

MADDIE: Multi-Agent Drug Discovery Engine

arXiv:2610.16975v1 Announce Type: new Abstract: Drug discovery remains a resource-intensive and time-consuming process, involving billions of dollars and a decade of development to advance a drug to m

agentsarxiv-cs-ai

MagicGarment: Benchmarking Single-Image Standalone 3D Garment Reconstruction

arXiv:2610.19623v1 Announce Type: new Abstract: Single-image 3D reconstruction has advanced rapidly, yet standalone garments remain challenging due to thin-shell geometry, open boundaries, and layered

Tutorials

MemeLogos: Knowledge-Driven Retrieval-Augmented Reasoning for Harmful Meme Detection

arXiv:2610.15463v1 Announce Type: new Abstract: With the rapid proliferation of social media, harmful memes have become a growing threat to online ecosystems. Their harmfulness is often implicitly con

tutorialsarxiv-cs-ai

MIRAGE: Metric Inference and Reliability-Aware Gaussian Estimation from Feed-Forward Vision

arXiv:2610.12568v2 Announce Type: replace Abstract: Feed-forward 3D priors enable high-quality reconstruction from image streams but often lack reliable metric scale and suffer from long-term trajecto

Multi-Horizon Explainable Queue Forecasting and Resource-Aware Decision Support for Intelligent Border Control Using LightGBM

arXiv:2610.15930v1 Announce Type: new Abstract: Border crossing points are stochastic service systems in which traffic demand, traveler categories, registration status, inspection requirements, staffi

NVIDIA Nemotron 3.5 Super VL is now available on Ollama This model combines reasoning and visual understanding across a range of agent workf…

NVIDIA Nemotron 3.5 Super VL is now available on Ollama This model combines reasoning and visual understanding across a range of agent workflows. On a single GPU, this model delivers up to 5x higher t

model-releasesollama--x

@nvidia Run Nemotron 3.5 Super VL on Together AI Start building: https://www.together.ai/models/nemotron-3-5-super-vl

model-releasestogether-ai--x

NVIDIA’s Nemotron 3.5 Super VL is now available to run on the Together AI compute platform through an API. The model page—providing pricing, benchmarks, and documentation—is hosted at together.ai/mode

Player-1: Learning to Play from Synthetic Experience

arXiv:2610.20584v1 Announce Type: new Abstract: Computer-use agents have demonstrated strong capabilities in interpreting screens and executing keyboard and mouse actions. However, games, with their v

agentsarxiv-cs-cv

Read, Parse, Describe: Unified Document Parsing with Visual Element Description Generation

arXiv:2610.20335v1 Announce Type: new Abstract: Document understanding systems are typically evaluated as separate components via layout analysis, optical text recognition, reading-order prediction, a

Recall What Is Missing: Composing Evidence from Long-Term Agent Memory

arXiv:2610.15642v1 Announce Type: new Abstract: Under a limited context budget, a long-term agent must recall not merely memories that are individually relevant, but evidence that is collectively suff

agentsarxiv-cs-ai

Reels-RSI: Program-Level Self-Improvement for Code-Rendered Explainer Videos

arXiv:2610.14495v1 Announce Type: new Abstract: Explainer videos -- a worked geometry problem, why the sky is blue, how a dynasty fell -- are usually one more target for pixel video generation. We arg

Robust Real-Time Monocular Human Pose Estimation with Insole-Based Sensor Fusion

arXiv:2610.19494v1 Announce Type: new Abstract: Real-time monocular human pose estimation is an important sensing component for human-centered intelligent systems. While recent camera-based methods ha

SAM3RL: Memory Control via Reinforcement Learning for Visual Object Tracking

arXiv:2610.19931v1 Announce Type: new Abstract: Segment Anything Model 3 (SAM 3) is a foundation model for image and video segmentation that sets the state of the art in visual object tracking. Its tr

Self-Representation Alignment in Diffusion Models for Video Background Music Generation

arXiv:2610.15575v1 Announce Type: new Abstract: Diffusion models have been widely used for various generative tasks. However, recent studies have demonstrated that the internal representations learned

SMI: Ontology-Grounded Semantic IDs for Hierarchy-Aware Medical Concept Representation

arXiv:2610.18672v1 Announce Type: cross Abstract: Biomedical language models (LMs) provide strong representations for clinical tasks, but they often fail to capture the hierarchical structure among me

State Representation Shapes Long-Horizon Agent Learning and Transfer: An Empirical Study

arXiv:2610.15407v1 Announce Type: new Abstract: An end-to-end success rate alone cannot distinguish failure to learn an action from failure to apply it as task state changes. We study this distinction

Local Ai

STP-GUI: Spatially-Aware Token Pruning for Efficient Web-GUI Agents

arXiv:2610.20390v1 Announce Type: new Abstract: With the rapid development of vision-language models (VLMs), Web-GUI agents have achieved promising performance in interacting with real-world interface

local-aiarxiv-cs-cv

Text-Informed Training Data Filtering for Enhanced Virtual Flow Meter Performance

arXiv:2610.19860v1 Announce Type: cross Abstract: In sectors such as energy, aquaculture and chemical processing, the effectiveness of both mechanistic and data-driven models is frequently limited by

researcharxiv-cs-lg

The Anatomy of a Blind Spot: What an LLM Judge Must Be Shown, and How Much

arXiv:2610.15938v1 Announce Type: new Abstract: Evaluation of text generated by large language models (LLMs) is increasingly delegated to LLMs acting as judges, yet what such a judge must be shown rem

Today we’re releasing Muse Spark Open, the most capable US open-weight model to date. Built for coding and agentic work, it excels at long-h…

model-releasesyann-lecun--x

Today we’re releasing Muse Spark Open, the most capable US open-weight model to date. Built for coding and agentic work, it excels at long-horizon tasks, complex software engineering, and multi-step r

UltraBERT: Beyond the Limit of BERT Pre-Training

arXiv:2610.15028v1 Announce Type: cross Abstract: Recent bidirectional encoders have been modernized with innovations from causal large language models (LLMs). However, the pretraining recipe itself r

v0.40.5

model-releasesollama-releases

NVIDIA Nemotron 3.5 Super NVIDIA Nemotron 3.5 Super is a vision-language model for coding, reasoning, tool use, and document understanding. It pairs a 120B-parameter hybrid Mamba-2/Transformer mixture

VEDA: Generation of 3D Molecules via Variance-Exploding Diffusion with Annealing

arXiv:2511.09568v3 Announce Type: replace-cross Abstract: Diffusion models show promise for 3D molecular generation, but face a fundamental trade-off between sampling efficiency and conformational acc

VideoHarness-SRSI: Structured Recursive Self-Improvement for Video Understanding Harness

arXiv:2610.19424v1 Announce Type: new Abstract: LLM system capabilities depend not only on model parameters but also on the executable harnesses that organize information acquisition, tool use, reason

agentsarxiv-cs-cv

Tutorials

What Does LALM Post-training Learn? Rethinking Audio Understanding and Reasoning Capabilities

arXiv:2610.19476v1 Announce Type: cross Abstract: Post-training often improves the performance of large audio-language models on audio understanding and reasoning benchmarks. However, these improvemen

tutorialsarxiv-cs-cl

What makes NVIDIA Nemotron 3.5 Super VL different? → Text, image, document, and video understanding in one model → Reasoning and tool use wi…

model-releasestogether-ai--x

What makes NVIDIA Nemotron 3.5 Super VL different? → Text, image, document, and video understanding in one model → Reasoning and tool use with visual context preserved across steps → 120B hybrid MoE (

Why Do VLMs Fail at Remote Physiological Measurement? Rethinking with Physiological Grounding and Numerical Alignment

arXiv:2610.19052v1 Announce Type: new Abstract: Video-based remote physiological measurement (RPM) has broad applications, while Vision-Language Models (VLMs) provide a promising opportunity to enable

Why Generate a Click? Plug-in Decision Heads for Web Agents

arXiv:2610.20107v1 Announce Type: new Abstract: Web agents built on vision language models decide every action by generating text such as click(12), although most of that text encodes a choice among a

researcharxiv-cs-cl

Words to World: Benchmarking LLMs in Interactive Physical Environments

arXiv:2610.15228v1 Announce Type: new Abstract: Words are increasingly becoming an interface for action: large language models (LLMs) can now invoke tools, operate devices, and make decisions that aff