Search: “multimodal”

TwelveLabs Marengo Embed 3.0 is now generally available as an embedding model in Amazon Bedrock Knowledge Bases, bringing fully managed natural language search to video, image, and audio content. This

tutorialsaws-ml-blog

10 Sept 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Video-MOPD: Multi-Teacher On-Policy Distillation for Video Understanding

DGX agent

arXiv:2609.09300v1 Announce Type: new Abstract: Video understanding demands a convergence of complementary capabilities across perception, temporal understanding, and complex reasoning, which are diff

safetyarxiv-cs-cv

10 Sept 2026

xDailyBench: Benchmarking LLMs on Professional Consultation for Real-Life Problems

model-releasesarxiv-cs-ai

arXiv:2609.07784v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for everyday assistance, yet existing benchmarks only partially reflect the requests users naturally

10 Sept 2026

A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalities

arXiv:2609.05503v1 Announce Type: new Abstract: Diffusion models have become the dominant family of generative models in the visual domain. However, their widespread public availability enables misuse

Agents

A Two-Stage Framework for Ego-Centric Key Object Identification via Object State Prediction

arXiv:2609.07125v1 Announce Type: new Abstract: This paper presents a novel framework designed to enhance key object identification in autonomous driving. Existing methods primarily focus on either de

agentsarxiv-cs-cv

Ambient @ EgoProactive 2026 : Proactive Egocentric Assistance with Visually Grounded Supervision

arXiv:2609.07099v1 Announce Type: new Abstract: We present our submission to the EgoProactive track of the ECCV 2026 Wearable AI Challenge, which ranked first in the large-model division and second in

An overview of 3D Vision-Language Models

arXiv:2609.05583v1 Announce Type: new Abstract: Vision-Language Models (VLMs) are reshaping computer vision by aligning visual and textual embeddings, allowing models to recognize visual concepts and

Applications

AtomicVLA: Unlocking the Potential of Atomic Skill Learning in Robots

arXiv:2603.07648v2 Announce Type: replace-cross Abstract: Recent advances in Visual-Language-Action (VLA) models have shown promising potential for robotic manipulation tasks. However, real-world robo

applicationsarxiv-cs-cv

Attention-Enhanced Deep Features with Heterogeneous Ensemble Learning for Glaucoma Detection

arXiv:2609.06699v1 Announce Type: new Abstract: Glaucoma is a progressive optic neuropathy characterized by irreversible damage to the optic nerve, making timely diagnosis critical to prevent permanen

Local Ai

BlueprintAgent: Constraint-Triggered Targeted Revisits for Simulation-Ready Generation from Scanned Structural Blueprints

arXiv:2609.07362v1 Announce Type: cross Abstract: Converting in-service reinforced-concrete (RC) building blueprints into simulation-ready models---structured frame representations that support determ

local-aiarxiv-cs-cv

Companion-style QA Assistance in Ego-Vision

arXiv:2609.06721v1 Announce Type: new Abstract: AI companions are envisioned as always-on assistants that support users in daily life. With this regard, we introduce BuddyVQA, a benchmark for companio

Tutorials

Comparative Study of Anatomical and Learned Features in AI Models for Structural Brain MRI

arXiv:2609.06807v1 Announce Type: new Abstract: In this work, we comprehensively evaluate three popular feature-extraction paradigms in AI-based neuroimaging modeling: (1) computation of anatomical su

tutorialsarxiv-cs-cv

Concentrate After Imagination: Text-Conditioned Evidence Grounding for Partially Relevant Video Retrieval

arXiv:2609.08999v1 Announce Type: new Abstract: Partially Relevant Video Retrieval (PRVR) retrieves untrimmed videos when queries describe only short moments. Although recent methods improve local rep

ContextFlow: In-Context Flow Matching for Robot Manipulation

arXiv:2609.06852v1 Announce Type: new Abstract: Although highly effective in vision and language domains, applying in-context learning to robotics remains challenging. Existing autoregressive in-conte

researcharxiv-cs-ro

Continuous Token-Level Spatio-Temporal Context Modeling for Visual Object Tracking

arXiv:2609.07070v1 Announce Type: new Abstract: Spatio-temporal context has become increasingly crucial for visual tracking. However, most existing approaches extract spatio-temporal cues via discrete

Contrastive Knowledge Distillation for Anomaly Detection in Multi-Illumination/Focus Display Images

arXiv:2609.05520v1 Announce Type: new Abstract: In this paper, we tackle automatic anomaly detection in multi-illumination and multi-focus display images. The minute defects on the display surface are

DIVA: Exploiting Cross-Step Conditional Propagation for Visual Jailbreaks in Discrete Diffusion Vision-Language Models

arXiv:2609.05525v1 Announce Type: new Abstract: Large vision-language models (VLMs) are increasingly deployed in safety-critical settings, yet existing visual jailbreak research has focused almost exc

Facial Age Estimation for Age Fraud Detection in National ID Systems

arXiv:2609.05638v1 Announce Type: new Abstract: Identity fraud during biometric enrollment and updates remains a major challenge for large-scale national identity systems. A common fraud vector is mis

Federated Binary Gating with Server-Side Vision-Language Inference for Surveillance Anomaly Classification

arXiv:2609.07403v1 Announce Type: new Abstract: Privacy-sensitive surveillance systems could benefit from large vision-language models (VLMs), but such models typically require centralized access to r

HB-PVI: A Hierarchical Bayesian Personalization and Value-of-Information Framework for Complex Activity Recognition

arXiv:2609.05582v1 Announce Type: new Abstract: Personalization can improve activity-recognition performance, but participant-specific gains are heterogeneous, and every additional calibration label h

safetyarxiv-cs-lg

Agents

Hi-FLoop: Hierarchical State-Feedback Loops for Multi-Timescale World Modeling

arXiv:2609.08796v1 Announce Type: new Abstract: Multi-agent traffic simulation seeks diverse, coordinated, and physically realistic futures from maps and observed history. Long-horizon closed-loop gen

agentsarxiv-cs-cv

Infrastructure-based Monocular 3D Vehicle Localization Framework with Experimental Validation

arXiv:2609.05523v1 Announce Type: new Abstract: This paper presents a one-stage learning framework that maps monocular roadside-camera images directly to vehicle states in a ground-fixed coordinate fr

Knowing When Not to Answer: Abstention and Refusal Reasoning in Vision--Language Models

arXiv:2609.05540v1 Announce Type: new Abstract: Many medical conditions require diagnosis through detailed, multi-context clinical assessment rather than from visual appearance alone. Despite this, vi

MARS-CLIP: Multi-Resolution and Attention Refined Zero-Shot Image Segmentation

arXiv:2609.08283v1 Announce Type: new Abstract: Contrastive Language-Image Pre-training (CLIP) has demonstrated impressive capabilities in zero-shot transfer but often struggles with dense prediction

MCANet: A Multi-Scale Class-Specific Attention Network for Multi-Label Post-Hurricane Damage Assessment Using UAV Imagery

arXiv:2509.04757v2 Announce Type: replace Abstract: Hurricanes cause widespread damage to buildings, roads, and other infrastructure, making timely post-disaster damage assessment critical for emergen

Observing Health Outcomes Using Remote Sensing Imagery and Geo-Context Guided Visual Transformer

arXiv:2602.00110v2 Announce Type: replace Abstract: Visual transformers have driven major progress in remote sensing image analysis, particularly in object detection and segmentation. Recent vision-la

ProtoRAG: Prototype-Based Retrieval Augmentation for Few-Shot Fine-Grained Remote Sensing Object Detection

arXiv:2609.05953v1 Announce Type: new Abstract: Few-shot fine-grained object detection (FGOD) in remote sensing imagery is challenging because limited annotations must support both object localization

REVA-PO: Stabilizing Reinforcement Learning for Chest X-ray Report Generation

arXiv:2607.10147v2 Announce Type: replace Abstract: Automated chest X-ray report generation has recently benefited from reinforcement learning (RL) and large language models. However, RL training ofte

Self-Supervised Multi-View 3D Gaze Target Estimation via Probabilistic Ray Marching

arXiv:2609.07415v1 Announce Type: new Abstract: We present a self-supervised approach, Self-MVGTE, for estimating 3D gaze targets from multiple camera views. Unlike existing methods that independently

SimpleMemVLA: A Simple but Effective Native-Video Memory for Vision-Language-Action Models

arXiv:2609.05533v1 Announce Type: new Abstract: Long-horizon manipulation is partially observable: the information needed to choose the next action may appear only in observations from minutes earlier

SoftRerank: Hierarchical Soft Fusion with Candidate-Label Reranking for Long-Tailed Micro-Action Recognition

arXiv:2609.08221v1 Announce Type: new Abstract: Micro-actions are subtle, low-intensity non-verbal behaviors that provide cues to fine-grained human states, including emotions and intentions. Recogniz

Solution for UCF UrbanTwin LUMPI Track: Sim-to-Real Urban LiDAR 3D Object Detection

arXiv:2609.07590v1 Announce Type: new Abstract: We present our solution to the LUMPI track of the UCF UrbanTwin Sim2Real LiDAR Challenge at the 6th DriveX Workshop, ECCV 2026. The detector must be tra

SynthRCT: Scalable Conditional Deformation Synthesis for Synthetic Repeat CT Generation

arXiv:2609.08627v1 Announce Type: new Abstract: In proton therapy, plans are typically optimized on a single planning CT, making robustness evaluation essential under anatomical changes. However, curr

Time-Aware Assistive Navigation

arXiv:2609.05596v1 Announce Type: new Abstract: Can interactive vision-and-language agents learn not just what to say but also extbf{extit{when}} to say it? Current language models rarely plan over wh

Applications

Toward Robust Single-Photon Perception for Robots: A Condition-Aware Active Learning Approach

arXiv:2505.04376v2 Announce Type: replace-cross Abstract: LiDAR-based perception plays a fundamental role in modern robotic systems for environment understanding and navigation. Single-photon LiDAR (S

applicationsarxiv-cs-cv

Unexplored flaws in multiple-choice VQA make benchmarking unreliable

arXiv:2511.22341v2 Announce Type: replace Abstract: Previous works identify sensitivity to option order as a key issue in multiple-choice VQA (MC-VQA) evaluation and propose protocols to mitigate this

Uni-Inter: Unifying 3D Human Motion Synthesis Across Diverse Interaction Contexts

arXiv:2511.13032v2 Announce Type: replace Abstract: We present Uni-Inter, a unified framework for human motion generation that supports a wide range of interaction scenarios: including human-human, hu

Unified Vision-Centric Pedestrian Crossing Action Prediction via Adaptive Patch Projection and Proactive Spatial Rectification

arXiv:2609.07420v1 Announce Type: new Abstract: Vision cues are available and informative for pedestrian action prediction, but obtaining stable target-centric representations from video frames remain

Visual Search Augmented Chain-of-Thought Reasoning for Attribute Value Extraction from Product Videos

arXiv:2609.06410v1 Announce Type: cross Abstract: Existing approaches to visual attribute value extraction (AVE) primarily rely on static product images, failing to capture temporal cues, multi-angle

WeaveLA: Event Driven Cross-Subtask Latent Memory Weaving for Repetitive Robot Manipulation

arXiv:2606.17463v2 Announce Type: replace Abstract: Vision-Language-Action (VLA) policies have achieved remarkable single-step manipulation, yet they remain brittle precisely where each stage depends

What Are You Doing? A Closer Look at Controllable Human Video Generation

arXiv:2503.04666v2 Announce Type: replace Abstract: High-quality benchmarks are crucial for driving progress in machine learning research. However, despite the growing interest in video generation, th

I reduced image-processing token usage by ~95% compared with GPT-4o direct vision, while maintaining roughly the same accuracy.How significant is that?[P]

model-releasesr-machinelearning

I'm testing a new approach for reducing the cost of image-based LLM inference. I evaluated it on the MOMA Graph benchmark, using 1,315 questions. Compared with using GPT-4o to process the original ima

8 Sept 2026

inclusionAI/Ling-3.0-flash-VL · Hugging Face

model-releasesr-localllama

Ling-3.0-flash-VL inherits the language, reasoning, and long-context capabilities of Ling-3.0-flash, while extending them with native image and video understanding. The model has 124B total parameters

8 Sept 2026

Jensen Huang says that AGI has been achieved. I strongly disagree. GPT-6 performs really well on benchmarks, including ARC-AGI-3. But benchm…

model-releasesgary-marcus--x

Jensen Huang says that AGI has been achieved. I strongly disagree. GPT-6 performs really well on benchmarks, including ARC-AGI-3. But benchmark performance is not the same as general intelligence. GPT

7 Sept 2026

VISTA: Dense Multi-Label Classroom Coding with Vision-Language Models

arXiv:2609.04550v1 Announce Type: new Abstract: Video-language benchmarks are usually constructed by the dataset authors without published reliability statistics, leaving the noise floor of the constr

7 Sept 2026

Agents

A Case Study on Emergent Cheating and Whistleblowing in Autonomous Research Swarms

arXiv:2609.04170v1 Announce Type: new Abstract: Multi-agent AI science ecosystems rely on agents possessing tools that allow them to communicate, coordinate, and build on each other's work. Yet this s

agentsarxiv-cs-ai

4 Sept 2026

Analysis of Prompt Engineering for Drug Toxicity Prediction

arXiv:2609.03635v1 Announce Type: new Abstract: Clinical trials in the UK can cost up to {pounds}1.3 million, with approximately 90% drug failure rate. Toxicity is a major contributing factor in drug

researcharxiv-cs-ai

4 Sept 2026

Continuous Actions from Discrete Minds: Latent-Aligned Planning for End-to-End Autonomous Driving

arXiv:2609.04070v1 Announce Type: new Abstract: Bridging the gap between the discrete reasoning of Vision-Language Models and the continuous, physics-constrained nature of autonomous driving remains a