Search: “multimodal”

Mixture of Experts for Recognizing Depression from Interview and Reading Tasks

arXiv:2502.20213v2 Announce Type: replace Abstract: Depression is a mental disorder and can cause a variety of symptoms, including psychological, physical, and social. Speech has been proved an object

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

MOTOR-Bench: A Real-world Dataset and Multi-agent Framework for Zero-shot Human Mental State Understanding

DGX agent

arXiv:2605.09703v1 Announce Type: new Abstract: Understanding human mental states from natural behavior is crucial for intelligent systems in the real world. However, most current research focuses on

model-releasesarxiv-cs-cv

12 May 2026

Nested Slice Sampling: Vectorized Nested Sampling for GPU-Accelerated Inference

model-releasesarxiv-cs-lg

arXiv:2601.23252v2 Announce Type: replace-cross Abstract: Model comparison and calibrated uncertainty quantification often require integrating over parameters, but scalable inference can be challengin

PrimeKG-CL: A Continual Graph Learning Benchmark on Evolving Biomedical Knowledge Graphs

model-releasesarxiv-cs-ai

arXiv:2605.10529v1 Announce Type: new Abstract: Biomedical knowledge graphs underwrite drug repurposing and clinical decision support, yet the upstream ontologies they depend on update on independent

Qwen-Image-2.0 Technical Report

arXiv:2605.10730v1 Announce Type: new Abstract: We present Qwen-Image-2.0, an omni-capable image generation foundation model that unifies high-fidelity generation and precise image editing within a si

SAR-RAG: ATR Visual Question Answering by Semantic Search, Retrieval, and MLLM Generation

arXiv:2602.04712v2 Announce Type: replace-cross Abstract: We present a visual-context image-retrieval-augmented generation (ImageRAG)- assisted AI agent for automatic target recognition (ATR) of synth

agentsarxiv-cs-ai

SayNext-Bench: Why Do LLMs Struggle with Next-Utterance Anticipation?

model-releasesarxiv-cs-ai

arXiv:2602.00327v2 Announce Type: replace Abstract: We explore the use of large language models (LLMs) for next-utterance anticipation in human dialogue. Despite recent advances in LLMs demonstrating

VECTOR-Drive: Tightly Coupled Vision-Language and Trajectory Expert Routing for End-to-End Autonomous Driving

arXiv:2605.08830v1 Announce Type: cross Abstract: End-to-end autonomous driving requires models to understand traffic scenes, infer driving intent, and generate executable motion plans. Recent vision-

agentsarxiv-cs-ai

Bayesian Conformal Prediction as a Decision Risk Problem

arXiv:2602.03331v2 Announce Type: replace Abstract: We propose Bayesian Conformal Prediction (BCP), a framework that combines Bayesian posterior predictive distributions with PAC-style conformal risk

ChartREG++: Towards Benchmarking and Improving Chart Referring Expression Grounding under Diverse referring clues and Multi-Target Referring

model-releasesarxiv-cs-cl

arXiv:2605.07415v1 Announce Type: cross Abstract: Referring expression grounding is a core problem in visual grounding and is widely used as a diagnostic of spatial grounding and reasoning in vision a

Fine-tuning a vision-language model for fracture-surface morphology recognition

arXiv:2605.07145v1 Announce Type: cross Abstract: Vision-language models (VLMs) have shown strong potential for scientific image understanding, but general-purpose models often lack the domain-specifi

From Standalone LLMs to Integrated Intelligence: A Survey of Compound Al Systems

arXiv:2506.04565v2 Announce Type: replace-cross Abstract: Compound AI Systems (CAIS) are an emerging paradigm that integrates large language models (LLMs) with external components, including retriever

researcharxiv-cs-cl

GRAPE: Let GRPO Supervise Query Rewriting by Ranking for Retrieval

arXiv:2509.23370v2 Announce Type: replace Abstract: The CLIP model has established itself as a cornerstone of large-scale retrieval systems. However, its performance often degrades under distributiona

InterCoG: Towards Spatially Precise Image Editing with Interleaved Chain-of-Grounding Reasoning

arXiv:2603.01586v3 Announce Type: replace Abstract: Emerging unified editing models have demonstrated strong capabilities in general object editing tasks. However, it remains a significant challenge t

PRPO: Paragraph-level Policy Optimization for Vision-Language Deepfake Detection

arXiv:2509.26272v3 Announce Type: replace Abstract: The rapid rise of synthetic media has made deepfake detection a critical challenge for online safety and trust. Progress remains constrained by the

BOOOM: Loss-Function-Agnostic Black-Box Optimization over Orthonormal Manifolds for Machine Learning and Statistical Inference

arXiv:2605.04087v1 Announce Type: cross Abstract: Optimization over the Stiefel manifold St(p,d), the set of p imes d column-orthonormal matrices, is fundamental in statistics, machine learning, and s

7 May 2026

Gemini 3.1 Flash-Lite is now generally available on Gemini Enterprise

model-releasesgoogle-cloud-ai

Today, we’re thrilled to announce that Gemini 3.1 Flash-Lite, our fastest and most cost-efficient Gemini 3 series model yet, is now generally available. Designed for ultra-low latency, high-volume tas

7 May 2026

Audio-Visual Intelligence in Large Foundation Models

arXiv:2605.04045v1 Announce Type: new Abstract: Audio-Visual Intelligence (AVI) has emerged as a central frontier in artificial intelligence, bridging auditory and visual modalities to enable machines

Context- and Pixel-aware Large Language Model for Video Quality Assessment

arXiv:2505.16025v3 Announce Type: replace Abstract: Video quality assessment (VQA) is a challenging research topic with broad applications. Traditional hand-crafted and discriminative learning-based V

researcharxiv-cs-cv

DiagramNet: An End-to-End Recognition Framework and Dataset for Non-Standard System-Level Diagrams

model-releasesarxiv-cs-ai

arXiv:2605.01338v1 Announce Type: new Abstract: System-level diagrams encode the architectural blueprint of chip design, specifying module functions, dataflows, and interface protocols. However, non-s

Safety in Embodied AI: A Survey of Risks, Attacks, and Defenses

arXiv:2605.02900v1 Announce Type: cross Abstract: Embodied Artificial Intelligence (Embodied AI) integrates perception, cognition, planning, and interaction into agents that operate in open-world, saf

Applications

A Comprehensive Review of Fish Feeding Behavior Analysis in Aquaculture: Tasks, Techniques, and Applications

arXiv:2502.15311v3 Announce Type: replace Abstract: Fish feeding behavior analysis is a key foundation for intelligent feeding and precision aquaculture management, and plays an important role in impr

applicationsarxiv-cs-cv

Cloud Engineer’s AI Toolkit: Sign up Now for a Developer Workshop Near You!

model-releasesgoogle-cloud-ai

The world of AI is rapidly shifting from experimental Large Language Models to an era of Agentic AI. In the agentic era, autonomous software agents act on behalf of employees and consumers—driving a f

HeteroRAG: A Heterogeneous Retrieval-Augmented Generation Framework for Medical Vision Language Tasks

arXiv:2508.12778v2 Announce Type: replace Abstract: Medical large vision-language Models (Med-LVLMs) have shown promise in clinical applications but suffer from factual inaccuracies and unreliable out

safetyarxiv-cs-cl

MedMosaic: A Challenging Large Scale Benchmark of Diverse Medical Audio

model-releasesarxiv-cs-cl

arXiv:2605.00969v1 Announce Type: cross Abstract: We present MedMosaic, a medical audio question-answering dataset designed to benchmark language and audio reasoning models under realistic clinical co

OphMAE: Bridging Volumetric and Planar Imaging with a Foundation Model for Adaptive Ophthalmological Diagnosis

arXiv:2605.02714v1 Announce Type: new Abstract: The advent of foundation models has heralded a new era in medical artificial intelligence (AI), enabling the extraction of generalizable representations

Physiology-Aware Masked Cross-Modal Reconstruction for Biosignal Representation Learning

arXiv:2605.00973v1 Announce Type: new Abstract: Biosignals acquired from different locations on the body often provide temporally ordered views of the same underlying physiological process. However, m

SurgTEMP: Temporal-Aware Surgical Video Question Answering with Text-guided Visual Memory for Laparoscopic Cholecystectomy

arXiv:2603.29962v3 Announce Type: replace Abstract: Surgical procedures are inherently complex and risky, requiring extensive expertise and constant focus to navigate evolving intraoperative scenes. C

The Geometric Mechanics of Contrastive Representation Learning: Alignment Potentials, Entropic Dispersion, and Cross-modal Divergence

arXiv:2601.19597v3 Announce Type: replace Abstract: While InfoNCE underlies modern contrastive learning, its geometric mechanisms remain under-characterized beyond the canonical alignment--uniformity

safetyarxiv-cs-lg

Towards Visual Query Localization in the 3D World

arXiv:2605.01498v1 Announce Type: new Abstract: Visual query localization (VQL) aims to predict the spatio-temporal response of the most recent occurrence in a sequence given a query. Currently, most

Understanding the Performance Plateau in Text-to-Video Retrieval: A Comprehensive Empirical and Linguistic Analysis

arXiv:2605.00826v1 Announce Type: cross Abstract: Text-to-video retrieval enables users to find relevant video content using natural language queries, a task that has grown increasingly important with

Generating Statistical Charts with Validation-Driven LLM Workflows

arXiv:2605.00800v1 Announce Type: new Abstract: Generating diverse, readable statistical charts from tabular data remains challenging for LLMs, as many failures become apparent after rendering and are

4 May 2026

Let ViT Speak: Generative Language-Image Pre-training

arXiv:2605.00809v1 Announce Type: new Abstract: In this paper, we present extbf{Gen}erative extbf{L}anguage-extbf{I}mage extbf{P}re-training (GenLIP), a minimalist generative pretraining framework for

researcharxiv-cs-cv

4 May 2026

AEGIS: A Holistic Benchmark for Evaluating Forensic Analysis of AI-Generated Academic Images

arXiv:2604.28177v1 Announce Type: new Abstract: We introduce AEGIS, A holistic benchmark for Evaluating forensic analysis of AI-Generated academic ImageS. Compared to existing benchmarks, AEGIS featur

AI Models for Depressive Disorder Detection and Diagnosis: A Review

arXiv:2508.12022v2 Announce Type: replace Abstract: Major Depressive Disorder is one of the leading causes of disability worldwide, yet its diagnosis still depends largely on subjective clinical asses

safetyarxiv-cs-ai

Applications

Context as Prior: Bayesian-Inspired Intent Inference for Non-Speaking Agents with a Household Cat Testbed

arXiv:2604.27445v1 Announce Type: new Abstract: Many agents in real-world environments cannot reliably communicate their goals through language, including household pets, pre-verbal infants, and other

applicationsarxiv-cs-cv

Decoding Scientific Experimental Images: The SPUR Benchmark for Perception, Understanding, and Reasoning

arXiv:2604.27604v1 Announce Type: new Abstract: We introduce SPUR, a comprehensive benchmark for scientific experimental image perception, understanding, and reasoning, comprising 4,264 question-answe

Imitation Game for Adversarial Disillusion with Chain-of-Thought Reasoning in Generative AI

arXiv:2501.19143v2 Announce Type: replace Abstract: As the cornerstone of artificial intelligence, machine perception confronts a fundamental threat posed by adversarial illusions. These adversarial a

agentsarxiv-cs-ai

MotuBrain: An Advanced World Action Model for Robot Control

arXiv:2604.27792v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models achieve strong semantic generalization but often lack fine-grained modeling of world dynamics. Recent work explores

safetyarxiv-cs-ro

Simulating Infant First-Person Sensorimotor Experience via Motion Retargeting from Babies to Humanoids

arXiv:2604.27583v1 Announce Type: cross Abstract: Motion retargeting from humans to human-like artificial agents is becoming increasingly important as humanoid robots grow more capable. However, most

researcharxiv-cs-ro

DenseStep2M: A Scalable, Training-Free Pipeline for Dense Instructional Video Annotation

arXiv:2604.26565v1 Announce Type: new Abstract: Long-term video understanding requires interpreting complex temporal events and reasoning over procedural activities. While instructional video corpora,

Electricity price forecasting across Norway's five bidding zones in the post-crisis era

model-releasesarxiv-cs-lg

arXiv:2604.26634v1 Announce Type: new Abstract: Norway's electricity market is heavily dominated by hydropower, but the 2021--2022 energy crisis and stronger integration with Continental Europe have f

Perception Test 2025: Challenge Summary and a Unified VQA Extension

arXiv:2601.06287v2 Announce Type: replace Abstract: The Third Perception Test challenge was organised as a full-day workshop alongside the IEEE/CVF International Conference on Computer Vision (ICCV) 2

Topology-Aware Representation Alignment for Semi-Supervised Vision-Language Learning

arXiv:2604.26370v1 Announce Type: new Abstract: Vision-language models have shown strong performance, but they often generalize poorly to specialized domains. While semi-supervised vision-language lea

Agentic AI for Remote Sensing: Technical Challenges and Research Directions

arXiv:2604.24919v1 Announce Type: new Abstract: Earth Observation (EO) is moving beyond static prediction toward multi-step analytical workflows that require coordinated reasoning over data, tools, an

agentsarxiv-cs-cv

An analysis of sensor selection for fruit picking with suction-based grippers

arXiv:2604.24906v1 Announce Type: cross Abstract: Robotic fruit harvesting often fails to reliably detect whether a fruit has been successfully picked, limiting efficiency and increasing crop damage.

BEVal: A Cross-dataset Evaluation Study of BEV Segmentation Models for Autonomous Driving

arXiv:2408.16322v4 Announce Type: replace Abstract: Current research in semantic bird's-eye view segmentation for autonomous driving focuses solely on optimizing neural network models using a single d

agentsarxiv-cs-cv

Calibrated Fusion for Heterogeneous Graph-Vector Retrieval in Multi-Hop QA

arXiv:2603.28886v2 Announce Type: replace-cross Abstract: Graph-augmented retrieval combines dense similarity with graph-based relevance signals such as Personalized PageRank (PPR), but these scores h