Search: “multimodal”

EAD-Net: Emotion-Aware Talking Head Generation with Spatial Refinement and Temporal Coherence

arXiv:2604.23325v1 Announce Type: cross Abstract: Emotionally talking head video generation aims to generate expressive portrait videos with accurate lip synchronization and emotional facial expressio

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Early Warning of Intraoperative Adverse Events via Transformer-Driven Multi-Label Learning

DGX agent

arXiv:2603.05212v2 Announce Type: replace-cross Abstract: Early warning of intraoperative adverse events plays a vital role in reducing surgical risk and improving patient safety. While deep learning

safetyarxiv-cs-ai

28 Apr 2026

FreqCache: Accelerating Embodied VLN Models with Adaptive Frequency-Guided Token Caching

arXiv:2604.24391v1 Announce Type: new Abstract: Vision-Language-Navigation (VLN) models exhibit excellent navigation accuracy but incur high computational overhead. Token caching has emerged as a prom

researcharxiv-cs-ro

From Pixels to Explanations: Interpretable Diabetic Retinopathy Grading with CNN-Transformer Ensembles, Visual Explainability and Vision-Language Models

arXiv:2604.23079v1 Announce Type: cross Abstract: The quality of diabetic retinopathy (DR) screening relies on the ability to correctly grade severity; however, many deep-learning (DL) classifiers can

Agents

From Static to Interactive: Authoring Interactive Visualizations via Natural Language

arXiv:2601.17736v2 Announce Type: replace-cross Abstract: Interactivity is crucial for effective data visualizations. However, it is often challenging to implement interactions for existing static vis

agentsarxiv-cs-ai

Local Ai

Got early access access to LingBot-World-Fast at 17 FPS! Here's what I found.

local-air-stablediffusion

LingBot-World-Fast successfully preserves the structural integrity and physical logic of the teacher model , achieving acceleration that introduces a necessary trade-off in theoretical upper-bound qua

Grounding Before Generalizing: How AI Differs from Humans in Causal Transfer

arXiv:2604.24062v1 Announce Type: new Abstract: Extracting abstract causal structures and applying them to novel situations is a hallmark of human intelligence. While Large Language Models (LLMs) and

Hardware-Efficient Softmax and Layer Normalization with Guaranteed Normalization for Edge Devices

arXiv:2604.23647v1 Announce Type: cross Abstract: In Transformer models, non-GEMM (non-General Matrix Multiplication) operations -- especially Softmax and Layer Normalization (LayerNorm) -- often domi

researcharxiv-cs-lg

HeadRouter: Dynamic Head-Weight Routing for Task-Adaptive Audio Token Pruning in Large Audio Language Models

arXiv:2604.23717v1 Announce Type: cross Abstract: Recent large audio language models (LALMs) demonstrate remarkable capabilities in processing extended multi-modal sequences, yet incur high inference

researcharxiv-cs-cl

In-Sync: Adaptation of Speech Aware Large Language Models for ASR with Word Level Timestamp Predictions

arXiv:2604.22817v1 Announce Type: cross Abstract: Recent advances in speech-aware language models have coupled strong acoustic encoders with large language models, enabling systems that move beyond tr

safetyarxiv-cs-cl

InCoM: Intent-Driven Perception and Structured Coordination for Mobile Manipulation

arXiv:2602.23024v2 Announce Type: replace Abstract: Mobile manipulation is a fundamental capability for general-purpose robotic agents, requiring both coordinated control of the mobile base and manipu

safetyarxiv-cs-ro

Intervention-Aware Multiscale Representation Learning from Imaging Phenomics and Perturbation Transcriptomics

arXiv:2604.22832v1 Announce Type: cross Abstract: Microscopy-based phenotypic profiling is scalable for drug discovery but lacks the mechanistic depth of transcriptomics, which remains costly and scar

Applications

IoT-Enhanced CNN-Based Labelled Crack Detection for Additive Manufacturing Image Annotation in Industry 4.0

arXiv:2604.22857v1 Announce Type: new Abstract: This paper presents an IoT-enhanced deep learning framework for automated crack detection in Additive Manufacturing (AM) surfaces using convolutional ne

applicationsarxiv-cs-cv

Jailbreaking Frontier Foundation Models Through Intention Deception

arXiv:2604.24082v1 Announce Type: cross Abstract: Large (vision-)language models exhibit remarkable capability but remain highly susceptible to jailbreaking. Existing safety training approaches aim to

Learning Under Low Illumination: A Dataset and Algorithm for Traffic Sign Recognition

arXiv:2511.17183v2 Announce Type: replace Abstract: Traffic signboards are vital for road safety and intelligent transportation systems, enabling navigation and autonomous driving. Yet, recognizing tr

Learning Under Moral Hazard with Instrumental Regression and Generalized Method of Moments

arXiv:2405.20642v3 Announce Type: replace Abstract: Machine learning has become increasingly popular in informing data-driven policy-making. Policies influence behavior in individuals or populations,

safetyarxiv-cs-lg

Less is More in Semantic Space: Intrinsic Decoupling via Clifford-M for Fundus Image Classification

arXiv:2603.20806v2 Announce Type: replace Abstract: Multi-label fundus diagnosis requires features that capture both fine-grained lesions and large-scale retinal structure. Many multi-scale medical vi

safetyarxiv-cs-cv

Light 'em Up: Enabling Few-Shot Low-Light 3D Gaussian Splatting with Multi-Scale Explicit Retinex Illumination Decoupling

arXiv:2604.24053v1 Announce Type: new Abstract: Full 360^irc novel view synthesis under low-light conditions remains challenging. Insufficient illumination, noise amplification, and view-dependent pho

researcharxiv-cs-cv

MegaScale-Data: Scaling Dataloader for Multisource Large Foundation Model Training

arXiv:2504.09844v4 Announce Type: replace-cross Abstract: Modern frameworks for training large foundation models (LFMs) employ dataloaders in a data-parallel manner, with each loader processing a disj

Multi-Plane HyperX: A Low-Latency and Cost-Effective Network for Large-Scale AI and HPC Systems

arXiv:2604.23519v1 Announce Type: cross Abstract: Multi-plane architectures have become increasingly prevalent in the Fat-Tree networks of AI data centers. By leveraging multiple ports on a single net

researcharxiv-cs-lg

Multivariate Gaussian NeRF for Wide Field-of-View Ultrasound Reconstruction

arXiv:2604.24187v1 Announce Type: new Abstract: Wide Field-of-View (WFoV) reconstruction enhances 3D ultrasound imaging by providing valuable anatomical context for segmentation models and visualizati

researcharxiv-cs-cv

Nemotron 3 Nano Omni is available locally on Ollama! This requires the latest Ollama 0.22 release.

Nemotron 3 Nano Omni is available locally on Ollama! This requires the latest Ollama 0.22 release. Meet Nemotron 3 Nano Omni 👋 Our latest addition to the Nemotron family is the highest efficiency, ope

model-releasesollama--x

NeuroClaw Technical Report

arXiv:2604.24696v1 Announce Type: new Abstract: Agentic artificial intelligence systems promise to accelerate scientific workflows, but neuroimaging poses unique challenges: heterogeneous modalities (

'Noisier' Noise Contrastive Eestimation is (Almost) Maximum Likelihood

arXiv:2405.16730v2 Announce Type: replace-cross Abstract: Noise Contrastive Estimation (NCE) has fueled major breakthroughs in representation learning and generative modeling. Yet a long-standing chal

NVIDIA Launches Nemotron 3 Nano Omni Model, Unifying Vision, Audio and Language for up to 9x More Efficient AI Agents

model-releasesnvidia-blog

AI agent systems today juggle separate models for vision, speech and language — losing time and context as they pass data from one model to the other. Unveiled today, NVIDIA Nemotron 3 Nano Omni is an

On the Complementarity of Quantum and Classical Features: Adaptive Hybrid Quantum-Classical Feature Fusion for Breast Cancer Classification

arXiv:2604.22903v1 Announce Type: cross Abstract: The integration of quantum machine learning with classical deep learning offers promising avenues for medical image analysis by mapping data into high

Orthogonal Representation Learning for Estimating Causal Quantities

arXiv:2502.04274v4 Announce Type: replace Abstract: End-to-end representation learning has become a powerful tool for estimating causal quantities from high-dimensional observational data, but its eff

safetyarxiv-cs-lg

Partition-of-Unity Gaussian Kolmogorov-Arnold Networks

arXiv:2604.23599v1 Announce Type: cross Abstract: Gaussian basis functions provide an efficient and flexible alternative to spline activations in KANs. In this work, we introduce the partition-of-unit

Robust Audio-Text Retrieval via Cross-Modal Attention and Hybrid Loss

model-releasesarxiv-cs-cl

arXiv:2604.23323v1 Announce Type: new Abstract: Audio-text retrieval enables semantic alignment between audio content and natural language queries, supporting applications in multimedia search, access

Applications

Scalable LLM-based Coding of Dialogue in Healthcare Simulation: Balancing Coding Performance, Processing Time, and Environmental Impact

arXiv:2604.23255v1 Announce Type: cross Abstract: Research shows that dialogue, the interactive process through which participants articulate their thinking, plays a central role in constructing share

applicationsarxiv-cs-ai

See Further, Think Deeper: Advancing VLM's Reasoning Ability with Low-level Visual Cues and Reflection

arXiv:2604.24339v1 Announce Type: cross Abstract: Recent advances in Vision-Language Models (VLMs) have benefited from Reinforcement Learning (RL) for enhanced reasoning. However, existing methods sti

Hardware

Self-Rewarding Vision-Language Model via Reasoning Decomposition

arXiv:2508.19652v2 Announce Type: replace Abstract: Vision-Language Models (VLMs) often suffer from visual hallucinations: generating things that are not consistent with visual inputs and language sho

hardwarearxiv-cs-cv

Tutorials

SMoES: Soft Modality-Guided Expert Specialization in MoE-VLMs

arXiv:2604.23996v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) has become a prevalent backbone for large vision-language models (VLMs), yet how modality-specific signals should guide expert

tutorialsarxiv-cs-cv

SoccerRef-Agents: Multi-Agent System for Automated Soccer Refereeing

arXiv:2604.23392v1 Announce Type: new Abstract: Refereeing is vital in sports, where fair, accurate, and explainable decisions are fundamental. While intelligent assistant technologies are being widel

Structural Pruning of Large Vision Language Models: A Comprehensive Study on Pruning Dynamics, Recovery, and Data Efficiency

model-releasesarxiv-cs-cl

arXiv:2604.24380v1 Announce Type: new Abstract: While Large Vision Language Models (LVLMs) demonstrate impressive capabilities, their substantial computational and memory requirements pose deployment

Towards Holistic Evaluation of Large Audio-Language Models: A Comprehensive Survey

arXiv:2505.15957v4 Announce Type: replace-cross Abstract: With advancements in large audio-language models (LALMs), which enhance large language models (LLMs) with auditory capabilities, these models

V-SEAM: Visual Semantic Editing and Attention Modulating for Causal Interpretability of Vision-Language Models

model-releasesarxiv-cs-cl

arXiv:2509.14837v2 Announce Type: replace Abstract: Recent advances in causal interpretability have extended from language models to vision-language models (VLMs), seeking to reveal their internal mec

VAPO: End-to-end Slide-Enhanced Speech Recognition with Omni-modal Large Language Models

arXiv:2510.08618v2 Announce Type: replace-cross Abstract: Omni-modal large language models (OLLMs) offer a promising end-to-end solution for slide-enhanced speech recognition due to their inherent mul

Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines

arXiv:2604.23001v1 Announce Type: cross Abstract: Despite remarkable progress in Vision--Language--Action (VLA) models, a central bottleneck remains underexamined: the data infrastructure that underli

Vision-Language-Action Safety: Threats, Challenges, Evaluations, and Mechanisms

arXiv:2604.23775v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models are emerging as a unified substrate for embodied intelligence. This shift raises a new class of safety challenges, s

safetyarxiv-cs-ro

Tutorials

ZID-Net: Zero-Inference Diffusion Prior Decoupling Network for Single Image Dehazing

arXiv:2604.23709v1 Announce Type: new Abstract: Single image dehazing is often constrained by a trade-off between restoration quality and computational efficiency. While efficient, CNN networks strugg

tutorialsarxiv-cs-cv

A systematic review of generative AI usage for IT project management

arXiv:2604.21958v1 Announce Type: cross Abstract: This paper aims to synthesize current knowledge on generative AI in IT project management using the PRISMA methodology to provide researchers with a c

An Integrated Framework for Explainable, Fair, and Observable Hospital Readmission Prediction: Development and Validation on MIMIC-IV

arXiv:2604.22535v1 Announce Type: new Abstract: Objective: To propose and retrospectively validate an integrated framework addressing three barriers to clinical translation of readmission prediction:

safetyarxiv-cs-lg

Applications

An Interdisciplinary and Cross-Task Review on Missing Data Imputation

arXiv:2511.01196v3 Announce Type: replace-cross Abstract: Missing data is a fundamental challenge in data science, significantly hindering analysis and decision-making across a wide range of disciplin

applicationsarxiv-cs-ai

Are Video Models Emerging as Zero-Shot Learners and Reasoners in Medical Imaging?

arXiv:2510.10254v2 Announce Type: replace Abstract: Recent advances in large generative models have shown that simple autoregressive formulations, when scaled appropriately, can exhibit strong zero-sh

researcharxiv-cs-cv

ChangeQuery: Advancing Remote Sensing Change Analysis for Natural and Human-Induced Disasters from Visual Detection to Semantic Understanding

arXiv:2604.22333v1 Announce Type: cross Abstract: Rapid situational awareness is critical in post-disaster response. While remote sensing damage assessment is evolving from pixel-level change detectio

CharTide: Data-Centric Chart-to-Code Generation via Tri-Perspective Tuning and Inquiry-Driven Evolution

arXiv:2604.22192v1 Announce Type: new Abstract: Chart-to-code generation demands strict visual precision and syntactic correctness from Vision-Language Models (VLMs). However, existing approaches are

Foundation models for discovering robust biomarkers of neurological disorders from dynamic functional connectivity

arXiv:2604.22018v1 Announce Type: cross Abstract: Several brain foundation models (FM) have recently been proposed to predict brain disorders by modelling dynamic functional connectivity (FC). While t