Search: “multimodal”

rPPG-VQA: A Video Quality Assessment Framework for Unsupervised rPPG Training

arXiv:2604.11156v1 Announce Type: new Abstract: Unsupervised remote photoplethysmography (rPPG) promises to leverage unlabeled video data, but its potential is hindered by a critical challenge: traini

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Semantic Segmentation Algorithm Based on Light Field and LiDAR Fusion

DGX agent

arXiv:2510.06687v2 Announce Type: replace-cross Abstract: Semantic segmentation serves as a cornerstone of scene understanding in autonomous driving but continues to face significant challenges under

agentsarxiv-cs-ai

14 Apr 2026

Specificity-aware reinforcement learning for fine-grained open-world classification

arXiv:2603.03197v3 Announce Type: replace Abstract: Classifying fine-grained visual concepts under open-world settings, i.e., without a predefined label set, demands models to be both accurate and spe

tutorialsarxiv-cs-cv

SpeechLess: Micro-utterance with Personalized Spatial Memory-aware Assistant in Everyday Augmented Reality

arXiv:2602.00793v2 Announce Type: replace-cross Abstract: Speaking aloud to a wearable AR assistant in public can be socially awkward, and re-articulating the same requests every day creates unnecessa

researcharxiv-cs-cl

Structural Gating and Effect-aligned Lag-resolved Temporal Causal Discovery Framework with Application to Heat-Pollution Extremes

arXiv:2604.10371v1 Announce Type: new Abstract: This study proposes Structural Gating and Effect-aligned Discovery for Temporal Causal Discovery (SGED-TCD), a novel and general framework for lag-resol

Text-Guided 6D Object Pose Rearrangement via Closed-Loop VLM Agents

arXiv:2604.09781v1 Announce Type: new Abstract: Vision-Language Models (VLMs) exhibit strong visual reasoning capabilities, yet they still struggle with 3D understanding. In particular, VLMs often fai

agentsarxiv-cs-cv

Towards Brain MRI Foundation Models for the Clinic: Findings from the FOMO25 Challenge

arXiv:2604.11679v1 Announce Type: new Abstract: Clinical deployment of automated brain MRI analysis faces a fundamental challenge: clinical data is heterogeneous and noisy, and high-quality labels are

Towards Proactive Information Probing: Customer Service Chatbots Harvesting Value from Conversation

arXiv:2604.11077v1 Announce Type: new Abstract: Customer service chatbots are increasingly expected to serve not merely as reactive support tools for users, but as strategic interfaces for harvesting

Unified Unsupervised and Sparsely-Supervised 3D Object Detection by Semantic Pseudo-Labeling and Prototype Learning

arXiv:2602.21484v2 Announce Type: replace Abstract: 3D object detection is essential for autonomous driving and robotic perception, yet its reliance on large-scale manually annotated data limits scala

agentsarxiv-cs-cv

Variational Latent Entropy Estimation Disentanglement: Controlled Attribute Leakage for Face Recognition

arXiv:2604.11250v1 Announce Type: new Abstract: Face recognition embeddings encode identity, but they also encode other factors such as gender and ethnicity. Depending on how these factors are used by

safetyarxiv-cs-cv

Variational Visual Question Answering for Uncertainty-Aware Selective Prediction

arXiv:2505.09591v3 Announce Type: replace-cross Abstract: Despite remarkable progress in recent years, Vision Language Models (VLMs) remain prone to overconfidence and hallucinations on tasks such as

VERTIGO: Visual Preference Optimization for Cinematic Camera Trajectory Generation

arXiv:2604.02467v2 Announce Type: replace-cross Abstract: Cinematic camera control relies on a tight feedback loop between director and cinematographer, where camera motion and framing are continuousl

VidAudio-Bench: Benchmarking V2A and VT2A Generation across Four Audio Categories

arXiv:2604.10542v1 Announce Type: cross Abstract: Video-to-Audio (V2A) generation is essential for immersive multimedia experiences, yet its evaluation remains underexplored. Existing benchmarks typic

Visual Late Chunking: An Empirical Study of Contextual Chunking for Efficient Visual Document Retrieval

arXiv:2604.10167v1 Announce Type: cross Abstract: Multi-vector models dominate Visual Document Retrieval (VDR) due to their fine-grained matching capabilities, but their high storage and computational

researcharxiv-cs-cl

WARPED: Wrist-Aligned Rendering for Robot Policy Learning from Egocentric Human Demonstrations

arXiv:2604.10809v1 Announce Type: new Abstract: Recent advancements in learning from human demonstration have shown promising results in addressing the scalability and high cost of data collection req

safetyarxiv-cs-ro

WearBCI Dataset: Understanding and Benchmarking Real-World Wearable Brain-Computer Interfaces Signals

arXiv:2604.09649v1 Announce Type: cross Abstract: Brain-computer interfaces (BCIs) have opened new platforms for human-computer interaction, medical diagnostics, and neurorehabilitation. Wearable BCI

Why Code, Why Now: An Information-Theoretic Perspective on the Limits of Machine Learning

arXiv:2602.13934v4 Announce Type: replace-cross Abstract: This paper offers a new perspective on the limits of machine learning: the ceiling on progress is set not by model size or algorithm choice bu

local-aiarxiv-cs-cl

ActionNex: A Virtual Outage Manager for Cloud Computing

arXiv:2604.03512v2 Announce Type: replace Abstract: Outage management in large-scale cloud operations remains heavily manual, requiring rapid triage, cross-team coordination, and experience-driven dec

agentsarxiv-cs-ai

AdaCubic: An Adaptive Cubic Regularization Optimizer for Deep Learning

arXiv:2604.09437v1 Announce Type: new Abstract: A novel regularization technique, AdaCubic, is proposed that adapts the weight of the cubic term. The heart of AdaCubic is an auxiliary optimization pro

researcharxiv-cs-lg

Applications

Adaptive Action Chunking at Inference-time for Vision-Language-Action Models

arXiv:2604.04161v2 Announce Type: replace Abstract: In Vision-Language-Action (VLA) models, action chunking (i.e., executing a sequence of actions without intermediate replanning) is a key technique t

applicationsarxiv-cs-ro

AMO-ENE: Attention-based Multi-Omics Fusion Model for Outcome Prediction in Extra Nodal Extension and HPV-associated Oropharyngeal Cancer

arXiv:2604.09280v1 Announce Type: cross Abstract: Extranodal extension (ENE) is an emerging prognostic factor in human papillomavirus (HPV)-associated oropharyngeal cancer (OPC), although it is curren

Applications

An Open-Source, Open Data Approach to Activity Classification from Triaxial Accelerometry in an Ambulatory Setting

arXiv:2604.09451v1 Announce Type: cross Abstract: The accelerometer has become an almost ubiquitous device, providing enormous opportunities in healthcare monitoring beyond step counting or other aver

applicationsarxiv-cs-lg

Another BRIXEL in the Wall: Towards Cheaper Dense Features

arXiv:2511.05168v2 Announce Type: replace Abstract: Vision foundation models achieve strong performance on both global and locally dense downstream tasks. Pretrained on large images, the recent DINOv3

local-aiarxiv-cs-cv

Applications

AR-KAN: Autoregressive-Weight-Enhanced Kolmogorov-Arnold Network for Time Series Forecasting

arXiv:2509.02967v3 Announce Type: replace-cross Abstract: Traditional neural networks struggle to capture the spectral structure of complex signals. Fourier neural networks (FNNs) attempt to address t

applicationsarxiv-cs-ai

Arbitration Failure, Not Perceptual Blindness: How Vision-Language Models Resolve Visual-Linguistic Conflicts

arXiv:2604.09364v1 Announce Type: cross Abstract: When a Vision-Language Model (VLM) sees a blue banana and answers 'yellow', is the problem of perception or arbitration? We explore the question in te

researcharxiv-cs-cl

B-MoE: A Body-Part-Aware Mixture-of-Experts 'All Parts Matter' Approach to Micro-Action Recognition

arXiv:2603.24245v3 Announce Type: replace Abstract: Micro-actions, fleeting and low-amplitude motions, such as glances, nods, or minor posture shifts, carry rich social meaning but remain difficult fo

b8772

local-aillama-cpp-releases

Build **b8772** is a recent incremental release of [llama.cpp](https://github.com/ggml-org/llama.cpp), the open-source C/C++ library for local LLM inference. Based on surrounding release activity, it

b8779

local-aillama-cpp-releases

Build **b8779** is an incremental release of [llama.cpp](https://github.com/ggml-org/llama.cpp), an open-source C/C++ framework for running large language model inference locally and in the cloud. Lik

Constraint-Aware Corrective Memory for Language-Based Drug Discovery Agents

arXiv:2604.09308v1 Announce Type: new Abstract: Large language models are making autonomous drug discovery agents increasingly feasible, but reliable success in this setting is not determined by any s

safetyarxiv-cs-ai

CORA: Conformal Risk-Controlled Agents for Safeguarded Mobile GUI Automation

arXiv:2604.09155v1 Announce Type: cross Abstract: Graphical user interface (GUI) agents powered by vision language models (VLMs) are rapidly moving from passive assistance to autonomous operation. How

Creator Incentives in Recommender Systems: A Cooperative Game-Theoretic Approach for Stable and Fair Collaboration in Multi-Agent Bandits

arXiv:2604.08643v1 Announce Type: new Abstract: User interactions in online recommendation platforms create interdependencies among content creators: feedback on one creator's content influences the s

Hardware

CSAttention: Centroid-Scoring Attention for Accelerating LLM Inference

arXiv:2604.08584v1 Announce Type: cross Abstract: Long-context LLMs increasingly rely on extended, reusable prefill prompts for agents and domain Q&A, pushing attention and KV-cache to become the domi

hardwarearxiv-cs-ai

Do Vision Language Models Need to Process Image Tokens?

arXiv:2604.09425v1 Announce Type: new Abstract: Vision Language Models (VLMs) have achieved remarkable success by integrating visual encoders with large language models (LLMs). While VLMs process dens

EXAONE 4.5 Technical Report

model-releasesarxiv-cs-cl

arXiv:2604.08644v1 Announce Type: new Abstract: This technical report introduces EXAONE 4.5, the first open-weight vision language model released by LG AI Research. EXAONE 4.5 is architected by integr

Geometry Reinforced Efficient Attention Tuning Equipped with Normals for Robust Stereo Matching

arXiv:2604.09142v1 Announce Type: new Abstract: Despite remarkable advances in image-driven stereo matching over the past decade, Synthetic-to-Realistic Zero-Shot (Syn-to-Real) generalization remains

How to find the sweet spot between cost and performance

model-releasesgoogle-cloud-ai

At Google Cloud, we often see customers asking themselves: 'How can we manage our generative AI costs effectively without sacrificing the performance and availability our applications demand?' This is

Inpaint workflows for z-image, qwen and flux fill onereward

model-releasesr-stablediffusion

This Reddit post from r/StableDiffusion shares ComfyUI inpainting workflows for several modern AI image models, including Z-Image, Qwen Image/Edit, and Flux-series models . Flux Fill is a dedicated in

Integrated electro-optic attention nonlinearities for transformers

arXiv:2604.09512v1 Announce Type: new Abstract: Transformers have emerged as the dominant neural-network architecture, achieving state-of-the-art performance in language processing and computer vision

researcharxiv-cs-lg

Large-Scale Universal Defect Generation: Foundation Models and Datasets

arXiv:2604.08915v1 Announce Type: cross Abstract: Existing defect/anomaly generation methods often rely on few-shot learning, which overfits to specific defect categories due to the lack of large-scal

Maybe hot take - I’ve read a bunch of RL for image generation papers over last few months and honestly it’s been pretty disappointing. All o…

tutorialsjeremy-howard--x

Maybe hot take - I’ve read a bunch of RL for image generation papers over last few months and honestly it’s been pretty disappointing. All of them are variations of GRPO and all of them are incrementa

MedFormer-UR: Uncertainty-Routed Transformer for Medical Image Classification

arXiv:2604.08868v1 Announce Type: cross Abstract: To ensure safe clinical integration, deep learning models must provide more than just high accuracy; they require dependable uncertainty quantificatio

local-aiarxiv-cs-ai

Noise-Aware In-Context Learning for Hallucination Mitigation in ALLMs

arXiv:2604.09021v1 Announce Type: cross Abstract: Auditory large language models (ALLMs) have demonstrated strong general capabilities in audio understanding and reasoning tasks. However, their reliab

OASIS: Online Activation Subspace Learning for Memory-Efficient Training

arXiv:2604.09406v1 Announce Type: new Abstract: Training large language models (LLMs) is constrained by memory requirements, with activations accounting for a substantial fraction of the total footpri

researcharxiv-cs-lg

OmniPrism: Learning Disentangled Visual Concept for Image Generation

arXiv:2412.12242v2 Announce Type: replace-cross Abstract: Creative visual concept generation often draws inspiration from specific concepts in a reference image to produce relevant outcomes. However,

tutorialsarxiv-cs-ai

Plasticity-Enhanced Multi-Agent Mixture of Experts for Dynamic Objective Adaptation in UAVs-Assisted Emergency Communication Networks

arXiv:2604.09028v1 Announce Type: cross Abstract: Unmanned aerial vehicles serving as aerial base stations can rapidly restore connectivity after disasters, yet abrupt changes in user mobility and tra

RetinexDualV2: Physically-Grounded Dual Retinex for Generalized UHD Image Restoration

arXiv:2603.27979v2 Announce Type: replace Abstract: We propose RetinexDualV2, a unified, physically grounded dual-branch framework for diverse Ultra-High-Definition (UHD) image restoration. Unlike gen

tutorialsarxiv-cs-cv

RIRF: Reasoning Image Restoration Framework

arXiv:2604.09511v1 Announce Type: new Abstract: Universal image restoration (UIR) aims to recover clean images from diverse and unknown degradations using a unified model. Existing UIR methods primari

agentsarxiv-cs-cv

Score-Driven Rating System for Sports

arXiv:2604.09143v1 Announce Type: new Abstract: This paper introduces a score-driven rating system, a generalization of the classical Elo rating system that employs the score, i.e. the gradient of the