Search: “multimodal”

hardwaretwo-minute-papers

This is a Two Minute Papers episode by Dr. Károly Zsolnai-Fehér reviewing a counterintuitive NVIDIA AI research result — likely covering a technique that defies conventional expectations yet delivers

11 Apr 2026

A Goal-Oriented Chatbot for Engaging the Elderly Through Family Photo Conversations

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2604.06184v1 Announce Type: cross Abstract: We propose a personalized chatbot designed for elderly individuals. The chatbot initiates discussions based on family photos, encouraging users to int

researcharxiv-cs-ai

10 Apr 2026

A Soft Robotic Interface for Chick-Robot Affective Interactions

arXiv:2604.08443v1 Announce Type: new Abstract: The potential of Animal-Robot Interaction (ARI) in welfare applications depends on how much an animal perceives a robotic agent as socially relevant, no

agentsarxiv-cs-ro

ACM Human-Computer Interaction Conference (CHI) 2026

researchapple-ml-research

Apple is presenting new research at the ACM CHI Conference on Human Factors in Computing Systems, held in person in Barcelona, Spain, from April 13–17, 2026, and is a sponsor of the event. Research...

Adaptive Differential Privacy for Federated Medical Image Segmentation Across Diverse Modalities

arXiv:2604.06518v1 Announce Type: cross Abstract: Large volumes of medical data remain underutilized because centralizing distributed data is often infeasible due to strict privacy regulations and ins

An Agentic Evaluation Architecture for Historical Bias Detection in Educational Textbooks

arXiv:2604.07883v1 Announce Type: cross Abstract: History textbooks often contain implicit biases, nationalist framing, and selective omissions that are difficult to audit at scale. We propose an agen

safetyarxiv-cs-cl

AnomalyAgent: Agentic Industrial Anomaly Synthesis via Tool-Augmented Reinforcement Learning

arXiv:2604.07900v1 Announce Type: new Abstract: Industrial anomaly generation is a crucial method for alleviating the data scarcity problem in anomaly detection tasks. Most existing anomaly synthesis

agentsarxiv-cs-cv

AVGen-Bench: A Task-Driven Benchmark for Multi-Granular Evaluation of Text-to-Audio-Video Generation

arXiv:2604.08540v1 Announce Type: cross Abstract: Text-to-Audio-Video (T2AV) generation is rapidly becoming a core interface for media creation, yet its evaluation remains fragmented. Existing benchma

Beyond the Mean: Modelling Annotation Distributions in Continuous Affect Prediction

arXiv:2604.07198v1 Announce Type: new Abstract: Emotion annotation is inherently subjective and cognitively demanding, producing signals that reflect diverse perceptions across annotators rather than

researcharxiv-cs-lg

Local Ai

Bridging Time and Space: Decoupled Spatio-Temporal Alignment for Video Grounding

arXiv:2604.08014v1 Announce Type: new Abstract: Spatio-Temporal Video Grounding requires jointly localizing target objects across both temporal and spatial dimensions based on natural language queries

local-aiarxiv-cs-cv

CNN-based Surface Temperature Forecasts with Ensemble Numerical Weather Prediction

arXiv:2507.18937v3 Announce Type: replace-cross Abstract: Due to limited computational resources, medium-range temperature forecasts typically rely on low-resolution numerical weather prediction (NWP)

Tutorials

Conditional flow matching for physics-constrained inverse problems with finite training data

arXiv:2603.14135v3 Announce Type: replace-cross Abstract: This study presents a conditional flow matching framework for solving physics-constrained Bayesian inverse problems. In this setting, samples

tutorialsarxiv-cs-lg

CubeGraph: Efficient Retrieval-Augmented Generation for Spatial and Temporal Data

arXiv:2604.06616v1 Announce Type: cross Abstract: Hybrid queries combining high-dimensional vector similarity search with spatio-temporal filters are increasingly critical for modern retrieval-augment

CycleChart: A Unified Consistency-Based Learning Framework for Bidirectional Chart Understanding and Generation

arXiv:2512.19173v2 Announce Type: replace Abstract: Current chart-related tasks, such as chart generation (NL2Chart), chart schema parsing, chart data parsing, and chart question answering (ChartQA),

Data Leakage in Automotive Perception: Practitioners' Insights

arXiv:2604.06899v1 Announce Type: cross Abstract: Data leakage is the inadvertent transfer of information between training and evaluation datasets that poses a subtle, yet critical, risk to the reliab

safetyarxiv-cs-lg

DISSECT: Diagnosing Where Vision Ends and Language Priors Begin in Scientific VLMs

model-releasesarxiv-cs-ai

arXiv:2604.06250v1 Announce Type: cross Abstract: When asked to describe a molecular diagram, a Vision-Language Model correctly identifies ``a benzene ring with an -OH group.'' When asked to reason ab

DSCA: Dynamic Subspace Concept Alignment for Lifelong VLM Editing

arXiv:2604.07965v1 Announce Type: new Abstract: Model editing aims to update knowledge to add new concepts and change relevant information without retraining. Lifelong editing is a challenging task, p

Dual-level Modality Debiasing Learning for Unsupervised Visible-Infrared Person Re-Identification

arXiv:2512.03745v2 Announce Type: replace Abstract: Two-stage learning pipeline has achieved promising results in unsupervised visible-infrared person re-identification (USL-VI-ReID). It first perform

EMSDialog: Synthetic Multi-person Emergency Medical Service Dialogue Generation from Electronic Patient Care Reports via Multi-LLM Agents

arXiv:2604.07549v1 Announce Type: new Abstract: Conversational diagnosis prediction requires models to track evolving evidence in streaming clinical conversations and decide when to commit to a diagno

agentsarxiv-cs-cl

Enabling Intrinsic Reasoning over Dense Geospatial Embeddings with DFR-Gemma

arXiv:2604.07490v1 Announce Type: new Abstract: Representation learning for geospatial and spatio-temporal data plays a critical role in enabling general-purpose geospatial intelligence. Recent geospa

Environmental, Social and Governance Sentiment Analysis on Slovene News: A Novel Dataset and Models

arXiv:2604.06826v1 Announce Type: cross Abstract: Environmental, Social, and Governance (ESG) considerations are increasingly integral to assessing corporate performance, reputation, and long-term sus

Tutorials

EPIR: An Efficient Patch Tokenization, Integration and Representation Framework for Micro-expression Recognition

arXiv:2604.08106v1 Announce Type: new Abstract: Micro-expression recognition can obtain the real emotion of the individual at the current moment. Although deep learning-based methods, especially Trans

tutorialsarxiv-cs-cv

Exploring Natural Language-Based Strategies for Efficient Number Learning in Children through Reinforcement Learning

arXiv:2410.08334v2 Announce Type: replace-cross Abstract: In this paper, we build a reinforcement learning framework to study how children compose numbers using base-ten blocks. Studying numerical cog

FireSenseNet: A Dual-Branch CNN with Cross-Attentive Feature Interaction for Next-Day Wildfire Spread Prediction

arXiv:2604.07675v1 Announce Type: new Abstract: Accurate prediction of next-day wildfire spread is critical for disaster response and resource allocation. Existing deep learning approaches typically c

FlowExtract: Procedural Knowledge Extraction from Maintenance Flowcharts

arXiv:2604.06770v1 Announce Type: cross Abstract: Maintenance procedures in manufacturing facilities are often documented as flowcharts in static PDFs or scanned images. They encode procedural knowled

Hardware

ForkKV: Scaling Multi-LoRA Agent Serving via Copy-on-Write Disaggregated KV Cache

arXiv:2604.06370v1 Announce Type: cross Abstract: The serving paradigm of large language models (LLMs) is rapidly shifting towards complex multi-agent workflows where specialized agents collaborate ov

hardwarearxiv-cs-lg

Local Ai

From Synthetic Data to Real Restorations: Diffusion Model for Patient-specific Dental Crown Completion

arXiv:2603.26588v2 Announce Type: replace-cross Abstract: We present ToothCraft, a diffusion-based model for the contextual generation of tooth crowns, trained on artificially created incomplete teeth

local-aiarxiv-cs-lg

Front-End Ethics for Sensor-Fused Health Conversational Agents: An Ethical Design Space for Biometrics

arXiv:2604.06203v1 Announce Type: cross Abstract: The integration of continuous data from built-in sensors and Large Language Models (LLMs) has fueled a surge of 'Sensor-Fused LLM agents' for personal

Generating Attribution Reports for Manipulated Facial Images: A Dataset and Baseline

model-releasesarxiv-cs-ai

arXiv:2412.19685v2 Announce Type: replace-cross Abstract: Existing facial forgery detection methods typically focus on binary classification or pixel-level localization, providing little semantic insi

GraphWalker: Graph-Guided In-Context Learning for Clinical Reasoning on Electronic Health Records

arXiv:2604.06684v1 Announce Type: new Abstract: Clinical Reasoning on Electronic Health Records (EHRs) is a fundamental yet challenging task in modern healthcare. While in-context learning (ICL) offer

applicationsarxiv-cs-lg

GroupGPT: A Token-efficient and Privacy-preserving Agentic Framework for Multi-User Chat Assistant

arXiv:2603.01059v3 Announce Type: replace Abstract: Recent advances in large language models (LLMs) have enabled increasingly capable chatbots. However, most existing systems focus on single-user sett

Harf-Speech: A Clinically Aligned Framework for Arabic Phoneme-Level Speech Assessment

model-releasesarxiv-cs-ai

arXiv:2604.06191v1 Announce Type: cross Abstract: Automated phoneme-level pronunciation assessment is vital for scalable speech therapy and language learning, yet validated tools for Arabic remain sca

High-Precision Estimation of the State-Space Complexity of Shogi via the Monte Carlo Method

arXiv:2604.06189v1 Announce Type: new Abstract: Determining the state-space complexity of the game of Shogi (Japanese Chess) has been a challenging problem, with previous combinatorial estimates leavi

How SAP Concur automates expense reporting with agentic AI

model-releasesgoogle-cloud-ai

For decades, expense automation relied on a simple premise: If the machine can read the text, it can do the work. But anyone who has ever tried to scan a crumpled, smudged, or sun-bleached receipt fro

HY-Embodied-0.5: Embodied Foundation Models for Real-World Agents

arXiv:2604.07430v1 Announce Type: new Abstract: We introduce HY-Embodied-0.5, a family of foundation models specifically designed for real-world embodied agents. To bridge the gap between general Visi

Local Ai

JoyAI-Image-Edit now has ComfyUI support

local-air-stablediffusion

As of April 10, 2026, JoyAI-Image-Edit added ComfyUI support, enabling users to run its instruction-guided image editing capabilities through ComfyUI's node-based workflow interface. JoyAI-Image i...

KD-MARL: Resource-Aware Knowledge Distillation in Multi-Agent Reinforcement Learning

arXiv:2604.06691v1 Announce Type: new Abstract: Real world deployment of multi agent reinforcement learning MARL systems is fundamentally constrained by limited compute memory and inference time. Whil

Large Language Models for Outpatient Referral: Problem Definition, Benchmarking and Challenges

arXiv:2503.08292v4 Announce Type: replace-cross Abstract: Large language models (LLMs) are increasingly applied to outpatient referral tasks across healthcare systems. However, there is a lack of stan

Latent Anomaly Knowledge Excavation: Unveiling Sparse Sensitive Neurons in Vision-Language Models

arXiv:2604.07802v1 Announce Type: new Abstract: Large-scale vision-language models (VLMs) exhibit remarkable zero-shot capabilities, yet the internal mechanisms driving their anomaly detection (AD) pe

researcharxiv-cs-cv

Learning to Search: A Decision-Based Agent for Knowledge-Based Visual Question Answering

arXiv:2604.07146v2 Announce Type: replace Abstract: Knowledge-based visual question answering (KB-VQA) requires vision-language models to understand images and use external knowledge, especially for r

agentsarxiv-cs-cv

Lexical Tone is Hard to Quantize: Probing Discrete Speech Units in Mandarin and Yoruba

arXiv:2604.07467v1 Announce Type: new Abstract: Discrete speech units (DSUs) are derived by quantising representations from models trained using self-supervised learning (SSL). They are a popular repr

researcharxiv-cs-cl

Low-Rank Key Value Attention

arXiv:2601.11471v3 Announce Type: replace Abstract: The key-value (KV) cache is a primary memory bottleneck in Transformers. We propose Low-Rank Key-Value (LRKV) attention, which reduces KV cache memo

researcharxiv-cs-lg

Hardware

Measurement of Generative AI Workload Power Profiles for Whole-Facility Data Center Infrastructure Planning

arXiv:2604.07345v1 Announce Type: cross Abstract: The rapid growth of generative artificial intelligence (AI) has introduced unprecedented computational demands, driving significant increases in the e

hardwarearxiv-cs-lg

MoE Routing Testbed: Studying Expert Specialization and Routing Behavior at Small Scale

arXiv:2604.07030v1 Announce Type: new Abstract: Sparse Mixture-of-Experts (MoE) architectures are increasingly popular for frontier large language models (LLM) but they introduce training challenges d

researcharxiv-cs-lg

MonoUNet: A Robust Tiny Neural Network for Automated Knee Cartilage Segmentation on Point-of-Care Ultrasound Devices

arXiv:2604.07780v1 Announce Type: cross Abstract: Objective: To develop a robust and compact deep learning model for automated knee cartilage segmentation on point-of-care ultrasound (POCUS) devices.

safetyarxiv-cs-cv

MorphDistill: Distilling Unified Morphological Knowledge from Pathology Foundation Models for Colorectal Cancer Survival Prediction

arXiv:2604.06390v1 Announce Type: cross Abstract: Background: Colorectal cancer (CRC) remains a leading cause of cancer-related mortality worldwide. Accurate survival prediction is essential for treat

Multi-Turn Reasoning LLMs for Task Offloading in Mobile Edge Computing

arXiv:2604.07148v1 Announce Type: new Abstract: Emerging computation-intensive applications impose stringent latency requirements on resource-constrained mobile devices. Mobile Edge Computing (MEC) ad

safetyarxiv-cs-lg

NTIRE 2026 Challenge on Bitstream-Corrupted Video Restoration: Methods and Results

arXiv:2604.06945v2 Announce Type: replace Abstract: This paper reports on the NTIRE 2026 Challenge on Bitstream-Corrupted Video Restoration (BSCVR). The challenge aims to advance research on recoverin