Search: “multimodal”

Beyond the Mean: Modelling Annotation Distributions in Continuous Affect Prediction

arXiv:2604.07198v1 Announce Type: new Abstract: Emotion annotation is inherently subjective and cognitively demanding, producing signals that reflect diverse perceptions across annotators rather than

researcharxiv-cs-lg

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

Bridging Time and Space: Decoupled Spatio-Temporal Alignment for Video Grounding

DGX agent

arXiv:2604.08014v1 Announce Type: new Abstract: Spatio-Temporal Video Grounding requires jointly localizing target objects across both temporal and spatial dimensions based on natural language queries

local-aiarxiv-cs-cv

10 Apr 2026

CNN-based Surface Temperature Forecasts with Ensemble Numerical Weather Prediction

arXiv:2507.18937v3 Announce Type: replace-cross Abstract: Due to limited computational resources, medium-range temperature forecasts typically rely on low-resolution numerical weather prediction (NWP)

Tutorials

Conditional flow matching for physics-constrained inverse problems with finite training data

arXiv:2603.14135v3 Announce Type: replace-cross Abstract: This study presents a conditional flow matching framework for solving physics-constrained Bayesian inverse problems. In this setting, samples

tutorialsarxiv-cs-lg

CubeGraph: Efficient Retrieval-Augmented Generation for Spatial and Temporal Data

arXiv:2604.06616v1 Announce Type: cross Abstract: Hybrid queries combining high-dimensional vector similarity search with spatio-temporal filters are increasingly critical for modern retrieval-augment

CycleChart: A Unified Consistency-Based Learning Framework for Bidirectional Chart Understanding and Generation

model-releasesarxiv-cs-cl

arXiv:2512.19173v2 Announce Type: replace Abstract: Current chart-related tasks, such as chart generation (NL2Chart), chart schema parsing, chart data parsing, and chart question answering (ChartQA),

Data Leakage in Automotive Perception: Practitioners' Insights

arXiv:2604.06899v1 Announce Type: cross Abstract: Data leakage is the inadvertent transfer of information between training and evaluation datasets that poses a subtle, yet critical, risk to the reliab

safetyarxiv-cs-lg

DISSECT: Diagnosing Where Vision Ends and Language Priors Begin in Scientific VLMs

arXiv:2604.06250v1 Announce Type: cross Abstract: When asked to describe a molecular diagram, a Vision-Language Model correctly identifies ``a benzene ring with an -OH group.'' When asked to reason ab

DSCA: Dynamic Subspace Concept Alignment for Lifelong VLM Editing

arXiv:2604.07965v1 Announce Type: new Abstract: Model editing aims to update knowledge to add new concepts and change relevant information without retraining. Lifelong editing is a challenging task, p

Dual-level Modality Debiasing Learning for Unsupervised Visible-Infrared Person Re-Identification

arXiv:2512.03745v2 Announce Type: replace Abstract: Two-stage learning pipeline has achieved promising results in unsupervised visible-infrared person re-identification (USL-VI-ReID). It first perform

Agents

EMSDialog: Synthetic Multi-person Emergency Medical Service Dialogue Generation from Electronic Patient Care Reports via Multi-LLM Agents

arXiv:2604.07549v1 Announce Type: new Abstract: Conversational diagnosis prediction requires models to track evolving evidence in streaming clinical conversations and decide when to commit to a diagno

agentsarxiv-cs-cl

Enabling Intrinsic Reasoning over Dense Geospatial Embeddings with DFR-Gemma

model-releasesarxiv-cs-cl

arXiv:2604.07490v1 Announce Type: new Abstract: Representation learning for geospatial and spatio-temporal data plays a critical role in enabling general-purpose geospatial intelligence. Recent geospa

Environmental, Social and Governance Sentiment Analysis on Slovene News: A Novel Dataset and Models

arXiv:2604.06826v1 Announce Type: cross Abstract: Environmental, Social, and Governance (ESG) considerations are increasingly integral to assessing corporate performance, reputation, and long-term sus

Tutorials

EPIR: An Efficient Patch Tokenization, Integration and Representation Framework for Micro-expression Recognition

arXiv:2604.08106v1 Announce Type: new Abstract: Micro-expression recognition can obtain the real emotion of the individual at the current moment. Although deep learning-based methods, especially Trans

tutorialsarxiv-cs-cv

Exploring Natural Language-Based Strategies for Efficient Number Learning in Children through Reinforcement Learning

arXiv:2410.08334v2 Announce Type: replace-cross Abstract: In this paper, we build a reinforcement learning framework to study how children compose numbers using base-ten blocks. Studying numerical cog

FireSenseNet: A Dual-Branch CNN with Cross-Attentive Feature Interaction for Next-Day Wildfire Spread Prediction

arXiv:2604.07675v1 Announce Type: new Abstract: Accurate prediction of next-day wildfire spread is critical for disaster response and resource allocation. Existing deep learning approaches typically c

FlowExtract: Procedural Knowledge Extraction from Maintenance Flowcharts

arXiv:2604.06770v1 Announce Type: cross Abstract: Maintenance procedures in manufacturing facilities are often documented as flowcharts in static PDFs or scanned images. They encode procedural knowled

Hardware

ForkKV: Scaling Multi-LoRA Agent Serving via Copy-on-Write Disaggregated KV Cache

arXiv:2604.06370v1 Announce Type: cross Abstract: The serving paradigm of large language models (LLMs) is rapidly shifting towards complex multi-agent workflows where specialized agents collaborate ov

hardwarearxiv-cs-lg

Local Ai

From Synthetic Data to Real Restorations: Diffusion Model for Patient-specific Dental Crown Completion

arXiv:2603.26588v2 Announce Type: replace-cross Abstract: We present ToothCraft, a diffusion-based model for the contextual generation of tooth crowns, trained on artificially created incomplete teeth

local-aiarxiv-cs-lg

Front-End Ethics for Sensor-Fused Health Conversational Agents: An Ethical Design Space for Biometrics

arXiv:2604.06203v1 Announce Type: cross Abstract: The integration of continuous data from built-in sensors and Large Language Models (LLMs) has fueled a surge of 'Sensor-Fused LLM agents' for personal

Generating Attribution Reports for Manipulated Facial Images: A Dataset and Baseline

arXiv:2412.19685v2 Announce Type: replace-cross Abstract: Existing facial forgery detection methods typically focus on binary classification or pixel-level localization, providing little semantic insi

GraphWalker: Graph-Guided In-Context Learning for Clinical Reasoning on Electronic Health Records

arXiv:2604.06684v1 Announce Type: new Abstract: Clinical Reasoning on Electronic Health Records (EHRs) is a fundamental yet challenging task in modern healthcare. While in-context learning (ICL) offer

applicationsarxiv-cs-lg

GroupGPT: A Token-efficient and Privacy-preserving Agentic Framework for Multi-User Chat Assistant

model-releasesarxiv-cs-cl

arXiv:2603.01059v3 Announce Type: replace Abstract: Recent advances in large language models (LLMs) have enabled increasingly capable chatbots. However, most existing systems focus on single-user sett

Harf-Speech: A Clinically Aligned Framework for Arabic Phoneme-Level Speech Assessment

arXiv:2604.06191v1 Announce Type: cross Abstract: Automated phoneme-level pronunciation assessment is vital for scalable speech therapy and language learning, yet validated tools for Arabic remain sca

High-Precision Estimation of the State-Space Complexity of Shogi via the Monte Carlo Method

arXiv:2604.06189v1 Announce Type: new Abstract: Determining the state-space complexity of the game of Shogi (Japanese Chess) has been a challenging problem, with previous combinatorial estimates leavi

How SAP Concur automates expense reporting with agentic AI

model-releasesgoogle-cloud-ai

For decades, expense automation relied on a simple premise: If the machine can read the text, it can do the work. But anyone who has ever tried to scan a crumpled, smudged, or sun-bleached receipt fro

HY-Embodied-0.5: Embodied Foundation Models for Real-World Agents

arXiv:2604.07430v1 Announce Type: new Abstract: We introduce HY-Embodied-0.5, a family of foundation models specifically designed for real-world embodied agents. To bridge the gap between general Visi

Local Ai

JoyAI-Image-Edit now has ComfyUI support

local-air-stablediffusion

As of April 10, 2026, JoyAI-Image-Edit added ComfyUI support, enabling users to run its instruction-guided image editing capabilities through ComfyUI's node-based workflow interface. JoyAI-Image i...

KD-MARL: Resource-Aware Knowledge Distillation in Multi-Agent Reinforcement Learning

arXiv:2604.06691v1 Announce Type: new Abstract: Real world deployment of multi agent reinforcement learning MARL systems is fundamentally constrained by limited compute memory and inference time. Whil

Large Language Models for Outpatient Referral: Problem Definition, Benchmarking and Challenges

arXiv:2503.08292v4 Announce Type: replace-cross Abstract: Large language models (LLMs) are increasingly applied to outpatient referral tasks across healthcare systems. However, there is a lack of stan

Latent Anomaly Knowledge Excavation: Unveiling Sparse Sensitive Neurons in Vision-Language Models

arXiv:2604.07802v1 Announce Type: new Abstract: Large-scale vision-language models (VLMs) exhibit remarkable zero-shot capabilities, yet the internal mechanisms driving their anomaly detection (AD) pe

researcharxiv-cs-cv

Agents

Learning to Search: A Decision-Based Agent for Knowledge-Based Visual Question Answering

arXiv:2604.07146v2 Announce Type: replace Abstract: Knowledge-based visual question answering (KB-VQA) requires vision-language models to understand images and use external knowledge, especially for r

agentsarxiv-cs-cv

Lexical Tone is Hard to Quantize: Probing Discrete Speech Units in Mandarin and Yoruba

arXiv:2604.07467v1 Announce Type: new Abstract: Discrete speech units (DSUs) are derived by quantising representations from models trained using self-supervised learning (SSL). They are a popular repr

researcharxiv-cs-cl

Low-Rank Key Value Attention

arXiv:2601.11471v3 Announce Type: replace Abstract: The key-value (KV) cache is a primary memory bottleneck in Transformers. We propose Low-Rank Key-Value (LRKV) attention, which reduces KV cache memo

researcharxiv-cs-lg

Hardware

Measurement of Generative AI Workload Power Profiles for Whole-Facility Data Center Infrastructure Planning

arXiv:2604.07345v1 Announce Type: cross Abstract: The rapid growth of generative artificial intelligence (AI) has introduced unprecedented computational demands, driving significant increases in the e

hardwarearxiv-cs-lg

MoE Routing Testbed: Studying Expert Specialization and Routing Behavior at Small Scale

arXiv:2604.07030v1 Announce Type: new Abstract: Sparse Mixture-of-Experts (MoE) architectures are increasingly popular for frontier large language models (LLM) but they introduce training challenges d

researcharxiv-cs-lg

MonoUNet: A Robust Tiny Neural Network for Automated Knee Cartilage Segmentation on Point-of-Care Ultrasound Devices

arXiv:2604.07780v1 Announce Type: cross Abstract: Objective: To develop a robust and compact deep learning model for automated knee cartilage segmentation on point-of-care ultrasound (POCUS) devices.

safetyarxiv-cs-cv

MorphDistill: Distilling Unified Morphological Knowledge from Pathology Foundation Models for Colorectal Cancer Survival Prediction

arXiv:2604.06390v1 Announce Type: cross Abstract: Background: Colorectal cancer (CRC) remains a leading cause of cancer-related mortality worldwide. Accurate survival prediction is essential for treat

Multi-Turn Reasoning LLMs for Task Offloading in Mobile Edge Computing

arXiv:2604.07148v1 Announce Type: new Abstract: Emerging computation-intensive applications impose stringent latency requirements on resource-constrained mobile devices. Mobile Edge Computing (MEC) ad

safetyarxiv-cs-lg

NTIRE 2026 Challenge on Bitstream-Corrupted Video Restoration: Methods and Results

arXiv:2604.06945v2 Announce Type: replace Abstract: This paper reports on the NTIRE 2026 Challenge on Bitstream-Corrupted Video Restoration (BSCVR). The challenge aims to advance research on recoverin

ParseBench: A Document Parsing Benchmark for AI Agents

arXiv:2604.08538v1 Announce Type: new Abstract: AI agents are changing the requirements for document parsing. What matters is semantic correctness: parsed output must preserve the structure and

PD-SOVNet: A Physics-Driven Second-Order Vibration Operator Network for Estimating Wheel Polygonal Roughness from Axle-Box Vibrations

arXiv:2604.06620v1 Announce Type: new Abstract: Quantitative estimation of wheel polygonal roughness from axle-box vibration signals is a challenging yet practically relevant problem for rail-vehicle

applicationsarxiv-cs-lg

Phantasia: Context-Adaptive Backdoors in Vision Language Models

arXiv:2604.08395v1 Announce Type: new Abstract: Recent advances in Vision-Language Models (VLMs) have greatly enhanced the integration of visual perception and linguistic reasoning, driving rapid prog

researcharxiv-cs-cv

PhyAVBench: A Challenging Audio Physics-Sensitivity Benchmark for Physically Grounded Text-to-Audio-Video Generation

arXiv:2512.23994v3 Announce Type: replace-cross Abstract: Text-to-audio-video (T2AV) generation is central to applications such as filmmaking and world modeling. However, current models often fail to

Local Ai

PixelCAM: Pixel Class Activation Mapping for Histology Image Classification and ROI Localization

arXiv:2503.24135v3 Announce Type: replace Abstract: Weakly supervised object localization (WSOL) methods allow training models to classify images and localize ROIs. WSOL only requires low-cost image-c

local-aiarxiv-cs-cv

Agents

Predictive Representations for Skill Transfer in Reinforcement Learning

arXiv:2604.07016v1 Announce Type: new Abstract: A key challenge in scaling up Reinforcement Learning is generalizing learned behaviour. Without the ability to carry forward acquired knowledge an agent

agentsarxiv-cs-lg

PSR: Scaling Multi-Subject Personalized Image Generation with Pairwise Subject-Consistency Rewards

arXiv:2512.01236v2 Announce Type: replace Abstract: Personalized generation models for a single subject have demonstrated remarkable effectiveness, highlighting their significant potential. However, w

Qwen 3.6 Plus on AI Gateway

model-releasesvercel-blog

Alibaba's Qwen 3.6 Plus is now available on Vercel's AI Gateway, accessible via a unified API with no additional provider accounts required. Compared to Qwen 3.5 Plus, this model adds stronger age...