Search: “multimodal”

TabularQGAN: A quantum generative model for tabular data synthesis

arXiv:2505.22533v2 Announce Type: replace-cross Abstract: In this paper, we introduce a novel quantum generative model for synthesizing tabular data. Synthetic data is valuable in scenarios where real

applicationsarxiv-cs-ai

19 Aug 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Tutorials

Visual Prompting for Robotic Manipulation with Annotation-Guided Pick-and-Place Using ACT

DGX agent

arXiv:2508.08748v2 Announce Type: replace-cross Abstract: Robotic pick-and-place tasks in convenience stores pose challenges due to dense object arrangements, occlusions, and variations in object prop

tutorialsarxiv-cs-ai

19 Aug 2026

Does the Heart Show Your Pain? Tackling the X-ITE Pain Challenge with Self-Supervised ECG Representation Learning

arXiv:2608.14662v1 Announce Type: cross Abstract: Accurate recognition of pain using physiological signals remains a challenging problem due to pain's subjective nature and high inter-individual varia

ForceU-VLA: A Force-Aware Vision-Language-Action Model for Embodied Ultrasound Scanning

arXiv:2608.15009v1 Announce Type: cross Abstract: Embodied intelligent ultrasound scanning enables the automation and standardization of the ultrasound examination process by integrating perception, d

agentsarxiv-cs-cv

Making two action heads agree: coordination mechanisms and a runtime collapse certificate for flow-matching policies

arXiv:2608.15748v1 Announce Type: new Abstract: A dual-representation flow-matching policy decodes each predicted motion into joint and end-effector spaces, and the residual between the two kinematica

safetyarxiv-cs-ro

Quantum Models with Multi-Stage Training for Compositional Concept Generalization

arXiv:2608.15601v1 Announce Type: new Abstract: Compositional Concept Generalization (CoCoGen), the ability to systematically recombine learned primitives in novel contexts, is a key challenge for mul

researcharxiv-cs-lg

Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluation

arXiv:2608.16843v1 Announce Type: new Abstract: Foundation models are increasingly used for perception, reasoning, planning, and action generation in embodied agents, creating security risks that can

agentsarxiv-cs-ro

Can Language Models Understand mmWave Data? Benchmarking Large Language Models for mmWave Radar-Based Human Understanding

arXiv:2608.14179v1 Announce Type: new Abstract: Large language models (LLMs) have shown remarkable reasoning and generative capabilities, motivating their use as universal reasoning engines for percep

CMCNet: Aligning Ultrasound Image Embeddings with Textual TI-RADS Representations for Fine-Grained Thyroid Classification

arXiv:2608.13939v1 Announce Type: cross Abstract: Ultrasound is the primary imaging modality for assessing thyroid nodules, and the ACR TI-RADS framework standardizes diagnosis through five ultrasound

safetyarxiv-cs-ai

Debiasing Text-to-Image Evaluation via Implicit Cultural Alignment Reward Modeling

arXiv:2607.15740v2 Announce Type: replace-cross Abstract: As Text-to-Image (T2I) systems rapidly advance, evaluating the cultural authenticity of synthesized content has become increasingly important

Decoding Student Minds: Leveraging Conversational Agents for Psychological and Learning Analysis

arXiv:2512.10441v2 Announce Type: replace Abstract: This paper presents a psychologically-aware conversational agent designed to enhance both learning performance and emotional well-being in education

agentsarxiv-cs-cl

Designing Sustainable Federated Learning as a Service using Neural Architecture Search

arXiv:2608.14359v1 Announce Type: new Abstract: The sustainability constraints of FLaaS consumers pose significant challenges to maintaining carbon-feasible federated training in FLaaS environments. T

applicationsarxiv-cs-ai

Fashion Outfit Generation via Unified Sequential Composition Models

arXiv:2608.13888v1 Announce Type: new Abstract: The task of synthesizing stylistically coherent fashion outfits from massive item libraries, known as fashion outfit generation, remains a non-trivial c

researcharxiv-cs-lg

From Field Data to Global Food Systems Intelligence: A Semantic Graph Framework for Sustainable Wheat Production

arXiv:2502.19507v2 Announce Type: replace Abstract: In response to the growing need for structured, interoperable agricultural data, this paper presents the Sustainable Wheat Production Datahub, a mod

applicationsarxiv-cs-ai

Local Ai

Global-Local Dual Perception for MLLMs in High-Resolution Text-Rich Image Translation

arXiv:2602.21956v2 Announce Type: replace Abstract: Text Image Machine Translation (TIMT) aims to translate text embedded in images in the source-language into target-language, requiring synergistic i

local-aiarxiv-cs-cv

Leading-Silence Augmentation and Multi-Stage Synthetic Supervision for the Second MLC-SLM Challenge

arXiv:2608.14150v1 Announce Type: new Abstract: The second Multilingual Conversational Speech Language Model (MLC-SLM) Challenge evaluates two tasks over complete, unsegmented multilingual conversatio

researcharxiv-cs-cl

Tutorials

Learning to Forecast Crop Growth from Earth Observation Data

arXiv:2608.14281v1 Announce Type: new Abstract: Forecasting crop growth across agricultural landscapes is important for improving the productivity, resilience, and operational management of farming sy

tutorialsarxiv-cs-cv

LLM-Advisor: An LLM Advisor for Cost-efficient Path Planning across Multiple Terrains

arXiv:2503.01236v3 Announce Type: replace-cross Abstract: This paper addresses fixed-graph terrain-aware path refinement, in which a global planner is restricted to a predefined route space and may re

Marionette: Predicting World States, Rendering Geometry, Painting Appearance

arXiv:2608.14530v1 Announce Type: cross Abstract: Interactive game world models typically autoregress visual observations directly in pixel or latent space, forcing structured properties such as pose,

MINT: A Universal Zero-Shot Predictor for Transaction Data

arXiv:2608.14198v1 Announce Type: cross Abstract: Banks analyse sequential financial transaction data to perform many tasks, including fraud prevention, credit risk assessment and offer personalizatio

safetyarxiv-cs-cl

MobileMem: Learning from a Year of Mobile Experiences

arXiv:2608.13606v1 Announce Type: new Abstract: The next generation of AI agents is increasingly moving beyond systems that answer isolated questions toward persistent personal assistants that can und

OCOO-T : A Simple and Scalable Virtual Cell Model for Transcriptional Perturbation Response Prediction

arXiv:2606.12838v2 Announce Type: replace-cross Abstract: Predicting single-cell transcriptional responses to genetic, chemical and cytokine perturbations is a fundamental challenge in computational b

PISA: A Pseudo-Individual Source-Domain Feature Adaptation Framework for Test-Time Open-Vocabulary Object Detection

arXiv:2608.14142v1 Announce Type: new Abstract: Open-vocabulary object detection test-time adaptation (OVOD-TTA) aims to address the performance degradation that pre-trained base models suffer when en

safetyarxiv-cs-cv

Tutorials

Point-Supervised Skeleton-Based Human Action Segmentation

arXiv:2603.06201v2 Announce Type: replace Abstract: Skeleton-based temporal action segmentation is a fundamental yet challenging task, playing a crucial role in enabling intelligent systems to perceiv

tutorialsarxiv-cs-cv

PRM-as-a-Judge 1.5: A Toolkit for Robot Process Assessment

model-releasesarxiv-cs-cv

arXiv:2608.14284v1 Announce Type: cross Abstract: Fine-grained robotic evaluation matters for understanding embodied models, going beyond binary success rates and rule-based process scores. We present

READ: A Retrieval-Alignment Diffusion Framework for Structure-based Drug Design

arXiv:2506.14488v2 Announce Type: replace-cross Abstract: Structure-based drug design (SBDD) models are central to modern pharmaceutical research, enabling the rational exploration of protein-ligand i

safetyarxiv-cs-lg

TeachMateGPT: A Multi-Agent Knowledge-Grounded Framework for Pedagogical Assessment Generation from Science Curriculum Materials

arXiv:2608.13708v1 Announce Type: cross Abstract: Automatically generating textbook-grounded assessment items can reduce science teachers' workload, but existing retrieval-augmented generation (RAG) s

agentsarxiv-cs-ai

TRUE-Colon: Exposing a Consistent Transfer Asymmetry in Real-Time Polyp Detection

arXiv:2608.13711v1 Announce Type: cross Abstract: Computer-aided detection (CADe) systems for colonoscopy promise to reduce clinical miss rates, yet reliable real-world deployment remains elusive. Thi

applicationsarxiv-cs-cv

AI for Mycetoma Diagnosis in Histopathological Images: The MICCAI 2024 Challenge

arXiv:2512.21792v2 Announce Type: replace Abstract: Mycetoma is a neglected tropical disease caused by fungi or bacteria leading to severe tissue damage and disabilities. It affects poor and rural com

applicationsarxiv-cs-cv

Can Generalist Vision Language Models (VLMs) Rival Specialist Medical VLMs? Benchmarking and Strategic Insights

arXiv:2506.17337v5 Announce Type: replace-cross Abstract: Vision Language Models (VLMs) have shown promise in automating image diagnosis and interpretation in clinical settings. However, developing sp

CityRiSE: Reasoning Urban Socio-Economic Status in Large Vision-Language Models via Reinforcement Learning

arXiv:2510.22282v2 Announce Type: replace-cross Abstract: Urban socio-economic sensing plays a vital role in advancing global sustainable development goals. With the advent of Large Vision-Language Mo

Tutorials

Class Geometry as Supervision for Sample-Efficient Open-World Detection

arXiv:2608.12698v1 Announce Type: new Abstract: Open-world object detection requires models to recognize known categories, reject unfamiliar objects, and incorporate new classes over time. This is esp

tutorialsarxiv-cs-cv

Concept Drift Detection and Adaptive Retraining of Malware Classification Models

arXiv:2608.13465v1 Announce Type: cross Abstract: Concept drift refers to changes over time in the statistical properties of data, as compared to the data that was used to train a learning model. Mach

Decomposition of Evidence, Contradiction, and Fragility in Perturbation Responses

arXiv:2608.12935v1 Announce Type: new Abstract: Perturbation methods explain model decisions by measuring prediction changes under altered inputs, but response magnitude tells us only how much a model

Dual-Flow Transformers: Decoupling the Primary Prefill Path from Additional Decode Computation

arXiv:2608.12385v1 Announce Type: new Abstract: As large language models serve more requests, cumulative inference cost is becoming increasingly important relative to one-time training cost. The two i

EGRL: Edge generation-guided relation-aware learning for RNA-protein interaction prediction

arXiv:2608.12906v1 Announce Type: cross Abstract: RNA-Protein Interactions (RPIs) are critical for regulating cellular functions. While traditional wet-lab experiments for RPI detection are costly and

How Good are Foundation Models in Longitudinal MRI Disease Progression Reasoning?

model-releasesarxiv-cs-cv

arXiv:2608.13309v1 Announce Type: new Abstract: Magnetic Resonance Imaging (MRI) interpretation is fundamental to clinical decision-making, requiring radiologists to integrate multi-view anatomical pl

Knowledge-guided Pattern Discovery via Coupled Tensor Factorizations

arXiv:2608.13234v1 Announce Type: new Abstract: In order to understand complex systems such as the human metabolome or human brain, different sensing technologies are used, generating complex data. Th

researcharxiv-cs-lg

Large Language Models Pass the History Exam But Miss the <<History>>: A Polish High School Exit Exam Matura Benchmark

model-releasesarxiv-cs-cl

arXiv:2608.12343v1 Announce Type: new Abstract: AI chatbots are widely used by students as knowledge sources, yet LLM benchmarks rarely assess interpretative historical reasoning. We evaluate eight le

LongEarth-R1: Benchmarking and Aligning Vision-Language Models for Long-Horizon Earth Observation Reasoning

arXiv:2608.13344v1 Announce Type: new Abstract: Long-horizon Earth observation reasoning requires models to organize multi-stage geographic evolution, localize spatial changes, detect temporal anomali

QuISE: Defense against Typographic Attacks on VLMs via Query-Irrelevant Semantic Editing

arXiv:2608.13119v1 Announce Type: new Abstract: Typographic attacks pose a critical threat to vision-language models (VLMs) by injecting misleading text into images and causing models to rely on adver

researcharxiv-cs-cv

Reconstructing Historical Manuscripts through MSI: The Potential of Contrast in Assessing Image Quality and Legibility

arXiv:2608.13381v1 Announce Type: new Abstract: Digital restoration of historical manuscript images aims to improve readability while preserving the authenticity of cultural heritage documents. Howeve

researcharxiv-cs-cv

Local Ai

SketchSense: Learning to Interpret Imperfect Sketch Guidance for Image Inpainting

arXiv:2608.13186v1 Announce Type: new Abstract: Sketch-guided image inpainting provides intuitive structural control, yet real sketches often mix reliable global intent with locally crowded, displaced

local-aiarxiv-cs-cv

TraVEL: Trajectory-Guided Video Embedding Learning for Driving-Video Retrieval

model-releasesarxiv-cs-cv

arXiv:2608.13495v1 Announce Type: new Abstract: Efficiently retrieving relevant clips from large-scale driving logs is essential for data curation, model development, and safety analysis. Structured a

How China-Origin Vision-Language Models Move from Refusal to Reframing in State Alignment

arXiv:2608.11816v1 Announce Type: cross Abstract: State-aligned distortion has been documented in China-origin text-based large language models (LLMs), but whether, and in what form, it arises in mult

13 Aug 2026

ConfTriage: A Calibration-Aware LLM Triage Framework for Pulmonary Nodule Malignancy with Selective Specialist Deferral

arXiv:2608.10885v1 Announce Type: new Abstract: Pulmonary nodule malignancy prediction typically depends on image-trained specialist deep learning (DL) models that require substantial annotated imagin

safetyarxiv-cs-cv

12 Aug 2026

Conversational versus Dashboard Explainable AI for UAV Intrusion Detection: An Empirical Study of Operator Trust and Reliance

arXiv:2608.10434v1 Announce Type: new Abstract: Machine learning-based Intrusion Detection Systems (IDS) have demonstrated superior performance in securing Unmanned Aerial Vehicle (UAV) networks. Howe

12 Aug 2026

DIMOS: Disentangling Instance-level Moving Object Segmentation