Search: “multimodal”

Open-Linguistic Concept Unified Learning for Cross-Site Interpretable Dermatology Image Diagnosis

arXiv:2608.03225v1 Announce Type: new Abstract: Human-interpretable computer-aided diagnosis is crucial for clinical decision making. Concept-based models excel by providing transparent reasoning and

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Predictive Set Theory: A Generative Framework for Cognitive Architecture with Operationalized Core Mechanisms

DGX agent

arXiv:2608.02704v1 Announce Type: new Abstract: Predictive processing theories portray the brain as a hierarchical prediction engine that minimizes prediction error, yet they lack operational definiti

researcharxiv-cs-ai

5 Aug 2026

SlimVLM: Sensitivity-aware Dynamic Structured Pruning with Adaptive Visual Token Selection for Efficient Vision-Language Models

arXiv:2608.03580v1 Announce Type: new Abstract: While Vision-Language Models (VLMs) have demonstrated remarkable performance in processing and understanding both text and images, their large parameter

UniGD: A Unified Generative-Discriminative Framework for Industrial Retrieval

arXiv:2608.03150v1 Announce Type: new Abstract: Generative retrieval (GR) is a promising paradigm for industrial search advertising, yet its deployment is constrained by strict relevance and latency r

researcharxiv-cs-ai

UniWorld-Design: From Pixel Generation to Layer-Native Design

arXiv:2608.03971v1 Announce Type: new Abstract: We introduce UniWorld-Design, a framework that redefines image generation from flat pixel synthesis to structured visual composition, with semantic RGBA

VIBE: Vector Index Benchmark for Embeddings

model-releasesarxiv-cs-lg

arXiv:2505.17810v2 Announce Type: replace Abstract: Approximate nearest neighbor (ANN) search is a performance-critical component of many machine learning pipelines, and rigorous benchmarking is essen

Abduction Without a Body? Representational Grounding and the Abduction Loop for Scientific Hypothesis Generation

arXiv:2608.02505v1 Announce Type: cross Abstract: Can scientific abduction occur without continuous sensorimotor embodiment? Recent arguments in AI and philosophy of science hold that genuine hypothes

ACE-GraphRAG: Agentic Context Engineering for Hierarchical GraphRAG

arXiv:2608.01269v1 Announce Type: new Abstract: Hierarchical Graph Retrieval-Augmented Generation (GraphRAG) organizes corpus knowledge at multiple levels of granularity, yet fixed context constructio

safetyarxiv-cs-cl

AdaThinkV: Adaptive Thinking for Token-Efficient Video Reasoning

arXiv:2608.01980v1 Announce Type: new Abstract: Chain-of-thought (CoT) reasoning can improve performance on difficult video questions but often wastes decoding tokens on simple ones. We study whether

safetyarxiv-cs-cv

Amortized Inference of Multi-Modal Posteriors using Likelihood-Weighted Normalizing Flows

model-releasesarxiv-cs-lg

arXiv:2512.04954v3 Announce Type: replace Abstract: We present a novel technique for amortized posterior estimation using Normalizing Flows trained with likelihood-weighted importance sampling. This a

ArabicDialectSafety: A Dialect-Aware Benchmark for Arabic Content Safety Classification

arXiv:2608.01291v1 Announce Type: new Abstract: We present ArabicDialectSafety, a human-curated Arabic safety dataset of 25,071 prompts covering six Arabic varieties: Modern Standard Arabic, Syrian, E

Artificial Intelligence for the Characterization of Particles and Fibers by Optical Microscopy

arXiv:2608.00361v1 Announce Type: new Abstract: Optical microscopy of particle and fiber dispersions involves interpreting subtle visual cues influenced by specimen morphology, chemical composition, m

Beyond Symmetric Fusion: Exploiting Task-Dependent Modality Strengths for RGB-Event Small Object Detection

arXiv:2608.01302v1 Announce Type: new Abstract: State-of-the-art RGB-Event detectors improve the detection of small, fast-moving objects by combining complementary features from RGB and Event data, ye

Can Humans Dream of Electric Sheep? Human-Written Samples for Fine-Grained Vision-and-Language Hallucination Benchmarking

arXiv:2608.01021v1 Announce Type: cross Abstract: In an age of rapid model turnover, how do we make hallucination evaluation more perennial? We explore whether human-written hallucination samples coul

Can You Trust the Confidence? ConfBench for Vision-Language Models on Document Extraction

arXiv:2608.01792v1 Announce Type: cross Abstract: Intelligent document processing (IDP) with vision-language models (VLMs) hinges on confidence scores trustworthy enough to route extractions between a

Characterizing Treatment-Context Medication Evidence Across Clinic Notes and Structured EHR Medication History

arXiv:2608.01570v1 Announce Type: new Abstract: Clinic notes and structured electronic health record (EHR) medication history often contain different medication information. Same-visit disagreement be

Tutorials

CoT-Edit: Let CoT Guide Instruction Video Editing

arXiv:2608.01113v1 Announce Type: new Abstract: Text-driven instruction-based video editing in complex scenes remains challenging: purely textual prompts often fail to capture precise spatial relation

tutorialsarxiv-cs-cv

Counting the Cost of War Under Satellite Embargo: Zero-Shot Estimation of Impacted Infrastructure

arXiv:2608.00119v1 Announce Type: new Abstract: Rapid estimation of impacted structures - critical for conflict-zone humanitarian response - is frequently hindered by post-strike satellite data embarg

safetyarxiv-cs-cv

Decoding Children's Gait Behavior

arXiv:2608.00371v1 Announce Type: new Abstract: We introduce a new problem domain for human action recognition: the fine-grained analysis of children's gait behaviors from standard RGB video. We speci

Decoupling semantics from vision: A framework for faithful visual-text compression evaluation

arXiv:2608.01848v1 Announce Type: new Abstract: Recent visual-text compression (VTC) methods, typified by DeepSeek-OCR, report impressive high token compression ratios for long-context modeling tasks

DiffusionGemma Technical Report

arXiv:2608.00146v1 Announce Type: new Abstract: We introduce DiffusionGemma, an experimental open-weight language model that uses discrete diffusion to generate text at exceptionally high speed. Rathe

Discriminative Axis, Not Data Volume: What a Contrastive Corpus Teaches an Audio Embedding

arXiv:2608.01560v1 Announce Type: new Abstract: Scaling the corpus is the default remedy when a contrastive representation lacks an attribute. We report a case where it does nothing, and identify what

Distill What the Student Can See: Fisher-Projected On-Policy Distillation for Vision-Language Models

arXiv:2608.01263v1 Announce Type: new Abstract: On-policy distillation (OPD) samples trajectories from the current student policy and minimizes token-level divergence between student and teacher next-

safetyarxiv-cs-lg

Agents

DriveCode: Domain Specific Numerical Encoding for LLM-Based Autonomous Driving

arXiv:2603.00919v3 Announce Type: replace Abstract: Large language models (LLMs) have shown great promise for autonomous driving. However, discretizing numbers into tokens limits precise numerical rea

agentsarxiv-cs-cv

EgoIntent: A Pre-Outcome Micro-Step Benchmark for Understanding What, Why, and Next

arXiv:2603.12147v2 Announce Type: replace Abstract: Egocentric video provides a natural modality for studying human behavior, but conventional visual understanding captures mainly observable scenes, o

Grounded Vision-Language Interpreter for Long-Horizon Bimanual Task and Motion Planning

arXiv:2506.03270v3 Announce Type: replace Abstract: While recent advances in vision-language models have accelerated language-guided robot planning, their black-box nature lacks the safety guarantees

safetyarxiv-cs-ro

HAFI-VLM: A Frequency Perspective for Diagnosing and Enhancing Visual Perception in Vision-Language Models

arXiv:2608.02124v1 Announce Type: cross Abstract: Vision-language models (VLMs) remain unreliable when predictions require fine-grained visual evidence. We identify a previously overlooked cause: spec

IDraw: Artist Verification from Digital Drawing Images

arXiv:2608.01737v1 Announce Type: new Abstract: As digital drawings are increasingly shared online, reliable authorship verification has become important for protecting artists and resolving disputes.

Learning Panorama-Aware VLA for Mobile Manipulation with Whole-Body Teleoperation

arXiv:2608.02257v1 Announce Type: new Abstract: Mobile manipulation is a key capability for embodied intelligence, enabling robots to accomplish complex multi-stage tasks in open-world environments. H

safetyarxiv-cs-ro

Localization in Spatiotemporal Fields via Environmental PDEs

arXiv:2608.00272v1 Announce Type: new Abstract: This paper proposes a localization framework that uses spatiotemporal fields governed by partial differential equations (PDEs) as localization signature

safetyarxiv-cs-ro

MemSIF: From Structured Interactions to Dual-Track Fact Memory for LLM Agents

arXiv:2608.01742v1 Announce Type: cross Abstract: Long-term memory is critical for LLM agents operating over long-horizon interactions. However, several persistent limitations of existing memory syste

Messages, Not Tokens: Grounded Coresets for Faithful VLM Compression

arXiv:2608.02134v1 Announce Type: new Abstract: Modern vision language models (VLMs) turn high-resolution images into long sequences of visual tokens. Every token traverses the language decoder and pe

MonitorVLM-v2: A Deployed Vision-Language Framework for Real-Time Safety Violation Detection

arXiv:2608.00975v1 Announce Type: new Abstract: Large vision--language models (VLMs) can reason step by step about complex visual scenes, but this open-ended, autoregressive chain-of-thought (CoT) app

safetyarxiv-cs-cv

MoRAL: Sensor-Grounded BEV Reasoning for Compact VLMs toward Edge-Oriented Autonomous Driving

arXiv:2608.02449v1 Announce Type: new Abstract: Deploying vision-language models (VLMs) for safety-critical spatial reasoning on resource-constrained autonomous driving platforms requires both compact

Parameter-Dynamic Adaptive Fusion and Calibration Network for RGBT Tracking

arXiv:2608.01807v1 Announce Type: new Abstract: Existing RGBT trackers typically employ fusion functions with fixed parameters across different targets and scenarios. Although dynamic-architecture met

PhysAgent: A Multi-Agent Framework for Reliable Remote Heart Rate Estimation

arXiv:2608.00066v1 Announce Type: new Abstract: Remote photoplethysmography (rPPG) enables non-contact heart-rate estimation from facial videos, but its weak physiological signal is easily corrupted b

ScrambleToolBench: Agents Search Exhaustively Even When Their Own Map Points to the Next Step

arXiv:2608.02358v1 Announce Type: new Abstract: To operate robustly in open-world environments, autonomous agents should be able to infer the behavior of unfamiliar systems through interaction alone,

Seeing the Unseen: Towards Training-Free Inspection for Wind Turbine Blades Using Knowledge-Augmented Vision Language Models

arXiv:2510.22868v2 Announce Type: replace Abstract: Wind turbine blades operate in harsh environments, making timely damage detection essential for preventing failures and optimizing maintenance. Dron

Local Ai

StyleForge: Indoor Furniture Styling by Counterfactual Reasoning in a Hypergraph Field

arXiv:2608.01954v1 Announce Type: new Abstract: Fixed-layout indoor furniture styling requires selecting assets that form a coherent room without changing the prescribed furniture categories, position

local-aiarxiv-cs-cv

Local Ai

TELLER: Non-intrusive Cross-Layer Root-Cause Analysis for LLM Inference

arXiv:2608.01975v1 Announce Type: cross Abstract: Large language model (LLM) inference has evolved from an offline workload into a continuously operated software service, yet root-cause analysis remai

local-aiarxiv-cs-cl

Local Ai

Through the LENS: Local Geometric Decomposition of Vision-Language Model Representations

arXiv:2608.00561v1 Announce Type: cross Abstract: Vision-language models (VLMs) process image patches and text tokens in a shared residual stream, but the local geometry through which the two modaliti

local-aiarxiv-cs-cl

TS-Reasoner: Aligning Time Series Foundation Models with LLM Reasoning

arXiv:2510.03519v2 Announce Type: replace Abstract: Time series reasoning is crucial to decision-making in diverse domains, including finance, energy, and scientific discovery. While existing time ser

safetyarxiv-cs-cl

When Retrieval Helps and Distracts: Evaluating Evidence-Generating LLMs for Biomedical Claim Verification

arXiv:2608.01409v1 Announce Type: new Abstract: Biomedical fact-checking systems must do more than predict whether a claim is supported, contradicted, or unaddressed: they should also produce evidence

Adjudicated Captioning: Multi-Agent Alignment Scoring and Consensus-Distilled Beam Arbitration for Strict Zero-Shot Image Captioning

arXiv:2607.28986v1 Announce Type: cross Abstract: Zero-shot image captioning (ZIC) describes images without paired image-caption supervision during captioner training, relying on text-only corpora and

safetyarxiv-cs-ai

DoubleHelix: Structured Cross-Modal Fusion for Audio-Visual Speech Recognition with LLMs

arXiv:2607.29112v1 Announce Type: cross Abstract: Audio-visual speech recognition (AVSR) relies on effective fusion of audio and visual modalities, yet existing approaches treat cross-modal interactio

safetyarxiv-cs-ai

Agents

EduPanel: A Three-Agent LLM Judge for Teaching Videos -- Reliability, Complementarity, and Human Trust Calibration

arXiv:2607.18529v2 Announce Type: replace-cross Abstract: Teaching videos are becoming a major medium for education, creating a growing need for scalable evaluation of their pedagogical quality. Exist

agentsarxiv-cs-ai

Evaluation-Verification Reward for Consistent Multi-Reference Image Editing

arXiv:2607.29025v1 Announce Type: new Abstract: While recent image editing models have made rapid progress, multi-reference editing remains challenging, particularly in maintaining visual consistency

GEMSS: A Variational Method for Discovering Multiple Sparse Solutions in Classification and Regression Problems

model-releasesarxiv-cs-lg

arXiv:2602.08913v3 Announce Type: replace Abstract: In underdetermined regression and classification problems, multiple feature subsets often yield equivalent predictive performance. In applied settin