Search: “multimodal”

arXiv:2607.21881v1 Announce Type: new Abstract: Agricultural field maps are often proprietary, incomplete, or outdated, yet they provide the spatial framework for crop monitoring, production accountin

applicationsarxiv-cs-cv

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

General Value Functions for Remaining Useful Life and Failure-Mode Prediction

DGX agent

arXiv:2607.22268v1 Announce Type: cross Abstract: Remaining useful life (RUL) prediction and failure-mode classification are central tasks in predictive maintenance. Many data-driven pipelines use fix

researcharxiv-cs-lg

27 Jul 2026

Layer-wise LoRA fine-tuning: a similarity metric approach

model-releasesarxiv-cs-lg

arXiv:2602.05988v2 Announce Type: replace Abstract: Pre-training Large Language Models (LLMs) on web-scale datasets becomes fundamental for advancing general-purpose AI. In contrast, enhancing their p

Low-Altitude Channel Multipath Prediction via Panoramic Perception and Vision-Language Model

arXiv:2607.21953v1 Announce Type: new Abstract: Unmanned aerial vehicle (UAV) communication is expected to support a wide range of low-altitude applications in 6G mobile networks. However, traditional

MEUSLI: a Multilingual Projector for LLM-based ASR and Beyond

arXiv:2607.22100v1 Announce Type: new Abstract: Lightweight projectors are an established way to connect pre-trained speech encoders with large language models (LLMs), mapping acoustic features into t

researcharxiv-cs-cl

Molt: A Scalable PyTorch-Native Training Framework for Agentic Reinforcement Learning

arXiv:2607.21653v1 Announce Type: cross Abstract: Agentic reinforcement learning research is constant algorithm modification, new estimators, new pipeline stages, new rollout schemes, and in mainstrea

safetyarxiv-cs-cl

An Evaluation Framework for Structured Audio Captions Validated by Controlled Perturbations

arXiv:2607.21424v1 Announce Type: new Abstract: Recent advancements in automated audio captioning (AAC) have shifted from monolithic sentence generation toward structured formats that explicitly disen

researcharxiv-cs-cl

Tutorials

Beyond SBDD: Geometric Deep Learning in Polypharmacology and Multi-target Drug Design

arXiv:2607.20550v1 Announce Type: cross Abstract: The traditional 'one drug, one target' paradigm of structure-based drug design (SBDD) frequently proves inadequate for treating multifactorial disease

tutorialsarxiv-cs-ai

GroupVideo: Multi-Identity Customized Text-to-Video Generation

arXiv:2607.21027v1 Announce Type: new Abstract: Current identity customized video generation methodologies are predominantly limited to single-identity scenarios, as the lack of explicit identity sepa

Agents

GS-Agent: Creating 4D Physical Worlds With Generative Simulation

arXiv:2607.21522v1 Announce Type: cross Abstract: Creating dynamic and physically realistic 4D worlds from natural language descriptions is both fascinating and challenging. Traditional computer graph

agentsarxiv-cs-ai

Marking the Wrong Symptoms: Evaluating LLM Watermarks in Medical Texts

arXiv:2607.20462v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly integrated into clinical workflows, stressing the need for reliable traceability of model-generated output

researcharxiv-cs-ai

MedGame: Storytelling Gamification Empowered by Large Language Models for Medical Education

model-releasesarxiv-cs-cl

arXiv:2607.21570v1 Announce Type: new Abstract: Large Language Models (LLMs) show promise for medical education, but most existing systems focus on localized interactions such as question answering or

MemTools: A Unified Research Framework for Interoperable Agent Memory

model-releasesarxiv-cs-cl

arXiv:2607.21404v1 Announce Type: new Abstract: While memory systems are essential for agent architectures, pervasive architectural fragmentation restricts systematic research. Existing implementation

Multi-Task Learning for Heterogeneous Prediction from Video Game State with Transfer Learning

arXiv:2607.21290v1 Announce Type: cross Abstract: Multi-task learning (MTL) is a promising approach for prediction tasks derived from video game state data, as modern game telemetry provides multiple

researcharxiv-cs-ai

MVEI & EmObserver: Empowering MLLM-Oriented Visual Emotional Intelligence via Emotion Statement Judgement

arXiv:2607.21061v1 Announce Type: new Abstract: Affective Image Content Analysis (AICA) aims to recognize and understand emotions elicited by visual content, representing an indispensable step toward

OpenForgeRL: Train Harness-native Agents in Any Environment

arXiv:2607.21557v1 Announce Type: new Abstract: Modern AI agents rely on elaborate inference harnesses such as Claude Code, Codex, and OpenClaw to drive multi-turn reasoning, tool use, and access to e

Semantics at an Angle: When Cosine Similarity Works Until It Doesn't

arXiv:2504.16318v3 Announce Type: replace Abstract: Cosine similarity is a standard comparison rule for learned representations in information retrieval, natural language processing, computer vision,

researcharxiv-cs-lg

URF: A Unified Robot Control-Policy Framework for Stable Contact Aware Manipulation

arXiv:2607.20912v1 Announce Type: new Abstract: Learning-based manipulation policies usually predict robot actions from sensory observations and leave their execution to a separate low-level controlle

safetyarxiv-cs-ro

When Are Reasoning-Based Guardrails Not Efficient? ResponseGuard: A Fast Vision-Language Guard for Real-Time Moderation

arXiv:2607.21401v1 Announce Type: cross Abstract: A vision-language AI assistant returns its answer as a stream of generated tokens. Therefore, a safety guard that watches that answer has to keep up w

Tutorials

Antigen-specific Antibody Multi-modal Foundation Model for Functional Antibody Design

arXiv:2607.20057v1 Announce Type: cross Abstract: Antibodies are essential proteins that play a central role in immune recognition by binding specific antigen molecules. Although recent protein langua

tutorialsarxiv-cs-lg

Clinical Pathways as Safety Specifications for Physical AI in Hospital Wards

arXiv:2607.19827v1 Announce Type: new Abstract: Ensuring safety in Physical AI systems operating in real-world environments is a critical challenge, particularly in hospital wards where vulnerable pat

safetyarxiv-cs-ro

Contrastive On-Policy Distillation

arXiv:2607.19046v1 Announce Type: new Abstract: On-policy Distillation (OPD) supervises a student model on trajectories sampled from its own policy by minimizing the divergence between the output dist

CreatiPoster: Towards Editable and Controllable Multi-Layer Graphic Design Generation

arXiv:2506.10890v2 Announce Type: replace Abstract: Graphic design plays a crucial role in both commercial and personal contexts, yet creating high-quality, editable, and aesthetically pleasing graphi

Detect Early, Escalate Rarely: Anytime Detection of AI-Generated Video from the Compressed Bitstream

arXiv:2607.19476v1 Announce Type: new Abstract: Detectors for AI-generated video are evaluated offline. A clip is decoded to pixels and scored once, increasingly by a large vision-language model. Dete

Local Ai

Development of an automated, reliable, and clinically meaningful artificial intelligence (AI) tool for diagnosing cardiac disease from conventional cardiovascular magnetic resonance (CMR) images

arXiv:2607.20087v1 Announce Type: new Abstract: Aims: Cardiovascular magnetic resonance (CMR) imaging enables non-invasive assessment of myocardial structure, function, and pathology, but requires sub

local-aiarxiv-cs-cv

Dual Adversarial Fine-tuning for Enhancing Robustness of Large Vision Language Model

arXiv:2607.18958v1 Announce Type: new Abstract: While Large Vision-Language Models (LVLMs), represented by LLaVA and GPT-4V, have demonstrated remarkable capabilities, their visual inputs remain vulne

Applications

EA-Nav: Learning Safe Visual Navigation Policies with Embodiment Awareness

arXiv:2607.19880v1 Announce Type: new Abstract: Cross-embodiment navigation is a key challenge in embodied intelligence. Due to differences in embodiment, the same visual observation may imply differe

applicationsarxiv-cs-ro

ENTRAP-VL: A Taxonomic Probe for Dual Contextual Entrainment in Vision-Language Models

arXiv:2607.20092v1 Announce Type: cross Abstract: Contextual entrainment is the tendency of a model to let auxiliary context in its input pull its output, independently of whether that context is rele

LC-SLab -- An object-based deep learning framework for large-scale land cover classification from satellite imagery and sparse in-situ labels

arXiv:2509.15868v2 Announce Type: replace Abstract: Large-scale land cover maps generated using deep learning play a critical role across a wide range of Earth science applications. Open in-situ datas

Lean-SAM2: Target-Anchored Memory and Encoder Acceleration for SAM2

arXiv:2607.19811v1 Announce Type: new Abstract: The Segment Anything Model 2 (SAM2) has advanced temporal promptable segmentation, yet its deployment remains hindered by heavy memory cross-attention o

Hardware

Mage-Flow: An Efficient Native-Resolution Foundation Model for Image Generation and Editing

arXiv:2607.19064v2 Announce Type: replace-cross Abstract: Large-scale visual generators are increasingly capable but costly to train, fine-tune, and deploy. We introduce Mage-Flow, a compact 4B-scale

hardwarearxiv-cs-ai

Mitigating Modality and Language-Style Gaps for Zero-Shot Video Moment Retrieval

arXiv:2607.19027v1 Announce Type: new Abstract: Zero-shot video moment retrieval aims to overcome the limitations of traditional approaches that require large-scale datasets annotated with text and it

MVGD-Net: A Novel Motion-aware Video Glass Surface Detection Method

arXiv:2601.13715v2 Announce Type: replace Abstract: Glass surface ubiquitous in both daily life and professional environments presents a potential threat to vision-based systems, such as robot and dro

Now We Know? A Systematic Comparison of TerraMind and THOR

arXiv:2607.18504v1 Announce Type: cross Abstract: Benchmarks for Geospatial Foundation Models (GFMs) increasingly rank models by aggregate score, but such rankings obscure why models differ: how much

Read or Ignore? A Unified Benchmark for Typographic-Attack Robustness and Text Recognition in Vision-Language Models

arXiv:2512.11899v2 Announce Type: replace Abstract: Large vision-language models (LVLMs) are vulnerable to typographic attacks, where misleading text inserted into an image can override visual underst

Local Ai

RIM: A Retrieval-In-Matching Framework for Cross-Domain Global Visual Localization of UAVs

arXiv:2607.20116v1 Announce Type: new Abstract: Global visual localization of unmanned aerial vehicles (UAVs) using remote-sensing reference maps has attracted increasing attention. However, acquisiti

local-aiarxiv-cs-cv

Local Ai

Robust Activation Map Rectification for Weakly Supervised Volumetric Segmentation: Temporal Coherence as a Free Lunch

arXiv:2607.19877v1 Announce Type: new Abstract: Weakly supervised segmentation relies heavily on class activation maps (CAMs) to initially localize target regions. However, CAMs are often noisy and pr

local-aiarxiv-cs-cv

Semantic Richness or Geometric Reasoning? The Fragility of VLM's Visual Invariance

arXiv:2604.01848v4 Announce Type: replace Abstract: This work investigates the fundamental fragility of state-of-the-art Vision-Language Models (VLMs) under basic geometric transformations. While mode

Applications

STEMTOX: From Collaborative Tags to Fine-Grained Toxic Meme Detection via Entropy-Guided Multi-Task Learning

arXiv:2508.04166v3 Announce Type: replace-cross Abstract: Memes, as a widely used mode of online communication, often serve as vehicles for spreading harmful content. However, limitations in data acce

applicationsarxiv-cs-cl

STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching

arXiv:2607.19986v1 Announce Type: new Abstract: Stereo matching is a fundamental task in 3D reconstruction. Despite remarkable advances, the prevailing paradigms formulate stereo matching as a determi

Agents

Symbol and Footprint Database for Electronic Components by Agentic Recognition and Generation

arXiv:2607.19767v1 Announce Type: new Abstract: A rich and recognizable component library is the cornerstone of printed circuit board (PCB) design and generation. Traditionally, engineers manually cre

agentsarxiv-cs-ai

VizRAG: Enhancing Retrieval-Augmented Generation with Hypergraph Visualization

arXiv:2607.19830v1 Announce Type: new Abstract: Hypergraph-based RAG systems surpass traditional graph-based approaches by organizing complex n-ary atomic facts among entities, rather than relying sol

researcharxiv-cs-cl

A Hybrid Mamba for Audio-Visual Navigation

arXiv:2607.13110v1 Announce Type: cross Abstract: Since the paradigm centered on convolutional neural networks and recurrent architectures was established in 2020, the fundamental backbone networks fo

researcharxiv-cs-ai

CF-Net: Conflict Fusion with Speaker Normalisation and Certainty Weighting for Ambivalence/Hesitancy Recognition

arXiv:2607.13976v1 Announce Type: new Abstract: Detecting ambivalence and hesitancy (AH) in unconstrained video is challenging because the target signal is inherently ambiguous and expressed through s

Continuously Evolving Deepfake Detection: An Architecture and Public-Benchmark Evaluation of a Dynamic Detection System

arXiv:2607.13234v1 Announce Type: cross Abstract: Deepfake detectors that achieve near-perfect scores on academic benchmarks collapse on real-world content: recent in-the-wild evaluations report AUC d

Agents

Multi-Agent Collaborative Reasoning with Tool-Augmented Evidence for Urban Region Profiling

arXiv:2607.13558v1 Announce Type: new Abstract: Urban region profiling constitutes a core problem in urban computing, supporting applications such as population estimation, economic assessment, and en

agentsarxiv-cs-ai

Prospective clinical indication, post-hoc report leakage, and fusion design in multi-image chest radiograph classification: a patient-clustered evaluation

arXiv:2607.13800v1 Announce Type: cross Abstract: Chest radiograph datasets often combine multiple images with Clinical Indication, Findings, and Impression, although these inputs are produced at diff

Quantum Circuit Vision: Cost-Aware Evaluation of Visual AI Agents for Quantum Code Generation

arXiv:2607.10057v1 Announce Type: cross Abstract: Can AI agents visually comprehend quantum circuit diagrams and generate verified executable code--and at what cost? We present Quantum Circuit Vision,