Search: “multimodal”

PianoFlow: Music-Aware Streaming Piano Motion Generation with Bimanual Coordination

arXiv:2604.12856v1 Announce Type: new Abstract: Audio-driven bimanual piano motion generation requires precise modeling of complex musical structures and dynamic cross-hand coordination. However, exis

Qwen3 technical arch

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

Qwen3 is a series of large language models spanning both dense and Mixture-of-Experts (MoE) architectures, with parameter scales ranging from 0.6B to 235B, and a key innovation being the integration o

local-air-stablediffusion

15 Apr 2026

Reading Between the Pixels: Linking Text-Image Embedding Alignment to Typographic Attack Success on Vision-Language Models

model-releasesarxiv-cs-cv

arXiv:2604.12371v1 Announce Type: new Abstract: We study typographic prompt injection attacks on vision-language models (VLMs), where adversarial text is rendered as images to bypass safety mechanisms

Redefining Quality Criteria and Distance-Aware Score Modeling for Image Editing Assessment

arXiv:2604.12175v1 Announce Type: new Abstract: Recent advances in image editing have heightened the need for reliable Image Editing Quality Assessment (IEQA). Unlike traditional methods, IEQA require

safetyarxiv-cs-cv

RePAIR: Interactive Machine Unlearning through Prompt-Aware Model Repair

arXiv:2604.12820v1 Announce Type: new Abstract: Large language models (LLMs) inherently absorb harmful knowledge, misinformation, and personal data during pretraining on large-scale web corpora, with

local-aiarxiv-cs-ai

Retrievals Can Be Detrimental: Unveiling the Backdoor Vulnerability of Retrieval-Augmented Diffusion Models

arXiv:2501.13340v4 Announce Type: replace Abstract: Diffusion models (DMs) have recently demonstrated remarkable generation capability. However, their training generally requires huge computational re

Ride the Wave: Precision-Allocated Sparse Attention for Smooth Video Generation

arXiv:2604.12219v1 Announce Type: cross Abstract: Video Diffusion Transformers have revolutionized high-fidelity video generation but suffer from the massive computational burden of self-attention. Wh

local-aiarxiv-cs-ai

SecureWebArena: A Holistic Security Evaluation Benchmark for LVLM-based Web Agents

model-releasesarxiv-cs-cv

arXiv:2510.10073v2 Announce Type: replace-cross Abstract: Large vision-language model (LVLM)-based web agents are emerging as powerful tools for automating complex online tasks. However, when deployed

Applications

SmellNet: A Large-scale Dataset for Real-world Smell Recognition

arXiv:2506.00239v5 Announce Type: replace Abstract: The ability of AI to sense and identify various substances based on their smell alone can have profound impacts on allergen detection (e.g. smelling

applicationsarxiv-cs-ai

Spatial Atlas: Compute-Grounded Reasoning for Spatial-Aware Research Agent Benchmarks

arXiv:2604.12102v1 Announce Type: new Abstract: We introduce compute-grounded reasoning (CGR), a design paradigm for spatial-aware research agents in which every answerable sub-problem is resolved by

Stress Detection Using Wearable Physiological and Sociometric Sensors

arXiv:2604.12746v1 Announce Type: new Abstract: Stress remains a significant social problem for individuals in modern societies. This paper presents a machine learning approach for the automatic detec

researcharxiv-cs-lg

Tencent HY-World-2.0 is now public

local-air-stablediffusion

Tencent HY-World 2.0 is an open-source AI world model that generates real 3D scenes directly usable in game engines like Unreal Engine and Unity; unlike previous versions which produced video-based wo

The Enforcement and Feasibility of Hate Speech Moderation on Twitter

arXiv:2604.12289v1 Announce Type: cross Abstract: Online hate speech is associated with substantial social harms, yet it remains unclear how consistently platforms enforce hate speech policies or whet

researcharxiv-cs-cl

Towards Platonic Representation for Table Reasoning: A Foundation for Permutation-Invariant Retrieval

arXiv:2604.12133v1 Announce Type: new Abstract: Historical approaches to Table Representation Learning (TRL) have largely adopted the sequential paradigms of Natural Language Processing (NLP). We argu

safetyarxiv-cs-ai

TriFit: Trimodal Fusion with Protein Dynamics for Mutation Fitness Prediction

model-releasesarxiv-cs-lg

arXiv:2604.12026v1 Announce Type: new Abstract: Predicting the functional impact of single amino acid substitutions (SAVs) is central to understanding genetic disease and engineering therapeutic prote

Uncertainty-Aware Image Classification In Biomedical Imaging Using Spectral-normalized Neural Gaussian Processes

arXiv:2602.02370v2 Announce Type: replace Abstract: Accurate histopathologic interpretation is key for clinical decision-making; however, current deep learning models for digital pathology are often o

safetyarxiv-cs-cv

Visual Diffusion Models are Geometric Solvers

arXiv:2510.21697v2 Announce Type: replace Abstract: In this paper we show that visual diffusion models can serve as effective geometric solvers: they can directly reason about geometric problems by wo

WikiSeeker: Rethinking the Role of Vision-Language Models in Knowledge-Based Visual Question Answering

model-releasesarxiv-cs-cl

arXiv:2604.05818v2 Announce Type: replace-cross Abstract: Multi-modal Retrieval-Augmented Generation (RAG) has emerged as a highly effective paradigm for Knowledge-Based Visual Question Answering (KB-

XRZero-G0: Pushing the Frontier of Dexterous Robotic Manipulation with Interfaces, Quality and Ratios

arXiv:2604.13001v1 Announce Type: new Abstract: The acquisition of high-quality, action-aligned demonstration data remains a fundamental bottleneck in scaling foundation models for dexterous robot man

safetyarxiv-cs-ro

Tutorials

A Data-driven Loss Weighting Scheme across Heterogeneous Tasks for Image Denoising

arXiv:2301.06081v4 Announce Type: replace-cross Abstract: In a variational denoising model, weight in the data fidelity term plays the role of enhancing the noise-removal capability. It is profoundly

tutorialsarxiv-cs-cv

A Proposed Biomedical Data Policy Framework to Reduce Fragmentation, Improve Quality, and Incentivize Sharing in Indian Healthcare in the era of Artificial Intelligence and Digital Health

arXiv:2604.11125v1 Announce Type: new Abstract: India generates vast biomedical data through postgraduate research, government hospital services and audits, government schemes, private hospitals and t

safetyarxiv-cs-ai

A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation

arXiv:2508.09977v4 Announce Type: replace Abstract: In the context of novel view synthesis, 3D Gaussian Splatting (3DGS) has recently emerged as an efficient and competitive counterpart to Neural Radi

ABot-Claw: A Foundation for Persistent, Cooperative, and Self-Evolving Robotic Agents

arXiv:2604.10096v1 Announce Type: new Abstract: Current embodied intelligent systems still face a substantial gap between high-level reasoning and low-level physical execution in open-world environmen

local-aiarxiv-cs-cv

Active Diffusion Matching: Score-based Iterative Alignment of Cross-Modal Retinal Images

arXiv:2604.10084v1 Announce Type: new Abstract: Objective: The study aims to address the challenge of aligning Standard Fundus Images (SFIs) and Ultra-Widefield Fundus Images (UWFIs), which is difficu

safetyarxiv-cs-cv

AHC: Meta-Learned Adaptive Compression for Continual Object Detection on Memory-Constrained Microcontrollers

arXiv:2604.09576v1 Announce Type: new Abstract: Deploying continual object detection on microcontrollers (MCUs) with under 100KB memory requires efficient feature compression that can adapt to evolvin

researcharxiv-cs-ai

AI tool to analyze a video and generate a prompt?

local-air-stablediffusion

This Reddit thread from r/StableDiffusion discusses the community's search for AI tools capable of analyzing an existing video and automatically generating a descriptive text prompt from it — essentia

Hardware

AIRA_2: Overcoming Bottlenecks in AI Research Agents

arXiv:2603.26499v2 Announce Type: replace Abstract: Existing research has identified three structural performance bottlenecks in AI research agents: (1) synchronous single-GPU execution constrains sam

hardwarearxiv-cs-ai

Ambivalence/Hesitancy Recognition in Videos for Personalized Digital Health Interventions

arXiv:2604.11730v1 Announce Type: new Abstract: Using behavioural science, health interventions focus on behaviour change by providing a framework to help patients acquire and maintain healthy habits

Any 3D Scene is Worth 1K Tokens: 3D-Grounded Representation for Scene Generation at Scale

arXiv:2604.11331v1 Announce Type: new Abstract: 3D scene generation has long been dominated by 2D multi-view or video diffusion models. This is due not only to the lack of scene-level 3D latent repres

Attention Sink in Transformers: A Survey on Utilization, Interpretation, and Mitigation

arXiv:2604.10098v1 Announce Type: new Abstract: As the foundational architecture of modern machine learning, Transformers have driven remarkable progress across diverse AI domains. Despite their trans

researcharxiv-cs-lg

Audio Flamingo Next: Next-Generation Open Audio-Language Models for Speech, Sound, and Music

arXiv:2604.10905v1 Announce Type: cross Abstract: We present Audio Flamingo Next (AF-Next), the next-generation and most capable large audio-language model in the Audio Flamingo series, designed to ad

Back to the Barn with LLAMAs: Evolving Pretrained LLM Backbones in Finetuning Vision Language Models

arXiv:2604.10985v1 Announce Type: new Abstract: Vision-Language Models (VLMs) have rapidly advanced by leveraging powerful pre-trained Large Language Models (LLMs) as core reasoning backbones. As new

BiCLIP: Domain Canonicalization via Structured Geometric Transformation

arXiv:2603.08942v2 Announce Type: replace-cross Abstract: Recent advances in vision-language models (VLMs) have demonstrated remarkable zero-shot capabilities, yet adapting these models to specialized

Breaking the KV Cache Bottleneck: Fan Duality Model Achieves O(1) Decode Memory with Superior Associative Recall

arXiv:2604.07716v2 Announce Type: replace Abstract: We present FDM (Fan Duality Model), a linear sequence architecture that resolves the fundamental tension between memory efficiency and associative r

researcharxiv-cs-lg

Applications

Can Textual Reasoning Improve the Performance of MLLMs on Fine-grained Visual Classification?

arXiv:2601.06993v2 Announce Type: replace Abstract: Multi-modal large language models (MLLMs) exhibit strong general-purpose capabilities, yet still struggle on Fine-Grained Visual Classification (FGV

applicationsarxiv-cs-cv

Hardware

CodeQuant: Unified Clustering and Quantization for Enhanced Outlier Smoothing in Low-Precision Mixture-of-Experts

arXiv:2604.10496v1 Announce Type: new Abstract: Outliers have emerged as a fundamental bottleneck in preserving accuracy for low-precision large models, particularly within Mixture-of-Experts (MoE) ar

hardwarearxiv-cs-lg

COMPOSITE-Stem

arXiv:2604.09836v1 Announce Type: new Abstract: AI agents hold growing promise for accelerating scientific discovery; yet, a lack of frontier evaluations hinders adoption into real workflows. Expert-w

CSPO: Alleviating Reward Ambiguity for Structured Table-to-LaTeX Generation

arXiv:2604.10918v1 Announce Type: new Abstract: Tables contain rich structured information, yet when stored as images their contents remain 'locked' within pixels. Converting table images into LaTeX c

safetyarxiv-cs-ai

CUTEv2: Unified and Configurable Matrix Extension for Diverse CPU Architectures with Minimal Design Overhead

arXiv:2604.11615v1 Announce Type: cross Abstract: Matrix extensions have emerged as an essential feature in modern CPUs to address the surging demands of AI workloads. However, existing designs often

researcharxiv-cs-ai

DA-PTQ: Drift-Aware Post-Training Quantization for Efficient Vision-Language-Action Models

arXiv:2604.11572v1 Announce Type: new Abstract: Vision-Language-Action models (VLAs) have demonstrated strong potential for embodied AI, yet their deployment on resource-limited robots remains challen

researcharxiv-cs-ro

Decoding Ancient Oracle Bone Script via Generative Dictionary Retrieval

arXiv:2604.09668v1 Announce Type: cross Abstract: Understanding humanity's earliest writing systems is crucial for reconstructing civilization's origins, yet many ancient scripts remain undeciphered.

🚀 deepagents 0.5 release 👉 Async subagents - kick off background tasks on any Agent Protocol backed server while you continue to interact …

model-releasesharrison-chase--x

🚀 deepagents 0.5 release 👉 Async subagents - kick off background tasks on any Agent Protocol backed server while you continue to interact with the main agent. Start multiple background tasks in parall

Degradation-Aware and Structure-Preserving Diffusion for Real-World Image Super-Resolution

arXiv:2604.11470v1 Announce Type: new Abstract: Real-world image super-resolution is particularly challenging for diffusion models because real degradations are complex, heterogeneous, and rarely mode

local-aiarxiv-cs-cv

Doc-PP: Document Policy Preservation Benchmark for Large Vision-Language Models

model-releasesarxiv-cs-cl

arXiv:2601.03926v2 Announce Type: replace Abstract: The deployment of Large Vision-Language Models (LVLMs) for real-world document question answering is often constrained by dynamic, user-defined poli

Applications

Dual-Margin Embedding for Fine-Grained Long-Tailed Plant Taxonomy

arXiv:2512.18994v2 Announce Type: replace Abstract: Taxonomic classification of ecological families, genera, and species underpins biodiversity monitoring and conservation. Existing computer vision me

applicationsarxiv-cs-cv

Dynamic Adaptive Attention and Supervised Contrastive Learning: A Novel Hybrid Framework for Text Sentiment Classification

arXiv:2604.10459v1 Announce Type: new Abstract: The exponential growth of user-generated movie reviews on digital platforms has made accurate text sentiment classification a cornerstone task in natura

researcharxiv-cs-cl

Agents

EDFNet: Early Fusion of Edge and Depth for Thin-Obstacle Segmentation in UAV Navigation

arXiv:2604.09694v1 Announce Type: new Abstract: Autonomous Unmanned Aerial Vehicles (UAVs) must reliably detect thin obstacles such as wires, poles, and branches to navigate safely in real-world envir

agentsarxiv-cs-cv

Efficient Personalization of Generative User Interfaces

arXiv:2604.09876v1 Announce Type: cross Abstract: Generative user interfaces (UIs) create new opportunities to adapt interfaces to individual users on demand, but personalization remains difficult bec

researcharxiv-cs-ai