Search: “multimodal”

Deco: Extending Personal Physical Objects into Pervasive AI Companion through a Dual-Embodiment Framework

arXiv:2605.03882v1 Announce Type: cross Abstract: Individuals frequently form deep attachments to physical objects (e.g., plush toys) that usually cannot sense or respond to their emotions. While AI c

researcharxiv-cs-ai

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

DiffCap-Bench: A Comprehensive, Challenging, Robust Benchmark for Image Difference Captioning

DGX agent

arXiv:2605.04503v1 Announce Type: new Abstract: Image Difference Captioning (IDC) generates natural language descriptions that precisely identify differences between two images, serving as a key bench

model-releasesarxiv-cs-cv

7 May 2026

EdgeRazor: A Lightweight Framework for Large Language Models via Mixed-Precision Quantization-Aware Distillation

arXiv:2605.04062v1 Announce Type: new Abstract: Recent years have witnessed an increasing interest in deploying LLMs on resource-constrained devices, among which quantization has emerged as a promisin

researcharxiv-cs-lg

Tutorials

From Diffusion to Rectified Flow: Rethinking Text-Based Segmentation

arXiv:2605.04590v1 Announce Type: new Abstract: Text-based image segmentation aims to delineate object boundaries within an image from text prompts, offering higher flexibility and broader application

tutorialsarxiv-cs-cv

From Knowledge to Action: Outcomes of the 2025 Large Language Model (LLM) Hackathon for Applications in Materials Science and Chemistry

arXiv:2605.03205v1 Announce Type: cross Abstract: Large language models (LLMs) are rapidly changing how researchers in materials science and chemistry discover, organize, and act on scientific knowled

Full text search is in Public Preview on Pinecone. Check out the bird search demo built by Senior Developer Advocate, Arjun Patel which inde…

model-releasespinecone--x

Full text search is in Public Preview on Pinecone. Check out the bird search demo built by Senior Developer Advocate, Arjun Patel which indexes 2,000 Wikipedia bird articles in one index across four f

Hierarchical Visual Agent: Managing Contexts in Joint Image-Text Space for Advanced Chart Reasoning

arXiv:2605.04304v1 Announce Type: cross Abstract: Advanced chart question answering requires both precise perception of small visual elements and multi-step reasoning across several subplots. While ex

agentsarxiv-cs-cl

Learning Correct Behavior from Examples: Validating Sequential Execution in Autonomous Agents

arXiv:2605.03159v1 Announce Type: new Abstract: As autonomous agents become increasingly sophisticated, validating their sequential behavior presents a significant challenge. Traditional testing appro

Redefining AI Red Teaming in the Agentic Era: From Weeks to Hours

model-releasesarxiv-cs-ai

arXiv:2605.04019v1 Announce Type: new Abstract: AI systems are entering critical domains like healthcare, finance, and defense, yet remain vulnerable to adversarial attacks. While AI red teaming is a

The Tsetlin Machine Goes Deep: Logical Learning and Reasoning With Graphs

arXiv:2507.14874v2 Announce Type: replace Abstract: Pattern recognition with concise and flat AND-rules makes the Tsetlin Machine (TM) both interpretable and efficient, while the power of Tsetlin auto

researcharxiv-cs-lg

VTAgent: Agentic Keyframe Anchoring for Evidence-Aware Video TextVQA

arXiv:2605.04870v1 Announce Type: new Abstract: Video text-based visual question answering (Video TextVQA) aims to answer questions by reasoning over visual textual content appearing in videos. Despit

A Knowledge-Driven LLM-Based Decision-Support System for Explainable Defect Analysis and Mitigation Guidance in Laser Powder Bed Fusion

arXiv:2605.01100v1 Announce Type: new Abstract: This work presents a knowledge-driven decision-support system that integrates structured defect knowledge with LLM-based reasoning to provide explainabl

safetyarxiv-cs-ai

A User-Centric Analysis of Explainability in AI-Based Medical Image Diagnosis

arXiv:2605.02903v1 Announce Type: cross Abstract: In recent years, AI systems in the medical domain have advanced significantly. However, despite outperforming humans, they are rarely used in practice

ADAPTS: Agentic Decomposition for Automated Protocol-agnostic Tracking of Symptoms

arXiv:2605.03212v1 Announce Type: cross Abstract: Modeling latent clinical constructs from unconstrained clinical interactions is a unique challenge in affective computing. We present ADAPTS (Agentic

safetyarxiv-cs-cl

AI in Agriculture: A Survey of Deep Learning Techniques for Crops, Fisheries and Livestock

arXiv:2507.22101v2 Announce Type: replace Abstract: Crops, fisheries and livestock form the backbone of global food production, essential to feed the ever-growing global population. However, these sec

applicationsarxiv-cs-cv

BifrostUMI: Bridging Robot-Free Demonstrations and Humanoid Whole-Body Manipulation

arXiv:2605.03452v1 Announce Type: new Abstract: High-quality data collection is a fundamental cornerstone for training humanoid whole-body visuomotor policies. Current data acquisition paradigms predo

safetyarxiv-cs-ro

Tutorials

CBV: Clean-label Backdoor Attacks on Vision Language Models via Diffusion Models

arXiv:2605.02202v1 Announce Type: new Abstract: Vision-Language Models (VLMs) have achieved remarkable success in tasks such as image captioning and visual question answering (VQA). However, as their

tutorialsarxiv-cs-ai

Claw-Eval: Towards Trustworthy Evaluation of Autonomous Agents

arXiv:2604.06132v2 Announce Type: replace Abstract: Large language models are increasingly deployed as autonomous agents for multi-step workflows in real-world software environments. However, existing

safetyarxiv-cs-ai

Diffusion Masked Pretraining for Dynamic Point Cloud

arXiv:2605.03639v1 Announce Type: new Abstract: Dynamic point cloud pretraining is still dominated by masked reconstruction objectives. However, these objectives inherit two key limitations. Existing

Explainable AI for Blind and Low-Vision Users: Navigating Trust, Modality, and Interpretability in the Agentic Era

arXiv:2604.00187v2 Announce Type: replace-cross Abstract: Explainable Artificial Intelligence (XAI) is critical for ensuring trust and accountability, yet its development remains predominantly visual.

From Experimental Limits to Physical Insight: A Retrieval-Augmented Multi-Agent Framework for Interpreting Searches Beyond the Standard Model

arXiv:2605.02491v1 Announce Type: cross Abstract: Modern searches for physics beyond the Standard Model produce rapidly expanding literature containing heterogeneous information, including textual ana

Generate, Filter, Control, Replay: A Comprehensive Survey of Rollout Strategies for LLM Reinforcement Learning

arXiv:2605.02913v1 Announce Type: new Abstract: Reinforcement learning (RL) has become a central post-training tool for improving the reasoning abilities of large language models (LLMs). In these syst

agentsarxiv-cs-lg

InsTraj: Instructing Diffusion Models with Travel Intentions to Generate Real-world Trajectories

arXiv:2604.04106v2 Announce Type: replace Abstract: The generation of realistic and controllable GPS trajectories is a fundamental task for applications in urban planning, mobility simulation, and pri

applicationsarxiv-cs-ai

Intelligent Agents with Emotional Intelligence: Current Trends, Challenges, and Future Prospects

arXiv:2511.20657v2 Announce Type: replace-cross Abstract: The development of agents with emotional intelligence is becoming increasingly vital due to their significant role in human-computer interacti

MedGemma 1.5 Technical Report

arXiv:2604.05081v2 Announce Type: replace Abstract: We introduce MedGemma 1.5 4B, the latest model in the MedGemma collection. MedGemma 1.5 expands on MedGemma 1 by integrating additional capabilities

local-aiarxiv-cs-ai

Music Interpretation and Emotion Perception: A Computational and Neurophysiological Investigation

arXiv:2506.01982v3 Announce Type: replace-cross Abstract: This study investigates emotional expression and perception in music performance using computational and neurophysiological methods. The influ

researcharxiv-cs-ai

Proteo-R1: Reasoning Foundation Models for De Novo Protein Design

arXiv:2605.02937v1 Announce Type: new Abstract: Deep learning in de novo protein design has achieved atomic-level fidelity. However, existing models remain largely non-deliberative: they directly synt

researcharxiv-cs-lg

Refining Compositional Diffusion for Reliable Long-Horizon Planning

arXiv:2605.03075v1 Announce Type: cross Abstract: Compositional diffusion planning generates long-horizon trajectories by stitching together overlapping short-horizon segments through score compositio

local-aiarxiv-cs-lg

Strong Opinions, Loosely Held on Agent + Harness Engineering: 1. You can outperform any default harness+model (including codex & claude code…

model-releasesharrison-chase--x

Strong Opinions, Loosely Held on Agent + Harness Engineering: 1. You can outperform any default harness+model (including codex & claude code) on pretty much any Task by engineering the harness around

The Garden of Forking Paths: Narrative Arc-Conditioned Gameplay Planning

arXiv:2605.01245v1 Announce Type: cross Abstract: Narrative archetypes (e.g., Hero's Journey, Three-act structure) provide universal story structures that resonate across cultures and media and are im

safetyarxiv-cs-ai

TMD-Bench: A Multi-Level Evaluation Paradigm for Music-Dance Co-Generation

model-releasesarxiv-cs-ai

arXiv:2605.01809v1 Announce Type: cross Abstract: Unified audio-visual generation is rapidly gaining industrial and creative relevance, enabling applications in virtual production and interactive medi

Uni-OPD: Unifying On-Policy Distillation with a Dual-Perspective Recipe

arXiv:2605.03677v1 Announce Type: new Abstract: On-policy distillation (OPD) has recently emerged as an effective post-training paradigm for consolidating the capabilities of specialized expert models

safetyarxiv-cs-lg

Anticipation-VLA: Solving Long-Horizon Embodied Tasks via Anticipation-based Subgoal Generation

arXiv:2605.01772v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have emerged as a powerful paradigm for embodied intelligence, enabling robots to perform tasks based on natural l

safetyarxiv-cs-lg

ARIS: Agentic and Relationship Intelligence System for Social Robots

model-releasesarxiv-cs-ro

arXiv:2605.00943v1 Announce Type: new Abstract: Foundational models have advanced social robotics, enabling richer perception and communicative interaction with users. However, current systems still s

Bridging the Experimental Last Mile: Digitizing Laboratory Know-How for Safe AI-Assisted Support

arXiv:2604.16345v2 Announce Type: replace-cross Abstract: While advances in materials informatics have accelerated the development of Self-Driving Laboratories (SDLs), human-led experiments remain sta

local-aiarxiv-cs-ai

BRITE: A Benchmark for Reliable and Interpretable T2V Evaluation on Implausible Scenarios

arXiv:2605.00873v1 Announce Type: cross Abstract: The rapid advancement of photorealistic Text-to-Video (T2V) generation brings in an urgent need for up-to-date evaluation methods. Existing benchmarks

CADFit: Precise Mesh-to-CAD Program Generation with Hybrid Optimization

arXiv:2605.01171v1 Announce Type: new Abstract: Despite recent progress, recovering parametric CAD construction sequences from geometric input, such as meshes or point clouds, is a key challenge for d

applicationsarxiv-cs-cv

CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Models

arXiv:2605.01925v1 Announce Type: new Abstract: We introduce CADFS, a data-centric framework that enables large vision-language models to generate complex CAD design histories. Existing generative CAD

applicationsarxiv-cs-cv

CEZSAR: A Contrastive Embedding Method for Zero-Shot Action Recognition

arXiv:2605.01165v1 Announce Type: new Abstract: This paper proposes a novel Zero-Shot Action Recognition~(ZSAR) method based on contrastive learning. In ZSAR, we aim to classify examples from classes

Combining Facial Videos and Biosignals for Stress Estimation During Driving

arXiv:2601.04376v3 Announce Type: replace Abstract: Reliable stress recognition is critical in applications such as medical monitoring and safety-critical systems, including real-world driving. While

safetyarxiv-cs-cv

DGS-Net: Distillation-Guided Gradient Surgery for CLIP Fine-Tuning in AI-Generated Image Detection

arXiv:2511.13108v3 Announce Type: replace Abstract: The rapid progress of generative models such as GANs and diffusion models has led to the widespread proliferation of AI-generated images, raising co

DynoSLAM: Dynamic SLAM with Generative Graph Neural Networks for Real-World Social Navigation

arXiv:2605.02759v1 Announce Type: cross Abstract: Traditional Simultaneous Localization and Mapping (SLAM) algorithms rely heavily on the static environment assumption, which severely limits their app

local-aiarxiv-cs-cv

FEAT: Fashion Editing and Try-On from Any Design

arXiv:2605.02393v1 Announce Type: new Abstract: Fashion design aims to express a designer's creative intent and to depict how garments interact with the human body. Recent methods condition on multimo

Human Cognitive Benchmarks Reveal Foundational Visual Gaps in MLLMs

model-releasesarxiv-cs-cl

arXiv:2502.16435v4 Announce Type: replace-cross Abstract: Humans develop perception through a bottom-up hierarchy: from basic primitives and Gestalt principles to high-level semantics. In contrast, cu

InfiltrNet: Dual-Branch CNN-Transformer Architecture for Brain Tumor Infiltration Risk Prediction

arXiv:2605.02230v1 Announce Type: new Abstract: Gliomas are aggressive brain tumors that infiltrate surrounding tissue beyond the visible tumor margins observed on Magnetic Resonance Imaging (MRI). Pr

LiteVLA-H: Dual-Rate Vision-Language-Action Inference for Onboard Aerial Guidance and Semantic Perception

arXiv:2605.00884v1 Announce Type: new Abstract: Vision-language-action (VLA) models have shown strong semantic grounding and task generalization in manipulation, but aerial deployment remains difficul

MemeLens: Multilingual Multitask VLMs for Memes

arXiv:2601.12539v3 Announce Type: replace-cross Abstract: Memes are a dominant medium for online communication and manipulation because meaning emerges from interactions between embedded text, imagery

researcharxiv-cs-cl

Hardware

MusicInfuser: Making Video Diffusion Listen and Dance

arXiv:2503.14505v3 Announce Type: replace Abstract: We introduce MusicInfuser, an approach that aligns pre-trained text-to-video diffusion models to generate high-quality dance videos synchronized wit

hardwarearxiv-cs-cv