Search: “multimodal”

Fake-HR1: Rethinking Reasoning of Vision Language Model for Synthetic Image Detection

arXiv:2602.10042v3 Announce Type: replace-cross Abstract: Recent studies have demonstrated that incorporating Chain-of-Thought (CoT) reasoning into the detection process can enhance a model's ability

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

FashionMV: Product-Level Composed Image Retrieval with Multi-View Fashion Data

DGX agent

arXiv:2604.10297v1 Announce Type: cross Abstract: Composed Image Retrieval (CIR) retrieves target images using a reference image paired with modification text. Despite rapid advances, all existing met

model-releasesarxiv-cs-ai

14 Apr 2026

FGML-DG: Feynman-Inspired Cognitive Science Paradigm for Cross-Domain Medical Image Segmentation

arXiv:2604.10524v1 Announce Type: new Abstract: In medical image segmentation across multiple modalities (e.g., MRI, CT, etc.) and heterogeneous data sources (e.g., different hospitals and devices), D

safetyarxiv-cs-cv

From Perception to Planning: Evolving Ego-Centric Task-Oriented Spatiotemporal Reasoning via Curriculum Learning

arXiv:2604.10517v1 Announce Type: new Abstract: Modern vision-language models achieve strong performance in static perception, but remain limited in the complex spatiotemporal reasoning required for e

From Redaction to Restoration: Deep Learning for Medical Image Anonymization and Reconstruction

arXiv:2604.11376v1 Announce Type: cross Abstract: Removing patient-specific information from medical images is crucial to enable sharing and open science without compromising patient identities. Howev

Fusion Complexity Inversion: Why Simpler Cross View Modules Outperform SSMs and Cross View Attention Transformers for Pasture Biomass Regression

arXiv:2603.07819v3 Announce Type: replace Abstract: Accurate estimation of pasture biomass from agricultural imagery is critical for sustainable livestock management, yet existing methods are limited

HECTOR: Human-centric Hierarchical Coordination and Supervision of Robotic Fleets under Continual Temporal Tasks

arXiv:2604.10892v1 Announce Type: new Abstract: Robotic fleets can be extremely efficient when working concurrently and collaboratively, e.g., for delivery, surveillance, search and rescue. However, i

tutorialsarxiv-cs-ro

HuiYanEarth-SAR: A Foundation Model for High-Fidelity and Low-Cost Global Remote Sensing Imagery Generation

arXiv:2604.11444v1 Announce Type: new Abstract: Synthetic Aperture Radar (SAR) imagery generation is essential for deepening the study of scattering mechanisms, establishing trustworthy electromagneti

Agents

Human Centered Non Intrusive Driver State Modeling Using Personalized Physiological Signals in Real World Automated Driving

arXiv:2604.11549v1 Announce Type: cross Abstract: In vehicles with partial or conditional driving automation (SAE Levels 2-3), the driver remains responsible for supervising the system and responding

agentsarxiv-cs-lg

Immune2V: Image Immunization Against Dual-Stream Image-to-Video Generation

arXiv:2604.10837v1 Announce Type: new Abstract: Image-to-video (I2V) generation has the potential for societal harm because it enables the unauthorized animation of static images to create realistic d

Local Ai

Inside the Scaffold: A Source-Code Taxonomy of Coding Agent Architectures

arXiv:2604.03515v2 Announce Type: replace-cross Abstract: LLM-based coding agents can localize bugs, generate patches, and run tests with diminishing human oversight, yet the scaffolding code that sur

local-aiarxiv-cs-ai

Jailbreaking the Matrix: Nullspace Steering for Controlled Model Subversion

arXiv:2604.10326v1 Announce Type: cross Abstract: Large language models remain vulnerable to jailbreak attacks -- inputs designed to bypass safety mechanisms and elicit harmful responses -- despite ad

Language Reconstruction with Brain Predictive Coding from fMRI Data

arXiv:2405.11597v2 Announce Type: replace-cross Abstract: Many recent studies have shown that the perception of speech can be decoded from brain signals and subsequently reconstructed as continuous la

tutorialsarxiv-cs-ai

Latent Instruction Representation Alignment: defending against jailbreaks, backdoors and undesired knowledge in LLMs

arXiv:2604.10403v1 Announce Type: new Abstract: We address jailbreaks, backdoors, and unlearning for large language models (LLMs). Unlike prior work, which trains LLMs based on their actions when give

safetyarxiv-cs-lg

Legal2LogicICL: Improving Generalization in Transforming Legal Cases to Logical Formulas via Diverse Few-Shot Learning

arXiv:2604.11699v1 Announce Type: cross Abstract: This work aims to improve the generalization of logic-based legal reasoning systems by integrating recent advances in NLP with legal-domain adaptive f

LiveGesture Streamable Co-Speech Gesture Generation Model

arXiv:2604.10927v1 Announce Type: new Abstract: We propose LiveGesture, the first fully streamable, speech-driven full-body gesture generation framework that operates with zero look-ahead and supports

LLM-based Realistic Safety-Critical Driving Video Generation

arXiv:2507.01264v2 Announce Type: replace-cross Abstract: Designing diverse and safety-critical driving scenarios is essential for evaluating autonomous driving systems. In this paper, we propose a no

LottieGPT: Tokenizing Vector Animation for Autoregressive Generation

arXiv:2604.11792v1 Announce Type: new Abstract: Despite rapid progress in video generation, existing models are incapable of producing vector animation, a dominant and highly expressive form of multim

Lung Cancer Detection Using Deep Learning

arXiv:2604.10765v1 Announce Type: cross Abstract: Lung cancer, the second leading cause of cancer-related deaths, is primarily linked to long-term tobacco smoking (85% of cases). Surprisingly, 10-15%

MedLVR: Latent Visual Reasoning for Reliable Medical Visual Question Answering

arXiv:2604.09757v1 Announce Type: cross Abstract: Medical vision--language models (VLMs) have shown strong potential for medical visual question answering (VQA), yet their reasoning remains largely te

Local Ai

MedP-CLIP: Medical CLIP with Region-Aware Prompt Integration

arXiv:2604.11197v1 Announce Type: new Abstract: Contrastive Language-Image Pre-training (CLIP) has demonstrated outstanding performance in global image understanding and zero-shot transfer through lar

local-aiarxiv-cs-cv

MerNav: A Highly Generalizable Memory-Execute-Review Framework for Zero-Shot Object Goal Navigation

arXiv:2602.05467v2 Announce Type: replace-cross Abstract: Visual Language Navigation (VLN) is one of the fundamental capabilities for embodied intelligence and a critical challenge that urgently needs

applicationsarxiv-cs-cl

Perceived Importance of Cognitive Skills Among Computing Students in the Era of AI

arXiv:2604.10730v1 Announce Type: cross Abstract: The availability and increasing integration of generative AI tools have transformed computing education. While AI in education presents opportunities,

applicationsarxiv-cs-ai

Prompt Injection as Role Confusion

arXiv:2603.12277v3 Announce Type: replace-cross Abstract: Language models remain vulnerable to prompt injection attacks despite extensive safety training. We trace this failure to role confusion: mode

RealSR-R1: Reinforcement Learning for Real-World Image Super-Resolution with Vision-Language Chain-of-Thought

arXiv:2506.16796v4 Announce Type: replace Abstract: Real-World Image Super-Resolution is one of the most challenging task in image restoration. However, existing methods struggle with an accurate unde

safetyarxiv-cs-cv

RECIPER: A Dual-View Retrieval Pipeline for Procedure-Oriented Materials Question Answering

arXiv:2604.11229v1 Announce Type: cross Abstract: Retrieving procedure-oriented evidence from materials science papers is difficult because key synthesis details are often scattered across long, conte

ReContraster: Making Your Posters Stand Out with Regional Contrast

arXiv:2604.10442v1 Announce Type: new Abstract: Effective poster design requires rapidly capturing attention and clearly conveying messages. Inspired by the ``contrast effects'' principle, we propose

Resisting Humanization: Ethical Front-End Design Choices in AI for Sensitive Contexts

arXiv:2603.24853v2 Announce Type: replace Abstract: Ethical debates in AI have primarily focused on back-end issues such as data governance, model training, and algorithmic decision-making. Less atten

applicationsarxiv-cs-ai

Rethinking Token-Level Credit Assignment in RLVR: A Polarity-Entropy Analysis

arXiv:2604.11056v1 Announce Type: cross Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has substantially improved the reasoning ability of Large Language Models (LLMs). However, its s

Revisiting Compositionality in Dual-Encoder Vision-Language Models: The Role of Inference

arXiv:2604.11496v1 Announce Type: cross Abstract: Dual-encoder Vision-Language Models (VLMs) such as CLIP are often characterized as bag-of-words systems due to their poor performance on compositional

safetyarxiv-cs-cl

Ro-SLM: Onboard Small Language Models for Robot Task Planning and Operation Code Generation

arXiv:2604.10929v1 Announce Type: new Abstract: Recent advances in large language models (LLMs) provide robots with contextual reasoning abilities to comprehend human instructions. Yet, current LLM-en

tutorialsarxiv-cs-ro

Scene Change Detection with Vision-Language Representation Learning

arXiv:2604.11402v1 Announce Type: new Abstract: Scene change detection (SCD) is crucial for urban monitoring and navigation but remains challenging in real-world environments due to lighting variation

applicationsarxiv-cs-cv

Semantic-Space Exploration and Exploitation in RLVR for LLM Reasoning

arXiv:2509.23808v4 Announce Type: replace-cross Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) for LLM reasoning is often framed as balancing exploration and exploitation in action sp

researcharxiv-cs-cl

SinkTrack: Attention Sink based Context Anchoring for Large Language Models

arXiv:2604.10027v1 Announce Type: new Abstract: Large language models (LLMs) suffer from hallucination and context forgetting. Prior studies suggest that attention drift is a primary cause of these pr

Sonilo is now available in ComfyUI via Partner Nodes: AI video-to-music that generates soundtracks synchronized to your footage. @Sonilo_mus…

Sonilo is now available in ComfyUI via Partner Nodes: AI video-to-music that generates soundtracks synchronized to your footage. @Sonilo_music reads visuals, pacing, and emotional cues so audio stays

applicationscomfyui--x

Steered LLM Activations are Non-Surjective

arXiv:2604.09839v1 Announce Type: new Abstract: Activation steering is a popular white-box control technique that modifies model activations to elicit an abstract change in output behavior. It has als

Sub-32B open weights models now offer GPT-5 level intelligence with Qwen3.5 27B (Reasoning) matching GPT-5 (medium) at 42 and Gemma 4 31B (R…

model-releasesclem-delangue--x

Sub-32B open weights models now offer GPT-5 level intelligence with Qwen3.5 27B (Reasoning) matching GPT-5 (medium) at 42 and Gemma 4 31B (Reasoning) matching GPT-5 (low) at 39 on the Artificial Analy

Suiren-1.0 Technical Report: A Family of Molecular Foundation Models

arXiv:2603.21942v2 Announce Type: replace-cross Abstract: We introduce Suiren-1.0, a family of molecular foundation models for the accurate modeling of diverse organic systems. Suiren-1.0 comprising t

SwinTextUNet: Integrating CLIP-Based Text Guidance into Swin Transformer U-Nets for Medical Image Segmentation

arXiv:2604.10000v1 Announce Type: new Abstract: Precise medical image segmentation is fundamental for enabling computer aided diagnosis and effective treatment planning. Traditional models that rely s

TaFall: Balance-Informed Fall Detection via Passive Thermal Sensing

arXiv:2604.09693v1 Announce Type: cross Abstract: Falls are a major cause of injury and mortality among older adults, yet most incidents occur in private indoor environments where monitoring must bala

applicationsarxiv-cs-ai

TAG-Head: Time-Aligned Graph Head for Plug-and-Play Fine-grained Action Recognition

arXiv:2604.11498v1 Announce Type: new Abstract: Fine-grained human action recognition (FHAR) is challenging because visually similar actions differ by subtle spatio-temporal cues. Many recent systems

Template-assisted Contrastive Learning of Task-oriented Dialogue Sentence Embeddings

model-releasesarxiv-cs-ai

arXiv:2305.14299v3 Announce Type: replace-cross Abstract: Learning high quality sentence embeddings from dialogues has drawn increasing attentions as it is essential to solve a variety of dialogue-ori

Industry

Time to follow http://hf.co/tencent!

Time to follow http://hf.co/tencent! Genie3 generates videos. We generate 𝟯𝗗 𝘄𝗼𝗿𝗹𝗱𝘀 you can actually use. Launching tomorrow — Tencent #HYWorld 2.0, an engine-ready World Model🚀 This isn't a video. It

industryclem-delangue--x

TimeRewarder: Learning Dense Reward from Passive Videos via Frame-wise Temporal Distance

arXiv:2509.26627v2 Announce Type: replace Abstract: Designing dense rewards is crucial for reinforcement learning (RL), yet in robotics it often demands extensive manual effort and lacks scalability.

tutorialsarxiv-cs-ai

TRACE: An Experiential Framework for Coherent Multi-hop Knowledge Graph Question Answering

arXiv:2604.11193v1 Announce Type: new Abstract: Multi-hop Knowledge Graph Question Answering (KGQA) requires coherent reasoning across relational paths, yet existing methods often treat each reasoning

tutorialsarxiv-cs-cl

Unmixing-Guided Spatial-Spectral Mamba with Clustering Tokens for Hyperspectral Image Classification

arXiv:2604.09948v1 Announce Type: new Abstract: Although hyperspectral image (HSI) classification is critical for supporting various environmental applications, it is a challenging task due to the spe

tutorialsarxiv-cs-cv

Warm-Started Reinforcement Learning for Iterative 3D/2D Liver Registration

arXiv:2604.10245v1 Announce Type: new Abstract: Registration between preoperative CT and intraoperative laparoscopic video plays a crucial role in augmented reality (AR) guidance for minimally invasiv

safetyarxiv-cs-cv

When Meaning Isn't Literal: Exploring Idiomatic Meaning Across Languages and Modalities

model-releasesarxiv-cs-cl

arXiv:2604.10787v1 Announce Type: new Abstract: Idiomatic reasoning, deeply intertwined with metaphor and culture, remains a blind spot for contemporary language models, whose progress skews toward su