AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
Human
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
9,441 results
Tutorials

Generating a Paracosm for Training-Free Zero-Shot Composed Image Retrieval

DGX agent

arXiv:2602.00813v5 Announce Type: replace Abstract: Composed Image Retrieval (CIR) is the task of retrieving a target image from a database using a multimodal query, which consists of a reference imag

tutorialsarxiv-cs-cv
26 Jun 2026
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Research

TAVR-VLM: Risk-Conditioned Causal Grounding for Hallucination-Resistant Report Generation

DGX agent

arXiv:2606.26874v1 Announce Type: new Abstract: Transcatheter Aortic Valve Replacement (TAVR) planning requires meticulous multimodal reasoning. However, adapting Multimodal Large Language Models (MLL

researcharxiv-cs-ai
26 Jun 2026
Safety

Decoupling Semantics and Logic: A Training-Free Coarse-to-Fine Pipeline for Video Retrieval-Augmented Generation

DGX agent

arXiv:2606.07924v1 Announce Type: cross Abstract: This paper presents our system description for the 2nd Workshop on Multimodal Augmented Generation via MultimodAl Retrieval (MAGMaR). Addressing the c

safetyarxiv-cs-ai
9 Jun 2026
Safety

Watch, Remember, Reason: Human-View Video Understanding with MLLMs

DGX agent

arXiv:2606.07433v1 Announce Type: cross Abstract: Video understanding is being rapidly transformed by multimodal large language models (MLLMs), as research moves from short clips to long, multimodal,

safetyarxiv-cs-ai
8 Jun 2026
Research

UniCanvas: A Diffusion-base Unified Model for Text-in-Image Joint Generation

DGX agent

arXiv:2606.04264v1 Announce Type: new Abstract: Recent years have seen remarkable progress in unified vision-language models handling both multimodal understanding and generation within a single archi

researcharxiv-cs-cv
4 Jun 2026
Tutorials

Checking Fact with Better Retrieval: Dynamic Contrastive Learning for Evidence Retrieval

DGX agent

arXiv:2605.27449v1 Announce Type: cross Abstract: In the field of multimodal fact checking, the accuracy of retrieving evidence from different modalities has a significant impact on the downstream cla

tutorialsarxiv-cs-ai
28 May 2026
Safety

IVR-R1: Refining Trajectories through Iterative Visual-Grounded Reasoning in Reinforcement Learning

DGX agent

arXiv:2605.23997v1 Announce Type: cross Abstract: Multimodal large language models via reinforcement learning (RL) have demonstrated remarkable capabilities in complex visual reasoning tasks, yet they

safetyarxiv-cs-ai
26 May 2026
Model Releases

CMKL: Modality-Aware Continual Learning for Evolving Biomedical Knowledge Graphs

DGX agent

arXiv:2605.10510v1 Announce Type: cross Abstract: Biomedical knowledge graphs are increasingly large, dynamic, and multimodal, driven by rapid advances in biotechnology such as high-throughput sequenc

model-releasesarxiv-cs-ai
12 May 2026
Model Releases

Phoenix-VL 1.5 Medium Technical Report

DGX agent

arXiv:2605.10391v1 Announce Type: cross Abstract: We introduce Phoenix-VL 1.5 Medium, a 123B-parameter natively multimodal and multilingual foundation model, adapted to regional languages and the Sing

model-releasesarxiv-cs-ai
12 May 2026
Model Releases

DRIFT: Transferring Reasoning Priors for Efficient MLLM Fine-Tuning

DGX agent

arXiv:2510.15050v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) have made rapid progress, yet their reasoning ability often lags behind strong text-only LLMs. Bridging thi

model-releasesarxiv-cs-cv
28 Apr 2026
Research

MemeScouts@LT-EDI 2026: Asking the Right Questions -- Prompted Weak Supervision for Meme Hate Speech Detection

DGX agent

arXiv:2604.24179v1 Announce Type: cross Abstract: Detecting hate speech in memes is challenging due to their multimodal nature and subtle, culturally grounded cues such as sarcasm and context. While r

researcharxiv-cs-ai
28 Apr 2026
Safety

OS-SPEAR: A Toolkit for the Safety, Performance,Efficiency, and Robustness Analysis of OS Agents

DGX agent

arXiv:2604.24348v1 Announce Type: new Abstract: The evolution of Multimodal Large Language Models (MLLMs) has shifted the focus from text generation to active behavioral execution, particularly via OS

safetyarxiv-cs-cl
28 Apr 2026
Research

Revisiting Content-Based Music Recommendation: Efficient Feature Aggregation from Large-Scale Music Models

DGX agent

arXiv:2604.20847v1 Announce Type: cross Abstract: Music Recommendation Systems (MRSs) are a cornerstone of modern streaming platforms. Existing recommendation models, spanning both recall and ranking

researcharxiv-cs-ai
24 Apr 2026
Model Releases

Are We Using the Right Benchmark: An Evaluation Framework for Visual Token Compression Methods

DGX agent

arXiv:2510.07143v3 Announce Type: replace Abstract: Recent efforts to accelerate inference in Multimodal Large Language Models (MLLMs) have largely focused on visual token compression. The effectivene

model-releasesarxiv-cs-cv
21 Apr 2026
Research

BARD: Bridging AutoRegressive and Diffusion Vision-Language Models Via Highly Efficient Progressive Block Merging and Stage-Wise Distillation

DGX agent

arXiv:2604.16514v1 Announce Type: new Abstract: Autoregressive vision-language models (VLMs) deliver strong multimodal capability, but their token-by-token decoding imposes a fundamental inference bot

researcharxiv-cs-cv
21 Apr 2026
Safety

Rethinking Jailbreak Detection of Large Vision Language Models with Representational Contrastive Scoring

DGX agent

arXiv:2512.12069v3 Announce Type: replace-cross Abstract: Large Vision-Language Models (LVLMs) are vulnerable to a growing array of multimodal jailbreak attacks, necessitating defenses that are both g

safetyarxiv-cs-cl
21 Apr 2026
Safety

SynopticBench: Evaluating Vision-Language Models on Generating Weather Forecast Discussions of the Future

DGX agent

arXiv:2604.16451v1 Announce Type: new Abstract: Recent advances in visual-language models (VLMs) have led to significant improvements in a plethora of complex multimodal tasks like image captioning, r

safetyarxiv-cs-cl
21 Apr 2026
Safety

Chain of Modality: From Static Fusion to Dynamic Orchestration in Omni-MLLMs

DGX agent

arXiv:2604.14520v1 Announce Type: new Abstract: Omni-modal Large Language Models (Omni-MLLMs) promise a unified integration of diverse sensory streams. However, recent evaluations reveal a critical pe

safetyarxiv-cs-cv
17 Apr 2026
Safety

Echoes Over Time: Unlocking Length Generalization in Video-to-Audio Generation Models

DGX agent

arXiv:2602.20981v3 Announce Type: replace Abstract: Scaling multimodal alignment between video and audio is challenging, particularly due to limited data and the mismatch between text descriptions and

safetyarxiv-cs-cv
16 Apr 2026
Safety

Why MLLMs Struggle to Determine Object Orientations

DGX agent

arXiv:2604.13321v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) struggle with tasks that require reasoning about 2D object orientation in images, as documented in prior work.

safetyarxiv-cs-cv
16 Apr 2026
Safety

DocSeeker: Structured Visual Reasoning with Evidence Grounding for Long Document Understanding

DGX agent

arXiv:2604.12812v1 Announce Type: new Abstract: Existing Multimodal Large Language Models (MLLMs) suffer from significant performance degradation on the long document understanding task as document le

safetyarxiv-cs-ai
15 Apr 2026
Research

Does Visual Token Pruning Improve Calibration? An Empirical Study on Confidence in MLLMs

DGX agent

arXiv:2604.12035v1 Announce Type: new Abstract: Visual token pruning is a widely used strategy for efficient inference in multimodal large language models (MLLMs), but existing work mainly evaluates i

researcharxiv-cs-cv
15 Apr 2026
Safety

GeoAlign: Geometric Feature Realignment for MLLM Spatial Reasoning

DGX agent

arXiv:2604.12630v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) have exhibited remarkable performance in various visual tasks, yet still struggle with spatial reasoning. Rec

safetyarxiv-cs-cl
15 Apr 2026
Local Ai

TempR1: Improving Temporal Understanding of MLLMs via Temporal-Aware Multi-Task Reinforcement Learning

DGX agent

arXiv:2512.03963v3 Announce Type: replace Abstract: Enhancing the temporal understanding of Multimodal Large Language Models (MLLMs) is essential for advancing long-form video analysis, enabling tasks

local-aiarxiv-cs-cv
15 Apr 2026
Model Releases

ITIScore: An Image-to-Text-to-Image Rating Framework for the Image Captioning Ability of MLLMs

DGX agent

arXiv:2604.03765v2 Announce Type: replace Abstract: Recent advances in multimodal large language models (MLLMs) have greatly improved image understanding and captioning capabilities. However, existing

model-releasesarxiv-cs-cv
14 Apr 2026
Safety

Reasoning Resides in Layers: Restoring Temporal Reasoning in Video-Language Models with Layer-Selective Merging

DGX agent

arXiv:2604.11399v1 Announce Type: cross Abstract: Multimodal adaptation equips large language models (LLMs) with perceptual capabilities, but often weakens the reasoning ability inherited from languag

safetyarxiv-cs-cl
14 Apr 2026
Safety

SVD-Prune: Training-Free Token Pruning For Efficient Vision-Language Models

DGX agent

arXiv:2604.11530v1 Announce Type: cross Abstract: Vision-Language Models (VLM) have revolutionized multimodal learning by jointly processing visual and textual information. Yet, they face significant

safetyarxiv-cs-ai
14 Apr 2026
Safety

AudioRole: An Audio Dataset for Character Role-Playing in Large Language Models

DGX agent

arXiv:2509.23435v2 Announce Type: replace-cross Abstract: The creation of high-quality multimodal datasets remains fundamental for advancing role-playing capabilities in large language models (LLMs).

safetyarxiv-cs-ai
10 Apr 2026
Model Releases

Making MLLMs Blind: Adversarial Smuggling Attacks in MLLM Content Moderation

DGX agent

arXiv:2604.06950v2 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs) are increasingly being deployed as automated content moderators. Within this landscape, we uncover a critic

model-releasesarxiv-cs-cv
10 Apr 2026
Model Releases

Small Vision-Language Models are Smart Compressors for Long Video Understanding

DGX agent

arXiv:2604.08120v1 Announce Type: cross Abstract: Adapting Multimodal Large Language Models (MLLMs) for hour-long videos is bottlenecked by context limits. Dense visual streams saturate token budgets

model-releasesarxiv-cs-cl
10 Apr 2026
Research

Uni-ViGU: Towards Unified Video Generation and Understanding via A Diffusion-Based Video Generator

DGX agent

arXiv:2604.08121v1 Announce Type: new Abstract: Unified multimodal models integrating visual understanding and generation face a fundamental challenge: visual generation incurs substantially higher co

researcharxiv-cs-cv
10 Apr 2026
Model Releases

Cross-Modal Latent Influence: Patch-Level Training Sample Attribution for Vision-Language Models

DGX agent

arXiv:2610.14190v1 Announce Type: new Abstract: Explaining a vision--language model (VLM) prediction requires tracing training-example influence to the multimodal evidence that mediates it, yet existi

model-releasesarxiv-cs-ai
15 Oct 2026
Research

Cross-Protocol Personality Assessment with LLMs: Aligning Behavioral Evidence with Human Ratings

DGX agent

arXiv:2610.16050v1 Announce Type: new Abstract: Personality assessment from asynchronous video interviews (AVIs) plays a crucial role in recruitment by enabling standardized and behaviorally grounded

researcharxiv-cs-ai
15 Oct 2026
Safety

Hallucination-aware Faithful Reasoning in Remote Sensing

DGX agent

arXiv:2610.18369v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have demonstrated promising capabilities for remote sensing reasoning, yet they frequently generate visually un

safetyarxiv-cs-cv
14 Oct 2026
Safety

Images Talk Back: Guiding MMDiTs by Suppressing Image-to-Text Feedback

DGX agent

arXiv:2610.13941v2 Announce Type: replace Abstract: Multimodal diffusion transformers (MMDiTs) allow the evolving image to update internal text representations through joint attention. These represent

safetyarxiv-cs-cv
14 Oct 2026
Research

Natural Language Generation from Visual Events: State-of-the-Art and Key Open Questions

DGX agent

arXiv:2502.13034v4 Announce Type: replace-cross Abstract: In recent years, a substantial body of work in visually grounded natural language processing has focused on real-life multimodal scenarios suc

researcharxiv-cs-cv
14 Oct 2026
Model Releases

DEAF: A Benchmark for Diagnostic Evaluation of Acoustic Faithfulness in Audio Language Models

DGX agent

arXiv:2603.18048v3 Announce Type: replace Abstract: Recent Audio Multimodal Large Language Models (Audio MLLMs) demonstrate impressive performance on speech benchmarks, yet it remains unclear whether

model-releasesarxiv-cs-ai
12 Oct 2026
Tutorials

AssemState: Manual and Physical-State-Guided Reasoning for Zero-shot Furniture Assembly

DGX agent

arXiv:2610.08446v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have made significant progress in visual understanding, but precise 3D spatial reasoning integrated with physic

tutorialsarxiv-cs-ai
7 Oct 2026
Model Releases

MedHorizon: Towards Long-context Medical Video Understanding in the Wild

DGX agent

arXiv:2605.06537v2 Announce Type: replace Abstract: Medical multimodal large language models (MLLMs) have advanced image understanding and short-video analysis, but real clinical review often requires

model-releasesarxiv-cs-cv
7 Oct 2026
Model Releases

Answer with Evidence: Consistency-Aware Grounded Visual Question Answering for Roadside Traffic Scenes

DGX agent

arXiv:2610.05274v1 Announce Type: new Abstract: Roadside traffic reasoning requires every free-form textual claim to be backed by visual evidence. Existing grounded multimodal large language models (M

model-releasesarxiv-cs-cv
6 Oct 2026
Model Releases

MedAD-R1: Consistency-Reinforced Policy Optimization for Interpretable Medical Anomaly Detection

DGX agent

arXiv:2602.01081v2 Announce Type: replace Abstract: Medical Anomaly Detection (MedAD) offers a promising direction for medical image analysis with Large Multimodal Models (LMMs). However, progress is

model-releasesarxiv-cs-cv
6 Oct 2026
Model Releases

Representation--Behavior Alignment for Explainable Weakly-Supervised Video Anomaly Detection

DGX agent

arXiv:2610.05129v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) provide a natural way to make video anomaly detection more explainable. However, their final decisions do not a

model-releasesarxiv-cs-cv
6 Oct 2026
Research

RoMod: Temporal Routing Modulation via Mixture-of-Experts for Video Anomaly Detection

DGX agent

arXiv:2610.05131v1 Announce Type: new Abstract: Intermediate-layer features from multimodal large language models have shown strong potential for video anomaly detection (VAD), yet the origin of their

researcharxiv-cs-cv
6 Oct 2026
Safety

Slow-Fast Multi-Teacher On-Policy Distillation for Capability Preservation

DGX agent

arXiv:2610.02324v1 Announce Type: cross Abstract: Foundation multimodal large language models are designed to support a broad spectrum of capabilities across diverse domains. Multi-teacher on-policy d

safetyarxiv-cs-ai
5 Oct 2026
Model Releases

Do MLLM Judges Judge the Edit? Auditing Bias in Image Editing Evaluation with Verified Quality Preservation

DGX agent

arXiv:2610.01670v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are increasingly used as automated judges for instruction-based image editing and as reward signals for model t

model-releasesarxiv-cs-cv
2 Oct 2026
Research

ThinkV2V: Unleashing the Reasoning Capability of MLLMs for Instruction-Guided Video Editing

DGX agent

arXiv:2609.38541v1 Announce Type: new Abstract: Instruction-guided video editing has made significant progress, yet existing methods use multimodal large language models (MLLMs) primarily as semantic

researcharxiv-cs-cv
1 Oct 2026
Research

When Integral Meets Decomposition: A Signal-Level Self-Supervised Feature Decompose Paradigm for Multi-Modal Image Fusion

DGX agent

arXiv:2609.39004v1 Announce Type: new Abstract: Multimodal image fusion (MMIF) aims to integrate complementary information from different modalities into a high-quality fused image and support downstr

researcharxiv-cs-cv
1 Oct 2026
Research

Multifunctional Locomotion Control of Multi-Jointed BURs with Swimming and gait Capabilities

DGX agent

arXiv:2609.37086v1 Announce Type: new Abstract: Multimodal biomimetic underwater robots (BURs) can conduct underwater tasks suitable for the environment. Combining the characteristics of aquatic organ

researcharxiv-cs-ro
30 Sept 2026
← Previous
1…6061626364…197
Next →