AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
Human
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
9,441 results
Model Releases

Zero-Shot Mission-Level Evaluation for Aerial MLLM Agents

DGX agent

arXiv:2607.22014v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) are emerging as core reasoning modules for embodied agents, yet it remains unclear how well general-purpose m

model-releasesarxiv-cs-cl
27 Jul 2026
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Safety

MELLA: Bridging Linguistic Capability and Cultural Groundedness for Low-Resource Language MLLMs

DGX agent

arXiv:2508.05502v2 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) perform strongly in high-resource languages, yet often produce fluent but culturally 'thin' descripti

safetyarxiv-cs-ai
24 Jul 2026
Tutorials

UMSS: Towards Unsupervised Multi-modal Semantic Segmentation

DGX agent

arXiv:2607.12372v1 Announce Type: new Abstract: Multimodal semantic segmentation (MSS) is essential for robust perception in complex environments, yet its potential remains largely untapped because of

tutorialsarxiv-cs-cv
15 Jul 2026
Research

iFLYTEK-Embodied-Omni Technical Report

DGX agent

arXiv:2607.02542v1 Announce Type: new Abstract: General-purpose embodied agents must understand multimodal instructions, anticipate how their environment will evolve, and produce precise control actio

researcharxiv-cs-ai
7 Jul 2026
Hardware

An Efficient vLLM-Based Inference Pipeline for Unified Audio Understanding and Generation

DGX agent

arXiv:2607.02119v1 Announce Type: cross Abstract: While Large Multimodal Models excel in comprehension, high-throughput inference engines lack native support for multimodal generation. This is severe

hardwarearxiv-cs-ai
3 Jul 2026
Model Releases

LOPA: Enhancing Spoken Language Assessment via Latent Ordinal Prototype Alignment

DGX agent

arXiv:2606.31310v1 Announce Type: new Abstract: Fueled by increasing model scale and multimodal inputs, Multimodal Large Language Models (MLLMs) have emerged as a promising paradigm for Spoken Languag

model-releasesarxiv-cs-cl
1 Jul 2026
Research

RASR: Retrieval-Augmented Semantic Reasoning for Fake News Video Detection

DGX agent

arXiv:2604.06687v2 Announce Type: replace Abstract: Multimodal fake news video detection is a crucial research direction for maintaining the credibility of online information. Existing studies primari

researcharxiv-cs-cv
1 Jul 2026
Tutorials

Before Thinking, Learn to Decide: Proactive Routing for Efficient Visual Reasoning

DGX agent

arXiv:2606.30217v1 Announce Type: new Abstract: Large multimodal models have achieved strong reasoning on complex visual tasks, but their inference efficiency is often restricted by long chains of tho

tutorialsarxiv-cs-cl
30 Jun 2026
Model Releases

Bridging VideoQA and Video-Guided Agentic Tasks via Generalized Keyframe Extraction

DGX agent

arXiv:2606.29445v1 Announce Type: cross Abstract: Video understanding is a fundamental capability for multimodal intelligence, and recent Multimodal Large Language Models (MLLMs) have achieved remarka

model-releasesarxiv-cs-ai
30 Jun 2026
Research

TOPS: First-Principles Visual Token Pruning via Constructing Token Optimal Preservation Sets for Efficient MLLM Inference

DGX agent

arXiv:2606.27161v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have achieved strong multimodal reasoning capabilities, but their efficiency is limited by the large number of

researcharxiv-cs-ai
26 Jun 2026
Research

ViQ: Text-Aligned Visual Quantized Representations at Any Resolution

DGX agent

arXiv:2606.27313v1 Announce Type: new Abstract: A unified representation for text and vision is a natural pursuit, as it enables simpler multimodal modeling and more efficient training. However, repre

researcharxiv-cs-cv
26 Jun 2026
Research

Findings of the MAGMaR 2026 Shared Task

DGX agent

arXiv:2606.12295v1 Announce Type: cross Abstract: This overview paper presents the results of the shared task for the second workshop on Multimodal Augmented Generation via Multimodal Retrieval (MAGMa

researcharxiv-cs-cl
11 Jun 2026
Research

MentisOculi: Revealing the Limits of Reasoning with Mental Imagery

DGX agent

arXiv:2602.02465v2 Announce Type: replace Abstract: Frontier models are transitioning from multimodal large language models (MLLMs) that merely ingest visual information to unified multimodal models (

researcharxiv-cs-ai
11 Jun 2026
Model Releases

Kwai Keye-VL-2.0 Technical Report

DGX agent

arXiv:2606.10651v1 Announce Type: new Abstract: We introduce Kwai Keye-VL-2.0-30B-A3B, an open-source Mixture-of-Experts (MoE) multimodal foundation model designed to advance long-video understanding

model-releasesarxiv-cs-cv
10 Jun 2026
Research

Optical Reasoning: Rethinking Images as an Expressive Reasoning Medium Beyond Text

DGX agent

arXiv:2606.09585v1 Announce Type: new Abstract: Chain-of-Thought (CoT) improves the performance of Large Language Models (LLMs) and has been extended to Multimodal Large Language Models (MLLMs). More

researcharxiv-cs-ai
9 Jun 2026
Model Releases

COMBINER: Composed Image Retrieval Guided by Attribute-based Neighbor Relations

DGX agent

arXiv:2606.04604v1 Announce Type: new Abstract: Composed Image Retrieval (CIR) represents a challenging retrieval task that targets locating specific images through multimodal inputs. Despite recent p

model-releasesarxiv-cs-cv
4 Jun 2026
Agents

MUSE: A Unified Agentic Harness for MLLMs

DGX agent

arXiv:2606.03005v1 Announce Type: cross Abstract: Despite rapid progress, multimodal large language models (MLLMs) still fail on tasks that humans solve effortlessly, such as navigating a grid maze fr

agentsarxiv-cs-ai
3 Jun 2026
Model Releases

Do Text Edits Generalize to Visual Generation? Benchmarking Cross-Modal Knowledge Editing in UMMs

DGX agent

arXiv:2606.00477v1 Announce Type: new Abstract: Unified multimodal models (UMMs) have emerged as a promising paradigm for general-purpose multimodal intelligence. As they are deployed in real-world ap

model-releasesarxiv-cs-cl
2 Jun 2026
Model Releases

OmniRetriever: Any-to-Any Audio-Video-Text Retrieval via Fusion-as-Teacher Distillation

DGX agent

arXiv:2605.26641v1 Announce Type: new Abstract: Unified multimodal embedding spaces have become the standard interface for cross-modal retrieval and multimodal RAG, and recent audio-video-text (AVT) e

model-releasesarxiv-cs-cv
27 May 2026
Model Releases

Same Model, Different Weakness: How Language and Modality Reshape the Jailbreak Attack Surface in Frontier MLLMs

DGX agent

arXiv:2605.23157v1 Announce Type: new Abstract: The attack surface of a multimodal large language model (MLLM) is language-dependent in ways that reveal the mechanistic structure of alignment failures

model-releasesarxiv-cs-cl
25 May 2026
Model Releases

MapTab: Are MLLMs Ready for Multi-Criteria Route Planning in Heterogeneous Graphs?

DGX agent

arXiv:2602.18600v3 Announce Type: replace Abstract: Systematic evaluation of Multimodal Large Language Models (MLLMs) is crucial for advancing Artificial General Intelligence (AGI). However, existing

model-releasesarxiv-cs-lg
23 May 2026
Model Releases

DeFacto: Counterfactual Thinking with Images for Enforcing Evidence-Grounded and Faithful Reasoning

DGX agent

arXiv:2509.20912v4 Announce Type: replace Abstract: Recent advances in multimodal language models (MLLMs) have made thinking with images a dominant paradigm for multimodal reasoning. However, existing

model-releasesarxiv-cs-ai
22 May 2026
Research

EVA01: Unified Native 3D Understanding and Generation via Mixture-of-Transformers

DGX agent

arXiv:2605.16745v1 Announce Type: new Abstract: This paper addresses the challenge of integrating 3D meshes as a native modality within Multimodal Large Language Models (MLLMs). Diffusion-based large

researcharxiv-cs-cv
19 May 2026
Model Releases

TOBench: A Task-Oriented Omni-Modal Benchmark for Real-World Tool-Using Agents

DGX agent

arXiv:2605.16909v1 Announce Type: new Abstract: Tool-using agents are increasingly expected to operate across realistic professional workflows, where they must interpret multimodal inputs, coordinate

model-releasesarxiv-cs-ai
19 May 2026
Model Releases

A Cross-Modal Prompt Injection Attack against Large Vision-Language Models with Image-Only Perturbation

DGX agent

arXiv:2605.16090v1 Announce Type: cross Abstract: Large vision-language models (LVLMs) have emerged as a powerful paradigm for multimodal intelligence, but their growing deployment also expands the at

model-releasesarxiv-cs-cv
18 May 2026
Agents

Earth Science Foundation Models: From Perception to Reasoning and Discovery

DGX agent

arXiv:2605.12542v1 Announce Type: cross Abstract: Large foundation models (FMs) are transforming Earth science by integrating heterogeneous multimodal data, such as multi-platform imagery, gridded rea

agentsarxiv-cs-lg
14 May 2026
Research

Can MLLMs Reason About Visual Persuasion? Evaluating the Efficacy and Faithfulness of Reasoning

DGX agent

arXiv:2605.08965v1 Announce Type: new Abstract: Despite strong performance of Multimodal Large Language Models (MLLMs) on multimodal tasks, predicting whether and why an image is persuasive remains ch

researcharxiv-cs-cv
12 May 2026
Safety

Instruction Anchor: Dissecting the Mechanistic Dynamics of Modality Arbitration

DGX agent

arXiv:2602.03677v2 Announce Type: replace Abstract: Modality following is the ability to selectively leverage multimodal contexts based on user instructions. It is fundamental to the safety and reliab

safetyarxiv-cs-cl
12 May 2026
Safety

S1-MMAlign: A Large-Scale, Multi-Disciplinary Dataset for Scientific Figure-Text Understanding

DGX agent

arXiv:2601.00264v2 Announce Type: replace Abstract: Multimodal learning has revolutionized general domain tasks, yet its application in scientific discovery is hindered by the profound semantic gap be

safetyarxiv-cs-cv
7 May 2026
Local Ai

ScrapMem: A Bio-inspired Framework for On-device Personalized Agent Memory via Optical Forgetting

DGX agent

arXiv:2605.03804v1 Announce Type: new Abstract: Long-term personalized memory for LLM agents is challenging on resource-limited edge devices due to high storage costs and multimodal complexity. To add

local-aiarxiv-cs-ai
7 May 2026
Model Releases

MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interaction

DGX agent

arXiv:2604.27393v1 Announce Type: new Abstract: Recent progress in multimodal large language models (MLLMs) has brought AI capabilities from static offline data processing to real-time streaming inter

model-releasesarxiv-cs-cl
1 May 2026
Model Releases

State Beyond Appearance: Diagnosing and Improving State Consistency in Dial-Based Measurement Reading

DGX agent

arXiv:2604.26614v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have achieved impressive progress on general multimodal tasks, yet they remain brittle on dial-based measuremen

model-releasesarxiv-cs-cv
30 Apr 2026
Model Releases

AdaTooler-V: Adaptive Tool-Use for Images and Videos

DGX agent

arXiv:2512.16918v3 Announce Type: replace Abstract: Recent advances have shown that multimodal large language models (MLLMs) benefit from multimodal interleaved chain-of-thought (CoT) with vision tool

model-releasesarxiv-cs-cv
29 Apr 2026
Research

Audio Video Verbal Analysis (AVVA) for Capturing Classroom Dialogues

DGX agent

arXiv:2604.22043v1 Announce Type: cross Abstract: Background: The classroom discourse analysis has been transformed by the growing use of audio-video multimodal data, which demands analytical methods

researcharxiv-cs-lg
27 Apr 2026
Research

Rethinking Token Pruning for Historical Screenshots in GUI Visual Agents: Semantic, Spatial, and Temporal Perspectives

DGX agent

arXiv:2603.26041v3 Announce Type: replace Abstract: In recent years, GUI visual agents built upon Multimodal Large Language Models (MLLMs) have demonstrated strong potential in navigation tasks. Howev

researcharxiv-cs-cv
27 Apr 2026
Tutorials

PhysMem: Scaling Test-time Physical Memory for Robot Manipulation

DGX agent

arXiv:2602.20323v5 Announce Type: replace-cross Abstract: Reliable object manipulation requires understanding physical properties that vary across objects and environments. Vision-language model (VLM)

tutorialsarxiv-cs-ai
22 Apr 2026
Model Releases

AVRT: Audio-Visual Reasoning Transfer through Single-Modality Teachers

DGX agent

arXiv:2604.16617v1 Announce Type: new Abstract: Recent advances in reasoning models have shown remarkable progress in text-based domains, but transferring those capabilities to multimodal settings, e.

model-releasesarxiv-cs-cv
21 Apr 2026
Safety

CGCMA: Conditionally-Gated Cross-Modal Attention for Event-Conditioned Asynchronous Fusion

DGX agent

arXiv:2604.16411v1 Announce Type: new Abstract: We study asynchronous alignment, a first-class multimodal learning setting in which a dense primary stream must be fused with sporadic external context

safetyarxiv-cs-lg
21 Apr 2026
Research

Culinary Crossroads: A RAG Framework for Enhancing Diversity in Cross-Cultural Recipe Adaptation

DGX agent

arXiv:2507.21934v2 Announce Type: replace Abstract: In cross-cultural recipe adaptation, the goal is not only to ensure cultural appropriateness and retain the original dish's essence, but also to pro

researcharxiv-cs-cl
21 Apr 2026
Model Releases

From Inheritance to Saturation: Disentangling the Evolution of Visual Redundancy for Architecture-Aware MLLM Inference Acceleration

DGX agent

arXiv:2604.16462v1 Announce Type: new Abstract: High-resolution Multimodal Large Language Models (MLLMs) face prohibitive computational costs during inference due to the explosion of visual tokens. Ex

model-releasesarxiv-cs-cv
21 Apr 2026
Research

MUSEG: Reinforcing Video Temporal Understanding via Timestamp-Aware Multi-Segment Grounding

DGX agent

arXiv:2505.20715v2 Announce Type: replace-cross Abstract: Video temporal understanding is crucial for multimodal large language models (MLLMs) to reason over events in videos. Despite recent advances

researcharxiv-cs-cl
21 Apr 2026
Model Releases

PlanViz: Evaluating Planning-Oriented Image Generation and Editing for Computer-Use Tasks

DGX agent

arXiv:2602.06663v2 Announce Type: replace Abstract: Unified multimodal models (UMMs) have shown impressive capabilities in generating natural images and supporting multimodal reasoning. However, their

model-releasesarxiv-cs-cv
21 Apr 2026
Research

SmoGVLM: A Small, Graph-enhanced Vision-Language Model

DGX agent

arXiv:2604.16517v1 Announce Type: cross Abstract: Large vision-language models (VLMs) achieve strong performance on multimodal tasks but often suffer from hallucination and poor grounding in knowledge

researcharxiv-cs-cl
21 Apr 2026
Research

LLaMo: Scaling Pretrained Language Models for Unified Motion Understanding and Generation with Continuous Autoregressive Tokens

DGX agent

arXiv:2602.12370v2 Announce Type: replace Abstract: Recent progress in large models has led to significant advances in unified multimodal generation and understanding. However, the development of mode

researcharxiv-cs-cv
20 Apr 2026
Model Releases

RefereeBench: Are Video MLLMs Ready to be Multi-Sport Referees

DGX agent

arXiv:2604.15736v1 Announce Type: cross Abstract: While Multimodal Large Language Models (MLLMs) excel at generic video understanding, their ability to support specialized, rule-grounded decision-maki

model-releasesarxiv-cs-cl
20 Apr 2026
Tutorials

CausalEmbed: Auto-Regressive Multi-Vector Generation in Latent Space for Visual Document Embedding

DGX agent

arXiv:2601.21262v3 Announce Type: replace Abstract: Although Multimodal Large Language Models (MLLMs) have shown remarkable potential in Visual Document Retrieval (VDR) through generating high-quality

tutorialsarxiv-cs-cl
17 Apr 2026
Research

From Reactive to Proactive: Assessing the Proactivity of Voice Agents via ProVoice-Bench

DGX agent

arXiv:2604.15037v1 Announce Type: cross Abstract: Recent advancements in LLM agents are gradually shifting from reactive, text-based paradigms toward proactive, multimodal interaction. However, existi

researcharxiv-cs-cl
17 Apr 2026
Model Releases

Rethinking Patient Education as Multi-turn Multi-modal Interaction

DGX agent

arXiv:2604.14656v1 Announce Type: cross Abstract: Most medical multimodal benchmarks focus on static tasks such as image question answering, report generation, and plain-language rewriting. Patient ed

model-releasesarxiv-cs-cl
17 Apr 2026
← Previous
1…6263646566…197
Next →