AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries125,057
  • Agents10,448
  • Applications7,093
  • Companies3
  • Concepts7
  • Hardware2,728
  • Industry6,780
  • Local Ai6,925
  • Model Releases35,932
  • Research29,267
  • Safety19,340
  • Syntheses31
  • Tools1,775
  • Tutorials4,728

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries125,057
  • Agents10,448
  • Applications7,093
  • Companies3
  • Concepts7
  • Hardware2,728
  • Industry6,780
  • Local Ai6,925
  • Model Releases35,932
  • Research29,267
  • Safety19,340
  • Syntheses31
  • Tools1,775
  • Tutorials4,728

Source
125,057Total entries
60Added by human
124,997Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
61+ results
18 Aug 2026

How Box is unlocking multimodal enterprise agents with Gemini Embeddings 2

Model ReleasesDGX agent

Enterprise content management is experiencing its biggest architectural shift since the cloud migration era. For years, enterprises have stored trillions of gigabytes of critical data in Box: financia

4 May 2026

Learning Multimodal Energy-Based Model with Multimodal Variational Auto-Encoder via MCMC Revision

ResearchDGX agent

arXiv:2605.00644v1 Announce Type: new Abstract: Energy-based models (EBMs) are a flexible class of deep generative models and are well-suited to capture complex dependencies in multimodal data. Howeve

2 Oct 2026

Gestalt: Large Multimodal Interplay Model

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
SafetyDGX agent

arXiv:2610.00576v1 Announce Type: new Abstract: In this paper, we propose Gestalt, a new paradigm of large multimodal model built around multimodal interplay. Despite rapid advances, large multimodal

Coupling Perception and Reasoning in Federated Multimodal Graph Foundation Models

ResearchDGX agent

arXiv:2610.00277v1 Announce Type: new Abstract: Federated multimodal graph foundation models (GFMs) aim to adapt pretrained multimodal models to decentralized graph data, where each client owns a priv

MOVE: Multimodal Open-world Verification and Expansion for Graph Learning

ResearchDGX agent

arXiv:2610.00268v1 Announce Type: new Abstract: Multimodal graph learning faces a fundamental challenge: new classes may emerge after deployment, while models are trained with a fixed label space. Exi

27 Sept 2026

Also please feel free to fight in the comments about 'pure LLMs' versus multimodal LLMs versus multimodal LLMs with tool use or whatever. I …

AgentsDGX agent

Ethan Mollick invited readers to discuss the distinctions between **pure large language models (LLMs)**, **multimodal LLMs** that process multiple data types (e.g., text, images), and **multimodal LLM

10 Jul 2026

Cognitive-structured Multimodal Agent for Multimodal Understanding, Generation, and Editing

Model ReleasesDGX agent

arXiv:2607.08497v1 Announce Type: cross Abstract: Recent unified multimodal models show a single architecture can jointly perform vision/language understanding and image generation/editing. However, t

21 Aug 2026

Brace yourselves. We just entered a new era of frontier multimodal models. DeepSeek-V4-Flash-Vision-Exp advances multimodal agent performanc…

Model ReleasesDGX agent

Brace yourselves. We just entered a new era of frontier multimodal models. DeepSeek-V4-Flash-Vision-Exp advances multimodal agent performance. Also, pay attention to Ox Alpha 1M token contexts with te

Dynamic Gated Cross-Modal Fusion with Sarcastic-aware Contrastive Regularization for Multimodal Sarcasm Detection

SafetyDGX agent

arXiv:2608.19942v1 Announce Type: new Abstract: Multimodal sarcasm detection aims to identify sarcastic intent from multimodal content, where inconsistencies between literal meaning and contextual cue

DeepSeek unveils an experimental multimodal version of its V4 Flash model, saying it nears the performance of Anthropic's Opus 4.8 on multimodal agentic tests (Bloomberg)

Model ReleasesDGX agent

Bloomberg: DeepSeek unveils an experimental multimodal version of its V4 Flash model, saying it nears the performance of Anthropic's Opus 4.8 on multimodal agentic tests — DeepSeek unveiled an experim

SPyCE: Skill-Policy Co-evolution for Multimodal Agents

Local AiDGX agent

arXiv:2607.13854v2 Announce Type: replace Abstract: Multimodal agents that think with images iteratively manipulate visual evidence and invoke tools across many steps. Existing reinforcement learning

Robust Incomplete Multimodal Sentiment Analysis via Iterative Proxy Correction

ApplicationsDGX agent

arXiv:2608.19971v1 Announce Type: new Abstract: Multimodal sentiment analysis aims to infer affective states by integrating language, visual, and acoustic cues. However, real-world multimodal inputs a

1 Oct 2026

Multimodal Flow: Unified Flow Modeling of Language and Vision in Embedding Spaces

Model ReleasesDGX agent

arXiv:2609.40362v1 Announce Type: new Abstract: We present Multimodal Flow, a fully continuous generative model of language and vision. Most unified multimodal models either model both language and qu

MCD: Causal Distillation of Multimodal In-Context Learning in Large Vision-Language Models

SafetyDGX agent

arXiv:2609.39920v1 Announce Type: cross Abstract: Large vision-language models (LVLMs) exhibit strong multimodal in-context learning (ICL) capabilities, yet this ability degrades substantially as mode

12 May 2026

Generative Giants, Retrieval Weaklings: Why do Multimodal Large Language Models Fail at Multimodal Retrieval?

ResearchDGX agent

arXiv:2512.19115v2 Announce Type: replace Abstract: Despite the remarkable success of multimodal large language models (MLLMs) in generative tasks, we observe that they exhibit a counterintuitive defi

Skill-CMIB: Multimodal Agent Skill for Consistent Action via Conditional Multimodal Information Bottleneck

AgentsDGX agent

arXiv:2605.08526v1 Announce Type: new Abstract: While LLM-based agents excel at planning and executing long action sequences, their execution often remains inconsistent across trials, limiting reliabi

MicroWorld: Empowering Multimodal Large Language Models to Bridge the Microscopic Domain Gap with Multimodal Attribute Graph

Model ReleasesDGX agent

arXiv:2605.10120v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) show remarkable potential for scientific reasoning, yet their performance in specialized domains such as micr

11 Sept 2026

V-Retrver: Evidence-Driven Agentic Reasoning for Universal Multimodal Retrieval

AgentsDGX agent

arXiv:2602.06034v3 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs) have recently been applied to universal multimodal retrieval, where Chain-of-Thought (CoT) reasoning improv

Beyond Surface Imitation: Contrastive Modeling for Reasoning Path Alignment in Multimodal In-Context Learning

SafetyDGX agent

arXiv:2609.10177v1 Announce Type: new Abstract: In-context learning (ICL) is widely used in multimodal large language models (MLLMs) and achieves strong performance across a wide range of multimodal t

The Illusion of Balanced Multimodal Sentiment Analysis: Beyond the Limits of Optimization-Based Methods

ResearchDGX agent

arXiv:2609.11247v1 Announce Type: new Abstract: Multimodal Sentiment Analysis (MSA) remains constrained by modality imbalance, yet the field continues to rely on optimization-based balancing methods t

1 Jun 2026

👏👏 Introducing Qwen3.7-Plus — a multimodal agent model that unifies vision and language into one versatile agent foundation. ✅ Multimodal …

Model ReleasesDGX agent

👏👏 Introducing Qwen3.7-Plus — a multimodal agent model that unifies vision and language into one versatile agent foundation. ✅ Multimodal interactive hybrid agent: unified GUI & CLI operation across v

16 Apr 2026

VLM Performance:Qwen3.6 is natively multimodal, and Qwen3.6-35B-A3B showcases perception and multimodal reasoning capabilities that far exce…

Model ReleasesDGX agent

VLM Performance:Qwen3.6 is natively multimodal, and Qwen3.6-35B-A3B showcases perception and multimodal reasoning capabilities that far exceed what its size would suggest, with only around 3 billion a

30 Sept 2026

Can Multimodal Large Language Models Generate and Detect Multimodal Social Media Fake News?

Model ReleasesDGX agent

arXiv:2609.35809v1 Announce Type: cross Abstract: The rapid advancement of generative AI raises concerns about the misuse of Multimodal LLMs (MLLMs) for large-scale disinformation campaigns on social

Paired Multimodal Scaling Laws

ResearchDGX agent

arXiv:2609.36263v1 Announce Type: cross Abstract: Existing multimodal scaling laws fit multimodality terms empirically after testing and never vary how much data is multimodally paired at fixed data b

22 Sept 2026

Generalized Multimodal Foundation Model

ApplicationsDGX agent

arXiv:2609.22107v1 Announce Type: cross Abstract: Making prediction with multimodal data is widely used in diverse scenarios. Existing multimodal fusion models, once deployed, can only handle predefin

12 Aug 2026

MIDAS: Mutual Information Disentanglement with Uncertainty-Aware Fusion for Incomplete Multimodal Sentiment Analysis

SafetyDGX agent

arXiv:2608.09986v1 Announce Type: new Abstract: Most existing multimodal sentiment analysis approaches assume access to complete multimodal inputs. However, real-world applications frequently encounte

6 Aug 2026

When Modalities Remember: Continual Learning for Multimodal Knowledge Graphs

SafetyDGX agent

arXiv:2604.02778v2 Announce Type: replace Abstract: Real-world multimodal knowledge graphs (MMKGs) are dynamic, with new entities, relations, and multimodal knowledge emerging over time. Existing cont

10 Apr 2026

URMF: Uncertainty-aware Robust Multimodal Fusion for Multimodal Sarcasm Detection

SafetyDGX agent

arXiv:2604.06728v1 Announce Type: cross Abstract: Multimodal sarcasm detection (MSD) aims to identify sarcastic intent from semantic incongruity between text and image. Although recent methods have im

8 Oct 2026

MUNITE: Unified Multimodal Latent Inference for Any-to-Any Multimodal Generation

SafetyDGX agent

arXiv:2610.09866v1 Announce Type: new Abstract: We introduce MUNITE, a latent-variable framework for flexible any-to-any multimodal generation that treats encoding and latent generation as the same in

10 Sept 2026

MVFA: A Multi-View Text-Guided Multimodal Fusion LLM Adapter for Sentiment Analysis and Emotion Recognition

Model ReleasesDGX agent

arXiv:2609.06188v1 Announce Type: new Abstract: Multimodal sentiment analysis and emotion recognition in conversations demand effective modeling of heterogeneous interactions across textual, acoustic,

4 Aug 2026

Douyin Multimodal Embedding Model Technical Report

ApplicationsDGX agent

arXiv:2608.02148v1 Announce Type: cross Abstract: Multimodal representation learning is a cornerstone of modern AI. By encoding multimodal queries and targets into vectors, it powers industrial search

21 May 2026

DiMextsuperscript{3}: Bridging Multilingual and Multimodal Models via Direction- and Magnitude-Aware Merging

Model ReleasesDGX agent

arXiv:2605.12960v2 Announce Type: replace Abstract: Towards more general and human-like intelligence, large language models should seamlessly integrate both multilingual and multimodal capabilities; h

22 Apr 2026

DT2IT-MRM: Debiased Preference Construction and Iterative Training for Multimodal Reward Modeling

SafetyDGX agent

arXiv:2604.19544v1 Announce Type: new Abstract: Multimodal reward models (MRMs) play a crucial role in aligning Multimodal Large Language Models (MLLMs) with human preferences. Training a good MRM req

Unveiling Fine-Grained Visual Traces: Evaluating Multimodal Interleaved Reasoning Chains in Multimodal STEM Tasks

Model ReleasesDGX agent

arXiv:2604.19697v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have shown promising reasoning abilities, yet evaluating their performance in specialized domains remains chall

11 Aug 2026

Multimodal Model Diffing for Feature Discovery and Control

SafetyDGX agent

arXiv:2608.09928v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) exhibit strong visual understanding, yet the internal features that cause these behaviors remain difficult to

31 Jul 2026

OPLD: On-Policy Latent Distillation for Multimodal Reasoning

SafetyDGX agent

arXiv:2607.28154v1 Announce Type: new Abstract: Interleaved multimodal Chain-of-Thought (CoT) improves visual reasoning by incorporating auxiliary visual evidence into intermediate reasoning. However,

8 Jul 2026

Decoding the Multimodal Mind: Generalizable Brain-to-Text Translation via Multimodal Alignment and Adaptive Routing

Model ReleasesDGX agent

arXiv:2505.10356v3 Announce Type: replace Abstract: Decoding language from the human brain remains a grand challenge for Brain-Computer Interfaces (BCIs). Current approaches typically rely on unimodal

15 May 2026

MultiMat: Multimodal Program Synthesis for Procedural Materials using Large Multimodal Models

ApplicationsDGX agent

arXiv:2509.22151v3 Announce Type: replace Abstract: Material node graphs are programs that generate the 2D channels of procedural materials, including geometry such as roughness and displacement maps,

27 Apr 2026

Beyond Chain-of-Thought: Rewrite as a Universal Interface for Generative Multimodal Embeddings

SafetyDGX agent

arXiv:2604.22280v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have emerged as a promising foundation for universal multimodal embeddings. Recent studies have shown that reas

Inter-Stance: A Dyadic Multimodal Corpus for Conversational Stance Analysis

ResearchDGX agent

arXiv:2604.22739v1 Announce Type: new Abstract: Social interactions dominate our perceptions of the world and shape our daily behavior by attaching social meaning to acts as simple and spontaneous as

21 Apr 2026

MARA: A Multimodal Adaptive Retrieval-Augmented Framework for Document Question Answering

ResearchDGX agent

arXiv:2604.16313v1 Announce Type: cross Abstract: Retrieval-based multimodal document QA aims to identify and integrate relevant information from visually rich documents with complex multimodal struct

14 Apr 2026

M^3KG-RAG: Multi-hop Multimodal Knowledge Graph-enhanced Retrieval-Augmented Generation

AgentsDGX agent

arXiv:2512.20136v3 Announce Type: replace-cross Abstract: Retrieval-Augmented Generation (RAG) has recently been extended to multimodal settings, connecting multimodal large language models (MLLMs) wi

14 Oct 2026

Design Choices for Multimodal Transformer Learning with Missing and Longitudinal Healthcare Data

TutorialsDGX agent

arXiv:2610.14436v1 Announce Type: cross Abstract: Multimodal learning offers the potential to improve predictions by integrating complementary information from heterogeneous data sources. However, mul

Dependency, Compression, and Synergy: A Unified Information-Theoretic View of Multimodal Learning

Model ReleasesDGX agent

arXiv:2609.14421v1 Announce Type: cross Abstract: Recent advances in multimodal foundation models have intensified the need to understand how different modalities share, preserve, and complement infor

7 Oct 2026

Dynamic Alignment and Calibration for Multimodal Learning

Model ReleasesDGX agent

arXiv:2610.07928v1 Announce Type: cross Abstract: Dynamic multimodal learning aims to learn robust representations by adaptively modeling information discrepancies across modalities. However, existing

Source-Learned Reliance for Selective Test-Time Adaptation of Multimodal Time Series

TutorialsDGX agent

arXiv:2610.07499v1 Announce Type: new Abstract: Multimodal wearable systems must remain reliable when sensor streams become noisy or unavailable. Existing multimodal test-time adaptation (TTA) methods

24 Sept 2026

BiCFlow-MER: Orchestrating Discriminative and Generative Multimodal Emotion Recognition via Conditional Transport

Model ReleasesDGX agent

arXiv:2609.27615v1 Announce Type: new Abstract: In multimodal emotion recognition (MER), human affective states are inferred by integrating complementary cues from multiple modalities. In audio-text M

16 Sept 2026

MOCC-R1: Reinforcing Reasoning-Response Consistency for Multimodal Counselor Response Generation

ResearchDGX agent

arXiv:2609.17180v1 Announce Type: new Abstract: Multimodal counselor response generation (MCRG) aims to generate an appropriate counselor response from multimodal dialogue histories. Progress is limit

9 Sept 2026

Evolution of Multimodal Question Answering: From Modality-Adaptive Extraction to Unified Language Representation

Model ReleasesDGX agent

arXiv:2609.08896v1 Announce Type: cross Abstract: The rapid growth of multimodal data has intensified the need for question answering (QA) systems capable of reasoning across heterogeneous sources suc

3 Sept 2026

Beyond Modality Harmony: Orthogonal Purification and Topology-Guided MoE for Conflict-Aware Multimodal Recommendation

SafetyDGX agent

arXiv:2609.02152v1 Announce Type: cross Abstract: Multimodal Recommender Systems (MRSs) typically rely on a flawed 'modality harmony' assumption, presuming that multimodal features are inherently bene

1 Sept 2026

LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPO

Model ReleasesDGX agent

arXiv:2608.29357v1 Announce Type: new Abstract: Multimodal search agents answer visual questions by interleaving image understanding, web retrieval, tool use, and evidence synthesis. Strong systems ex

Multimodal Adaptive Expert Selection with Text Routing and Ordinal Prototype Optimization for Sentiment Analysis

ResearchDGX agent

arXiv:2608.30726v1 Announce Type: new Abstract: Multimodal Sentiment Analysis (MSA) is a fundamental component of affective computing that aims to decipher complex emotional states by integrating verb

SGM: Safety Glasses for Multimodal Large Language Models via Neuron-Level Detoxification

Model ReleasesDGX agent

arXiv:2512.15052v4 Announce Type: replace-cross Abstract: Disclaimer: Samples in this paper may be harmful and cause discomfort. Multimodal large language models (MLLMs) enable multimodal understandin

28 May 2026

Tackling Multimodal Learning Challenges with Mixture-of-Expert: A Survey

Model ReleasesDGX agent

arXiv:2605.27431v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) presents a naturally compatible and scalable framework for multimodal learning, demonstrating strong adaptability across dive

11 May 2026

InterLV-Search: Benchmarking Interleaved Multimodal Agentic Search

Model ReleasesDGX agent

arXiv:2605.07510v1 Announce Type: cross Abstract: Existing benchmarks for multimodal agentic search evaluate multimodal search and visual browsing, but visual evidence is either confined to the input

15 Apr 2026

MODIX: A Training-Free Multimodal Information-Driven Positional Index Scaling for Vision-Language Models

SafetyDGX agent

arXiv:2604.12537v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) have achieved remarkable progress in multimodal understanding, yet their positional encoding mechanisms remain suboptima

9 Oct 2026

Omni-Diffusion-Distill: Few-Step Distillation of Unified Multimodal Diffusion Large Language Models

TutorialsDGX agent

arXiv:2610.10990v1 Announce Type: new Abstract: Unified multimodal diffusion large language models (dLLMs) offer a single architecture for both image generation and multimodal understanding, but their

17 Sept 2026

Divide and Conquer: Mixture-of-Bottleneck Experts in Informative Ordinal Space for Video-based Multimodal Sentiment Analysis

ResearchDGX agent

arXiv:2609.18470v1 Announce Type: cross Abstract: Video-based Multimodal sentiment analysis (MSA) must handle information from text, audio, and image sequence in human speaking videos, yet current met

15 Sept 2026

V-ICAL Bench: Evaluating Video In-Context Learning for Multimodal Agents in Interactive Environments

Model ReleasesDGX agent

arXiv:2609.15683v1 Announce Type: new Abstract: While In-Context Learning (ICL) enables models to adapt from exemplars without parameter updates, multimodal ICL remains largely underexplored, particul

12 Sept 2026

Mr.LHDR: A Benchmark for Multimodal Real-World Long-Horizon Deep Research Agents

Model ReleasesDGX agent

arXiv:2609.11318v1 Announce Type: new Abstract: Deep research agents are increasingly capable of web search, tool use, multimodal evidence analysis, and information synthesis. However, existing benchm

← Previous
1
Next →
9,881 results
← Previous
123…165
Next →