AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries123,194
  • Agents10,336
  • Applications7,012
  • Companies3
  • Concepts7
  • Hardware2,694
  • Industry6,766
  • Local Ai6,840
  • Model Releases35,411
  • Research28,731
  • Safety18,965
  • Syntheses30
  • Tools1,773
  • Tutorials4,626

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries123,194
  • Agents10,336
  • Applications7,012
  • Companies3
  • Concepts7
  • Hardware2,694
  • Industry6,766
  • Local Ai6,840
  • Model Releases35,411
  • Research28,731
  • Safety18,965
  • Syntheses30
  • Tools1,773
  • Tutorials4,626

Source
HumanDGX agent

123,194Total entries
59Added by human
123,135Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
49+ results
Model Releases

How Box is unlocking multimodal enterprise agents with Gemini Embeddings 2

DGX agent

Enterprise content management is experiencing its biggest architectural shift since the cloud migration era. For years, enterprises have stored trillions of gigabytes of critical data in Box: financia

model-releasesgoogle-cloud-ai
18 Aug 2026
Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Research

Learning Multimodal Energy-Based Model with Multimodal Variational Auto-Encoder via MCMC Revision

DGX agent

arXiv:2605.00644v1 Announce Type: new Abstract: Energy-based models (EBMs) are a flexible class of deep generative models and are well-suited to capture complex dependencies in multimodal data. Howeve

researcharxiv-cs-lg
4 May 2026
Safety

Gestalt: Large Multimodal Interplay Model

DGX agent

arXiv:2610.00576v1 Announce Type: new Abstract: In this paper, we propose Gestalt, a new paradigm of large multimodal model built around multimodal interplay. Despite rapid advances, large multimodal

safetyarxiv-cs-cv
2 Oct 2026
Agents

Also please feel free to fight in the comments about 'pure LLMs' versus multimodal LLMs versus multimodal LLMs with tool use or whatever. I …

DGX agent

Ethan Mollick invited readers to discuss the distinctions between **pure large language models (LLMs)**, **multimodal LLMs** that process multiple data types (e.g., text, images), and **multimodal LLM

agentsethan-mollick--x
27 Sept 2026
Model Releases

Cognitive-structured Multimodal Agent for Multimodal Understanding, Generation, and Editing

DGX agent

arXiv:2607.08497v1 Announce Type: cross Abstract: Recent unified multimodal models show a single architecture can jointly perform vision/language understanding and image generation/editing. However, t

model-releasesarxiv-cs-ai
10 Jul 2026
Model Releases

Brace yourselves. We just entered a new era of frontier multimodal models. DeepSeek-V4-Flash-Vision-Exp advances multimodal agent performanc…

DGX agent

Brace yourselves. We just entered a new era of frontier multimodal models. DeepSeek-V4-Flash-Vision-Exp advances multimodal agent performance. Also, pay attention to Ox Alpha 1M token contexts with te

model-releasesdair-ai--x
21 Aug 2026
Model Releases

Multimodal Flow: Unified Flow Modeling of Language and Vision in Embedding Spaces

DGX agent

arXiv:2609.40362v1 Announce Type: new Abstract: We present Multimodal Flow, a fully continuous generative model of language and vision. Most unified multimodal models either model both language and qu

model-releasesarxiv-cs-cv
1 Oct 2026
Safety

Dynamic Gated Cross-Modal Fusion with Sarcastic-aware Contrastive Regularization for Multimodal Sarcasm Detection

DGX agent

arXiv:2608.19942v1 Announce Type: new Abstract: Multimodal sarcasm detection aims to identify sarcastic intent from multimodal content, where inconsistencies between literal meaning and contextual cue

safetyarxiv-cs-cl
21 Aug 2026
Research

Generative Giants, Retrieval Weaklings: Why do Multimodal Large Language Models Fail at Multimodal Retrieval?

DGX agent

arXiv:2512.19115v2 Announce Type: replace Abstract: Despite the remarkable success of multimodal large language models (MLLMs) in generative tasks, we observe that they exhibit a counterintuitive defi

researcharxiv-cs-cv
12 May 2026
Agents

Skill-CMIB: Multimodal Agent Skill for Consistent Action via Conditional Multimodal Information Bottleneck

DGX agent

arXiv:2605.08526v1 Announce Type: new Abstract: While LLM-based agents excel at planning and executing long action sequences, their execution often remains inconsistent across trials, limiting reliabi

agentsarxiv-cs-lg
12 May 2026
Agents

V-Retrver: Evidence-Driven Agentic Reasoning for Universal Multimodal Retrieval

DGX agent

arXiv:2602.06034v3 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs) have recently been applied to universal multimodal retrieval, where Chain-of-Thought (CoT) reasoning improv

agentsarxiv-cs-cv
11 Sept 2026
Model Releases

DeepSeek unveils an experimental multimodal version of its V4 Flash model, saying it nears the performance of Anthropic's Opus 4.8 on multimodal agentic tests (Bloomberg)

DGX agent

Bloomberg: DeepSeek unveils an experimental multimodal version of its V4 Flash model, saying it nears the performance of Anthropic's Opus 4.8 on multimodal agentic tests — DeepSeek unveiled an experim

model-releasestechmeme
21 Aug 2026
Model Releases

👏👏 Introducing Qwen3.7-Plus — a multimodal agent model that unifies vision and language into one versatile agent foundation. ✅ Multimodal …

DGX agent

👏👏 Introducing Qwen3.7-Plus — a multimodal agent model that unifies vision and language into one versatile agent foundation. ✅ Multimodal interactive hybrid agent: unified GUI & CLI operation across v

model-releasesqwen--x
1 Jun 2026
Model Releases

VLM Performance:Qwen3.6 is natively multimodal, and Qwen3.6-35B-A3B showcases perception and multimodal reasoning capabilities that far exce…

DGX agent

VLM Performance:Qwen3.6 is natively multimodal, and Qwen3.6-35B-A3B showcases perception and multimodal reasoning capabilities that far exceed what its size would suggest, with only around 3 billion a

model-releasesqwen--x
16 Apr 2026
Research

Coupling Perception and Reasoning in Federated Multimodal Graph Foundation Models

DGX agent

arXiv:2610.00277v1 Announce Type: new Abstract: Federated multimodal graph foundation models (GFMs) aim to adapt pretrained multimodal models to decentralized graph data, where each client owns a priv

researcharxiv-cs-lg
2 Oct 2026
Model Releases

Can Multimodal Large Language Models Generate and Detect Multimodal Social Media Fake News?

DGX agent

arXiv:2609.35809v1 Announce Type: cross Abstract: The rapid advancement of generative AI raises concerns about the misuse of Multimodal LLMs (MLLMs) for large-scale disinformation campaigns on social

model-releasesarxiv-cs-ai
30 Sept 2026
Applications

Generalized Multimodal Foundation Model

DGX agent

arXiv:2609.22107v1 Announce Type: cross Abstract: Making prediction with multimodal data is widely used in diverse scenarios. Existing multimodal fusion models, once deployed, can only handle predefin

applicationsarxiv-cs-cl
22 Sept 2026
Safety

MIDAS: Mutual Information Disentanglement with Uncertainty-Aware Fusion for Incomplete Multimodal Sentiment Analysis

DGX agent

arXiv:2608.09986v1 Announce Type: new Abstract: Most existing multimodal sentiment analysis approaches assume access to complete multimodal inputs. However, real-world applications frequently encounte

safetyarxiv-cs-ai
12 Aug 2026
Safety

When Modalities Remember: Continual Learning for Multimodal Knowledge Graphs

DGX agent

arXiv:2604.02778v2 Announce Type: replace Abstract: Real-world multimodal knowledge graphs (MMKGs) are dynamic, with new entities, relations, and multimodal knowledge emerging over time. Existing cont

safetyarxiv-cs-cl
6 Aug 2026
Safety

URMF: Uncertainty-aware Robust Multimodal Fusion for Multimodal Sarcasm Detection

DGX agent

arXiv:2604.06728v1 Announce Type: cross Abstract: Multimodal sarcasm detection (MSD) aims to identify sarcastic intent from semantic incongruity between text and image. Although recent methods have im

safetyarxiv-cs-ai
10 Apr 2026
Safety

MUNITE: Unified Multimodal Latent Inference for Any-to-Any Multimodal Generation

DGX agent

arXiv:2610.09866v1 Announce Type: new Abstract: We introduce MUNITE, a latent-variable framework for flexible any-to-any multimodal generation that treats encoding and latent generation as the same in

safetyarxiv-cs-lg
8 Oct 2026
Safety

Beyond Surface Imitation: Contrastive Modeling for Reasoning Path Alignment in Multimodal In-Context Learning

DGX agent

arXiv:2609.10177v1 Announce Type: new Abstract: In-context learning (ICL) is widely used in multimodal large language models (MLLMs) and achieves strong performance across a wide range of multimodal t

safetyarxiv-cs-ai
11 Sept 2026
Model Releases

MVFA: A Multi-View Text-Guided Multimodal Fusion LLM Adapter for Sentiment Analysis and Emotion Recognition

DGX agent

arXiv:2609.06188v1 Announce Type: new Abstract: Multimodal sentiment analysis and emotion recognition in conversations demand effective modeling of heterogeneous interactions across textual, acoustic,

model-releasesarxiv-cs-ai
10 Sept 2026
Applications

Douyin Multimodal Embedding Model Technical Report

DGX agent

arXiv:2608.02148v1 Announce Type: cross Abstract: Multimodal representation learning is a cornerstone of modern AI. By encoding multimodal queries and targets into vectors, it powers industrial search

applicationsarxiv-cs-cl
4 Aug 2026
Model Releases

DiMextsuperscript{3}: Bridging Multilingual and Multimodal Models via Direction- and Magnitude-Aware Merging

DGX agent

arXiv:2605.12960v2 Announce Type: replace Abstract: Towards more general and human-like intelligence, large language models should seamlessly integrate both multilingual and multimodal capabilities; h

model-releasesarxiv-cs-cl
21 May 2026
Model Releases

MicroWorld: Empowering Multimodal Large Language Models to Bridge the Microscopic Domain Gap with Multimodal Attribute Graph

DGX agent

arXiv:2605.10120v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) show remarkable potential for scientific reasoning, yet their performance in specialized domains such as micr

model-releasesarxiv-cs-ai
12 May 2026
Safety

DT2IT-MRM: Debiased Preference Construction and Iterative Training for Multimodal Reward Modeling

DGX agent

arXiv:2604.19544v1 Announce Type: new Abstract: Multimodal reward models (MRMs) play a crucial role in aligning Multimodal Large Language Models (MLLMs) with human preferences. Training a good MRM req

safetyarxiv-cs-ai
22 Apr 2026
Model Releases

Unveiling Fine-Grained Visual Traces: Evaluating Multimodal Interleaved Reasoning Chains in Multimodal STEM Tasks

DGX agent

arXiv:2604.19697v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have shown promising reasoning abilities, yet evaluating their performance in specialized domains remains chall

model-releasesarxiv-cs-cv
22 Apr 2026
Local Ai

SPyCE: Skill-Policy Co-evolution for Multimodal Agents

DGX agent

arXiv:2607.13854v2 Announce Type: replace Abstract: Multimodal agents that think with images iteratively manipulate visual evidence and invoke tools across many steps. Existing reinforcement learning

local-aiarxiv-cs-cl
21 Aug 2026
Safety

Multimodal Model Diffing for Feature Discovery and Control

DGX agent

arXiv:2608.09928v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) exhibit strong visual understanding, yet the internal features that cause these behaviors remain difficult to

safetyarxiv-cs-ai
11 Aug 2026
Safety

OPLD: On-Policy Latent Distillation for Multimodal Reasoning

DGX agent

arXiv:2607.28154v1 Announce Type: new Abstract: Interleaved multimodal Chain-of-Thought (CoT) improves visual reasoning by incorporating auxiliary visual evidence into intermediate reasoning. However,

safetyarxiv-cs-cv
31 Jul 2026
Model Releases

Decoding the Multimodal Mind: Generalizable Brain-to-Text Translation via Multimodal Alignment and Adaptive Routing

DGX agent

arXiv:2505.10356v3 Announce Type: replace Abstract: Decoding language from the human brain remains a grand challenge for Brain-Computer Interfaces (BCIs). Current approaches typically rely on unimodal

model-releasesarxiv-cs-cl
8 Jul 2026
Applications

MultiMat: Multimodal Program Synthesis for Procedural Materials using Large Multimodal Models

DGX agent

arXiv:2509.22151v3 Announce Type: replace Abstract: Material node graphs are programs that generate the 2D channels of procedural materials, including geometry such as roughness and displacement maps,

applicationsarxiv-cs-cv
15 May 2026
Safety

Beyond Chain-of-Thought: Rewrite as a Universal Interface for Generative Multimodal Embeddings

DGX agent

arXiv:2604.22280v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have emerged as a promising foundation for universal multimodal embeddings. Recent studies have shown that reas

safetyarxiv-cs-cv
27 Apr 2026
Research

MARA: A Multimodal Adaptive Retrieval-Augmented Framework for Document Question Answering

DGX agent

arXiv:2604.16313v1 Announce Type: cross Abstract: Retrieval-based multimodal document QA aims to identify and integrate relevant information from visually rich documents with complex multimodal struct

researcharxiv-cs-cl
21 Apr 2026
Agents

M^3KG-RAG: Multi-hop Multimodal Knowledge Graph-enhanced Retrieval-Augmented Generation

DGX agent

arXiv:2512.20136v3 Announce Type: replace-cross Abstract: Retrieval-Augmented Generation (RAG) has recently been extended to multimodal settings, connecting multimodal large language models (MLLMs) wi

agentsarxiv-cs-ai
14 Apr 2026
Model Releases

Dynamic Alignment and Calibration for Multimodal Learning

DGX agent

arXiv:2610.07928v1 Announce Type: cross Abstract: Dynamic multimodal learning aims to learn robust representations by adaptively modeling information discrepancies across modalities. However, existing

model-releasesarxiv-cs-ai
7 Oct 2026
Research

Paired Multimodal Scaling Laws

DGX agent

arXiv:2609.36263v1 Announce Type: cross Abstract: Existing multimodal scaling laws fit multimodality terms empirically after testing and never vary how much data is multimodally paired at fixed data b

researcharxiv-cs-ai
30 Sept 2026
Model Releases

BiCFlow-MER: Orchestrating Discriminative and Generative Multimodal Emotion Recognition via Conditional Transport

DGX agent

arXiv:2609.27615v1 Announce Type: new Abstract: In multimodal emotion recognition (MER), human affective states are inferred by integrating complementary cues from multiple modalities. In audio-text M

model-releasesarxiv-cs-ai
24 Sept 2026
Research

MOCC-R1: Reinforcing Reasoning-Response Consistency for Multimodal Counselor Response Generation

DGX agent

arXiv:2609.17180v1 Announce Type: new Abstract: Multimodal counselor response generation (MCRG) aims to generate an appropriate counselor response from multimodal dialogue histories. Progress is limit

researcharxiv-cs-ai
16 Sept 2026
Research

The Illusion of Balanced Multimodal Sentiment Analysis: Beyond the Limits of Optimization-Based Methods

DGX agent

arXiv:2609.11247v1 Announce Type: new Abstract: Multimodal Sentiment Analysis (MSA) remains constrained by modality imbalance, yet the field continues to rely on optimization-based balancing methods t

researcharxiv-cs-cl
11 Sept 2026
Model Releases

Evolution of Multimodal Question Answering: From Modality-Adaptive Extraction to Unified Language Representation

DGX agent

arXiv:2609.08896v1 Announce Type: cross Abstract: The rapid growth of multimodal data has intensified the need for question answering (QA) systems capable of reasoning across heterogeneous sources suc

model-releasesarxiv-cs-cv
9 Sept 2026
Safety

Beyond Modality Harmony: Orthogonal Purification and Topology-Guided MoE for Conflict-Aware Multimodal Recommendation

DGX agent

arXiv:2609.02152v1 Announce Type: cross Abstract: Multimodal Recommender Systems (MRSs) typically rely on a flawed 'modality harmony' assumption, presuming that multimodal features are inherently bene

safetyarxiv-cs-ai
3 Sept 2026
Model Releases

LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPO

DGX agent

arXiv:2608.29357v1 Announce Type: new Abstract: Multimodal search agents answer visual questions by interleaving image understanding, web retrieval, tool use, and evidence synthesis. Strong systems ex

model-releasesarxiv-cs-ai
1 Sept 2026
Research

Multimodal Adaptive Expert Selection with Text Routing and Ordinal Prototype Optimization for Sentiment Analysis

DGX agent

arXiv:2608.30726v1 Announce Type: new Abstract: Multimodal Sentiment Analysis (MSA) is a fundamental component of affective computing that aims to decipher complex emotional states by integrating verb

researcharxiv-cs-ai
1 Sept 2026
Applications

Robust Incomplete Multimodal Sentiment Analysis via Iterative Proxy Correction

DGX agent

arXiv:2608.19971v1 Announce Type: new Abstract: Multimodal sentiment analysis aims to infer affective states by integrating language, visual, and acoustic cues. However, real-world multimodal inputs a

applicationsarxiv-cs-cl
21 Aug 2026
Model Releases

Tackling Multimodal Learning Challenges with Mixture-of-Expert: A Survey

DGX agent

arXiv:2605.27431v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) presents a naturally compatible and scalable framework for multimodal learning, demonstrating strong adaptability across dive

model-releasesarxiv-cs-ai
28 May 2026
Model Releases

InterLV-Search: Benchmarking Interleaved Multimodal Agentic Search

DGX agent

arXiv:2605.07510v1 Announce Type: cross Abstract: Existing benchmarks for multimodal agentic search evaluate multimodal search and visual browsing, but visual evidence is either confined to the input

model-releasesarxiv-cs-cl
11 May 2026
← Previous
1
Next →
9,674 results
← Previous
123…202
Next →