AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries123,304
  • Agents10,352
  • Applications7,013
  • Companies3
  • Concepts7
  • Hardware2,702
  • Industry6,776
  • Local Ai6,847
  • Model Releases35,469
  • Research28,731
  • Safety18,972
  • Syntheses31
  • Tools1,775
  • Tutorials4,626

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries123,304
  • Agents10,352
  • Applications7,013
  • Companies3
  • Concepts7
  • Hardware2,702
  • Industry6,776
  • Local Ai6,847
  • Model Releases35,469
  • Research28,731
  • Safety18,972
  • Syntheses31
  • Tools1,775
  • Tutorials4,626

Source
Human
123,304Total entries
60Added by human
123,244Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
49+ results
Research

Learning Multimodal Energy-Based Model with Multimodal Variational Auto-Encoder via MCMC Revision

DGX agent

arXiv:2605.00644v1 Announce Type: new Abstract: Energy-based models (EBMs) are a flexible class of deep generative models and are well-suited to capture complex dependencies in multimodal data. Howeve

researcharxiv-cs-lg
4 May 2026
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Safety

Gestalt: Large Multimodal Interplay Model

DGX agent

arXiv:2610.00576v1 Announce Type: new Abstract: In this paper, we propose Gestalt, a new paradigm of large multimodal model built around multimodal interplay. Despite rapid advances, large multimodal

safetyarxiv-cs-cv
2 Oct 2026
Model Releases

Cognitive-structured Multimodal Agent for Multimodal Understanding, Generation, and Editing

DGX agent

arXiv:2607.08497v1 Announce Type: cross Abstract: Recent unified multimodal models show a single architecture can jointly perform vision/language understanding and image generation/editing. However, t

model-releasesarxiv-cs-ai
10 Jul 2026
Model Releases

Multimodal Flow: Unified Flow Modeling of Language and Vision in Embedding Spaces

DGX agent

arXiv:2609.40362v1 Announce Type: new Abstract: We present Multimodal Flow, a fully continuous generative model of language and vision. Most unified multimodal models either model both language and qu

model-releasesarxiv-cs-cv
1 Oct 2026
Safety

Dynamic Gated Cross-Modal Fusion with Sarcastic-aware Contrastive Regularization for Multimodal Sarcasm Detection

DGX agent

arXiv:2608.19942v1 Announce Type: new Abstract: Multimodal sarcasm detection aims to identify sarcastic intent from multimodal content, where inconsistencies between literal meaning and contextual cue

safetyarxiv-cs-cl
21 Aug 2026
Research

Generative Giants, Retrieval Weaklings: Why do Multimodal Large Language Models Fail at Multimodal Retrieval?

DGX agent

arXiv:2512.19115v2 Announce Type: replace Abstract: Despite the remarkable success of multimodal large language models (MLLMs) in generative tasks, we observe that they exhibit a counterintuitive defi

researcharxiv-cs-cv
12 May 2026
Agents

Skill-CMIB: Multimodal Agent Skill for Consistent Action via Conditional Multimodal Information Bottleneck

DGX agent

arXiv:2605.08526v1 Announce Type: new Abstract: While LLM-based agents excel at planning and executing long action sequences, their execution often remains inconsistent across trials, limiting reliabi

agentsarxiv-cs-lg
12 May 2026
Agents

V-Retrver: Evidence-Driven Agentic Reasoning for Universal Multimodal Retrieval

DGX agent

arXiv:2602.06034v3 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs) have recently been applied to universal multimodal retrieval, where Chain-of-Thought (CoT) reasoning improv

agentsarxiv-cs-cv
11 Sept 2026
Research

Coupling Perception and Reasoning in Federated Multimodal Graph Foundation Models

DGX agent

arXiv:2610.00277v1 Announce Type: new Abstract: Federated multimodal graph foundation models (GFMs) aim to adapt pretrained multimodal models to decentralized graph data, where each client owns a priv

researcharxiv-cs-lg
2 Oct 2026
Model Releases

Can Multimodal Large Language Models Generate and Detect Multimodal Social Media Fake News?

DGX agent

arXiv:2609.35809v1 Announce Type: cross Abstract: The rapid advancement of generative AI raises concerns about the misuse of Multimodal LLMs (MLLMs) for large-scale disinformation campaigns on social

model-releasesarxiv-cs-ai
30 Sept 2026
Applications

Generalized Multimodal Foundation Model

DGX agent

arXiv:2609.22107v1 Announce Type: cross Abstract: Making prediction with multimodal data is widely used in diverse scenarios. Existing multimodal fusion models, once deployed, can only handle predefin

applicationsarxiv-cs-cl
22 Sept 2026
Safety

MIDAS: Mutual Information Disentanglement with Uncertainty-Aware Fusion for Incomplete Multimodal Sentiment Analysis

DGX agent

arXiv:2608.09986v1 Announce Type: new Abstract: Most existing multimodal sentiment analysis approaches assume access to complete multimodal inputs. However, real-world applications frequently encounte

safetyarxiv-cs-ai
12 Aug 2026
Safety

When Modalities Remember: Continual Learning for Multimodal Knowledge Graphs

DGX agent

arXiv:2604.02778v2 Announce Type: replace Abstract: Real-world multimodal knowledge graphs (MMKGs) are dynamic, with new entities, relations, and multimodal knowledge emerging over time. Existing cont

safetyarxiv-cs-cl
6 Aug 2026
Safety

URMF: Uncertainty-aware Robust Multimodal Fusion for Multimodal Sarcasm Detection

DGX agent

arXiv:2604.06728v1 Announce Type: cross Abstract: Multimodal sarcasm detection (MSD) aims to identify sarcastic intent from semantic incongruity between text and image. Although recent methods have im

safetyarxiv-cs-ai
10 Apr 2026
Safety

MUNITE: Unified Multimodal Latent Inference for Any-to-Any Multimodal Generation

DGX agent

arXiv:2610.09866v1 Announce Type: new Abstract: We introduce MUNITE, a latent-variable framework for flexible any-to-any multimodal generation that treats encoding and latent generation as the same in

safetyarxiv-cs-lg
8 Oct 2026
Safety

Beyond Surface Imitation: Contrastive Modeling for Reasoning Path Alignment in Multimodal In-Context Learning

DGX agent

arXiv:2609.10177v1 Announce Type: new Abstract: In-context learning (ICL) is widely used in multimodal large language models (MLLMs) and achieves strong performance across a wide range of multimodal t

safetyarxiv-cs-ai
11 Sept 2026
Model Releases

MVFA: A Multi-View Text-Guided Multimodal Fusion LLM Adapter for Sentiment Analysis and Emotion Recognition

DGX agent

arXiv:2609.06188v1 Announce Type: new Abstract: Multimodal sentiment analysis and emotion recognition in conversations demand effective modeling of heterogeneous interactions across textual, acoustic,

model-releasesarxiv-cs-ai
10 Sept 2026
Applications

Douyin Multimodal Embedding Model Technical Report

DGX agent

arXiv:2608.02148v1 Announce Type: cross Abstract: Multimodal representation learning is a cornerstone of modern AI. By encoding multimodal queries and targets into vectors, it powers industrial search

applicationsarxiv-cs-cl
4 Aug 2026
Model Releases

DiMextsuperscript{3}: Bridging Multilingual and Multimodal Models via Direction- and Magnitude-Aware Merging

DGX agent

arXiv:2605.12960v2 Announce Type: replace Abstract: Towards more general and human-like intelligence, large language models should seamlessly integrate both multilingual and multimodal capabilities; h

model-releasesarxiv-cs-cl
21 May 2026
Model Releases

MicroWorld: Empowering Multimodal Large Language Models to Bridge the Microscopic Domain Gap with Multimodal Attribute Graph

DGX agent

arXiv:2605.10120v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) show remarkable potential for scientific reasoning, yet their performance in specialized domains such as micr

model-releasesarxiv-cs-ai
12 May 2026
Safety

DT2IT-MRM: Debiased Preference Construction and Iterative Training for Multimodal Reward Modeling

DGX agent

arXiv:2604.19544v1 Announce Type: new Abstract: Multimodal reward models (MRMs) play a crucial role in aligning Multimodal Large Language Models (MLLMs) with human preferences. Training a good MRM req

safetyarxiv-cs-ai
22 Apr 2026
Model Releases

Unveiling Fine-Grained Visual Traces: Evaluating Multimodal Interleaved Reasoning Chains in Multimodal STEM Tasks

DGX agent

arXiv:2604.19697v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have shown promising reasoning abilities, yet evaluating their performance in specialized domains remains chall

model-releasesarxiv-cs-cv
22 Apr 2026
Local Ai

SPyCE: Skill-Policy Co-evolution for Multimodal Agents

DGX agent

arXiv:2607.13854v2 Announce Type: replace Abstract: Multimodal agents that think with images iteratively manipulate visual evidence and invoke tools across many steps. Existing reinforcement learning

local-aiarxiv-cs-cl
21 Aug 2026
Safety

Multimodal Model Diffing for Feature Discovery and Control

DGX agent

arXiv:2608.09928v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) exhibit strong visual understanding, yet the internal features that cause these behaviors remain difficult to

safetyarxiv-cs-ai
11 Aug 2026
Safety

OPLD: On-Policy Latent Distillation for Multimodal Reasoning

DGX agent

arXiv:2607.28154v1 Announce Type: new Abstract: Interleaved multimodal Chain-of-Thought (CoT) improves visual reasoning by incorporating auxiliary visual evidence into intermediate reasoning. However,

safetyarxiv-cs-cv
31 Jul 2026
Model Releases

Decoding the Multimodal Mind: Generalizable Brain-to-Text Translation via Multimodal Alignment and Adaptive Routing

DGX agent

arXiv:2505.10356v3 Announce Type: replace Abstract: Decoding language from the human brain remains a grand challenge for Brain-Computer Interfaces (BCIs). Current approaches typically rely on unimodal

model-releasesarxiv-cs-cl
8 Jul 2026
Applications

MultiMat: Multimodal Program Synthesis for Procedural Materials using Large Multimodal Models

DGX agent

arXiv:2509.22151v3 Announce Type: replace Abstract: Material node graphs are programs that generate the 2D channels of procedural materials, including geometry such as roughness and displacement maps,

applicationsarxiv-cs-cv
15 May 2026
Safety

Beyond Chain-of-Thought: Rewrite as a Universal Interface for Generative Multimodal Embeddings

DGX agent

arXiv:2604.22280v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have emerged as a promising foundation for universal multimodal embeddings. Recent studies have shown that reas

safetyarxiv-cs-cv
27 Apr 2026
Research

MARA: A Multimodal Adaptive Retrieval-Augmented Framework for Document Question Answering

DGX agent

arXiv:2604.16313v1 Announce Type: cross Abstract: Retrieval-based multimodal document QA aims to identify and integrate relevant information from visually rich documents with complex multimodal struct

researcharxiv-cs-cl
21 Apr 2026
Agents

M^3KG-RAG: Multi-hop Multimodal Knowledge Graph-enhanced Retrieval-Augmented Generation

DGX agent

arXiv:2512.20136v3 Announce Type: replace-cross Abstract: Retrieval-Augmented Generation (RAG) has recently been extended to multimodal settings, connecting multimodal large language models (MLLMs) wi

agentsarxiv-cs-ai
14 Apr 2026
Model Releases

Dynamic Alignment and Calibration for Multimodal Learning

DGX agent

arXiv:2610.07928v1 Announce Type: cross Abstract: Dynamic multimodal learning aims to learn robust representations by adaptively modeling information discrepancies across modalities. However, existing

model-releasesarxiv-cs-ai
7 Oct 2026
Research

Paired Multimodal Scaling Laws

DGX agent

arXiv:2609.36263v1 Announce Type: cross Abstract: Existing multimodal scaling laws fit multimodality terms empirically after testing and never vary how much data is multimodally paired at fixed data b

researcharxiv-cs-ai
30 Sept 2026
Model Releases

BiCFlow-MER: Orchestrating Discriminative and Generative Multimodal Emotion Recognition via Conditional Transport

DGX agent

arXiv:2609.27615v1 Announce Type: new Abstract: In multimodal emotion recognition (MER), human affective states are inferred by integrating complementary cues from multiple modalities. In audio-text M

model-releasesarxiv-cs-ai
24 Sept 2026
Research

MOCC-R1: Reinforcing Reasoning-Response Consistency for Multimodal Counselor Response Generation

DGX agent

arXiv:2609.17180v1 Announce Type: new Abstract: Multimodal counselor response generation (MCRG) aims to generate an appropriate counselor response from multimodal dialogue histories. Progress is limit

researcharxiv-cs-ai
16 Sept 2026
Research

The Illusion of Balanced Multimodal Sentiment Analysis: Beyond the Limits of Optimization-Based Methods

DGX agent

arXiv:2609.11247v1 Announce Type: new Abstract: Multimodal Sentiment Analysis (MSA) remains constrained by modality imbalance, yet the field continues to rely on optimization-based balancing methods t

researcharxiv-cs-cl
11 Sept 2026
Model Releases

Evolution of Multimodal Question Answering: From Modality-Adaptive Extraction to Unified Language Representation

DGX agent

arXiv:2609.08896v1 Announce Type: cross Abstract: The rapid growth of multimodal data has intensified the need for question answering (QA) systems capable of reasoning across heterogeneous sources suc

model-releasesarxiv-cs-cv
9 Sept 2026
Safety

Beyond Modality Harmony: Orthogonal Purification and Topology-Guided MoE for Conflict-Aware Multimodal Recommendation

DGX agent

arXiv:2609.02152v1 Announce Type: cross Abstract: Multimodal Recommender Systems (MRSs) typically rely on a flawed 'modality harmony' assumption, presuming that multimodal features are inherently bene

safetyarxiv-cs-ai
3 Sept 2026
Model Releases

LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPO

DGX agent

arXiv:2608.29357v1 Announce Type: new Abstract: Multimodal search agents answer visual questions by interleaving image understanding, web retrieval, tool use, and evidence synthesis. Strong systems ex

model-releasesarxiv-cs-ai
1 Sept 2026
Research

Multimodal Adaptive Expert Selection with Text Routing and Ordinal Prototype Optimization for Sentiment Analysis

DGX agent

arXiv:2608.30726v1 Announce Type: new Abstract: Multimodal Sentiment Analysis (MSA) is a fundamental component of affective computing that aims to decipher complex emotional states by integrating verb

researcharxiv-cs-ai
1 Sept 2026
Applications

Robust Incomplete Multimodal Sentiment Analysis via Iterative Proxy Correction

DGX agent

arXiv:2608.19971v1 Announce Type: new Abstract: Multimodal sentiment analysis aims to infer affective states by integrating language, visual, and acoustic cues. However, real-world multimodal inputs a

applicationsarxiv-cs-cl
21 Aug 2026
Model Releases

Tackling Multimodal Learning Challenges with Mixture-of-Expert: A Survey

DGX agent

arXiv:2605.27431v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) presents a naturally compatible and scalable framework for multimodal learning, demonstrating strong adaptability across dive

model-releasesarxiv-cs-ai
28 May 2026
Model Releases

InterLV-Search: Benchmarking Interleaved Multimodal Agentic Search

DGX agent

arXiv:2605.07510v1 Announce Type: cross Abstract: Existing benchmarks for multimodal agentic search evaluate multimodal search and visual browsing, but visual evidence is either confined to the input

model-releasesarxiv-cs-cl
11 May 2026
Research

Inter-Stance: A Dyadic Multimodal Corpus for Conversational Stance Analysis

DGX agent

arXiv:2604.22739v1 Announce Type: new Abstract: Social interactions dominate our perceptions of the world and shape our daily behavior by attaching social meaning to acts as simple and spontaneous as

researcharxiv-cs-cv
27 Apr 2026
Safety

MODIX: A Training-Free Multimodal Information-Driven Positional Index Scaling for Vision-Language Models

DGX agent

arXiv:2604.12537v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) have achieved remarkable progress in multimodal understanding, yet their positional encoding mechanisms remain suboptima

safetyarxiv-cs-ai
15 Apr 2026
Tutorials

Omni-Diffusion-Distill: Few-Step Distillation of Unified Multimodal Diffusion Large Language Models

DGX agent

arXiv:2610.10990v1 Announce Type: new Abstract: Unified multimodal diffusion large language models (dLLMs) offer a single architecture for both image generation and multimodal understanding, but their

tutorialsarxiv-cs-cv
9 Oct 2026
Tutorials

Source-Learned Reliance for Selective Test-Time Adaptation of Multimodal Time Series

DGX agent

arXiv:2610.07499v1 Announce Type: new Abstract: Multimodal wearable systems must remain reliable when sensor streams become noisy or unavailable. Existing multimodal test-time adaptation (TTA) methods

tutorialsarxiv-cs-lg
7 Oct 2026
Research

MOVE: Multimodal Open-world Verification and Expansion for Graph Learning

DGX agent

arXiv:2610.00268v1 Announce Type: new Abstract: Multimodal graph learning faces a fundamental challenge: new classes may emerge after deployment, while models are trained with a fixed label space. Exi

researcharxiv-cs-lg
2 Oct 2026
Safety

MCD: Causal Distillation of Multimodal In-Context Learning in Large Vision-Language Models

DGX agent

arXiv:2609.39920v1 Announce Type: cross Abstract: Large vision-language models (LVLMs) exhibit strong multimodal in-context learning (ICL) capabilities, yet this ability degrades substantially as mode

safetyarxiv-cs-cl
1 Oct 2026
← Previous
1
Next →
9,027 results
← Previous
123…189
Next →