AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries123,194
  • Agents10,336
  • Applications7,012
  • Companies3
  • Concepts7
  • Hardware2,694
  • Industry6,766
  • Local Ai6,840
  • Model Releases35,411
  • Research28,731
  • Safety18,965
  • Syntheses30
  • Tools1,773
  • Tutorials4,626

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries123,194
  • Agents10,336
  • Applications7,012
  • Companies3
  • Concepts7
  • Hardware2,694
  • Industry6,766
  • Local Ai6,840
  • Model Releases35,411
  • Research28,731
  • Safety18,965
  • Syntheses30
  • Tools1,773
  • Tutorials4,626

Source
HumanDGX agent

123,194Total entries
59Added by human
123,135Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
9,674 results
Applications

Modality Disentangled Learning for Incomplete Multimodal Emotion Recognition: A Primitive Memory Distillation Perspective

DGX agent

arXiv:2608.30563v1 Announce Type: new Abstract: Multimodal Emotion Recognition (MER) systems often suffer from missing modalities in real-world scenarios. Existing methods usually generate, align, or

applicationsarxiv-cs-cv
1 Sept 2026
Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Research

Recurrence Meets Transformers for Universal Multimodal Retrieval

DGX agent

arXiv:2509.08897v2 Announce Type: replace-cross Abstract: With the rapid advancement of multimodal retrieval and its application in LLMs and multimodal LLMs, increasingly complex retrieval tasks have

researcharxiv-cs-cl
27 Aug 2026
Local Ai

ReFrame: Evidence-Guided Test-Time Safety Alignment in Multimodal Large Language Models

DGX agent

arXiv:2608.21100v1 Announce Type: new Abstract: While multimodal large language models (MLLMs) extend model capabilities beyond text, they also make safety alignment increasingly challenging. Multimod

local-aiarxiv-cs-ai
24 Aug 2026
Model Releases

DeepSeek-V4-Flash-Vision-Exp is now live on the DeepSeek API Platform! 🚀 🔹 This experimental multimodal model matches DeepSeek-V4-Flash on…

DGX agent

DeepSeek-V4-Flash-Vision-Exp is now live on the DeepSeek API Platform! 🚀 🔹 This experimental multimodal model matches DeepSeek-V4-Flash on text capabilities—including agents, reasoning, and world know

model-releasesdeepseek--x
21 Aug 2026
Safety

COMIC: Reference-Aware Safety Gating for Multimodal Large Language Models

DGX agent

arXiv:2608.17234v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) are increasingly used to interact with screenshots, scanned documents, diagrams, and other visually grounded

safetyarxiv-cs-ai
19 Aug 2026
Safety

Which Modality Decides? Counterfactual Modality Attribution for Multimodal LLMs

DGX agent

arXiv:2608.00076v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) increasingly support high-stakes decision making by combining complementary information from images and text. W

safetyarxiv-cs-cv
4 Aug 2026
Model Releases

CAER: Conflict-Aware Evidence Routing with Dual Prefix Experts for Multimodal Large Language Models

DGX agent

arXiv:2607.28991v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in multimodal understanding and generation. However, when textual inp

model-releasesarxiv-cs-cv
3 Aug 2026
Research

TIER-MoE: Trust-Informed Expert Routing via Conditional Modality Risk for Multimodal Fusion in Biomedical Classification

DGX agent

arXiv:2607.27289v1 Announce Type: new Abstract: The promise of multimodal fusion lies in combining complementary sources of evidence, yet more evidence does not always yield a better prediction. Recen

researcharxiv-cs-lg
31 Jul 2026
Model Releases

Towards Unified Multimodal Misinformation Detection in Social Media: A Benchmark Dataset and Baseline

DGX agent

arXiv:2509.25991v3 Announce Type: replace-cross Abstract: Detecting deceptive multimodal content on social media has become an increasingly important problem. Two major types of deception dominate: hu

model-releasesarxiv-cs-cv
31 Jul 2026
Agents

JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agents

DGX agent

arXiv:2607.23588v1 Announce Type: new Abstract: Creative AI is moving from single-step asset generation toward long-horizon multimodal production. Although recent generative models can synthesize high

agentsarxiv-cs-cv
28 Jul 2026
Model Releases

Medical-Checklist: Assessing the Comprehension of Medical Images by Multimodal Models

DGX agent

arXiv:2607.21998v1 Announce Type: new Abstract: This paper introduces a new benchmark test, Medical-Checklist, for assessing medical multimodal models. The recent advancements in multimodal models hav

model-releasesarxiv-cs-cv
27 Jul 2026
Research

Reconstructing Content via Collaborative Attention to Improve Multimodal Embedding Quality

DGX agent

arXiv:2603.01471v2 Announce Type: replace-cross Abstract: Multimodal embedding models, rooted in multimodal large language models (MLLMs), have yielded significant performance improvements across dive

researcharxiv-cs-lg
2 Jun 2026
Model Releases

MENTOR: Efficient Multimodal-Conditioned Tuning for Autoregressive Vision Generation Models

DGX agent

arXiv:2507.09574v3 Announce Type: replace-cross Abstract: Recent text-to-image models produce high-quality results but still struggle with precise visual control, balancing multimodal inputs, and requ

model-releasesarxiv-cs-ai
29 May 2026
Safety

Task-conditioned probing of instruction-tuned multimodal LLMs: Region-specific brain alignment patterns under naturalistic stimuli

DGX agent

arXiv:2506.08277v3 Announce Type: replace-cross Abstract: Recent voxel-wise multimodal brain encoding studies have shown that multimodal large language models (MLLMs) exhibit a higher degree of brain

safetyarxiv-cs-cl
21 May 2026
Safety

Prioritizing the Best: Incentivizing Reliable Multimodal Reasoning by Rewarding Beyond Answer Correctness

DGX agent

arXiv:2604.18892v1 Announce Type: new Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) improves multimodal reasoning by rewarding verifiable final answers. Yet answer-correct trajectori

safetyarxiv-cs-cl
22 Apr 2026
Safety

RemoteShield: Enable Robust Multimodal Large Language Models for Earth Observation

DGX agent

arXiv:2604.17243v1 Announce Type: new Abstract: A robust Multimodal Large Language Model (MLLM) for Earth Observation should maintain consistent interpretation and reasoning under realistic input vari

safetyarxiv-cs-cv
21 Apr 2026
Safety

DecAlign: Hierarchical Cross-Modal Alignment for Decoupled Multimodal Representation Learning

DGX agent

arXiv:2503.11892v3 Announce Type: replace Abstract: Multimodal representation learning aims to capture both shared and complementary semantic information across multiple modalities. However, the intri

safetyarxiv-cs-cv
14 Apr 2026
Research

Nano-EmoX: Unifying Multimodal Emotional Intelligence from Perception to Empathy

DGX agent

arXiv:2603.02123v3 Announce Type: replace Abstract: The development of affective multimodal language models (MLMs) has long been constrained by a gap between low-level perception and high-level intera

researcharxiv-cs-ai
14 Apr 2026
Research

Music Audio-Visual Question Answering Requires Specialized Multimodal Designs

DGX agent

arXiv:2505.20638v2 Announce Type: replace-cross Abstract: While recent Multimodal Large Language Models exhibit impressive capabilities for general multimodal tasks, specialized domains like music nec

researcharxiv-cs-cv
13 Apr 2026
Model Releases

See, Hear, and Understand: Benchmarking Audiovisual Human Speech Understanding in Multimodal Large Language Models

DGX agent

arXiv:2512.02231v2 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) are expected to jointly interpret vision, audio, and language, yet existing video benchmarks rarely a

model-releasesarxiv-cs-ai
13 Apr 2026
Safety

Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space

DGX agent

arXiv:2512.12623v3 Announce Type: replace-cross Abstract: Recent advancements in Multimodal Large Language Models (MLLMs) have significantly enhanced cross-modal understanding and reasoning by incorpo

safetyarxiv-cs-cl
10 Apr 2026
Research

Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenes

Human

AD2-Bench diagnoses multimodal reasoning via a Chain of Evidence, showing failures from spatial ambiguity and semantic uncertainty in adverse urban scenes.

multimodalbenchmarkreasoning
11 Jun 2025
Safety

InterView-C: A Synchronized Multimodal Corpus of VR Avatar-Mediated Survey Interviews

DGX agent

arXiv:2610.10145v1 Announce Type: new Abstract: We present InterView-C, a German multimodal corpus of 27 survey interviews conducted entirely in virtual reality, with both interlocutors represented by

safetyarxiv-cs-cl
8 Oct 2026
Model Releases

RSJEV: Discriminative Remote Sensing Scene Classification with Multimodal Large Language Models

DGX agent

arXiv:2610.08539v1 Announce Type: new Abstract: Remote sensing scene classification is a fundamental task in Earth observation and geospatial analysis. Existing approaches mainly follow three paradigm

model-releasesarxiv-cs-cv
7 Oct 2026
Model Releases

Understanding Affective Adaptation in Multimodal Foundation Models: Emergent Functional Specialization

DGX agent

arXiv:2601.15906v2 Announce Type: replace Abstract: Despite rapid progress in multimodal affective foundation models, how affective capabilities emerge within their internal architectures remains poor

model-releasesarxiv-cs-cv
5 Oct 2026
Model Releases

UnifiedAttack: Evaluating the Safety of Large Multimodal Models in Synergistic Harmful Image-Text Generation

DGX agent

arXiv:2610.00341v1 Announce Type: cross Abstract: As Large Multimodal Models (LMMs) transition toward natively unified architectures, evaluating their safety in synergistic harmful image-text generati

model-releasesarxiv-cs-cv
2 Oct 2026
Model Releases

UniEvo-VL: An On-policy Self-Distillation Training Recipe for Multimodal Model Self-improvement

DGX agent

arXiv:2609.38721v1 Announce Type: new Abstract: Modern multimodal models bring generation and understanding into a single unified system, which enables them to provide and learn from their own feedbac

model-releasesarxiv-cs-ai
1 Oct 2026
Model Releases

WorldAuditBench: Interactive 3D World Auditing with Multimodal Agents

DGX agent

arXiv:2609.40325v1 Announce Type: new Abstract: As interactive 3D worlds are increasingly used to study intelligent behavior, it becomes important to develop efficient pipelines for identifying anomal

model-releasesarxiv-cs-ai
1 Oct 2026
Safety

Representation Editing for Multimodal Test-Time Adaptation

DGX agent

arXiv:2609.32263v1 Announce Type: new Abstract: Multimodal test-time adaptation (TTA) aims to adapt a pretrained multimodal model online to distribution shift across modalities using unlabeled test da

safetyarxiv-cs-lg
29 Sept 2026
Safety

UniCache: Task- and Type-Aware KV Cache Compression for Unified Multimodal Models

DGX agent

arXiv:2609.32831v1 Announce Type: new Abstract: Unified multimodal models combine understanding, generation, and editing within a single network, offering a promising foundation for versatile multimod

safetyarxiv-cs-lg
29 Sept 2026
Model Releases

A parameter-efficient three-branch architecture for multimodal misinformation detection with limited annotations

DGX agent

arXiv:2512.20257v2 Announce Type: replace Abstract: With the rise of easily accessible generative tools for creating and manipulating multimedia content, the threat of realistic synthetic alterations

model-releasesarxiv-cs-cv
15 Sept 2026
Model Releases

Multimodal-Multiresolution Foundation Model for Lunar Remote Sensing

DGX agent

arXiv:2609.13283v1 Announce Type: cross Abstract: We present a multimodal foundation model for lunar remote sensing, pretrained from scratch on SomBench, a geographically partitioned corpus of nearly

model-releasesarxiv-cs-ai
15 Sept 2026
Model Releases

TwinICL: Diagnosing Multimodal In-Context Learning through Paired Counterfactuals

DGX agent

arXiv:2609.15028v1 Announce Type: new Abstract: In-context learning (ICL) enables models to infer tasks from demonstrations, but existing benchmarks generally lack matched text and image versions need

model-releasesarxiv-cs-cv
15 Sept 2026
Safety

Beyond Retrieval: Joint Supervision and Multimodal Document Ranking for Textbook Question Answering

DGX agent

arXiv:2505.13520v2 Announce Type: replace-cross Abstract: Textbook question answering (TQA) is a complex task, requiring the interpretation of complex multimodal context. Although recent advances have

safetyarxiv-cs-ai
10 Sept 2026
Applications

Large-Scale User Behavior Analysis in Multimodal AI-Assisted Manual Task Execution

DGX agent

arXiv:2609.07594v1 Announce Type: cross Abstract: Conversational Task Assistants (CTAs) are multimodal dialogue systems that support users in complex real-world tasks such as cooking and DIY through v

applicationsarxiv-cs-ai
10 Sept 2026
Model Releases

NeoMME: A Single-Tower Multimodal-Native Multilingual Foundation Encoder for Efficient Fine-Tuning and Inference

DGX agent

arXiv:2609.01657v1 Announce Type: cross Abstract: Multimodal models often build on architectures designed for generative vision-language modeling, typically combining separately pretrained vision enco

model-releasesarxiv-cs-ai
3 Sept 2026
Safety

Uncovering Understanding-Generation Synergy in Native Unified Multimodal Models: From Representation, Task to System

DGX agent

arXiv:2609.01607v1 Announce Type: new Abstract: While unified multimodal models (UMMs) jointly perform visual understanding and generation within a single model, functional unification does not guaran

safetyarxiv-cs-cv
2 Sept 2026
Safety

MMPCBench: Benchmarking Multimodal Large Language Models on Proactive Critique of Flawed Inputs

DGX agent

arXiv:2608.29286v1 Announce Type: new Abstract: As Multimodal Large Language Models (MLLMs) evolve into sophisticated interactive assistants, their reliability depends not only on following instructio

safetyarxiv-cs-ai
1 Sept 2026
Research

More Perspectives, Stronger Signals: Multi-Perspective Enhancement and Progressive Fusion for Multimodal Entity Representation Learning

DGX agent

arXiv:2608.29139v1 Announce Type: new Abstract: Learning effective multimodal entity representations is fundamental for reasoning tasks such as multimodal knowledge graph completion (MMKGC). However,

researcharxiv-cs-ai
1 Sept 2026
Model Releases

WeAgent-MMSearch: Native Text-Vision Interaction for Multimodal Search Agents

DGX agent

arXiv:2608.28062v2 Announce Type: replace Abstract: Multimodal search agents extend parametric knowledge with newly emerging and long-tail evidence from the open web. Yet many existing agentic search

model-releasesarxiv-cs-ai
1 Sept 2026
Research

NeoTriFuse: Reliability-Aware Multimodal Fusion under Missingness Heterogeneity for Neonatal Mortality Risk Prediction

DGX agent

arXiv:2608.26436v1 Announce Type: new Abstract: Neonatal mortality risk prediction from bedside monitoring data remains challenging due to extreme class imbalance, heterogeneous clinical risk factors,

researcharxiv-cs-lg
28 Aug 2026
Research

Visual Information-Guided Parallel Decoding for Diffusion Multimodal Large Language Models

DGX agent

arXiv:2608.26580v1 Announce Type: cross Abstract: Diffusion multimodal large language models (dMLLMs) have recently emerged as a new decoding paradigm for multimodal generation. Starting from a fully

researcharxiv-cs-cl
28 Aug 2026
Agents

A Survey on Foundations and Frontiers of Multimodal Agentic Frameworks: Techniques and Applications

DGX agent

arXiv:2608.20379v1 Announce Type: new Abstract: Advances in large language models (LLMs) have fueled a wave of research into agency: the ability to reason, plan, and act. This effort has produced agen

agentsarxiv-cs-ai
24 Aug 2026
Safety

Kinematic Knowledge Maps for Pattern Alignment: Structured Latent Representational Learning in Multimodal Gait Analysis

DGX agent

arXiv:2608.20969v1 Announce Type: new Abstract: Multimodal clinical AI is limited by weakly aligned inputs and the absence of domain-specific interpretable representations, particularly when learning

safetyarxiv-cs-cv
24 Aug 2026
Safety

Scaffolding Minds: Optimizing Latent Visual Target Representations for Multimodal Reasoning

DGX agent

arXiv:2608.19669v1 Announce Type: new Abstract: Latent reasoning has advanced multimodal reasoning through a two-stage training paradigm: (1) a helper image is encoded into latent tokens to teach visu

safetyarxiv-cs-cv
21 Aug 2026
Model Releases

UMER: Unifying Embedding and Ranking via Pair-Aware Discriminative Reasoning for Universal Multimodal Retrieval

DGX agent

arXiv:2608.18504v1 Announce Type: new Abstract: Universal multimodal retrieval aims to support diverse instruction-aware retrieval tasks, demanding both efficient corpus-scale matching and fine-graine

model-releasesarxiv-cs-ai
20 Aug 2026
Model Releases

Does Unification Come at a Cost? Uni-SafeBench: A Safety Benchmark for Unified Multimodal Large Models

DGX agent

arXiv:2604.00547v2 Announce Type: replace Abstract: Unified Multimodal Large Models (UMLMs) integrate understanding and generation capabilities within a single architecture. While unified architecture

model-releasesarxiv-cs-ai
19 Aug 2026
Safety

Where a New Concept Must Enter: Entry Point Gates Cross-Task Usability in Unified Multimodal Models

DGX agent

arXiv:2608.17564v1 Announce Type: cross Abstract: Unified multimodal models (UMMs) are motivated by the hope that understanding and generation reinforce each other but controlled ablations repeatedly

safetyarxiv-cs-ai
19 Aug 2026
← Previous
12345…202
Next →