AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries123,304
  • Agents10,352
  • Applications7,013
  • Companies3
  • Concepts7
  • Hardware2,702
  • Industry6,776
  • Local Ai6,847
  • Model Releases35,469
  • Research28,731
  • Safety18,972
  • Syntheses31
  • Tools1,775
  • Tutorials4,626

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries123,304
  • Agents10,352
  • Applications7,013
  • Companies3
  • Concepts7
  • Hardware2,702
  • Industry6,776
  • Local Ai6,847
  • Model Releases35,469
  • Research28,731
  • Safety18,972
  • Syntheses31
  • Tools1,775
  • Tutorials4,626

Source
Human
123,304Total entries
60Added by human
123,244Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
9,027 results
Safety

Transfer Safety Awareness for Cross-Modal Safety Drift in Multimodal Large Language Models

DGX agent

arXiv:2609.02082v1 Announce Type: cross Abstract: Visual modality enhances the capabilities of multimodal large language models (MLLMs) but also introduces a safety concern: a benign textual query may

safetyarxiv-cs-ai
3 Sept 2026
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Tutorials

Forbid Your Attention: Fooling Multimodal Large Language Models by Selectively Removing Intrinsic Focus in Spectral Domain

DGX agent

arXiv:2609.00788v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have extended the capability of large language models (LLMs) to process more contextual multimodal information,

tutorialsarxiv-cs-cv
2 Sept 2026
Safety

C3-UniMM: Causal Cycle-Consistent Unified Multimodal Modeling via Super Alignment and Shared Decoding Space

DGX agent

arXiv:2608.28603v1 Announce Type: new Abstract: Unified Multimodal Models aim to achieve any-to-any understanding and generation across arbitrary modalities. However, existing methods primarily rely o

safetyarxiv-cs-ai
1 Sept 2026
Local Ai

GarmentWeaver: Schema-Aware Structured Synthesis for Multimodal Sewing Patterns

DGX agent

arXiv:2608.30550v1 Announce Type: new Abstract: Multimodal Sewing pattern generation aims to infer executable sewing patterns from design cues such as sketches and textual descriptions. As an interpre

local-aiarxiv-cs-ai
1 Sept 2026
Research

HANIA: Planner-Guided Multimodal Graph Evidence Selection for Grounded Question Answering

DGX agent

arXiv:2608.29088v1 Announce Type: new Abstract: Multimodal question answering remains sensitive to noisy, incomplete, and weakly grounded evidence. Long unstructured contexts can introduce redundancy

researcharxiv-cs-ai
1 Sept 2026
Model Releases

ImageEval 2026: Culturally Grounded Arabic Multimodal Evaluation

DGX agent

arXiv:2608.30475v1 Announce Type: cross Abstract: We present an overview of the ImageEval 2026 shared task on culturally grounded Arabic multimodal evaluation. It includes two tasks: (i) AynVQA, cover

model-releasesarxiv-cs-ai
1 Sept 2026
Model Releases

Inter-3D VQA: A Roadside Multimodal Benchmark for 3D Spatiotemporally Grounded Visual Question Answering

DGX agent

arXiv:2608.28762v1 Announce Type: new Abstract: Recent advances in visual question answering (VQA) and multimodal large language models (MLLMs) have enabled natural-language reasoning over traffic sce

model-releasesarxiv-cs-cv
1 Sept 2026
Safety

MUSE: A Run-Centric Platform for Multimodal Unified Safety Evaluation of Large Language Models

DGX agent

arXiv:2603.02482v2 Announce Type: replace-cross Abstract: Safety evaluation of multimodal large language models requires tracking not only whether an attack succeeds, but also how the interaction unfo

safetyarxiv-cs-cl
1 Sept 2026
Research

Visual Token Coding for Video Multimodal Large Language Models

DGX agent

arXiv:2608.28008v1 Announce Type: new Abstract: In this paper, we propose a new token compression paradigm for video Multimodal Large Language Models (MLLMs), termed Visual Token Coding (VTC). Inspire

researcharxiv-cs-cv
31 Aug 2026
Model Releases

MMEmb-R1: Reasoning-Enhanced Multimodal Embedding with Pair-Aware Selection and Adaptive Control

DGX agent

arXiv:2604.06156v2 Announce Type: replace-cross Abstract: MLLMs have been successfully applied to multimodal embedding tasks, yet their generative reasoning capabilities remain underutilized. Directly

model-releasesarxiv-cs-cl
27 Aug 2026
Model Releases

OmniPhys: A Unified Multimodal Benchmark for Physics Understanding and Generation from Chinese Educational Corpora

DGX agent

arXiv:2608.25398v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have demonstrated strong abilities in solving diverse visual and textual reasoning tasks. However, their develo

model-releasesarxiv-cs-cl
27 Aug 2026
Model Releases

SciMIF: Understanding Multimodal Instruction Following in Scientific Domains

DGX agent

arXiv:2608.25973v1 Announce Type: cross Abstract: Understanding instruction-following capabilities in scientific domains is essential for effectively leveraging Multimodal Large Language Models (MLLMs

model-releasesarxiv-cs-lg
27 Aug 2026
Safety

LION: A Clifford Neural Paradigm for Multimodal-Attributed Graph Learning

DGX agent

arXiv:2608.24795v1 Announce Type: new Abstract: Recently, the rapid advancement of multimodal domains has driven a data-centric paradigm shift in graph ML, transitioning from text-attributed to multim

safetyarxiv-cs-lg
26 Aug 2026
Safety

EmotionDialogCN: A Spontaneous Multimodal Dataset for Mandarin Emotional Dialogue

DGX agent

arXiv:2608.20905v1 Announce Type: new Abstract: Face-to-face audiovisual interaction is central to human communication, conveying rich emotional and social cues. However, existing multimodal dialogue

safetyarxiv-cs-cv
24 Aug 2026
Research

GeoExplain: Multimodal Reasoning based on Hierarchy of Visual Information in Street View

DGX agent

arXiv:2506.16633v3 Announce Type: replace-cross Abstract: Multimodal reasoning is a process of understanding, integrating and inferring information across different data modalities. It has recently at

researcharxiv-cs-ai
24 Aug 2026
Safety

TiMi: Empower Time Series Transformers with Multimodal Mixture of Experts

DGX agent

arXiv:2602.21693v2 Announce Type: replace Abstract: Multimodal time series forecasting has garnered significant attention for its potential to provide more accurate predictions than traditional single

safetyarxiv-cs-lg
19 Aug 2026
Research

GraphLoom: Reliability-Calibrated Graph Evidence Routing for Multimodal KG-RAG

DGX agent

arXiv:2608.15056v1 Announce Type: new Abstract: Multimodal retrieval-augmented generation (RAG) systems often rely on long unstructured contexts or aggressively expanded evidence graphs, which can int

researcharxiv-cs-ai
18 Aug 2026
Model Releases

A Pathway to General-Purpose Scientific AI: Multimodal Comprehension of Scientific Images

DGX agent

arXiv:2608.14075v1 Announce Type: new Abstract: Scientific figures and tables encode essential experimental evidence, yet remain difficult for digital libraries and multimodal AI systems to retrieve a

model-releasesarxiv-cs-ai
17 Aug 2026
Model Releases

HounsWorld: A Multimodal World Model for Hidden Patient-State Readout, Reconstruction, and Simulation

DGX agent

arXiv:2608.12904v1 Announce Type: new Abstract: Clinical intelligence requires estimating a patient's underlying condition from incomplete observations rather than learning isolated mappings from scan

model-releasesarxiv-cs-cv
14 Aug 2026
Model Releases

Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenes

DGX agent

arXiv:2608.10954v1 Announce Type: cross Abstract: While Multimodal Large Language Models (MLLMs) demonstrate impressive performance in benign scenarios, their cognitive reliability deteriorates signif

model-releasesarxiv-cs-ai
12 Aug 2026
Research

InterPruner: Interactive Structured Pruning via Taylor-Implicit Criterion and Language-Prior Modulator for Multimodal Object Detection

DGX agent

arXiv:2608.10724v1 Announce Type: new Abstract: Multimodal object detection proves effective in remote sensing, especially the RGB-Infrared paradigm. The parallel feature extractors provide rich multi

researcharxiv-cs-cv
12 Aug 2026
Research

LookME: Lookup-Based Multimodal Embeddings for Layer Injection in Vision-Language Models

DGX agent

arXiv:2607.16305v2 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) have achieved strong progress in multimodal understanding. However, scaling dense or sparse Mixture-of-Experts (

researcharxiv-cs-ai
11 Aug 2026
Applications

C^2MOE: Consistency and Complementarity-guided Mixture of Experts for Incomplete Multimodal Emotion Learning

DGX agent

arXiv:2608.04013v1 Announce Type: cross Abstract: Recent advances in Multimodal Emotion Recognition in Conversations (MERC) highlight its reliance on complete multimodal inputs. However, real-world da

applicationsarxiv-cs-ai
6 Aug 2026
Agents

Beyond Simply Environment Scaling: Designing Effective Environment Distributions for Multimodal Agent Learning

DGX agent

arXiv:2608.03571v1 Announce Type: new Abstract: Recent works train agents by constructing large-scale multimodal environment pools. However, we find that simply increasing the number of multimodal env

agentsarxiv-cs-cv
5 Aug 2026
Safety

GALA: Generative Aligned Learning for Adaptive Multimodal Representation in the Taobao Shangou Recommender System

DGX agent

arXiv:2607.29213v1 Announce Type: cross Abstract: Modern recommender systems in food delivery increasingly leverage multimodal signals, including images, text, and user interaction histories, to enhan

safetyarxiv-cs-lg
3 Aug 2026
Research

TokenSwap: Benchmarking and Reducing the Modality Gap in Multimodal LLMs

DGX agent

arXiv:2607.28640v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) should generate consistent responses given semantically equivalent inputs across modalities. However, we observ

researcharxiv-cs-cl
3 Aug 2026
Agents

LEDGERMIND: Provenance-Constrained Multimodal Agentic Reasoning with a Structured Evidence Ledger

DGX agent

arXiv:2607.28374v1 Announce Type: new Abstract: Multimodal agents for visual question answering increasingly operate as multi-step trajectories that interleave perception, retrieval, and reasoning, ye

agentsarxiv-cs-lg
31 Jul 2026
Model Releases

MOON2.0: Dynamic Modality-balanced Multimodal Representation Learning for E-commerce Product Understanding

DGX agent

arXiv:2511.12449v3 Announce Type: replace Abstract: Recent Multimodal Large Language Models (MLLMs) have significantly advanced e-commerce product understanding. However, they still face three challen

model-releasesarxiv-cs-cv
31 Jul 2026
Safety

Regularizing modality contribution drift in multimodal continual learning

DGX agent

arXiv:2607.27260v1 Announce Type: new Abstract: Multimodal continual learning (MMCL) aims to learn emerging knowledge from multimodal data while preserving knowledge. To mitigate forgetting, current M

safetyarxiv-cs-lg
31 Jul 2026
Research

RRM: Experience-Driven Reflective Retrieval Memory for Long-Horizon Multimodal Reasoning

DGX agent

arXiv:2607.28156v1 Announce Type: new Abstract: Existing multimodal long-term memory agents use external memory to overcome the limited context available for long videos. However, most methods emphasi

researcharxiv-cs-cl
31 Jul 2026
Applications

Dual-Path LLM Reasoning for Multimodal Few-Shot Knowledge Graph Completion

DGX agent

arXiv:2607.26909v1 Announce Type: new Abstract: Knowledge graph completion (KGC) aims to infer missing facts in knowledge graphs (KGs), thereby improving their completeness and supporting downstream i

applicationsarxiv-cs-cl
30 Jul 2026
Tutorials

Visual Saliency Steering Distillation for Multimodal Chain-of-Thought Reasoning

DGX agent

arXiv:2607.22013v1 Announce Type: new Abstract: Multimodal chain-of-thought (CoT) reasoning integrates visual and textual cues through step-by-step inference. In small models with limited token budget

tutorialsarxiv-cs-cv
27 Jul 2026
Tutorials

Tuned Reverse Distillation: Enhancing Multimodal Industrial Anomaly Detection with Crossmodal Tuners

DGX agent

arXiv:2412.08949v4 Announce Type: replace Abstract: Knowledge distillation (KD) has been widely studied in unsupervised image Anomaly Detection (AD), but its application to unsupervised multimodal AD

tutorialsarxiv-cs-cv
8 Jul 2026
Research

Omni-Diffusion: Unified Multimodal Understanding and Generation with Masked Discrete Diffusion

DGX agent

arXiv:2603.06577v2 Announce Type: replace Abstract: While recent multimodal large language models (MLLMs) have made impressive strides, they predominantly employ a conventional autoregressive architec

researcharxiv-cs-cv
7 Jul 2026
Research

Magic-MM-Embedding: Towards Visual-Token-Efficient Universal Multimodal Embedding with MLLMs

DGX agent

arXiv:2602.05275v2 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs) have shown immense promise in universal multimodal retrieval, which aims to find relevant items of various

researcharxiv-cs-cv
2 Jul 2026
Research

CAMF-Det: Closure-Aware Multimodal Fusion for LiDAR-Camera 3D Object Detection on UAV Platforms

DGX agent

arXiv:2606.09143v1 Announce Type: new Abstract: Multimodal 3D object detection based on LiDAR and cameras has demonstrated excellent performance in ground-vehicle scenarios, but has not been explored

researcharxiv-cs-cv
9 Jun 2026
Research

GRAMformer: Any-Order Modality Interactions via Volumetric Multimodal Cross-Attention

DGX agent

arXiv:2606.06249v1 Announce Type: new Abstract: Transformer-based multimodal models rely on attention mechanisms to integrate information across heterogeneous modalities. Despite their success, existi

researcharxiv-cs-cv
5 Jun 2026
Model Releases

MAviS: A Multimodal Conversational Assistant For Avian Species

DGX agent

arXiv:2603.07294v2 Announce Type: replace Abstract: Fine-grained understanding and species-specific multimodal question answering are vital for advancing biodiversity conservation and ecological monit

model-releasesarxiv-cs-cv
5 Jun 2026
Safety

Diverse via bounded Agreement: Geometric Regularization for Multimodal Fusion

DGX agent

arXiv:2601.21670v3 Announce Type: replace-cross Abstract: Multimodal fusion is often treated as an optimization-balancing problem, where training signals are adjusted to prevent one modality from domi

safetyarxiv-cs-lg
26 May 2026
Safety

PID-Guided Partial Alignment for Multimodal Decentralized Federated Learning

DGX agent

arXiv:2601.10012v2 Announce Type: replace Abstract: Multimodal decentralized federated learning (DFL) must support collaboration among agents that hold different modality subsets and often different m

safetyarxiv-cs-lg
26 May 2026
Research

Leveraging Self-Paced Curriculum Learning for Enhanced Modality Balance in Multimodal Conversational Emotion Recognition

DGX agent

arXiv:2605.21565v1 Announce Type: new Abstract: Multimodal Emotion Recognition in Conversations (MERC) is a crucial task for understanding human interactions, where multimodal approaches integrating l

researcharxiv-cs-lg
23 May 2026
Model Releases

HAVEN: Hierarchically Aligned Multimodal Benchmark for Unified Video Understanding

DGX agent

arXiv:2605.19223v1 Announce Type: new Abstract: While Multimodal Large Language Models (MLLMs) exhibit strong performance on standard video tasks, their ability to faithfully summarize and reason over

model-releasesarxiv-cs-cv
20 May 2026
Research

Navigating the Emotion Tree: Hierarchical Hyperbolic RAG for Multimodal Emotion Recognition

DGX agent

arXiv:2605.18884v1 Announce Type: cross Abstract: Multimodal emotion recognition aims to integrate text, audio, and video sources to understand human affective states. Although multimodal large langua

researcharxiv-cs-cv
20 May 2026
Safety

Safety Geometry Collapse in Multimodal LLMs and Adaptive Drift Correction

DGX agent

arXiv:2605.18104v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) often fail to transfer safety capabilities learned in the text modality to semantically equivalent non-text inp

safetyarxiv-cs-ai
19 May 2026
Research

Seeing is Understanding: Unlocking Causal Attention into Modality-Mutual Attention for Multimodal LLMs

DGX agent

arXiv:2503.02597v3 Announce Type: replace-cross Abstract: Recent Multimodal Large Language Models (MLLMs) have demonstrated significant progress in perceiving and reasoning over multimodal inquiries,

researcharxiv-cs-ai
18 May 2026
Research

Do Composed Image Retrieval Benchmarks Require Multimodal Composition?

DGX agent

arXiv:2605.14787v1 Announce Type: cross Abstract: Composed Image Retrieval (CIR) is a multimodal retrieval task where a query consists of a reference image and a textual modification, and the goal is

researcharxiv-cs-cl
15 May 2026
Model Releases

MMCL-Bench: Multimodal Context Learning from Visual Rules, Procedures, and Evidence

DGX agent

arXiv:2605.12703v1 Announce Type: cross Abstract: We introduce MMCL-Bench, a benchmark for multimodal context learning: learning task-local rules, procedures, and empirical patterns from visual or mix

model-releasesarxiv-cs-ai
14 May 2026
Model Releases

RedDiffuser: Auditing Multimodal Safety Failures in Vision-Language Models via Reinforced Diffusion

DGX agent

arXiv:2503.06223v5 Announce Type: replace Abstract: Large Vision-Language Models (VLMs) are increasingly deployed in open-ended environments, where ensuring reliable safety under multimodal inputs is

model-releasesarxiv-cs-cv
11 May 2026
← Previous
1…34567…189
Next →