AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,119 results
21 Apr 2026

DOSE: Data Selection for Multi-Modal LLMs via Off-the-Shelf Models

SafetyDGX agent

arXiv:2604.16979v1 Announce Type: cross Abstract: High-quality and diverse multimodal data are essential for improving vision-language models (VLMs), yet existing datasets often contain noisy, redunda

16 Apr 2026

AudioX: A Unified Framework for Anything-to-Audio Generation

Model ReleasesDGX agent

arXiv:2503.10522v4 Announce Type: replace-cross Abstract: Audio and music generation based on flexible multimodal control signals is a widely applicable topic, with the following key challenges: 1) a

Seek-and-Solve: Benchmarking MLLMs for Visual Clue-Driven Reasoning in Daily Scenarios

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Model Releases
DGX agent

arXiv:2604.14041v1 Announce Type: new Abstract: Daily scenarios are characterized by visual richness, requiring Multimodal Large Language Models (MLLMs) to filter noise and identify decisive visual cl

14 Oct 2026

Probing and Inducing Clinical Modality Grounding in Brain Tumor Segmentation

Model ReleasesDGX agent

arXiv:2603.19844v3 Announce Type: replace Abstract: Multimodal MRI provides complementary information for brain tumor segmentation, but high accuracy alone does not reveal whether a model relies on cl

Jag: Direct Box Prediction for Efficient Visual Grounding

Local AiDGX agent

arXiv:2610.13239v2 Announce Type: replace Abstract: Visual grounding combines image--language understanding with geometric prediction, yet autoregressive multimodal models often express a box as a coo

PVFH-Bench: Benchmarking Premise-Induced Visual Fixation Hallucinations in Vision-Language Models

Model ReleasesDGX agent

arXiv:2610.14635v1 Announce Type: cross Abstract: Large Vision-Language Models (LVLMs) have achieved remarkable progress across a wide range of multimodal tasks. However, object hallucination remains

QK-Edit: Revisiting Attention-based Injection in MM-DiT for Image and Video Editing

ResearchDGX agent

arXiv:2610.17829v1 Announce Type: new Abstract: Multimodal Diffusion Transformers (MM-DiTs) have recently emerged as a powerful framework for unified text-vision synthesis, surpassing traditional U-Ne

MedEvo: Medical Reasoning Evolution through Knowledge Navigation

ResearchDGX agent

arXiv:2610.17690v1 Announce Type: cross Abstract: Medical multimodal reasoning models are typically trained on teacher-generated rationales, discarding the valid reasoning in students' own failed traj

RSAJEV: Training-Free Abstaining Prototype Memory for Eliminating Silent Hallucination in JEV-Based Remote Sensing Classification

ResearchDGX agent

arXiv:2610.15742v1 Announce Type: new Abstract: Scene classification of remote sensing imagery with multimodal large language models (MLLMs) is formulated as a single-forward-pass decision problem: ca

Uni-RS: A Spatially Faithful Unified Understanding and Generation Model for Remote Sensing

SafetyDGX agent

arXiv:2601.17673v2 Announce Type: replace Abstract: Unified remote sensing multimodal models exhibit a pronounced spatial reversal curse: Although they can accurately recognize and describe object loc

28 Sept 2026

OSPO: Object-Centric Self-Improving Preference Optimization for Text-to-Image Generation

SafetyDGX agent

arXiv:2506.02015v4 Announce Type: replace Abstract: Recent advances in Multimodal Large Language Models (MLLMs) have enabled unified multimodal understanding and generation. However, they still strugg

1 Sept 2026

GUIDE: Guiding Internal Evidence with Language Instructions

Model ReleasesDGX agent

arXiv:2608.30712v1 Announce Type: new Abstract: Large multimodal models follow instructions about what to generate, but not necessarily about what evidence to rely on. Hence, models may continue to de

Think, Look, and Revise: Inconsistency-Aware Visual Self-Correction in MLLMs

ResearchDGX agent

arXiv:2608.29374v1 Announce Type: new Abstract: Tool-augmented multimodal reasoning integrates external tools (e.g., object detection, depth estimation) into multimodal large language models (MLLMs) t

27 Aug 2026

Transient multimode heat transfer of an industrial automated tape laying process under rapidly changing conditions

Local AiDGX agent

arXiv:2608.25470v1 Announce Type: new Abstract: This work presents a transient heat-transfer model of an industrial automated tape laying (ATL) process designed to overcome the limitations of conventi

26 Aug 2026

HMGCLIP: Heterogeneous Multi-Granularity Contrastive Learning for E-commerce Representation Learning

Model ReleasesDGX agent

arXiv:2608.24467v1 Announce Type: new Abstract: Although recent Multimodal Large Language Models (MLLMs) have advanced general product understanding, they implicitly encode product information into gl

24 Aug 2026

KoViDoRe: Korean Visual Document Retrieval

Model ReleasesDGX agent

arXiv:2608.20840v1 Announce Type: cross Abstract: Recent advances in multimodal retrieval have improved the ability to retrieve information from visually rich documents such as PDFs and reports. Howev

20 Aug 2026

TTSD-FAR: Test-Time Self-Distillation with Fisher-Anchored Restoration for Missing-Modality Emotion Recognition in LVLMs

Model ReleasesDGX agent

arXiv:2608.18386v1 Announce Type: cross Abstract: Large video-language models (LVLMs) have shown remarkable performance on multimodal tasks like multimodal emotion recognition (ER) in the wild. ER is

7 Jul 2026

UniVideo: Unified Understanding, Generation, and Editing for Videos

Model ReleasesDGX agent

arXiv:2510.08377v4 Announce Type: replace Abstract: Unified multimodal models have shown promising results in multimodal content generation and editing but remain largely limited to the image domain.

AudioX-Turbo: A Unified Framework for Efficient Anything-to-Audio Generation

Model ReleasesDGX agent

arXiv:2606.12555v2 Announce Type: replace-cross Abstract: Audio and music generation based on flexible multimodal control signals is a widely applicable topic, with the following key challenges: 1) a

30 Jun 2026

Dual-Flow Reinforcement Learning with State-Aware Exploration

SafetyDGX agent

arXiv:2606.29820v1 Announce Type: cross Abstract: In complex continuous-control reinforcement learning tasks, multimodal optimal actions often coincide with uncertain, multimodal return distributions,

28 Apr 2026

MEG-RAG: Quantifying Multi-modal Evidence Grounding for Evidence Selection in RAG

Model ReleasesDGX agent

arXiv:2604.24564v1 Announce Type: new Abstract: Multimodal Retrieval-Augmented Generation (MRAG) addresses key limitations of Multimodal Large Language Models (MLLMs), such as hallucination and outdat

Discovering Failure Modes in Vision-Language Models using RL

SafetyDGX agent

arXiv:2604.04733v2 Announce Type: replace-cross Abstract: Vision-language Models (VLMs), despite achieving strong performance on multimodal benchmarks, often misinterpret straightforward visual concep

27 Apr 2026

Towards Temporal Compositional Reasoning in Long-Form Sports Videos

Model ReleasesDGX agent

arXiv:2604.22226v1 Announce Type: new Abstract: Sports videos are a challenging domain for multimodal understanding because they involve complex and dynamic human activities. Despite rapid progress in

CGC: Compositional Grounded Contrast for Fine-Grained Multi-Image Understanding

SafetyDGX agent

arXiv:2604.22498v1 Announce Type: cross Abstract: Although Multimodal Large Language Models (MLLMs) have advanced rapidly, they still face notable challenges in fine-grained multi-image understanding,

24 Apr 2026

Context Unrolling in Omni Models

ResearchDGX agent

arXiv:2604.21921v1 Announce Type: new Abstract: We present Omni, a unified multimodal model natively trained on diverse modalities, including text, images, videos, 3D geometry, and hidden representati

LLaDA2.0-Uni Released

Model ReleasesDGX agent

LLaDA2.0-Uni is a unified diffusion large language model (dLLM) based on Mixture-of-Experts architecture that seamlessly integrates multimodal understanding and generation. The model supports text-to-

23 Apr 2026

Exploring Spatial Intelligence from a Generative Perspective

Model ReleasesDGX agent

arXiv:2604.20570v1 Announce Type: new Abstract: Spatial intelligence is essential for multimodal large language models, yet current benchmarks largely assess it only from an understanding perspective.

Membership Inference for Contrastive Pre-training Models with Text-only PII Queries

SafetyDGX agent

arXiv:2603.14222v2 Announce Type: replace-cross Abstract: Contrastive pretraining models such as CLIP and CLAP, serve as the ubiquitous perceptual backbones for modern multimodal large models, yet the

X-PCR: A Benchmark for Cross-modality Progressive Clinical Reasoning in Ophthalmic Diagnosis

Model ReleasesDGX agent

arXiv:2604.20350v1 Announce Type: new Abstract: Despite significant progress in Multi-modal Large Language Models (MLLMs), their clinical reasoning capacity for multi-modal diagnosis remains largely u

14 Apr 2026

Diffusion-CAM: Faithful Visual Explanations for dMLLMs

ResearchDGX agent

arXiv:2604.11005v1 Announce Type: new Abstract: While diffusion Multimodal Large Language Models (dMLLMs) have recently achieved remarkable strides in multimodal generation, the development of interpr

Head-wise Modality Specialization within MLLMs for Robust Fake News Detection under Missing Modality

ApplicationsDGX agent

arXiv:2604.09711v1 Announce Type: cross Abstract: Multimodal fake news detection (MFND) aims to verify news credibility by jointly exploiting textual and visual evidence. However, real-world news diss

16 Oct 2026

WorldCast: Exploring Intelligent Visual Generation in World State Prediction

Model ReleasesDGX agent

arXiv:2610.20731v1 Announce Type: cross Abstract: Humans interpret multimodal observations of the world and forecast how it will evolve. Recent multimodal generative systems have demonstrated similar

27 Sept 2026

Wiki Lint Report — 2026-09-27

SynthesesDGX agent

Automated lint: 17 errors, 59669 warnings, 3 info

14 Sept 2026

Unified Text-Image Generation with Weakness-Targeted Post-Training

Model ReleasesDGX agent

arXiv:2601.04339v3 Announce Type: replace Abstract: Unified multimodal generation architectures that jointly produce text and images have recently emerged as a promising direction for text-to-image (T

11 Sept 2026

SenseNova-U1.5: Towards Native Unified Visual Intelligence

SafetyDGX agent

arXiv:2609.11929v1 Announce Type: new Abstract: We launch SenseNova-U1.5, an 8B-MoT native unified multimodal model that understands, reasons about, and generates visual content within an encoder-free

9 Sept 2026

MV-STRIDE: Enabling MLLMs to Master Multi-View Spatial Reasoning via Hierarchical Capability Modeling

ResearchDGX agent

arXiv:2609.07258v1 Announce Type: new Abstract: Despite the rapid progress of Multimodal Large Language Models (MLLMs) in 2D vision-language tasks, robust multi-view spatial reasoning remains a fundam

Generalist Open-World Temporal Perception

ResearchDGX agent

arXiv:2609.06823v1 Announce Type: new Abstract: The next generation of artificial intelligence systems will likely be natively temporal and multimodal in both inputs and outputs: able to converse, per

Wiki Lint Report — 2026-09-09

SynthesesDGX agent

Automated lint: 12 errors, 53990 warnings, 3 info

2 Sept 2026

Distributed Implicit Harm: A Compositional Safety Blind Spot in MLLM-Based Video Moderation

SafetyDGX agent

arXiv:2609.00206v1 Announce Type: cross Abstract: Despite their growing use in video moderation, multimodal large language models (MLLMs) exhibit a compositional safety blind spot: videos composed of

28 Aug 2026

TransMeme: A Multi-Agent Framework for Cross-Cultural Meme Transcreation

SafetyDGX agent

arXiv:2608.27127v1 Announce Type: new Abstract: Internet memes are a pervasive form of multimodal online communication; however, such communication often involves users from diverse linguistic and cul

VFA: Empowering Multilingual MLLMs via Vision-Free Adaptation

SafetyDGX agent

arXiv:2608.26155v1 Announce Type: cross Abstract: Multimodal large language models have advanced rapidly, yet most remain English-centric, as scaling multilingual multimodal instruction tuning is limi

11 Aug 2026

NeuPAT: Neuron-aware Plasticity Allocation Tuning for Language-Preserving MLLMs

ResearchDGX agent

arXiv:2608.08107v1 Announce Type: cross Abstract: Multimodal expansion of large language models (LLMs) enables new perceptual capabilities but often compromises the language intelligence acquired duri

10 Aug 2026

Kimi K2.5: Visual Agentic Intelligence

AgentsDGX agent

arXiv:2602.02276v2 Announce Type: replace-cross Abstract: We introduce Kimi K2.5, an open-source multimodal agentic model designed to advance general agentic intelligence. K2.5 emphasizes the joint op

3 Aug 2026

SPICE: Synergy and Partial Information Based Curriculum Evolution

ResearchDGX agent

arXiv:2606.16639v2 Announce Type: replace Abstract: Multimodal learning exploits complementary information across heterogeneous modalities. The informativeness of each modality can vary widely across

31 Jul 2026

FiRE: Enhancing MLLMs with Fine-Grained Context Learning for Complex Image Retrieval

SafetyDGX agent

arXiv:2607.27959v1 Announce Type: new Abstract: Due to their strong generalizable multimodal processing and reasoning capabilities, Multimodal Large Language Models (MLLMs) have demonstrated significa

15 Jul 2026

Hy-Embodied-VLM-1.0: Efficient Physical-World Agents

Model ReleasesDGX agent

arXiv:2607.12894v1 Announce Type: new Abstract: Building capable embodied agents requires not only multimodal perception and understanding, but also agentic capabilities for reasoning about actions, a

12 May 2026

Yeti: A compact protein structure tokenizer for reconstruction and multi-modal generation

ResearchDGX agent

arXiv:2605.09981v1 Announce Type: cross Abstract: Multimodal models that jointly reason over protein sequences, structures, and function annotations within a unified representation hold immense potent

11 May 2026

Anisotropic Modality Align

SafetyDGX agent

arXiv:2605.07825v1 Announce Type: cross Abstract: Training multimodal large language models has long been limited by the scarcity of high-quality paired multimodal data. Recent studies show that the s

20 Apr 2026

Robust Multispectral Semantic Segmentation under Missing or Full Modalities via Structured Latent Projection

SafetyDGX agent

arXiv:2604.15856v1 Announce Type: cross Abstract: Multimodal remote sensing data provide complementary information for semantic segmentation, but in real-world deployments, some modalities may be unav

15 Apr 2026

CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoning

SafetyDGX agent

arXiv:2602.00181v3 Announce Type: replace-cross Abstract: Understanding camera dynamics is a fundamental pillar of video spatial intelligence. However, existing multimodal models predominantly treat t

13 Apr 2026

ActFER: Agentic Facial Expression Recognition via Active Tool-Augmented Visual Reasoning

Local AiDGX agent

arXiv:2604.08990v1 Announce Type: new Abstract: Recent advances in Multimodal Large Language Models (MLLMs) have created new opportunities for facial expression recognition (FER), moving it beyond pur

10 Apr 2026

Decompose, Look, and Reason: Reinforced Latent Reasoning for VLMs

SafetyDGX agent

arXiv:2604.07518v1 Announce Type: new Abstract: Vision-Language Models often struggle with complex visual reasoning due to the visual information loss in textual CoT. Existing methods either add the c

SUPERGLASSES: Benchmarking Vision Language Models as Intelligent Agents for AI Smart Glasses

Model ReleasesDGX agent

arXiv:2602.22683v2 Announce Type: replace Abstract: The rapid advancement of AI-powered smart glasses-one of the hottest wearable devices-has unlocked new frontiers for multimodal interaction, with Vi

VAREX: A Benchmark for Multi-Modal Structured Extraction from Documents

Model ReleasesDGX agent

arXiv:2603.15118v2 Announce Type: replace Abstract: We introduce VAREX (VARied-schema EXtraction), a benchmark for evaluating multimodal foundation models on structured data extraction from government

15 Oct 2026

Neos: Learning to Interleave Search and Visual Reasoning

SafetyDGX agent

arXiv:2610.17043v1 Announce Type: new Abstract: Recent multimodal deep search agents have advanced tool use and visual content retrieval, yet they still struggle to convert intermediate visual evidenc

5 Oct 2026

Behavior Pack Optimization for Video MLLM Post-Training

ResearchDGX agent

arXiv:2610.03141v1 Announce Type: new Abstract: Video multimodal large language models (MLLMs) keep climbing video question answering benchmarks, yet shuffling the frames, masking the segment that sup

4 Oct 2026

Synthesis: Arxiv-Cs-Cv

SynthesesDGX agent

Auto-generated synthesis of 18054 entries about arxiv-cs-cv

1 Oct 2026

PixelUMM: Encoder-Free Unified Image and Video Understanding and Generation

ResearchDGX agent

arXiv:2609.38597v1 Announce Type: new Abstract: Unified Multimodal Models (UMMs) often rely on separate visual representations for understanding and generation, increasing visual context length and co

20 Sept 2026

Wiki Lint Report — 2026-09-20

SynthesesDGX agent

Automated lint: 14 errors, 54840 warnings, 3 info

13 Sept 2026

Wiki Lint Report — 2026-09-13

SynthesesDGX agent

Automated lint: 12 errors, 54839 warnings, 3 info

← Previous
1…4849505152…169
Next →