AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,652
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,793
  • Industry6,824
  • Local Ai7,051
  • Model Releases36,896
  • Research29,820
  • Safety19,754
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,652
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,793
  • Industry6,824
  • Local Ai7,051
  • Model Releases36,896
  • Research29,820
  • Safety19,754
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
Human
127,652Total entries
60Added by human
127,592Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
9,441 results
Safety

Multimodal Remote Inference

DGX agent

arXiv:2508.07555v3 Announce Type: replace Abstract: We consider a remote inference system with multiple modalities, where a multimodal machine learning (ML) model performs real-time inference using fe

safetyarxiv-cs-lg
28 Apr 2026
Model Releases

PDF-WuKong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Sampling

DGX agent
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

arXiv:2410.05970v3 Announce Type: replace-cross Abstract: Multimodal document understanding is a challenging task to process and comprehend large amounts of textual and visual information. Recent adva

model-releasesarxiv-cs-ai
28 Apr 2026
Safety

Handling Missing Modalities in Multimodal Survival Prediction for Non-Small Cell Lung Cancer

DGX agent

arXiv:2601.10386v2 Announce Type: replace-cross Abstract: Accurate survival prediction in Non-Small Cell Lung Cancer (NSCLC) requires integrating clinical, radiological, and histopathological data. Mu

safetyarxiv-cs-ai
27 Apr 2026
Model Releases

AITP: Traffic Accident Responsibility Allocation via Multimodal Large Language Models

DGX agent

arXiv:2604.20878v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have achieved remarkable progress in Traffic Accident Detection (TAD) and Traffic Accident Understanding (TAU).

model-releasesarxiv-cs-cl
24 Apr 2026
Research

MiMIC: Mitigating Visual Modality Collapse in Universal Multimodal Retrieval While Avoiding Semantic Misalignment

DGX agent

arXiv:2604.21326v1 Announce Type: cross Abstract: Universal Multimodal Retrieval (UMR) aims to map different modalities (e.g., visual and textual) into a shared embedding space for multi-modal retriev

researcharxiv-cs-ai
24 Apr 2026
Model Releases

Towards Multimodal Active Learning: Efficient Learning with Limited Paired Data

DGX agent

arXiv:2510.03247v2 Announce Type: replace-cross Abstract: Active learning (AL) is a principled strategy to reduce annotation cost in data-hungry deep learning. However, existing AL algorithms focus al

model-releasesarxiv-cs-ai
24 Apr 2026
Applications

From Raw Features to Effective Embeddings: A Three-Stage Approach for Multimodal Recipe Recommendation

DGX agent

arXiv:2511.19176v3 Announce Type: replace Abstract: Recipe recommendation has become an essential task in web-based food platforms. A central challenge is effectively leveraging rich multimodal featur

applicationsarxiv-cs-lg
23 Apr 2026
Research

LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model

DGX agent

arXiv:2604.20796v1 Announce Type: new Abstract: We present LLaDA2.0-Uni, a unified discrete diffusion large language model (dLLM) that supports multimodal understanding and generation within a nativel

researcharxiv-cs-cv
23 Apr 2026
Research

SSL-R1: Self-Supervised Visual Reinforcement Post-Training for Multimodal Large Language Models

DGX agent

arXiv:2604.20705v1 Announce Type: new Abstract: Reinforcement learning (RL) with verifiable rewards (RLVR) has demonstrated the great potential of enhancing the reasoning abilities in multimodal large

researcharxiv-cs-cv
23 Apr 2026
Agents

PanDA: Unsupervised Domain Adaptation for Multimodal 3D Panoptic Segmentation in Autonomous Driving

DGX agent

arXiv:2604.19379v1 Announce Type: new Abstract: This paper presents the first study on Unsupervised Domain Adaptation (UDA) for multimodal 3D panoptic segmentation (mm-3DPS), aiming to improve general

agentsarxiv-cs-cv
22 Apr 2026
Safety

ProjLens: Unveiling the Role of Projectors in Multimodal Model Safety

DGX agent

arXiv:2604.19083v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) have achieved remarkable success in cross-modal understanding and generation, yet their deployment is threate

safetyarxiv-cs-ai
22 Apr 2026
Safety

VimRAG: Navigating Massive Visual Context in Retrieval-Augmented Generation via Multimodal Memory Graph

DGX agent

arXiv:2602.12735v2 Announce Type: replace-cross Abstract: Effectively retrieving, reasoning, and understanding multimodal information remains a critical challenge for agentic systems. Traditional Retr

safetyarxiv-cs-cl
22 Apr 2026
Safety

Culture-Aware Humorous Captioning: Multimodal Humor Generation across Cultural Contexts

DGX agent

arXiv:2604.18091v1 Announce Type: new Abstract: Recent multimodal large language models have shown promising ability in generating humorous captions for images, yet they still lack stable control over

safetyarxiv-cs-cl
21 Apr 2026
Model Releases

Evaluating Multimodal LLMs for Inpatient Diagnosis: Real-World Performance, Safety, and Cost Across Ten Frontier Models

DGX agent

arXiv:2604.16980v1 Announce Type: new Abstract: Background: Large language models (LLMs) are increasingly proposed for diagnostic support, but few evaluations use real-world multimodal inpatient data,

model-releasesarxiv-cs-lg
21 Apr 2026
Safety

Instinct vs. Reflection: Unifying Token and Verbalized Confidence in Multimodal Large Models

DGX agent

arXiv:2604.17274v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have demonstrated exceptional capabilities in various perception and reasoning tasks. Despite this success, ens

safetyarxiv-cs-cv
21 Apr 2026
Model Releases

mEOL: Training-Free Instruction-Guided Multimodal Embedder for Vector Graphics and Image Retrieval

DGX agent

arXiv:2604.17054v1 Announce Type: new Abstract: Scalable Vector Graphics (SVGs) function both as visual images and as structured code that encode rich geometric and layout information, yet most method

model-releasesarxiv-cs-cv
21 Apr 2026
Model Releases

Multimodal Claim Extraction for Fact-Checking

DGX agent

arXiv:2604.16311v1 Announce Type: new Abstract: Automated Fact-Checking (AFC) relies on claim extraction as a first step, yet existing methods largely overlook the multimodal nature of today's misinfo

model-releasesarxiv-cs-cl
21 Apr 2026
Research

Reducing Peak Memory Usage for Modern Multimodal Large Language Model Pipelines

DGX agent

arXiv:2604.16734v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have recently demonstrated strong capabilities in understanding and generating responses from diverse visual in

researcharxiv-cs-cv
21 Apr 2026
Safety

Retrieval-Augmented Multimodal Model for Fake News Detection

DGX agent

arXiv:2604.18112v1 Announce Type: new Abstract: In recent years, multimodal multidomain fake news detection has garnered increasing attention. Nevertheless, this direction presents two significant cha

safetyarxiv-cs-cl
21 Apr 2026
Agents

Scaling Beyond Context: A Survey of Multimodal Retrieval-Augmented Generation for Document Understanding

DGX agent

arXiv:2510.15253v3 Announce Type: replace Abstract: Document understanding is critical for applications from financial analysis to scientific discovery. Current approaches, whether OCR-based pipelines

agentsarxiv-cs-cl
21 Apr 2026
Safety

M3R: Localized Rainfall Nowcasting with Meteorology-Informed MultiModal Attention

DGX agent

arXiv:2604.15377v1 Announce Type: cross Abstract: Accurate and timely rainfall nowcasting is crucial for disaster mitigation and water resource management. Despite recent advances in deep learning, pr

safetyarxiv-cs-cv
20 Apr 2026
Model Releases

PixDLM: A Dual-Path Multimodal Language Model for UAV Reasoning Segmentation

DGX agent

arXiv:2604.15670v1 Announce Type: new Abstract: Reasoning segmentation has recently expanded from ground-level scenes to remote-sensing imagery, yet UAV data poses distinct challenges, including obliq

model-releasesarxiv-cs-cv
20 Apr 2026
Research

Cornfigurator: Automated Planning for Any-to-Any Multimodal Model Serving

DGX agent

arXiv:2512.14098v3 Announce Type: replace Abstract: Any-to-Any models are an emerging class of multimodal models that accept combinations of text and multimodal data as input and generate them as outp

researcharxiv-cs-lg
17 Apr 2026
Safety

RaTA-Tool: Retrieval-based Tool Selection with Multimodal Large Language Models

DGX agent

arXiv:2604.14951v1 Announce Type: cross Abstract: Tool learning with foundation models aims to endow AI systems with the ability to invoke external resources -- such as APIs, computational utilities,

safetyarxiv-cs-cl
17 Apr 2026
Local Ai

The Cost of Language: Centroid Erasure Exposes and Exploits Modal Competition in Multimodal Language Models

DGX agent

arXiv:2604.14363v1 Announce Type: new Abstract: Multimodal language models systematically underperform on visual perception tasks, yet the structure underlying this failure remains poorly understood.

local-aiarxiv-cs-cl
17 Apr 2026
Safety

ChartNet: A Million-Scale, High-Quality Multimodal Dataset for Robust Chart Understanding

DGX agent

arXiv:2603.27064v2 Announce Type: replace-cross Abstract: Understanding charts requires models to jointly reason over geometric visual patterns, structured numerical data, and natural language -- a ca

safetyarxiv-cs-cl
16 Apr 2026
Model Releases

MAny: Merge Anything for Multimodal Continual Instruction Tuning

DGX agent

arXiv:2604.14016v1 Announce Type: new Abstract: Multimodal Continual Instruction Tuning (MCIT) is essential for sequential task adaptation of Multimodal Large Language Models (MLLMs) but is severely r

model-releasesarxiv-cs-lg
16 Apr 2026
Model Releases

MERRIN: A Benchmark for Multimodal Evidence Retrieval and Reasoning in Noisy Web Environments

DGX agent

arXiv:2604.13418v1 Announce Type: new Abstract: Motivated by the underspecified, multi-hop nature of search queries and the multimodal, heterogeneous, and often conflicting nature of real-world web re

model-releasesarxiv-cs-cl
16 Apr 2026
Safety

Why Multimodal In-Context Learning Lags Behind? Unveiling the Inner Mechanisms and Bottlenecks

DGX agent

arXiv:2604.13403v1 Announce Type: new Abstract: In-context learning (ICL) enables models to adapt to new tasks via inference-time demonstrations. Despite its success in large language models, the exte

safetyarxiv-cs-cv
16 Apr 2026
Safety

A Survey of Multimodal Mathematical Reasoning: From Perception, Alignment to Reasoning

DGX agent

arXiv:2603.08291v3 Announce Type: replace Abstract: Multimodal Mathematical Reasoning (MMR) has recently attracted increasing attention for its capability to solve mathematical problems involving both

safetyarxiv-cs-ai
15 Apr 2026
Research

BoxTuning: Directly Injecting the Object Box for Multimodal Model Fine-Tuning

DGX agent

arXiv:2604.11136v1 Announce Type: cross Abstract: Object-level spatial-temporal understanding is essential for video question answering, yet existing multimodal large language models (MLLMs) encode fr

researcharxiv-cs-ai
14 Apr 2026
Safety

C2F-Thinker: Coarse-to-Fine Reasoning with Hint-Guided Reinforcement Learning for Multimodal Sentiment Analysis

DGX agent

arXiv:2604.00013v2 Announce Type: replace-cross Abstract: Multimodal sentiment analysis aims to integrate textual, acoustic, and visual information for deep emotional understanding. Despite the progre

safetyarxiv-cs-ai
14 Apr 2026
Tutorials

Controlling Multimodal Conversational Agents with Coverage-Enhanced Latent Actions

DGX agent

arXiv:2601.07516v2 Announce Type: replace-cross Abstract: Vision-language models are increasingly employed as multimodal conversational agents (MCAs) for diverse conversational tasks. Recently, reinfo

tutorialsarxiv-cs-ai
14 Apr 2026
Research

Improving Pediatric Emergency Department Triage with Modality Dropout in Late Fusion Multimodal EHR Models

DGX agent

arXiv:2604.09905v1 Announce Type: new Abstract: Emergency department triage relies heavily on both quantitative vital signs and qualitative clinical notes, yet multimodal machine learning models predi

researcharxiv-cs-lg
14 Apr 2026
Model Releases

TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-training

DGX agent

arXiv:2604.10784v1 Announce Type: new Abstract: Recent advances in unified multimodal models (UMMs) have led to a proliferation of architectures capable of understanding, generating, and editing acros

model-releasesarxiv-cs-ai
14 Apr 2026
Safety

Dictionary-Aligned Concept Control for Safeguarding Multimodal LLMs

DGX agent

arXiv:2604.08846v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) have been shown to be vulnerable to malicious queries that can elicit unsafe responses. Recent work uses prom

safetyarxiv-cs-ai
13 Apr 2026
Safety

Mosaic: Multimodal Jailbreak against Closed-Source VLMs via Multi-View Ensemble Optimization

DGX agent

arXiv:2604.09253v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) are powerful but remain vulnerable to multimodal jailbreak attacks. Existing attacks mainly rely on either explicit visu

safetyarxiv-cs-ai
13 Apr 2026
Model Releases

Unified Multimodal Uncertain Inference

DGX agent

arXiv:2604.08701v1 Announce Type: new Abstract: We introduce Unified Multimodal Uncertain Inference (UMUI), a multimodal inference task spanning text, audio, and video, where models must produce calib

model-releasesarxiv-cs-cv
13 Apr 2026
Model Releases

Cognitive Mismatch in Multimodal Large Language Models for Discrete Symbol Understanding

DGX agent

arXiv:2603.18472v2 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) perform strongly on natural images, yet their ability to understand discrete visual symbols remains u

model-releasesarxiv-cs-cv
10 Apr 2026
Model Releases

Commander-GPT: Dividing and Routing for Multimodal Sarcasm Detection

DGX agent

arXiv:2506.19420v2 Announce Type: replace Abstract: Multimodal sarcasm understanding is a high-order cognitive task. Although large language models (LLMs) have shown impressive performance on many dow

model-releasesarxiv-cs-ai
10 Apr 2026
Applications

CompoDistill: Attention Distillation for Compositional Reasoning in Multimodal LLMs

DGX agent

arXiv:2510.12184v2 Announce Type: replace Abstract: Recently, efficient Multimodal Large Language Models (MLLMs) have gained significant attention as a solution to their high computational complexity,

applicationsarxiv-cs-cv
10 Apr 2026
Model Releases

Mitigating Visual Context Degradation in Large Multimodal Models: A Training-Free Decoupled Agentic Framework

DGX agent

arXiv:2509.23322v2 Announce Type: replace Abstract: With the continuous expansion of Large Language Models (LLMs) and advances in reinforcement learning, LLMs have demonstrated exceptional reasoning c

model-releasesarxiv-cs-cv
10 Apr 2026
Tutorials

Steering the Verifiability of Multimodal AI Hallucinations

DGX agent

arXiv:2604.06714v1 Announce Type: new Abstract: AI applications driven by multimodal large language models (MLLMs) are prone to hallucinations and pose considerable risks to human users. Crucially, su

tutorialsarxiv-cs-ai
10 Apr 2026
Safety

Following Delegation Traces to Study Human Oversight in Interaction with Multimodal AI

DGX agent

arXiv:2610.21948v1 Announce Type: cross Abstract: As multimodal AI systems are becoming our everyday thought partners, the shift towards studying how users transfer control to these systems becomes es

safetyarxiv-cs-ai
16 Oct 2026
Safety

MMSearch-OPD: Easy Made Hard, Hard Made Learnable for Long-Horizon Multimodal Search Agents

DGX agent

arXiv:2610.22240v1 Announce Type: new Abstract: Multimodal deep search is moving from short queries to long-horizon investigations that continually acquire evidence. However, training such agents rema

safetyarxiv-cs-cv
16 Oct 2026
Agents

TRACER: A Multimodal Harness for Patient Care in Hospitals

DGX agent

arXiv:2610.21266v1 Announce Type: cross Abstract: Continuous video and clinical records provide complementary information for understanding how patient behavior evolves over a hospital stay. A central

agentsarxiv-cs-ai
16 Oct 2026
Model Releases

UniFGVC: Universal Training-Free Few-Shot Fine-Grained Vision Classification via Attribute-Aware Multimodal Retrieval

DGX agent

arXiv:2508.04136v4 Announce Type: replace-cross Abstract: Few-shot fine-grained visual classification (FGVC) aims to discriminate between subtly different categories with very limited data. While Mult

model-releasesarxiv-cs-ai
16 Oct 2026
Model Releases

Measuring Epistemic Humility in Multimodal Large Language Models

DGX agent

arXiv:2509.09658v3 Announce Type: replace Abstract: Hallucinations in multimodal large language models (MLLMs), where a model generates content inconsistent with the input image, pose significant risk

model-releasesarxiv-cs-cv
15 Oct 2026
← Previous
1…1213141516…197
Next →