AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,652
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,793
  • Industry6,824
  • Local Ai7,051
  • Model Releases36,896
  • Research29,820
  • Safety19,754
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,652
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,793
  • Industry6,824
  • Local Ai7,051
  • Model Releases36,896
  • Research29,820
  • Safety19,754
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
Human
127,652Total entries
60Added by human
127,592Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
9,441 results
Model Releases

OmniHandwritingOCR: A Diagnostic Benchmark for Evaluating Multimodal LLMs in Handwritten OCR Scenarios

DGX agent

arXiv:2608.18586v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) are increasingly used as OCR systems in document and knowledge-processing pipelines, but their ability to fai

model-releasesarxiv-cs-ai
20 Aug 2026
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Safety

Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challenges

DGX agent

arXiv:2608.17605v1 Announce Type: cross Abstract: Conversational AI is moving beyond isolated text prompts toward sustained, multimodal interaction. In real conversations, users clarify goals, revise

safetyarxiv-cs-ai
19 Aug 2026
Model Releases

SCENARIODIFF: A Scenario-level Guidance Framework for Multimodal Time Series Forecasting--Extended Version

DGX agent

arXiv:2608.17164v1 Announce Type: new Abstract: Textual context such as news, reports, and logs can provide valuable signals for time series forecasting, especially when future dynamics are driven by

model-releasesarxiv-cs-lg
19 Aug 2026
Research

Hypergraph-based Multimodal Retrieval-Augmented Generation with Incremental Refinement

DGX agent

arXiv:2608.16628v1 Announce Type: new Abstract: Modern Multimodal Retrieval-Augmented Generation (M-RAG) systems are fundamentally limited by the binary connectivity paradigm of traditional simple gra

researcharxiv-cs-ai
18 Aug 2026
Model Releases

VibeWorlding: Can Multimodal Agents Construct 3D Open Worlds End-to-End?

DGX agent

arXiv:2608.15265v1 Announce Type: new Abstract: Constructing an interactive 3D open world from a user query is important. However, existing methods are primarily evaluated on idealized, simple queries

model-releasesarxiv-cs-ai
18 Aug 2026
Local Ai

HAM-RAG: Hierarchy-Aware Multimodal RAG for Structure-Faithful Interleaved Generation

DGX agent

arXiv:2608.14032v1 Announce Type: cross Abstract: Existing multimodal RAG methods often flatten structured documents into isolated text and image units, weakening the source organization and local tex

local-aiarxiv-cs-ai
17 Aug 2026
Research

Rethinking Auxiliary Modalities in Multimodal Zero-shot Anomaly Detection: From Semantic Fusion to Conditional Modulation

DGX agent

arXiv:2608.13973v1 Announce Type: new Abstract: Recent foundation model-based methods have endowed RGB images with strong zero-shot anomaly detection (ZSAD) through vision-language pretraining. Howeve

researcharxiv-cs-cv
17 Aug 2026
Research

When Is a Task Vector Enough? An Empirical Theory of Implicit Multimodal ICL

DGX agent

arXiv:2608.13385v1 Announce Type: new Abstract: Implicit multimodal in-context learning compresses demonstrations into internal interventions, ranging from static task vectors to query-conditioned tra

researcharxiv-cs-cv
14 Aug 2026
Tutorials

Rationale-Guided Learning for Multimodal Emotion Recognition

DGX agent

arXiv:2608.10448v1 Announce Type: new Abstract: Multimodal emotion recognition in conversation (MERC) requires understanding complex interactions between verbal and non-verbal cues. However, most exis

tutorialsarxiv-cs-ai
12 Aug 2026
Hardware

Aero Realtime: Fully Aligned Input-Output Streams for Low-Latency Streaming Multimodal Generation

DGX agent

arXiv:2608.08469v1 Announce Type: new Abstract: Existing streaming multimodal models process observations incrementally but still follow a turn-based prefill-then-decode pattern, making them non-duple

hardwarearxiv-cs-ai
11 Aug 2026
Model Releases

Expert-Guided Multimodal Fusion for Unified Emotion and Sentiment Analysis

DGX agent

arXiv:2601.07565v2 Announce Type: replace-cross Abstract: Multimodal emotion understanding requires the integration of heterogeneous data sources, including text, audio, and visual modalities, while s

model-releasesarxiv-cs-ai
11 Aug 2026
Model Releases

MELLON - Multimodal Enhanced LLM for Online Navigation

DGX agent

arXiv:2608.09121v1 Announce Type: new Abstract: Web navigation agents are capable of addressing various types of tasks on different websites. Current baselines on web navigation are either unimodal or

model-releasesarxiv-cs-ai
11 Aug 2026
Agents

F^2Agent: Financial Fusion of Agentic Intelligence for Multimodal Trading

DGX agent

arXiv:2608.05668v1 Announce Type: cross Abstract: With increasingly diverse and heterogeneous information sources, effectively leveraging multimodal data is becoming pivotal for high-quality financial

agentsarxiv-cs-ai
7 Aug 2026
Research

ViSR-KGC: Visual Subgraph Reasoning with Vision-Language Models for Multimodal Knowledge Graph Completion

DGX agent

arXiv:2608.05833v1 Announce Type: new Abstract: Knowledge graph completion (KGC) aims to infer missing entities or relations from incomplete graph structures, and has evolved into multimodal knowledge

researcharxiv-cs-ai
7 Aug 2026
Model Releases

Monte Carlo Tree Search for Table-to-Multimodal Report Generation

DGX agent

arXiv:2608.04071v1 Announce Type: new Abstract: Automatically generating professional multimodal reports comprising both textual analysis and visual charts from structured tabular data is a critical c

model-releasesarxiv-cs-ai
6 Aug 2026
Safety

Towards Physics of Multimodal Pretraining: Knowledge Flow, Modality Synergy, Early Unification, and Recipes

DGX agent

arXiv:2608.05000v1 Announce Type: new Abstract: Vision offers a critical axis for advancing foundation models, driving a shift towards natively unified multimodal pretraining. Despite this momentum, t

safetyarxiv-cs-cv
6 Aug 2026
Model Releases

DAIF: A Data-Driven Intermediate Fusion Framework for Multimodal Supervised Learning via Approximate Message Passing

DGX agent

arXiv:2608.02769v1 Announce Type: cross Abstract: Multimodal supervised learning seeks to leverage multiple heterogeneous data sources to improve predictive performance. A central challenge is determi

model-releasesarxiv-cs-lg
5 Aug 2026
Safety

Rethinking Modality Reliability in Multimodal Sentiment Analysis with Incomplete Observations

DGX agent

arXiv:2608.03611v1 Announce Type: new Abstract: Multimodal Sentiment Analysis (MSA) integrates text, audio, and vision to infer human affect, yet real-world multimodal observations are often incomplet

safetyarxiv-cs-ai
5 Aug 2026
Research

Enriched text-guided variational multimodal knowledge distillation network (VMD) for automated diagnosis of plaque vulnerability in 3D carotid artery MRI

DGX agent

arXiv:2509.11924v2 Announce Type: cross Abstract: Multimodal learning has attracted much attention in recent years due to its ability to effectively utilize data features from a variety of different m

researcharxiv-cs-lg
4 Aug 2026
Research

Explainable Multimodal AI for Adaptive Calibration of Archaeological Sensing Workflows

DGX agent

arXiv:2608.00074v1 Announce Type: new Abstract: This paper presents a multimodal machine-learning framework for calibration monitoring, quality assessment, and adaptive acquisition support in archaeol

researcharxiv-cs-cv
4 Aug 2026
Research

TRAM: Enhancing Multimodal Reasoning with Trajectory-Derived Auxiliary Memory

DGX agent

arXiv:2608.01922v1 Announce Type: new Abstract: Multimodal Large Reasoning Models (MLRMs) have achieved strong performance on tasks requiring visual understanding and multi-step inference. However, as

researcharxiv-cs-cl
4 Aug 2026
Local Ai

MMFGU: Multimodal Federated Graph Unlearning

DGX agent

arXiv:2607.28708v1 Announce Type: new Abstract: Multimodal federated graph learning enables clients to collaboratively train graph models over structural, textual, and visual signals without sharing p

local-aiarxiv-cs-lg
3 Aug 2026
Local Ai

Multimodal Reinforcement Learning with Adaptive Verifier for AI Agents

DGX agent

arXiv:2512.03438v3 Announce Type: replace Abstract: Agentic reasoning models trained with multimodal reinforcement learning (MMRL) have become increasingly capable, yet they are almost universally opt

local-aiarxiv-cs-ai
3 Aug 2026
Model Releases

MultivationBench: A Benchmark for Multimodal Sequential Motivation Reasoning

DGX agent

arXiv:2607.26465v1 Announce Type: new Abstract: Multimodal Large Language Models have sparked significant interest due to their potential for social intelligence; however, their ability to perform seq

model-releasesarxiv-cs-ai
31 Jul 2026
Research

Semantic-Aligned Structural Abstraction for Multimodal Sentiment Analysis

DGX agent

arXiv:2607.27790v1 Announce Type: new Abstract: Multimodal Sentiment Analysis (MSA) aims to interpret complex human emotions by integrating natural language with non-verbal modalities. Non-verbal moda

researcharxiv-cs-cl
31 Jul 2026
Research

Multimodal fusion of visual and morphometric features for avian bone classification

DGX agent

arXiv:2607.26743v1 Announce Type: new Abstract: Artificial intelligence has shown considerable potential for archaeological applications, yet its use in zooarchaeology remains limited, particularly fo

researcharxiv-cs-cv
30 Jul 2026
Applications

CHARM: A Multimodal Graph Foundation Model with Hierarchical Context Modeling for Zero-Shot Transfer

DGX agent

arXiv:2607.26023v1 Announce Type: new Abstract: Graph foundation models (GFMs) have emerged as a promising paradigm for transferring knowledge across graph domains and tasks. Real-world graphs associa

applicationsarxiv-cs-ai
29 Jul 2026
Tutorials

Offline-Online Curriculum RL for Multimodal Reasoning

DGX agent

arXiv:2607.23700v1 Announce Type: new Abstract: Multimodal large language models exhibit capabilities on reasoning tasks, yet often produce flawed intermediate steps while yielding correct final answe

tutorialsarxiv-cs-ai
28 Jul 2026
Local Ai

RP-OPSD: Resolution-Privileged On-Policy Self-Distillation for Multimodal Large Language Models

DGX agent

arXiv:2607.24447v1 Announce Type: new Abstract: On-Policy Self-Distillation (OPSD) uses privileged information available only to the teacher to provide dense token-level supervision on trajectories ge

local-aiarxiv-cs-cv
28 Jul 2026
Research

LunarFM: A Shared Multimodal Representation of the Moon's Surface

DGX agent

arXiv:2607.22408v1 Announce Type: new Abstract: The renewed global focus on lunar exploration, driven by the prospect of in-situ resource utilization and a sustained human presence on the Moon, has cr

researcharxiv-cs-lg
27 Jul 2026
Model Releases

RadSight: Towards Perceptually Reliable Multimodal Radiology Image Understanding

DGX agent

arXiv:2607.22293v1 Announce Type: new Abstract: Medical multimodal large language models (MLLMs) are increasingly expected to perform complex image understanding tasks, yet their reliability is often

model-releasesarxiv-cs-cv
27 Jul 2026
Research

SiGMA: Sign-Guided Merging and Adaptation for Multimodal Continual Instruction Tuning

DGX agent

arXiv:2607.20511v1 Announce Type: new Abstract: Multimodal Continual Instruction Tuning (MCIT) is crucial for adapting Multimodal Large Language Models (MLLMs) to evolving a sequence of downstream tas

researcharxiv-cs-ai
24 Jul 2026
Model Releases

Toward a Vision-Language Foundation Model for Medical Data: Multimodal Dataset and Benchmarks for Vietnamese PET/CT Report Generation

DGX agent

arXiv:2509.24739v4 Announce Type: replace Abstract: Vision-Language Foundation Models (VLMs), trained on large-scale multimodal datasets, have driven significant advances in Artificial Intelligence (A

model-releasesarxiv-cs-cv
23 Jul 2026
Agents

EvoGraph-R1: Self-Evolving Multimodal Knowledge Hypergraphs for Agentic Retrieval

DGX agent

arXiv:2607.12764v1 Announce Type: new Abstract: Retrieval-augmented generation (RAG) has emerged as a critical paradigm for grounding Multimodal Large Language Models (MLLMs) in external knowledge. Re

agentsarxiv-cs-cv
15 Jul 2026
Safety

Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks

DGX agent

arXiv:2607.07907v1 Announce Type: cross Abstract: With the growing adoption of VLMs, DMs, LLMs, and AFMs, these multimodal foundation models can inadvertently encode sensitive, copyrighted, biased, or

safetyarxiv-cs-ai
10 Jul 2026
Research

Attending to Multimodal Generation One Token at a Time

DGX agent

arXiv:2607.03738v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) generate responses autoregressively, integrating visual and linguistic information in an evolving context. Pr

researcharxiv-cs-ai
7 Jul 2026
Model Releases

Responsibility Distribution Estimation in Ego-View Accident Videos with Multimodal Large Language Models

DGX agent

arXiv:2607.03591v1 Announce Type: cross Abstract: Recent studies on multimodal traffic accident understanding have mainly relied on infrastructure-camera footage, satellite imagery, or structured cras

model-releasesarxiv-cs-ai
7 Jul 2026
Research

Hidden Forgetting in Continual Multimodal Learning: When Accuracy Survives but Grounding Fails

DGX agent

arXiv:2607.02020v1 Announce Type: new Abstract: Multimodal large language models must continually adapt to evolving tasks and domains, yet standard continual learning metrics mainly measure whether ol

researcharxiv-cs-ai
3 Jul 2026
Local Ai

Multimodal Knowledge Edit-Scoped Generalization for Online Recursive MLLM Editing

DGX agent

arXiv:2607.01978v1 Announce Type: new Abstract: Online multimodal knowledge editing requires injecting a continual stream of visual-textual corrections into multimodal large language models (MLLMs) wi

local-aiarxiv-cs-ai
3 Jul 2026
Safety

Harnessing Textual Refusal Directions for Multimodal Safety

DGX agent

arXiv:2606.31876v1 Announce Type: new Abstract: To improve safety in Large Language Models (LLMs) we can either perform post-training alignment or exploit refusal directions in the activation space. B

safetyarxiv-cs-ai
1 Jul 2026
Applications

AMR: Adaptive Modality Routing for Multimodal Polyglot Speaker Identification

DGX agent

arXiv:2606.29335v1 Announce Type: cross Abstract: Multimodal speaker identification systems face two key challenges in real-world deployment: missing modalities and language mismatch between training

applicationsarxiv-cs-ai
30 Jun 2026
Model Releases

Multimodal Graph RAG for Long-range Visually Rich Document Understanding

DGX agent

arXiv:2606.28780v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) are widely applied to visual document understanding. However, comprehending long documents remains an issue b

model-releasesarxiv-cs-cv
30 Jun 2026
Agents

ReasonRec: A Reasoning-Augmented Multimodal Agent for Unified Recommendation

DGX agent

arXiv:2606.28357v1 Announce Type: cross Abstract: Recent advances in multimodal recommenders excel at feature fusion but remain opaque and inefficient decision-makers, lacking explicit reasoning and s

agentsarxiv-cs-ai
30 Jun 2026
Applications

Evidential Fusion Network for Multimodal Survival Prediction under Missing Modalities

DGX agent

arXiv:2606.20757v1 Announce Type: new Abstract: Recent multimodal survival prediction models have demonstrated strong predictive performance by leveraging complementary information across modalities.

applicationsarxiv-cs-lg
23 Jun 2026
Tutorials

Look Light, Think Heavy: What Multimodal Chain-of-Thought Reasoning Can and Cannot Do

DGX agent

arXiv:2606.22565v1 Announce Type: cross Abstract: Chain-of-Thought (CoT) has become a standard method for improving reasoning capabilities in large language models (LLMs) by eliciting step-by-step thi

tutorialsarxiv-cs-cv
23 Jun 2026
Model Releases

LUQ: Layerwise Ultra-Low Bit Quantization for Multimodal Large Language Models

DGX agent

arXiv:2509.23729v3 Announce Type: replace Abstract: Large Language Models (LLMs) with multimodal capabilities have revolutionized vision-language tasks, but their deployment often requires huge memory

model-releasesarxiv-cs-cv
23 Jun 2026
Research

Frozen Multimodal Embeddings for Personality and Cognitive Ability Assessment in Asynchronous Video Interviews

DGX agent

arXiv:2606.11930v1 Announce Type: cross Abstract: Predicting psychological traits from asynchronous video interviews (AVIs) is a challenging multimodal learning problem because labeled datasets are li

researcharxiv-cs-ai
11 Jun 2026
Applications

MLaGA: Multimodal Large Language and Graph Assistant

DGX agent

arXiv:2506.02568v2 Announce Type: replace Abstract: Large Language Models (LLMs) have demonstrated substantial efficacy in advancing graph-structured data analysis. Prevailing LLM-based graph methods

applicationsarxiv-cs-ai
11 Jun 2026
← Previous
1…1011121314…197
Next →