AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,119 results
Local Ai

🚀 Introducing MiniCPM-V 4.7, our new open-source MLLM series! Advancing the Performance–Efficiency Pareto Frontier. It brings strong multim…

DGX agent

🚀 Introducing MiniCPM-V 4.7, our new open-source MLLM series! Advancing the Performance–Efficiency Pareto Frontier. It brings strong multimodal capabilities to iOS and Android devices with extreme eff

local-aiclem-delangue--x
12 Oct 2026
Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Model Releases

Is In-Domain Training Enough for Fine-Grained Industrial Anomaly Understanding?

DGX agent

arXiv:2610.12310v1 Announce Type: new Abstract: A single multimodal large language model (MLLM) struggles to excel simultaneously at detection, localization, description, and reasoning in multimodal i

model-releasesarxiv-cs-cv
9 Oct 2026
Hardware

VisionWeave: Weaving Elastic Visual Representations as a Native Capability of MLLMs

DGX agent

arXiv:2610.07987v1 Announce Type: cross Abstract: Multimodal large language models have become the dominant paradigm for visual understanding, but incur substantial costs by encoding inputs into dense

hardwarearxiv-cs-ai
7 Oct 2026
Safety

Visual-Invariance-Augmented Feature Optimal Alignment for Transferable Adversarial Attacks against Closed-Source MLLMs

DGX agent

arXiv:2610.06977v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) remain vulnerable to transferable adversarial examples, especially in black-box settings where only open-sour

safetyarxiv-cs-ai
7 Oct 2026
Model Releases

Do More Modalities Always Help? A Geometric Perspective on Missing-Modality Robustness

DGX agent

arXiv:2610.04792v1 Announce Type: cross Abstract: Missing modality remains a longstanding challenge in multimodal learning. Existing methods typically address this issue through modality recovery or a

model-releasesarxiv-cs-cv
6 Oct 2026
Model Releases

Fitting Vision Adapters at Frontier Scales

DGX agent

arXiv:2610.05897v1 Announce Type: new Abstract: Training a small projector between a frozen vision encoder and language model is an established approach to multimodal learning. As the parameter count

model-releasesarxiv-cs-cv
6 Oct 2026
Model Releases

UltraDub: Towards Authentic Dubbing by Unifying Visually-Steered Flow Learning and Trajectory Guidance

DGX agent

arXiv:2610.05932v1 Announce Type: new Abstract: Visual voice cloning requires intelligible, speaker-consistent speech synchronized with visible articulation. However, sequential multimodal conditionin

model-releasesarxiv-cs-cv
6 Oct 2026
Safety

Architecture-Dependent Fusion Pathways in MLLMs

DGX agent

arXiv:2610.03289v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) achieve strong performance across vision-language tasks, yet the internal mechanisms by which visual and textua

safetyarxiv-cs-lg
5 Oct 2026
Syntheses

Wiki Lint Report — 2026-10-04

DGX agent

Automated lint: 19 errors, 64915 warnings, 3 info

linthealth-checkautomated
4 Oct 2026
Model Releases

GPEC: Efficient Pre-LLM Gaussian Process Embedding Correction for Cardiac Video Caption Generation

DGX agent

arXiv:2610.00196v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have shown strong potential for video understanding and caption generation, but their performance may decline i

model-releasesarxiv-cs-cv
2 Oct 2026
Model Releases

VISTA: A Visual Harness for Reasoning in an Interactive World

DGX agent

arXiv:2610.02200v1 Announce Type: new Abstract: We show that multimodal models possess strong reasoning abilities and that an appropriate harness can unlock their potential to solve tasks across diver

model-releasesarxiv-cs-ai
2 Oct 2026
Model Releases

ReFigBench: Benchmarking Scientific Figure Reconstruction as Editable PowerPoint Artifacts

DGX agent

arXiv:2609.18844v1 Announce Type: new Abstract: Multimodal coding agents are expected to turn visual inputs into usable artifacts, and they act through a harness, the layer of tools, context managemen

model-releasesarxiv-cs-cl
17 Sept 2026
Safety

FLAT: Resampling Image and Text into 1D Flexible-Length Aligned Transmodal Tokens for Retrieval and Generation

DGX agent

arXiv:2609.16591v1 Announce Type: new Abstract: Traditional multimodal representation learning and generation are two stages: a contrastive or self-supervised visual encoder is trained first, followed

safetyarxiv-cs-cv
16 Sept 2026
Safety

OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learning

DGX agent

arXiv:2609.16057v1 Announce Type: cross Abstract: Unified multimodal large language models (MLLMs) and multi-agent systems have advanced visual generation. However, three limitations remain. (1) Exist

safetyarxiv-cs-ai
16 Sept 2026
Safety

GraMRAG: Orchestrating Multi-Agent Multi-Step Reasoning via Graph Memory with Reinforcement Learning

DGX agent

arXiv:2609.14066v1 Announce Type: cross Abstract: Although existing multi-agent Retrieval-Augmented Generation (RAG) systems have demonstrated promise on complex multimodal reasoning tasks, they remai

safetyarxiv-cs-ai
15 Sept 2026
Model Releases

Occlusal Geometry in Closed Form for Orthodontic Report Generation

DGX agent

arXiv:2609.13237v1 Announce Type: cross Abstract: Orthodontic report generation from intraoral data is normally cast as multimodal captioning, yet the released Bite2Text scan pairs are supplied alread

model-releasesarxiv-cs-cl
15 Sept 2026
Research

ViSAR: Training-Free Adaptive-k Retrieval for Visual Document Question Answering

DGX agent

arXiv:2609.02486v1 Announce Type: cross Abstract: Document Visual Question Answering (DocVQA) often leverages Retrieval-Augmented Generation (RAG), where late-interaction encoders are commonly used to

researcharxiv-cs-ai
3 Sept 2026
Model Releases

Fine-Grained Multi Image Object Hallucination Benchmark

DGX agent

arXiv:2608.30653v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) are increasingly deployed in multi-image scenarios requiring complex reasoning across visual contexts. Howeve

model-releasesarxiv-cs-ai
1 Sept 2026
Model Releases

OmniACBench: A Benchmark for Evaluating Context-Grounded Acoustic Control in Omni-Modal Models

DGX agent

arXiv:2603.23938v2 Announce Type: replace Abstract: Most testbeds for omni-modal models assess multimodal understanding via textual outputs, leaving it unclear whether these models can properly speak

model-releasesarxiv-cs-cl
1 Sept 2026
Model Releases

Omni-Interactive Universal Embedder

DGX agent

arXiv:2608.27044v1 Announce Type: new Abstract: Multimodal representation learning has been shifting from traditional two-tower architectures to large language model (LLM)-based embedders due to their

model-releasesarxiv-cs-ai
28 Aug 2026
Research

Video-FLAIR: Not Whether to Reason, But How

DGX agent

arXiv:2608.26495v1 Announce Type: new Abstract: Multimodal queries can require different types of reasoning. Some can be answered via perceptual reasoning, extracting information directly from the vis

researcharxiv-cs-cv
28 Aug 2026
Research

Giraffe: A Mapping Architecture from Hidden Text Representations to Visual Embeddings for Efficient Graphic Design

DGX agent

arXiv:2608.23970v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have made significant progress in understanding and interpreting mul- timedia content. However, their ability t

researcharxiv-cs-ai
26 Aug 2026
Safety

MedMix: Specialization-Consistent Federated Sparse MoEs under Modality Heterogeneity

DGX agent

arXiv:2608.13911v1 Announce Type: new Abstract: Federated multimodal medical AI faces modality heterogeneity at both the client and sample levels: clients may systematically lack access to specific mo

safetyarxiv-cs-lg
17 Aug 2026
Safety

Intern-S2-Preview: Scientific Agentic Foundation Model

DGX agent

arXiv:2608.13505v1 Announce Type: cross Abstract: Scientific discovery increasingly requires AI systems that can reason over scientific evidence of heterogeneous modalities, interact with scientific t

safetyarxiv-cs-cl
14 Aug 2026
Hardware

Ex-Omni-2D: Expressive Omni-Modal Dialogue Models with Native Visual Presence

DGX agent

arXiv:2608.10720v1 Announce Type: new Abstract: Omni-modal dialogue models can understand multimodal inputs and synthesize spoken replies, yet their responses remain visually disembodied. We introduce

hardwarearxiv-cs-ai
12 Aug 2026
Local Ai

LiquidAI/LFM2.5-VL-3B · Hugging Face

DGX agent

LFM2.5-VL-3B is a multimodal variant of LFM2.5, a family of hybrid models designed for on-device deployment. It builds on LFM2-VL-3B with further mid- and post-training. LFM2.5-VL-3B can process both

local-air-localllama
12 Aug 2026
Safety

Hierarchical Pre-Training of Vision Encoders with Large Language Model

DGX agent

arXiv:2604.00086v2 Announce Type: replace-cross Abstract: The field of computer vision has experienced significant advancements through scalable vision encoders and multimodal pre-training frameworks.

safetyarxiv-cs-cl
4 Aug 2026
Model Releases

SoM-1K: A Thousand-Problem Benchmark Dataset for Strength of Materials

DGX agent

arXiv:2509.21079v2 Announce Type: replace Abstract: Foundation models have shown remarkable capabilities in various domains, but their performance on complex, multimodal engineering problems remains l

model-releasesarxiv-cs-cl
4 Aug 2026
Research

ASCD: Attention-Steerable Contrastive Decoding for Reducing Hallucination in MLLM

DGX agent

arXiv:2506.14766v3 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) frequently hallucinate by over-committing to spurious visual cues. Prior remedies-Visual and Instruct

researcharxiv-cs-cl
30 Jul 2026
Agents

Metis: Memory Foundation Model

DGX agent

arXiv:2607.26760v1 Announce Type: new Abstract: Recent advances in AI agents have increasingly internalized native capabilities into their underlying foundation models, giving rise to multimodal found

agentsarxiv-cs-cl
30 Jul 2026
Model Releases

Understanding Knowledge Transfer Mechanism in Heterogeneous MLLM Fusion: A Simple Linear Approach

DGX agent

arXiv:2607.26608v1 Announce Type: new Abstract: Training-free fusion of heterogeneous multimodal large language models (MLLMs) provides a direct route for cross-scale capability transfer, yet improvem

model-releasesarxiv-cs-cv
30 Jul 2026
Syntheses

Wiki Lint Report — 2026-07-19

DGX agent

Automated lint: 20 errors, 8743 warnings, 3 info

linthealth-checkautomated
19 Jul 2026
Model Releases

Continual Learning with Elastic Regularization and Synthetic Replay for Federated MLLM Fine-Tuning

DGX agent

arXiv:2607.12112v1 Announce Type: cross Abstract: Federated fine-tuning of Multimodal Large Language Models (MLLMs) across distributed networks enables privacy-sensitive adaptation to evolving data st

model-releasesarxiv-cs-ai
15 Jul 2026
Model Releases

Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligence

DGX agent

arXiv:2607.12477v1 Announce Type: new Abstract: Autonomous UAV systems increasingly rely on multimodal large language models (MLLMs) to operate in complex real-world environments. Such embodied scenar

model-releasesarxiv-cs-cv
15 Jul 2026
Local Ai

OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computing

DGX agent

arXiv:2606.15920v2 Announce Type: replace Abstract: Reinforcement learning for multimodal large language models (MLLMs) is often hindered by severe reward sparsity in complex reasoning tasks. This cha

local-aiarxiv-cs-cv
10 Jul 2026
Safety

HunyuanImage 3.0 Technical Report

DGX agent

arXiv:2509.23951v3 Announce Type: replace Abstract: We present HunyuanImage 3.0, a native multimodal model that unifies multimodal understanding and generation within an autoregressive framework, with

safetyarxiv-cs-cv
29 Jun 2026
Tutorials

Generating a Paracosm for Training-Free Zero-Shot Composed Image Retrieval

DGX agent

arXiv:2602.00813v5 Announce Type: replace Abstract: Composed Image Retrieval (CIR) is the task of retrieving a target image from a database using a multimodal query, which consists of a reference imag

tutorialsarxiv-cs-cv
26 Jun 2026
Research

TAVR-VLM: Risk-Conditioned Causal Grounding for Hallucination-Resistant Report Generation

DGX agent

arXiv:2606.26874v1 Announce Type: new Abstract: Transcatheter Aortic Valve Replacement (TAVR) planning requires meticulous multimodal reasoning. However, adapting Multimodal Large Language Models (MLL

researcharxiv-cs-ai
26 Jun 2026
Safety

Decoupling Semantics and Logic: A Training-Free Coarse-to-Fine Pipeline for Video Retrieval-Augmented Generation

DGX agent

arXiv:2606.07924v1 Announce Type: cross Abstract: This paper presents our system description for the 2nd Workshop on Multimodal Augmented Generation via MultimodAl Retrieval (MAGMaR). Addressing the c

safetyarxiv-cs-ai
9 Jun 2026
Safety

Watch, Remember, Reason: Human-View Video Understanding with MLLMs

DGX agent

arXiv:2606.07433v1 Announce Type: cross Abstract: Video understanding is being rapidly transformed by multimodal large language models (MLLMs), as research moves from short clips to long, multimodal,

safetyarxiv-cs-ai
8 Jun 2026
Research

UniCanvas: A Diffusion-base Unified Model for Text-in-Image Joint Generation

DGX agent

arXiv:2606.04264v1 Announce Type: new Abstract: Recent years have seen remarkable progress in unified vision-language models handling both multimodal understanding and generation within a single archi

researcharxiv-cs-cv
4 Jun 2026
Tutorials

Checking Fact with Better Retrieval: Dynamic Contrastive Learning for Evidence Retrieval

DGX agent

arXiv:2605.27449v1 Announce Type: cross Abstract: In the field of multimodal fact checking, the accuracy of retrieving evidence from different modalities has a significant impact on the downstream cla

tutorialsarxiv-cs-ai
28 May 2026
Safety

IVR-R1: Refining Trajectories through Iterative Visual-Grounded Reasoning in Reinforcement Learning

DGX agent

arXiv:2605.23997v1 Announce Type: cross Abstract: Multimodal large language models via reinforcement learning (RL) have demonstrated remarkable capabilities in complex visual reasoning tasks, yet they

safetyarxiv-cs-ai
26 May 2026
Model Releases

CMKL: Modality-Aware Continual Learning for Evolving Biomedical Knowledge Graphs

DGX agent

arXiv:2605.10510v1 Announce Type: cross Abstract: Biomedical knowledge graphs are increasingly large, dynamic, and multimodal, driven by rapid advances in biotechnology such as high-throughput sequenc

model-releasesarxiv-cs-ai
12 May 2026
Model Releases

Phoenix-VL 1.5 Medium Technical Report

DGX agent

arXiv:2605.10391v1 Announce Type: cross Abstract: We introduce Phoenix-VL 1.5 Medium, a 123B-parameter natively multimodal and multilingual foundation model, adapted to regional languages and the Sing

model-releasesarxiv-cs-ai
12 May 2026
Model Releases

DRIFT: Transferring Reasoning Priors for Efficient MLLM Fine-Tuning

DGX agent

arXiv:2510.15050v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) have made rapid progress, yet their reasoning ability often lags behind strong text-only LLMs. Bridging thi

model-releasesarxiv-cs-cv
28 Apr 2026
Research

MemeScouts@LT-EDI 2026: Asking the Right Questions -- Prompted Weak Supervision for Meme Hate Speech Detection

DGX agent

arXiv:2604.24179v1 Announce Type: cross Abstract: Detecting hate speech in memes is challenging due to their multimodal nature and subtle, culturally grounded cues such as sarcasm and context. While r

researcharxiv-cs-ai
28 Apr 2026
Safety

OS-SPEAR: A Toolkit for the Safety, Performance,Efficiency, and Robustness Analysis of OS Agents

DGX agent

arXiv:2604.24348v1 Announce Type: new Abstract: The evolution of Multimodal Large Language Models (MLLMs) has shifted the focus from text generation to active behavioral execution, particularly via OS

safetyarxiv-cs-cl
28 Apr 2026
← Previous
1…6263646566…211
Next →