AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,119 results
Research

Yeti: A compact protein structure tokenizer for reconstruction and multi-modal generation

DGX agent

arXiv:2605.09981v1 Announce Type: cross Abstract: Multimodal models that jointly reason over protein sequences, structures, and function annotations within a unified representation hold immense potent

researcharxiv-cs-ai
12 May 2026
Safety

Anisotropic Modality Align

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
DGX agent

arXiv:2605.07825v1 Announce Type: cross Abstract: Training multimodal large language models has long been limited by the scarcity of high-quality paired multimodal data. Recent studies show that the s

safetyarxiv-cs-cv
11 May 2026
Safety

Discovering Failure Modes in Vision-Language Models using RL

DGX agent

arXiv:2604.04733v2 Announce Type: replace-cross Abstract: Vision-language Models (VLMs), despite achieving strong performance on multimodal benchmarks, often misinterpret straightforward visual concep

safetyarxiv-cs-ai
28 Apr 2026
Safety

CGC: Compositional Grounded Contrast for Fine-Grained Multi-Image Understanding

DGX agent

arXiv:2604.22498v1 Announce Type: cross Abstract: Although Multimodal Large Language Models (MLLMs) have advanced rapidly, they still face notable challenges in fine-grained multi-image understanding,

safetyarxiv-cs-ai
27 Apr 2026
Model Releases

LLaDA2.0-Uni Released

DGX agent

LLaDA2.0-Uni is a unified diffusion large language model (dLLM) based on Mixture-of-Experts architecture that seamlessly integrates multimodal understanding and generation. The model supports text-to-

model-releasesr-stablediffusion
24 Apr 2026
Model Releases

X-PCR: A Benchmark for Cross-modality Progressive Clinical Reasoning in Ophthalmic Diagnosis

DGX agent

arXiv:2604.20350v1 Announce Type: new Abstract: Despite significant progress in Multi-modal Large Language Models (MLLMs), their clinical reasoning capacity for multi-modal diagnosis remains largely u

model-releasesarxiv-cs-cv
23 Apr 2026
Safety

Robust Multispectral Semantic Segmentation under Missing or Full Modalities via Structured Latent Projection

DGX agent

arXiv:2604.15856v1 Announce Type: cross Abstract: Multimodal remote sensing data provide complementary information for semantic segmentation, but in real-world deployments, some modalities may be unav

safetyarxiv-cs-ai
20 Apr 2026
Safety

CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoning

DGX agent

arXiv:2602.00181v3 Announce Type: replace-cross Abstract: Understanding camera dynamics is a fundamental pillar of video spatial intelligence. However, existing multimodal models predominantly treat t

safetyarxiv-cs-ai
15 Apr 2026
Applications

Head-wise Modality Specialization within MLLMs for Robust Fake News Detection under Missing Modality

DGX agent

arXiv:2604.09711v1 Announce Type: cross Abstract: Multimodal fake news detection (MFND) aims to verify news credibility by jointly exploiting textual and visual evidence. However, real-world news diss

applicationsarxiv-cs-cl
14 Apr 2026
Local Ai

ActFER: Agentic Facial Expression Recognition via Active Tool-Augmented Visual Reasoning

DGX agent

arXiv:2604.08990v1 Announce Type: new Abstract: Recent advances in Multimodal Large Language Models (MLLMs) have created new opportunities for facial expression recognition (FER), moving it beyond pur

local-aiarxiv-cs-cv
13 Apr 2026
Safety

Decompose, Look, and Reason: Reinforced Latent Reasoning for VLMs

DGX agent

arXiv:2604.07518v1 Announce Type: new Abstract: Vision-Language Models often struggle with complex visual reasoning due to the visual information loss in textual CoT. Existing methods either add the c

safetyarxiv-cs-cl
10 Apr 2026
Model Releases

SUPERGLASSES: Benchmarking Vision Language Models as Intelligent Agents for AI Smart Glasses

DGX agent

arXiv:2602.22683v2 Announce Type: replace Abstract: The rapid advancement of AI-powered smart glasses-one of the hottest wearable devices-has unlocked new frontiers for multimodal interaction, with Vi

model-releasesarxiv-cs-cv
10 Apr 2026
Model Releases

VAREX: A Benchmark for Multi-Modal Structured Extraction from Documents

DGX agent

arXiv:2603.15118v2 Announce Type: replace Abstract: We introduce VAREX (VARied-schema EXtraction), a benchmark for evaluating multimodal foundation models on structured data extraction from government

model-releasesarxiv-cs-cv
10 Apr 2026
Safety

Neos: Learning to Interleave Search and Visual Reasoning

DGX agent

arXiv:2610.17043v1 Announce Type: new Abstract: Recent multimodal deep search agents have advanced tool use and visual content retrieval, yet they still struggle to convert intermediate visual evidenc

safetyarxiv-cs-ai
15 Oct 2026
Research

MedEvo: Medical Reasoning Evolution through Knowledge Navigation

DGX agent

arXiv:2610.17690v1 Announce Type: cross Abstract: Medical multimodal reasoning models are typically trained on teacher-generated rationales, discarding the valid reasoning in students' own failed traj

researcharxiv-cs-cv
14 Oct 2026
Research

RSAJEV: Training-Free Abstaining Prototype Memory for Eliminating Silent Hallucination in JEV-Based Remote Sensing Classification

DGX agent

arXiv:2610.15742v1 Announce Type: new Abstract: Scene classification of remote sensing imagery with multimodal large language models (MLLMs) is formulated as a single-forward-pass decision problem: ca

researcharxiv-cs-cv
14 Oct 2026
Safety

Uni-RS: A Spatially Faithful Unified Understanding and Generation Model for Remote Sensing

DGX agent

arXiv:2601.17673v2 Announce Type: replace Abstract: Unified remote sensing multimodal models exhibit a pronounced spatial reversal curse: Although they can accurately recognize and describe object loc

safetyarxiv-cs-cv
14 Oct 2026
Research

Behavior Pack Optimization for Video MLLM Post-Training

DGX agent

arXiv:2610.03141v1 Announce Type: new Abstract: Video multimodal large language models (MLLMs) keep climbing video question answering benchmarks, yet shuffling the frames, masking the segment that sup

researcharxiv-cs-cv
5 Oct 2026
Syntheses

Synthesis: Arxiv-Cs-Cv

DGX agent

Auto-generated synthesis of 18054 entries about arxiv-cs-cv

synthesisarxiv-cs-cvauto-generated
4 Oct 2026
Research

PixelUMM: Encoder-Free Unified Image and Video Understanding and Generation

DGX agent

arXiv:2609.38597v1 Announce Type: new Abstract: Unified Multimodal Models (UMMs) often rely on separate visual representations for understanding and generation, increasing visual context length and co

researcharxiv-cs-cv
1 Oct 2026
Syntheses

Wiki Lint Report — 2026-09-20

DGX agent

Automated lint: 14 errors, 54840 warnings, 3 info

linthealth-checkautomated
20 Sept 2026
Syntheses

Wiki Lint Report — 2026-09-13

DGX agent

Automated lint: 12 errors, 54839 warnings, 3 info

linthealth-checkautomated
13 Sept 2026
Research

Generalist Open-World Temporal Perception

DGX agent

arXiv:2609.06823v1 Announce Type: new Abstract: The next generation of artificial intelligence systems will likely be natively temporal and multimodal in both inputs and outputs: able to converse, per

researcharxiv-cs-cv
9 Sept 2026
Syntheses

Wiki Lint Report — 2026-09-09

DGX agent

Automated lint: 12 errors, 53990 warnings, 3 info

linthealth-checkautomated
9 Sept 2026
Research

Towards Vision-Language Geo-Foundation Model: A Survey

DGX agent

arXiv:2406.09385v3 Announce Type: replace Abstract: Vision-Language Foundation Models (VLFMs) have made remarkable progress on various multimodal tasks, such as image captioning, image-text retrieval,

researcharxiv-cs-cv
9 Sept 2026
Model Releases

Evaluating Perspectival Biases in Cross-Modal Retrieval

DGX agent

arXiv:2510.26861v4 Announce Type: replace-cross Abstract: Multimodal retrieval systems are expected to operate in a semantic space, agnostic to the language or cultural origin of the query. In practic

model-releasesarxiv-cs-cl
1 Sept 2026
Applications

FedCoRe: Target-Adaptive Completion for Missing Modalities in Healthcare Federated Learning

DGX agent

arXiv:2608.18311v1 Announce Type: cross Abstract: Federated multimodal models often assume every site has every modality, although hospitals differ in access to EHRs, chest radiographs, and ECGs. We s

applicationsarxiv-cs-ai
20 Aug 2026
Tutorials

Disentangled Shared Representations Improve Morpho-Transcriptomic Integration

DGX agent

arXiv:2608.14355v1 Announce Type: new Abstract: Spatial transcriptomics (ST) enables the simultaneous profiling of gene expression and tissue morphology, creating an opportunity to learn multimodal re

tutorialsarxiv-cs-ai
17 Aug 2026
Model Releases

SAFE-MEME: Structured Reasoning Framework for Robust Hate Speech Detection in Memes

DGX agent

arXiv:2412.20541v2 Announce Type: replace Abstract: Memes act as cryptic tools for sharing sensitive ideas, often requiring contextual knowledge to interpret them correctly. It makes multimodal meme m

model-releasesarxiv-cs-cl
28 Jul 2026
Model Releases

GameDevBench: Evaluating Agentic Capabilities Through Game Development

DGX agent

arXiv:2602.11103v2 Announce Type: replace Abstract: Despite rapid progress on coding agents, progress on their multimodal counterparts has lagged behind. A key challenge is the scarcity of evaluation

model-releasesarxiv-cs-ai
2 Jul 2026
Model Releases

ChronoPhyBench: Do MLLMs Truly Understand the World or Merely Exploit Language Priors?

DGX agent

arXiv:2606.07962v1 Announce Type: new Abstract: Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated remarkable proficiency in open-world reasoning and understanding. Howe

model-releasesarxiv-cs-cv
9 Jun 2026
Safety

Conditional Imputation for Within-Modality Missingness in Multi-Modal Federated Learning

DGX agent

arXiv:2604.23112v1 Announce Type: new Abstract: Multimodal Federated Learning (MMFL) enables privacy-preserving collaborative training, but real-world clinical applications often suffer from within-mo

safetyarxiv-cs-lg
28 Apr 2026
Agents

Visual Reasoning through Tool-supervised Reinforcement Learning

DGX agent

arXiv:2604.19945v1 Announce Type: new Abstract: In this paper, we investigate the problem of how to effectively master tool-use to solve complex visual reasoning tasks for Multimodal Large Language Mo

agentsarxiv-cs-cv
23 Apr 2026
Applications

Handling and Interpreting Missing Modalities in Patient Clinical Trajectories via Autoregressive Sequence Modeling

DGX agent

arXiv:2604.18753v1 Announce Type: cross Abstract: An active challenge in developing multimodal machine learning (ML) models for healthcare is handling missing modalities during training and deployment

applicationsarxiv-cs-ai
22 Apr 2026
Model Releases

The future of data lakehouse: Open and interoperable for the agentic era

DGX agent

Traditional lakehouses were engineered for the era of reporting, not the high-velocity, multimodal demands of AI agents. To bridge this gap, architecture must evolve into an AI-native foundation — one

model-releasesgoogle-cloud-ai
22 Apr 2026
Safety

EVE: Verifiable Self-Evolution of MLLMs via Executable Visual Transformations

DGX agent

arXiv:2604.18320v1 Announce Type: new Abstract: Self-evolution of multimodal large language models (MLLMs) remains a critical challenge: pseudo-label-based methods suffer from progressive quality degr

safetyarxiv-cs-cv
21 Apr 2026
Research

LLaVA-Octopus: Unlocking Instruction-Driven Adaptive Projector Fusion for Video Understanding

DGX agent

arXiv:2501.05067v3 Announce Type: replace Abstract: In this paper, we introduce LLaVA-Octopus, a novel video multimodal large language model. LLaVA-Octopus adaptively weights features from different v

researcharxiv-cs-cv
21 Apr 2026
Safety

Switch-KD: Visual-Switch Knowledge Distillation for Vision-Language Models

DGX agent

arXiv:2604.14629v1 Announce Type: new Abstract: Vision-Language Models (VLMs) have shown remarkable capabilities in joint vision-language understanding, but their large scale poses significant challen

safetyarxiv-cs-cv
17 Apr 2026
Model Releases

MedRCube: A Multidimensional Framework for Fine-Grained and In-Depth Evaluation of MLLMs in Medical Imaging

DGX agent

arXiv:2604.13756v1 Announce Type: new Abstract: The potential of Multimodal Large Language Models (MLLMs) in domain of medical imaging raise the demands of systematic and rigorous evaluation framework

model-releasesarxiv-cs-cl
16 Apr 2026
Research

OmniTrace: A Unified Framework for Generation-Time Attribution in Omni-Modal LLMs

DGX agent

arXiv:2604.13073v1 Announce Type: new Abstract: Modern multimodal large language models (MLLMs) generate fluent responses from interleaved text, image, audio, and video inputs. However, identifying wh

researcharxiv-cs-cl
16 Apr 2026
Safety

COXNet: Cross-Layer Fusion with Adaptive Alignment and Scale Integration for RGBT Tiny Object Detection

DGX agent

arXiv:2508.09533v2 Announce Type: replace-cross Abstract: Detecting tiny objects in multimodal Red-Green-Blue-Thermal (RGBT) imagery is a critical challenge in computer vision, particularly in surveil

safetyarxiv-cs-ai
14 Apr 2026
Safety

MM-LIMA: Less Is More for Alignment in Multi-Modal Datasets

DGX agent

arXiv:2308.12067v3 Announce Type: replace-cross Abstract: Multimodal large language models are typically trained in two stages: first pre-training on image-text pairs, and then fine-tuning using super

safetyarxiv-cs-ai
14 Apr 2026
Safety

See Fair, Speak Truth: Equitable Attention Improves Grounding and Reduces Hallucination in Vision-Language Alignment

DGX agent

arXiv:2604.09749v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) frequently hallucinate objects that are absent from the visual input, often because attention during decoding i

safetyarxiv-cs-cv
14 Apr 2026
Research

Test-time Scaling over Perception: Resolving the Grounding Paradox in Thinking with Images

DGX agent

arXiv:2604.11025v1 Announce Type: new Abstract: Recent multimodal large language models (MLLMs) have begun to support Thinking with Images by invoking visual tools such as zooming and cropping during

researcharxiv-cs-cv
14 Apr 2026
Tutorials

M-IDoL: Information Decomposition for Modality-Specific and Diverse Representation Learning in Medical Foundation Model

DGX agent

arXiv:2604.08936v1 Announce Type: new Abstract: Medical foundation models (MFMs) aim to learn universal representations from multimodal medical images that can generalize effectively to diverse downst

tutorialsarxiv-cs-cv
13 Apr 2026
Model Releases

SiMing-Bench: Evaluating Procedural Correctness from Continuous Interactions in Clinical Skill Videos

DGX agent

arXiv:2604.09037v1 Announce Type: cross Abstract: Current video benchmarks for multimodal large language models (MLLMs) focus on event recognition, temporal ordering, and long-context recall, but over

model-releasesarxiv-cs-cl
13 Apr 2026
Tutorials

Understanding Task Transfer in Vision-Language Models

DGX agent

arXiv:2511.18787v2 Announce Type: replace Abstract: Vision-Language Models (VLMs) perform well on multimodal benchmarks but lag behind humans and specialized models on visual perception tasks like dep

tutorialsarxiv-cs-cv
10 Apr 2026
Model Releases

RSIgen: Reciprocal Self-Improvement for Agentic Visual Generation

DGX agent

arXiv:2610.18688v1 Announce Type: new Abstract: Agentic visual generation produces experience that can improve the native understanding (agent) and generation roles of a unified multimodal backbone, b

model-releasesarxiv-cs-cv
14 Oct 2026
← Previous
1…6162636465…211
Next →