AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,117 results
Safety

LoMo: Local Modality Substitution for Deeper Vision-Language Fusion

DGX agent

arXiv:2605.30265v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) have achieved substantial progress across a wide range of understanding and reasoning tasks, driven by large-scale image

safetyarxiv-cs-cl
29 May 2026
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Research

SCoOP: Semantic Consistent Opinion Pooling for Uncertainty Quantification in Multiple Vision-Language Model Systems

DGX agent

arXiv:2603.23853v3 Announce Type: replace Abstract: Combining multiple Vision-Language Models (VLMs) can enhance multimodal reasoning and robustness, but aggregating heterogeneous models' outputs ampl

researcharxiv-cs-ai
29 May 2026
Safety

VLA-Trace: Diagnosing Vision-Language-Action Models through Representation and Behavior Tracing

DGX agent

arXiv:2605.30117v1 Announce Type: new Abstract: Understanding how Vision-Language-Action (VLA) models transform multimodal knowledge into embodied control remains an open challenge. We present VLA-Tra

safetyarxiv-cs-ai
29 May 2026
Research

OmniEgo-R^2: A Routed Reasoning Framework for the 1st Cross-Domain EgoCross Challenge at CVPR 2026

DGX agent

arXiv:2605.24481v2 Announce Type: replace Abstract: The 1st Cross-Domain EgoCross Challenge at EgoVis, CVPR 2026 evaluates whether multimodal large language models can reason over egocentric videos ac

researcharxiv-cs-cv
28 May 2026
Safety

DV-SFT: Direct Vision Supervision for Fine-Grained Visual Understanding

DGX agent

arXiv:2605.26656v1 Announce Type: new Abstract: Multimodal large language models are typically trained end-to-end to predict ground-truth answers, yet supervision signals are applied exclusively to te

safetyarxiv-cs-cv
27 May 2026
Model Releases

OCR-Reasoning Benchmark: Unveiling the True Capabilities of MLLMs in Complex Text-Rich Image Reasoning

DGX agent

arXiv:2505.17163v2 Announce Type: replace-cross Abstract: Recent advancements in multimodal slow-thinking systems have demonstrated remarkable performance across various visual reasoning tasks. Howeve

model-releasesarxiv-cs-ai
27 May 2026
Research

Touch-R1: Reinforcing Touch Reasoning in MLLMs

DGX agent

arXiv:2605.27154v1 Announce Type: new Abstract: While rule-based reinforcement learning has recently catalyzed explicit reasoning in multimodal models, tactile reasoning remains largely underexplored.

researcharxiv-cs-cv
27 May 2026
Model Releases

Decision-Making with Lightweight Confidence-Aware Language Model for Autonomous Driving

DGX agent

arXiv:2605.25393v1 Announce Type: new Abstract: Large Language Models (LLMs) and Multimodal LLMs (MLLMs) have demonstrated immense potential in autonomous driving (AD) by offering human-like reasoning

model-releasesarxiv-cs-ro
26 May 2026
Safety

Dynamic Neural Koopman Distillation for Real-Time Robot Control Using Diffusion Models

DGX agent

arXiv:2605.24924v1 Announce Type: new Abstract: Diffusion models excel at generating diverse and multimodal trajectories for robotic planning, yet their iterative denoising process introduces latency

safetyarxiv-cs-ro
26 May 2026
Local Ai

Localization then Neutralization: Gradient-guided Token Suppression against Visual Prompt Injection Attack

DGX agent

arXiv:2605.25194v1 Announce Type: new Abstract: Adversarial images pose a severe security threat to multimodal large language models through prompt injection. Existing defenses largely lack a principl

local-aiarxiv-cs-lg
26 May 2026
Model Releases

StructBreak: Structural Cognitive Overload-Induced Safety Failures in MLLMs

DGX agent

arXiv:2605.25534v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) excel at structural reasoning yet suffer from a sharp logical brittleness in structural consistency. We term th

model-releasesarxiv-cs-ai
26 May 2026
Local Ai

Your Embedding Model is SMARTer Than You Think

DGX agent

arXiv:2605.24938v1 Announce Type: cross Abstract: Multimodal retrieval relies heavily on single-vector retrievers, which compress rich, sequential token sequences into one single global representation

local-aiarxiv-cs-ai
26 May 2026
Model Releases

ETCHR: Editing To Clarify and Harness Reasoning

DGX agent

arXiv:2605.23897v1 Announce Type: cross Abstract: Multimodal Large Language Models have advanced visual reasoning, yet a purely textual chain of thought remains a bottleneck for questions that require

model-releasesarxiv-cs-ai
25 May 2026
Model Releases

Transcoders Trace Visual Grounding and Hallucinations in Vision-Language Models

DGX agent

arXiv:2605.22902v1 Announce Type: cross Abstract: Generative Vision-Language Models (VLMs) perform well on multimodal reasoning, but how visual inputs are transformed to text remains poorly understood

model-releasesarxiv-cs-ai
25 May 2026
Research

Bernini: Latent Semantic Planning for Video Diffusion

DGX agent

arXiv:2605.22344v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) and diffusion models have each reached remarkable maturity: MLLMs excel at reasoning over heterogeneous multimo

researcharxiv-cs-cv
22 May 2026
Model Releases

LongVT: Incentivizing 'Thinking with Long Videos' via Native Tool Calling

DGX agent

arXiv:2511.20785v3 Announce Type: replace Abstract: Large multimodal models (LMMs) have shown great potential for video reasoning with textual Chain-of-Thought. However, they remain vulnerable to hall

model-releasesarxiv-cs-cv
22 May 2026
Research

RISE: Reliable Improvement in Self-Evolving Vision-Language Models

DGX agent

arXiv:2605.20914v1 Announce Type: new Abstract: Vision-language models (VLMs) have achieved strong multimodal reasoning capabilities, but further improving them still relies heavily on large-scale hum

researcharxiv-cs-cv
21 May 2026
Model Releases

TextSculptor: Training and Benchmarking Scene Text Editing

DGX agent

arXiv:2605.21090v1 Announce Type: new Abstract: Recent advances in Multimodal Large Language Models (MLLMs) and diffusion-based generative models have substantially improved prompt-driven image editin

model-releasesarxiv-cs-cv
21 May 2026
Agents

What if Agents Could Imagine? Reinforcing Open-Vocabulary HOI Comprehension through Generation

DGX agent

arXiv:2602.11499v2 Announce Type: replace Abstract: Multimodal Large Language Models have shown promising capabilities in bridging visual and textual reasoning, yet their reasoning capabilities in Ope

agentsarxiv-cs-cv
21 May 2026
Model Releases

EgoBabyVLM: Benchmarking Cross-Modal Learning from Naturalistic Egocentric Video Data

DGX agent

arXiv:2605.19130v1 Announce Type: cross Abstract: Children acquire language grounding with remarkable robustness from limited visuo-linguistic input in ways that surpass today's best large multimodal

model-releasesarxiv-cs-ai
20 May 2026
Model Releases

EgoCoT-Bench: Benchmarking Grounded and Verifiable Operation-Centric Chain of Thought Reasoning for MLLMs

DGX agent

arXiv:2605.19559v1 Announce Type: cross Abstract: The rapid development of Multimodal Large Language Models (MLLMs) has led to growing interest in egocentric video understanding, specifically the abil

model-releasesarxiv-cs-ai
20 May 2026
Research

EnsemHalDet: Robust VLM Hallucination Detection via Ensemble of Internal State Detectors

DGX agent

arXiv:2604.02784v2 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) excel at multimodal tasks, but they remain vulnerable to hallucinations that are factually incorrect or unground

researcharxiv-cs-cl
20 May 2026
Safety

Reasoning Portability: Guiding Continual Learning for MLLMs in the RLVR Era

DGX agent

arXiv:2605.18903v1 Announce Type: cross Abstract: Vision-Language Models in Continual Learning (VLM-CL) aim to continuously adapt to new multimodal tasks while retaining prior knowledge. The emerging

safetyarxiv-cs-cv
20 May 2026
Research

A More Word-like Image Tokenization for MLLMs

DGX agent

arXiv:2605.17954v1 Announce Type: cross Abstract: Modern multimodal large language models (MLLMs) typically keep the language model fixed and train a visual projector that maps the pixels into a seque

researcharxiv-cs-ai
19 May 2026
Model Releases

Can’t wait for Gemini Omni in @NotebookLM cinematic explainer videos 👀

DGX agent

Emad Mostaque expressed anticipation for the integration of Google's Gemini Omni multimodal AI model into NotebookLM's cinematic explainer video generation features. The post suggests potential upcomi

model-releasesemad-mostaque--x
19 May 2026
Tutorials

CAVE: A Structured Credit Assignment Approach for Fragmented Visual Evidence Reasoning

DGX agent

arXiv:2605.16416v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) have achieved strong performance on general multimodal reasoning, yet remain challenged in integrating nonlocal visual i

tutorialsarxiv-cs-ai
19 May 2026
Model Releases

Google’s new Gemini 3.5 Flash is the clear leader on the Intelligence vs Speed Pareto frontier and makes large gains on GDPval-AA (real-worl…

DGX agent

Google’s new Gemini 3.5 Flash is the clear leader on the Intelligence vs Speed Pareto frontier and makes large gains on GDPval-AA (real-world agentic tasks), but is 5x the cost of Gemini 3 Flash @Goog

model-releasesjeremy-howard--x
19 May 2026
Safety

Improving MLLM Training Efficiency via Stage-Aware Sparsity

DGX agent

arXiv:2509.18150v2 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) have demonstrated outstanding performance across a variety of domains. However, training MLLMs is oft

safetyarxiv-cs-ai
19 May 2026
Model Releases

KVCapsule: Efficient Sequential KV Cache Compression for Vision-Language Models with Asymmetric Redundancy

DGX agent

arXiv:2605.16439v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) have emerged as a critical and fast-growing extension of Large Language Models (LLMs) that enable multimodal reasoning t

model-releasesarxiv-cs-ai
19 May 2026
Model Releases

MARS: Technical Report for the CASTLE Challenge at EgoVis 2026

DGX agent

arXiv:2605.18176v1 Announce Type: cross Abstract: This report presents MARS, short for Multimodal Agentic Reasoning with Source selection, our system for the CASTLE Challenge at EgoVis 2026. Participa

model-releasesarxiv-cs-ai
19 May 2026
Research

MHMamba: Multi-Head Mamba for 3D Brain Tumor Segmentation

DGX agent

arXiv:2605.16464v1 Announce Type: cross Abstract: Brain tumors exhibit high heterogeneity in morphology and multimodal contrast, making manual slice-by-slice de lineation time-consuming and experience

researcharxiv-cs-ai
19 May 2026
Applications

Reducing Hallucination in Vision-Language Models via Stage-wise Preference Optimization under Distribution Shift

DGX agent

arXiv:2605.16411v1 Announce Type: cross Abstract: Hallucination remains a fundamental challenge in vision-language models (VLMs), where autoregressive generation may produce linguistically plausible y

applicationsarxiv-cs-ai
19 May 2026
Research

t-gems: text-guided exit modules for decreasing clip image encoder

DGX agent

arXiv:2605.17499v1 Announce Type: new Abstract: Multimodal deep neural networks enhance deep comprehension by integrating diverse data modalities. Data from different modalities are typically projecte

researcharxiv-cs-lg
19 May 2026
Research

Virtual Nodes Guided Dynamic Graph Neural Network for Brain Tumor Segmentation with Missing Modalities

DGX agent

arXiv:2605.16880v1 Announce Type: new Abstract: Multimodal magnetic resonance imaging (MRI) is crucial for brain tumor segmentation, with many methods leveraging its four key modalities to capture com

researcharxiv-cs-ai
19 May 2026
Research

Degradation-Aware Blur-Segmentation of Brain Tumor

DGX agent

arXiv:2605.15671v1 Announce Type: cross Abstract: Multimodal 3D MRI brain tumor segmentation is a pivotal step in radiotherapy target delineation, surgical planning and post-treatment assessment. Exis

researcharxiv-cs-cv
18 May 2026
Safety

TopoEvo: A Topology-Aware Self-Evolving Multi-Agent Framework for Root Cause Analysis in Microservices

DGX agent

arXiv:2605.15611v1 Announce Type: new Abstract: Root cause analysis (RCA) in microservices is challenging due to (i) noisy and heterogeneous multimodal observability (metrics, logs, traces), (ii) casc

safetyarxiv-cs-ai
18 May 2026
Model Releases

Physics-R1: An Audited Olympiad Corpus and Recipe for Visual Physics Reasoning

DGX agent

arXiv:2605.14040v1 Announce Type: new Abstract: We audit the multimodal-physics evaluation pipeline end-to-end and document three undetected construction practices that distort how the field measures

model-releasesarxiv-cs-cl
15 May 2026
Research

SceneForge: Structured World Supervision from 3D Interventions

DGX agent

arXiv:2605.14399v1 Announce Type: new Abstract: Many multimodal learning tasks require supervision that remains consistent across edits, viewpoints, and scene-level interventions. However, such superv

researcharxiv-cs-cv
15 May 2026
Model Releases

VLRS-Bench: A Vision-Language Reasoning Benchmark for Remote Sensing

DGX agent

arXiv:2602.07045v2 Announce Type: replace-cross Abstract: Recent advancements in Multimodal Large Language Models (MLLMs) have enabled complex reasoning. However, existing remote sensing (RS) benchmar

model-releasesarxiv-cs-ai
15 May 2026
Research

AssemblyBench: Physics-Aware Assembly of Complex Industrial Objects

DGX agent

arXiv:2605.12845v1 Announce Type: cross Abstract: Assembling objects from parts requires understanding multimodal instructions, linking them to 3D components, and predicting physically plausible 6-DoF

researcharxiv-cs-ai
14 May 2026
Safety

PRA-PoE: Robust Alzheimer's Diagnosis with Arbitrary Missing Modalities

DGX agent

arXiv:2605.13081v1 Announce Type: new Abstract: Missing modalities are prevalent in real-world Alzheimer's disease (AD) assessment and pose a significant challenge to multimodal learning, particularly

safetyarxiv-cs-cv
14 May 2026
Model Releases

Visual Aesthetic Benchmark: Can Frontier Models Judge Beauty?

DGX agent

arXiv:2605.12684v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) are now routinely deployed for visual understanding, generation, and curation. A substantial fraction of thes

model-releasesarxiv-cs-ai
14 May 2026
Safety

Images in Sentences: Scaling Interleaved Instructions for Unified Visual Generation

DGX agent

arXiv:2605.12305v1 Announce Type: new Abstract: While recent advancements in multimodal language models have enabled image generation from expressive multi-image instructions, existing methods struggl

safetyarxiv-cs-cv
13 May 2026
Agents

SB-BEVFusion: Enhancing the Robustness against Sensor Malfunction and Corruptions

DGX agent

arXiv:2605.11799v1 Announce Type: new Abstract: Multimodal sensor fusion has demonstrated remarkable performance improvements over unimodal approaches in 3D object detection for autonomous vehicles. T

agentsarxiv-cs-cv
13 May 2026
Research

When Looking Is Not Enough: Visual Attention Structure Reveals Hallucination in MLLMs

DGX agent

arXiv:2605.11559v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have become a key interface for visual reasoning and grounded question answering, yet they remain vulnerable to

researcharxiv-cs-cv
13 May 2026
Research

Concise Geometric Description as a Bridge: Unleashing the Potential of LLM for Plane Geometry Problem Solving

DGX agent

arXiv:2601.21164v3 Announce Type: replace Abstract: Plane Geometry Problem Solving (PGPS) is a multimodal reasoning task that aims to solve a plane geometric problem based on a geometric diagram and p

researcharxiv-cs-ai
12 May 2026
Research

Knowledge Poisoning Attacks on Medical Multi-Modal Retrieval-Augmented Generation

DGX agent

arXiv:2605.10253v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) is a widely adopted paradigm for enhancing LLMs in medical applications by incorporating expert multimodal knowle

researcharxiv-cs-ai
12 May 2026
Model Releases

MPerS: Dynamic MLLM MixExperts Perception-Guided Remote Sensing Scene Segmentation

DGX agent

arXiv:2605.10769v1 Announce Type: cross Abstract: The multimodal fusion of images and scene captions has been extensively explored and applied in various fields. However, when dealing with complex rem

model-releasesarxiv-cs-ai
12 May 2026
← Previous
1…7879808182…211
Next →