AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,117 results
Research

OmniDrop: Layer-wise Token Pruning for Omni-modal LLMs via Query-Guidance

DGX agent

arXiv:2605.14458v1 Announce Type: new Abstract: Omni-modal large language models have demonstrated remarkable potential in holistic multimodal understanding; however, the token explosion caused by hig

researcharxiv-cs-ai
15 May 2026
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Agents

Video2GUI: Synthesizing Large-Scale Interaction Trajectories for Generalized GUI Agent Pretraining

DGX agent

arXiv:2605.14747v1 Announce Type: cross Abstract: Recent advances in multimodal large language models have driven growing interest in graphical user interface (GUI) agents, yet their generalization re

agentsarxiv-cs-ai
15 May 2026
Industry

AI training data provider Wirestock raises $23M in funding

DGX agent

Wirestock Inc., a startup that provides multimodal training datasets for artificial intelligence developers, has raised 23 million in funding. TechCrunch reported today that early-stage fund Nava Vent

industrysiliconangle
14 May 2026
Model Releases

CiteVQA: Benchmarking Evidence Attribution for Trustworthy Document Intelligence

DGX agent

arXiv:2605.12882v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) have significantly advanced document understanding, yet current Doc-VQA evaluations score only the final answ

model-releasesarxiv-cs-cv
14 May 2026
Model Releases

D-VLA: A High-Concurrency Distributed Asynchronous Reinforcement Learning Framework for Vision-Language-Action Models

DGX agent

arXiv:2605.13276v1 Announce Type: new Abstract: The rapid evolution of Embodied AI has enabled Vision-Language-Action (VLA) models to excel in multimodal perception and task execution. However, applyi

model-releasesarxiv-cs-ai
14 May 2026
Model Releases

Edit-Compass & EditReward-Compass: A Unified Benchmark for Image Editing and Reward Modeling

DGX agent

arXiv:2605.13062v1 Announce Type: new Abstract: Recent image editing models have achieved remarkable progress in instruction following, multimodal understanding, and complex visual editing. However, e

model-releasesarxiv-cs-cv
14 May 2026
Model Releases

From Pixels to BFS: High Maze Accuracy Does Not Imply Visual Planning

DGX agent

arXiv:2603.26839v2 Announce Type: replace-cross Abstract: How do multimodal models solve visual spatial tasks -- through genuine planning, or through brute-force search in token space? We introduce ex

model-releasesarxiv-cs-cv
14 May 2026
Model Releases

GHGbench: A Unified Multi-Entity, Multi-Task Benchmark for Carbon Emission Prediction

DGX agent

arXiv:2605.13743v1 Announce Type: new Abstract: Open datasets and benchmarks for entity-level carbon-emission prediction remain fragmented across access, scale, granularity, and evaluation. We introdu

model-releasesarxiv-cs-lg
14 May 2026
Model Releases

PanoWorld: Towards Spatial Supersensing in 360^irc Panorama World

DGX agent

arXiv:2605.13169v1 Announce Type: cross Abstract: Multimodal large laboratory models (MLLMs) still struggle with spatial understanding under the dominant perspective-image paradigm, which inherits the

model-releasesarxiv-cs-ai
14 May 2026
Tutorials

Revisit What You See: Revealing Visual Semantics in Vision Tokens to Guide LVLM Decoding

DGX agent

arXiv:2506.09522v3 Announce Type: replace-cross Abstract: Large Vision Language Models (LVLMs) achieve strong performance across multimodal tasks by integrating visual perception with language underst

tutorialsarxiv-cs-ai
14 May 2026
Safety

Think Twice, Act Once: Verifier-Guided Action Selection For Embodied Agents

DGX agent

arXiv:2605.12620v1 Announce Type: new Abstract: Building generalist embodied agents capable of solving complex real-world tasks remains a fundamental challenge in AI. Multimodal Large Language Models

safetyarxiv-cs-ai
14 May 2026
Model Releases

Beyond Localization: A Comprehensive Diagnosis of Perspective-Conditioned Spatial Reasoning in MLLMs from Omnidirectional Images

DGX agent

arXiv:2605.12413v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) show strong visual perception, yet remain limited in reasoning about space under changing viewpoints. We study

model-releasesarxiv-cs-cv
13 May 2026
Local Ai

Keep What Audio Cannot Say: Context-Preserving Token Pruning for Omni-LLMs

DGX agent

arXiv:2605.11605v1 Announce Type: new Abstract: Omnimodal Large Language Models (Omni-LLMs) incur substantial computational overhead due to the large number of multimodal input tokens they process, ma

local-aiarxiv-cs-cv
13 May 2026
Agents

LDDR: Linear-DPP-Based Dynamic-Resolution Frame Sampling for Video MLLMs

DGX agent

arXiv:2605.11477v1 Announce Type: new Abstract: Video understanding in multimodal large language models requires selecting informative frames from long, redundant videos under limited visual-token bud

agentsarxiv-cs-cv
13 May 2026
Safety

Logit-Attention Divergence: Mitigating Position Bias in Multi-Image Retrieval via Attention-Guided Calibration

DGX agent

arXiv:2605.11591v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have shown strong performance in multi-image cross-modal retrieval, yet suffer from severe position bias, where

safetyarxiv-cs-cv
13 May 2026
Research

MieDB-100k: A Comprehensive Dataset for Medical Image Editing

DGX agent

arXiv:2602.09587v2 Announce Type: replace Abstract: The scarcity of high-quality data remains a primary bottleneck in adapting multimodal generative models for medical image editing. Existing medical

researcharxiv-cs-cv
13 May 2026
Local Ai

SenseNova-U1 Technical Report: VAE-free Pixel-level Flow Matching with 32x Compression

DGX agent

SenseNova-U1 is a native unified multimodal model built on the NEO-unify architecture that eliminates visual encoders and VAEs, instead using a near-lossless visual interface that preserves semantic s

local-air-stablediffusion
13 May 2026
Applications

Towards Visually-Guided Movie Subtitle Translation for Indic Languages

DGX agent

arXiv:2605.11993v1 Announce Type: new Abstract: Movie subtitle translation is inherently multimodal, yet text-only systems often miss visual cues needed to convey emotion, action, and social nuance, e

applicationsarxiv-cs-cl
13 May 2026
Safety

Adversarial Attacks Against MLLMs via Progressive Resolution Processing and Adaptive Feature Alignment

DGX agent

arXiv:2605.09902v1 Announce Type: new Abstract: Adversarial perturbations can mislead Multimodal Large Language Models (MLLMs) recognize a benign image as a specific target object, posing serious risk

safetyarxiv-cs-cv
12 May 2026
Local Ai

b9122

DGX agent

Release b9122 of llama.cpp addresses precision issues for multimodal models through ggml-webgpu, including fixes for GELU functions, flash attention tile implementations, and type conflict resolution.

local-aillama-cpp-releases
12 May 2026
Research

CATS: Curvature Aware Temporal Selection for efficient long video understanding

DGX agent

arXiv:2605.09223v1 Announce Type: new Abstract: Understanding long videos with multimodal large language models (MLLMs) requires selecting a small subset of informative frames under strict computation

researcharxiv-cs-cv
12 May 2026
Model Releases

CoLVR: Enhancing Exploratory Latent Visual Reasoning via Contrastive Optimization

DGX agent

arXiv:2605.08802v1 Announce Type: new Abstract: Due to the potential for exploratory reasoning of Latent Visual Reasoning, recent works tend to enable MLLMs (Multimodal Large Language Models) to perfo

model-releasesarxiv-cs-cv
12 May 2026
Local Ai

Detector-Empowered Video Large Language Model for Efficient Spatio-Temporal Grounding

DGX agent

arXiv:2512.06673v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) are rapidly expanding from general video understanding to finer-grained understanding such as spatio-tempor

local-aiarxiv-cs-cv
12 May 2026
Model Releases

DocScope: Benchmarking Verifiable Reasoning for Trustworthy Long-Document Understanding

DGX agent

arXiv:2605.08888v1 Announce Type: new Abstract: Evaluating whether Multimodal Large Language Models can produce trustworthy, verifiable reasoning over long, visually rich documents requires evaluation

model-releasesarxiv-cs-cl
12 May 2026
Safety

GuardAD: Safeguarding Autonomous Driving MLLMs via Markovian Safety Logic

DGX agent

arXiv:2605.10386v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are increasingly integrated into autonomous driving (AD) systems; however, they remain vulnerable to diverse sa

safetyarxiv-cs-ai
12 May 2026
Safety

HY-Himmel Technical Report: Hierarchical Interleaved Multi-stream Motion Encoding for Long Video Understanding

DGX agent

arXiv:2605.08158v1 Announce Type: cross Abstract: Long-video understanding with multimodal language models suffers from three compounding bottlenecks: heavy decode cost to obtain dense RGB frames, qua

safetyarxiv-cs-ai
12 May 2026
Model Releases

LLaVA-UHD v4: What Makes Efficient Visual Encoding in MLLMs?

DGX agent

arXiv:2605.08985v1 Announce Type: new Abstract: Visual encoding constitutes a major computational bottleneck in Multimodal Large Language Models (MLLMs), especially for high-resolution image inputs. T

model-releasesarxiv-cs-cv
12 May 2026
Safety

Muninn: Your Trajectory Diffusion Model But Faster

DGX agent

arXiv:2605.09999v1 Announce Type: new Abstract: Diffusion-based trajectory planners can synthesize rich, multimodal robot motions, but their iterative denoising makes online planning and control prohi

safetyarxiv-cs-ro
12 May 2026
Model Releases

Omni-Persona: Systematic Benchmarking and Improving Omnimodal Personalization

DGX agent

arXiv:2605.09996v1 Announce Type: new Abstract: While multimodal large language models have advanced across text, image, and audio, personalization research has remained primarily vision-language, wit

model-releasesarxiv-cs-cv
12 May 2026
Safety

Perception Without Engagement: Dissecting the Causal Discovery Deficit in LMMs

DGX agent

arXiv:2605.09422v1 Announce Type: new Abstract: Although Large Multimodal Models (LMMs) have achieved strong performance on general video understanding, their susceptibility to textual prior shortcuts

safetyarxiv-cs-cl
12 May 2026
Research

SpaceMind++: Toward Allocentric Cognitive Maps for Spatially Grounded Video MLLMs

DGX agent

arXiv:2605.09449v1 Announce Type: new Abstract: Recent multimodal large language models (MLLMs) have made remarkable progress in visual understanding and language-based reasoning, yet they lack a pers

researcharxiv-cs-cv
12 May 2026
Safety

STRIVE: Structured Spatiotemporal Exploration for Reinforcement Learning in Video Question Answering

DGX agent

arXiv:2604.01824v2 Announce Type: replace Abstract: We introduce STRIVE (SpatioTemporal Reinforcement with Importance-aware Variant Exploration), a structured reinforcement learning framework for vide

safetyarxiv-cs-cv
12 May 2026
Model Releases

SYNCR: A Cross-Video Reasoning Benchmark with Synthetic Grounding

DGX agent

arXiv:2605.08412v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have made rapid progress in single-video understanding, yet their ability to reason across multiple independent

model-releasesarxiv-cs-cv
12 May 2026
Research

The Cartesian Shortcut: Re-evaluate Vision Reasoning in Polar Coordinate Space

DGX agent

arXiv:2605.09883v1 Announce Type: cross Abstract: As current Multimodal Large Language Models rapidly saturate canonical visual reasoning benchmarks, a key question emerges: do these strong scores gen

researcharxiv-cs-ai
12 May 2026
Research

Thinking with Novel Views: A Systematic Analysis of Generative-Augmented Spatial Intelligence

DGX agent

arXiv:2605.10588v1 Announce Type: new Abstract: Current Large Multimodal Models (LMMs) struggle with spatial reasoning tasks requiring viewpoint-dependent understanding, largely because they are confi

researcharxiv-cs-cv
12 May 2026
Model Releases

Tracking the Truth: Object-Centric Spatio-Temporal Monitoring for Video Large Language Models

DGX agent

arXiv:2605.08974v1 Announce Type: cross Abstract: While multimodal large language models (MLLMs) have advanced video understanding, they remain highly prone to hallucinations in dynamic scenes. We arg

model-releasesarxiv-cs-ai
12 May 2026
Model Releases

Uni-Synergy: Bridging Understanding and Generation for Personalized Reasoning via Co-operative Reinforcement Learning

DGX agent

arXiv:2605.10445v1 Announce Type: new Abstract: Unified Multimodal Models (UMMs) excel in general tasks but struggle to bridge the gap between personalized understanding and generation. Prior works la

model-releasesarxiv-cs-cv
12 May 2026
Safety

V-ABS: Action-Observer Driven Beam Search for Dynamic Visual Reasoning

DGX agent

arXiv:2605.10172v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) have achieved remarkable success in general perception, yet complex multi-step visual reasoning remains a per

safetyarxiv-cs-cl
12 May 2026
Local Ai

Vocabulary Hijacking in LVLMs: Unveiling Critical Attention Heads by Excluding Inert Tokens to Mitigate Hallucination

DGX agent

arXiv:2605.10622v1 Announce Type: cross Abstract: Large Vision-Language Models (LVLMs) have achieved remarkable progress in multimodal tasks, yet their reliability is persistently undermined by halluc

local-aiarxiv-cs-cv
12 May 2026
Model Releases

CrossCult-KIBench: A Benchmark for Cross-Cultural Knowledge Insertion in MLLMs

DGX agent

arXiv:2605.06115v2 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs), trained primarily on English-centric data, frequently generate culturally inappropriate or misaligned resp

model-releasesarxiv-cs-ai
11 May 2026
Model Releases

EgoPro-Bench: Benchmarking Personalized Proactive Interaction in Egocentric Video Streams

DGX agent

arXiv:2605.07299v1 Announce Type: cross Abstract: Existing Multimodal Large Language Models (MLLMs) remain primarily reactive, failing to continuously perceive environments or proactively assist users

model-releasesarxiv-cs-ai
11 May 2026
Local Ai

LTX 2.3 Distilled 1.1 using WwnGP.

DGX agent

LTX-2.3 is a multimodal video generation model released by Lightricks in March 2026, available in four checkpoint variants including a distilled variant that completes generation in as few as 8 denois

local-air-stablediffusion
11 May 2026
Model Releases

ProactiveMobile: A Comprehensive Benchmark for Boosting Proactive Intelligence on Mobile Devices

DGX agent

arXiv:2602.21858v4 Announce Type: replace Abstract: Multimodal large language models (MLLMs) have made significant progress in mobile agent development, yet their capabilities are predominantly confin

model-releasesarxiv-cs-ai
11 May 2026
Research

Retrieve, Integrate, and Synthesize: Spatial-Semantic Grounded Latent Visual Reasoning

DGX agent

arXiv:2605.07106v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have made remarkable progress on vision-language reasoning, yet most methods still compress visual evidence int

researcharxiv-cs-cl
11 May 2026
Tutorials

Tables Guide Vision: Learning to See the Heart through Tabular Data

DGX agent

arXiv:2503.14998v3 Announce Type: replace Abstract: Contrastive learning methods in computer vision typically rely on augmented views of the same image or multimodal pretraining strategies that align

tutorialsarxiv-cs-cv
11 May 2026
Research

Towards Explainable Industrial Anomaly Detection via Knowledge-Guided Latent Reasoning

DGX agent

arXiv:2602.09850v2 Announce Type: replace Abstract: Industrial anomaly detection demands precise reasoning over fine-grained defect patterns. However, existing multimodal large language models (MLLMs)

researcharxiv-cs-cv
11 May 2026
Model Releases

TraceAV-Bench: Benchmarking Multi-Hop Trajectory Reasoning over Long Audio-Visual Videos

DGX agent

arXiv:2605.07593v1 Announce Type: new Abstract: Real-world audio-visual understanding requires chaining evidence that is sparse, temporally dispersed, and split across the visual and auditory streams,

model-releasesarxiv-cs-cv
11 May 2026
Model Releases

Video Understanding Reward Modeling: A Robust Benchmark and Performant Reward Models

DGX agent

arXiv:2605.07872v1 Announce Type: cross Abstract: Multimodal reward models have advanced substantially in text and image domains, yet progress in video understanding reward modeling remains severely l

model-releasesarxiv-cs-ai
11 May 2026
← Previous
1…100101102103104…211
Next →