AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
Human
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
9,441 results
Local Ai

Keep What Audio Cannot Say: Context-Preserving Token Pruning for Omni-LLMs

DGX agent

arXiv:2605.11605v1 Announce Type: new Abstract: Omnimodal Large Language Models (Omni-LLMs) incur substantial computational overhead due to the large number of multimodal input tokens they process, ma

local-aiarxiv-cs-cv
13 May 2026
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Agents

LDDR: Linear-DPP-Based Dynamic-Resolution Frame Sampling for Video MLLMs

DGX agent

arXiv:2605.11477v1 Announce Type: new Abstract: Video understanding in multimodal large language models requires selecting informative frames from long, redundant videos under limited visual-token bud

agentsarxiv-cs-cv
13 May 2026
Safety

Logit-Attention Divergence: Mitigating Position Bias in Multi-Image Retrieval via Attention-Guided Calibration

DGX agent

arXiv:2605.11591v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have shown strong performance in multi-image cross-modal retrieval, yet suffer from severe position bias, where

safetyarxiv-cs-cv
13 May 2026
Research

MieDB-100k: A Comprehensive Dataset for Medical Image Editing

DGX agent

arXiv:2602.09587v2 Announce Type: replace Abstract: The scarcity of high-quality data remains a primary bottleneck in adapting multimodal generative models for medical image editing. Existing medical

researcharxiv-cs-cv
13 May 2026
Applications

Towards Visually-Guided Movie Subtitle Translation for Indic Languages

DGX agent

arXiv:2605.11993v1 Announce Type: new Abstract: Movie subtitle translation is inherently multimodal, yet text-only systems often miss visual cues needed to convey emotion, action, and social nuance, e

applicationsarxiv-cs-cl
13 May 2026
Safety

Adversarial Attacks Against MLLMs via Progressive Resolution Processing and Adaptive Feature Alignment

DGX agent

arXiv:2605.09902v1 Announce Type: new Abstract: Adversarial perturbations can mislead Multimodal Large Language Models (MLLMs) recognize a benign image as a specific target object, posing serious risk

safetyarxiv-cs-cv
12 May 2026
Research

CATS: Curvature Aware Temporal Selection for efficient long video understanding

DGX agent

arXiv:2605.09223v1 Announce Type: new Abstract: Understanding long videos with multimodal large language models (MLLMs) requires selecting a small subset of informative frames under strict computation

researcharxiv-cs-cv
12 May 2026
Model Releases

CoLVR: Enhancing Exploratory Latent Visual Reasoning via Contrastive Optimization

DGX agent

arXiv:2605.08802v1 Announce Type: new Abstract: Due to the potential for exploratory reasoning of Latent Visual Reasoning, recent works tend to enable MLLMs (Multimodal Large Language Models) to perfo

model-releasesarxiv-cs-cv
12 May 2026
Local Ai

Detector-Empowered Video Large Language Model for Efficient Spatio-Temporal Grounding

DGX agent

arXiv:2512.06673v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) are rapidly expanding from general video understanding to finer-grained understanding such as spatio-tempor

local-aiarxiv-cs-cv
12 May 2026
Model Releases

DocScope: Benchmarking Verifiable Reasoning for Trustworthy Long-Document Understanding

DGX agent

arXiv:2605.08888v1 Announce Type: new Abstract: Evaluating whether Multimodal Large Language Models can produce trustworthy, verifiable reasoning over long, visually rich documents requires evaluation

model-releasesarxiv-cs-cl
12 May 2026
Safety

GuardAD: Safeguarding Autonomous Driving MLLMs via Markovian Safety Logic

DGX agent

arXiv:2605.10386v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are increasingly integrated into autonomous driving (AD) systems; however, they remain vulnerable to diverse sa

safetyarxiv-cs-ai
12 May 2026
Safety

HY-Himmel Technical Report: Hierarchical Interleaved Multi-stream Motion Encoding for Long Video Understanding

DGX agent

arXiv:2605.08158v1 Announce Type: cross Abstract: Long-video understanding with multimodal language models suffers from three compounding bottlenecks: heavy decode cost to obtain dense RGB frames, qua

safetyarxiv-cs-ai
12 May 2026
Model Releases

LLaVA-UHD v4: What Makes Efficient Visual Encoding in MLLMs?

DGX agent

arXiv:2605.08985v1 Announce Type: new Abstract: Visual encoding constitutes a major computational bottleneck in Multimodal Large Language Models (MLLMs), especially for high-resolution image inputs. T

model-releasesarxiv-cs-cv
12 May 2026
Safety

Muninn: Your Trajectory Diffusion Model But Faster

DGX agent

arXiv:2605.09999v1 Announce Type: new Abstract: Diffusion-based trajectory planners can synthesize rich, multimodal robot motions, but their iterative denoising makes online planning and control prohi

safetyarxiv-cs-ro
12 May 2026
Model Releases

Omni-Persona: Systematic Benchmarking and Improving Omnimodal Personalization

DGX agent

arXiv:2605.09996v1 Announce Type: new Abstract: While multimodal large language models have advanced across text, image, and audio, personalization research has remained primarily vision-language, wit

model-releasesarxiv-cs-cv
12 May 2026
Safety

Perception Without Engagement: Dissecting the Causal Discovery Deficit in LMMs

DGX agent

arXiv:2605.09422v1 Announce Type: new Abstract: Although Large Multimodal Models (LMMs) have achieved strong performance on general video understanding, their susceptibility to textual prior shortcuts

safetyarxiv-cs-cl
12 May 2026
Research

SpaceMind++: Toward Allocentric Cognitive Maps for Spatially Grounded Video MLLMs

DGX agent

arXiv:2605.09449v1 Announce Type: new Abstract: Recent multimodal large language models (MLLMs) have made remarkable progress in visual understanding and language-based reasoning, yet they lack a pers

researcharxiv-cs-cv
12 May 2026
Safety

STRIVE: Structured Spatiotemporal Exploration for Reinforcement Learning in Video Question Answering

DGX agent

arXiv:2604.01824v2 Announce Type: replace Abstract: We introduce STRIVE (SpatioTemporal Reinforcement with Importance-aware Variant Exploration), a structured reinforcement learning framework for vide

safetyarxiv-cs-cv
12 May 2026
Model Releases

SYNCR: A Cross-Video Reasoning Benchmark with Synthetic Grounding

DGX agent

arXiv:2605.08412v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have made rapid progress in single-video understanding, yet their ability to reason across multiple independent

model-releasesarxiv-cs-cv
12 May 2026
Research

The Cartesian Shortcut: Re-evaluate Vision Reasoning in Polar Coordinate Space

DGX agent

arXiv:2605.09883v1 Announce Type: cross Abstract: As current Multimodal Large Language Models rapidly saturate canonical visual reasoning benchmarks, a key question emerges: do these strong scores gen

researcharxiv-cs-ai
12 May 2026
Research

Thinking with Novel Views: A Systematic Analysis of Generative-Augmented Spatial Intelligence

DGX agent

arXiv:2605.10588v1 Announce Type: new Abstract: Current Large Multimodal Models (LMMs) struggle with spatial reasoning tasks requiring viewpoint-dependent understanding, largely because they are confi

researcharxiv-cs-cv
12 May 2026
Model Releases

Tracking the Truth: Object-Centric Spatio-Temporal Monitoring for Video Large Language Models

DGX agent

arXiv:2605.08974v1 Announce Type: cross Abstract: While multimodal large language models (MLLMs) have advanced video understanding, they remain highly prone to hallucinations in dynamic scenes. We arg

model-releasesarxiv-cs-ai
12 May 2026
Model Releases

Uni-Synergy: Bridging Understanding and Generation for Personalized Reasoning via Co-operative Reinforcement Learning

DGX agent

arXiv:2605.10445v1 Announce Type: new Abstract: Unified Multimodal Models (UMMs) excel in general tasks but struggle to bridge the gap between personalized understanding and generation. Prior works la

model-releasesarxiv-cs-cv
12 May 2026
Safety

V-ABS: Action-Observer Driven Beam Search for Dynamic Visual Reasoning

DGX agent

arXiv:2605.10172v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) have achieved remarkable success in general perception, yet complex multi-step visual reasoning remains a per

safetyarxiv-cs-cl
12 May 2026
Local Ai

Vocabulary Hijacking in LVLMs: Unveiling Critical Attention Heads by Excluding Inert Tokens to Mitigate Hallucination

DGX agent

arXiv:2605.10622v1 Announce Type: cross Abstract: Large Vision-Language Models (LVLMs) have achieved remarkable progress in multimodal tasks, yet their reliability is persistently undermined by halluc

local-aiarxiv-cs-cv
12 May 2026
Model Releases

CrossCult-KIBench: A Benchmark for Cross-Cultural Knowledge Insertion in MLLMs

DGX agent

arXiv:2605.06115v2 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs), trained primarily on English-centric data, frequently generate culturally inappropriate or misaligned resp

model-releasesarxiv-cs-ai
11 May 2026
Model Releases

EgoPro-Bench: Benchmarking Personalized Proactive Interaction in Egocentric Video Streams

DGX agent

arXiv:2605.07299v1 Announce Type: cross Abstract: Existing Multimodal Large Language Models (MLLMs) remain primarily reactive, failing to continuously perceive environments or proactively assist users

model-releasesarxiv-cs-ai
11 May 2026
Model Releases

ProactiveMobile: A Comprehensive Benchmark for Boosting Proactive Intelligence on Mobile Devices

DGX agent

arXiv:2602.21858v4 Announce Type: replace Abstract: Multimodal large language models (MLLMs) have made significant progress in mobile agent development, yet their capabilities are predominantly confin

model-releasesarxiv-cs-ai
11 May 2026
Research

Retrieve, Integrate, and Synthesize: Spatial-Semantic Grounded Latent Visual Reasoning

DGX agent

arXiv:2605.07106v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have made remarkable progress on vision-language reasoning, yet most methods still compress visual evidence int

researcharxiv-cs-cl
11 May 2026
Tutorials

Tables Guide Vision: Learning to See the Heart through Tabular Data

DGX agent

arXiv:2503.14998v3 Announce Type: replace Abstract: Contrastive learning methods in computer vision typically rely on augmented views of the same image or multimodal pretraining strategies that align

tutorialsarxiv-cs-cv
11 May 2026
Research

Towards Explainable Industrial Anomaly Detection via Knowledge-Guided Latent Reasoning

DGX agent

arXiv:2602.09850v2 Announce Type: replace Abstract: Industrial anomaly detection demands precise reasoning over fine-grained defect patterns. However, existing multimodal large language models (MLLMs)

researcharxiv-cs-cv
11 May 2026
Model Releases

TraceAV-Bench: Benchmarking Multi-Hop Trajectory Reasoning over Long Audio-Visual Videos

DGX agent

arXiv:2605.07593v1 Announce Type: new Abstract: Real-world audio-visual understanding requires chaining evidence that is sparse, temporally dispersed, and split across the visual and auditory streams,

model-releasesarxiv-cs-cv
11 May 2026
Model Releases

Video Understanding Reward Modeling: A Robust Benchmark and Performant Reward Models

DGX agent

arXiv:2605.07872v1 Announce Type: cross Abstract: Multimodal reward models have advanced substantially in text and image domains, yet progress in video understanding reward modeling remains severely l

model-releasesarxiv-cs-ai
11 May 2026
Safety

VideoRouter: Query-Adaptive Dual Routing for Efficient Long-Video Understanding

DGX agent

arXiv:2605.05848v2 Announce Type: replace-cross Abstract: Video large multimodal models increasingly face a scalability bottleneck: long videos produce excessively long visual-token sequences, which s

safetyarxiv-cs-ai
11 May 2026
Safety

How Does the Lagrangian Guide Safe Reinforcement Learning through Diffusion Models?

DGX agent

arXiv:2602.02924v2 Announce Type: replace Abstract: Diffusion policy sampling enables reinforcement learning (RL) to represent multimodal action distributions beyond suboptimal unimodal Gaussian polic

safetyarxiv-cs-lg
7 May 2026
Agents

Physical Adversarial Clothing Evades Visible-Thermal Detectors via Non-Overlapping RGB-T Pattern

DGX agent

arXiv:2605.04675v1 Announce Type: new Abstract: Visible-thermal (RGB-T) object detection is a crucial technology for applications such as autonomous driving, where multimodal fusion enhances performan

agentsarxiv-cs-cv
7 May 2026
Research

When Relations Break: Analyzing Relation Hallucination in Vision-Language Model Under Rotation and Noise

DGX agent

arXiv:2605.05045v1 Announce Type: cross Abstract: Vision-language models (VLMs) achieve strong multimodal performance but remain prone to relation hallucination, which requires accurate reasoning over

researcharxiv-cs-cl
7 May 2026
Safety

Catching the Infection Before It Spreads: Foresight-Guided Defense in Multi-Agent Systems

DGX agent

arXiv:2605.01758v1 Announce Type: new Abstract: Large multimodal model-based Multi-Agent Systems (MASs) enable collaborative complex problem solving through specialized agents. However, MASs are vulne

safetyarxiv-cs-ai
6 May 2026
Research

CellxPert: Inference-Time MCMC Steering of a Multi-Omics Single-Cell Foundation Model for In-Silico Perturbation

DGX agent

arXiv:2605.00930v1 Announce Type: cross Abstract: In this work, we introduce CellxPert, a scalable multimodal foundation model that unifies single-cell and spatial multi-omics within a common represen

researcharxiv-cs-ai
6 May 2026
Research

Conditional Diffusion Sampling

DGX agent

arXiv:2605.04013v1 Announce Type: cross Abstract: Sampling from unnormalized multimodal distributions with limited density evaluations remains a fundamental challenge in machine learning and natural s

researcharxiv-cs-lg
6 May 2026
Research

CoVSpec: Efficient Device-Edge Co-Inference for Vision-Language Models via Speculative Decoding

DGX agent

arXiv:2605.02218v1 Announce Type: new Abstract: Vision-language models (VLMs) have demonstrated strong capabilities in multimodal perception and reasoning. However, deploying large VLMs on mobile devi

researcharxiv-cs-ai
6 May 2026
Model Releases

DataEvolver: Let Your Data Build and Improve Itself via Goal-Driven Loop Agents

DGX agent

arXiv:2605.01789v1 Announce Type: new Abstract: Constructing controllable visual data is a major bottleneck for image editing and multimodal understanding. Useful supervision is rarely produced by a s

model-releasesarxiv-cs-ai
6 May 2026
Model Releases

Task-Aware Scanning Parameter Configuration for Robotic Inspection Using Vision Language Embeddings and Hyperdimensional Computing

DGX agent

arXiv:2605.03909v1 Announce Type: cross Abstract: Robotic laser profiling is widely used for dimensional verification and surface inspection, yet measurement fidelity is often dominated by sensor conf

model-releasesarxiv-cs-cv
6 May 2026
Model Releases

Valley3: Scaling Omni Foundation Models for E-commerce

DGX agent

arXiv:2605.01278v1 Announce Type: new Abstract: In this work, we present Valley3, an omni multimodal large language model (MLLM) developed for diverse global e-commerce tasks, with unified understandi

model-releasesarxiv-cs-ai
6 May 2026
Model Releases

VisInject: Disruption != Injection -- A Dual-Dimension Evaluation of Universal Adversarial Attacks on Vision-Language Models

DGX agent

arXiv:2605.01449v1 Announce Type: cross Abstract: Universal adversarial attacks on aligned multimodal large language models are increasingly reported with attack success rates in the 60-80% range, sug

model-releasesarxiv-cs-ai
6 May 2026
Safety

Beyond Perceptual Shortcuts: Causal-Inspired Debiasing Optimization for Generalizable Video Reasoning in Lightweight MLLMs

DGX agent

arXiv:2605.01324v1 Announce Type: new Abstract: Although reinforcement learning (RL) has significantly advanced reasoning capabilities in large multimodal language models (MLLMs), its efficacy remains

safetyarxiv-cs-cv
5 May 2026
Research

EduGage: Methods and Dataset for Sensor-Based Momentary Assessment of Engagement in Self-Guided Video Learning

DGX agent

arXiv:2605.01238v1 Announce Type: cross Abstract: Engagement, which links to attentional, emotional, and cognitive dimensions, plays an important role in learning. In online and video-based learning e

researcharxiv-cs-cv
5 May 2026
Model Releases

Efficient Reasoning with Hidden Thinking

DGX agent

arXiv:2501.19201v2 Announce Type: replace Abstract: Chain-of-Thought (CoT) reasoning has become a powerful framework for improving complex problem-solving capabilities in Multimodal Large Language Mod

model-releasesarxiv-cs-cl
5 May 2026
← Previous
1…9596979899…197
Next →