AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,117 results
Model Releases

Multimodal Optimal Transport for Training-free Temporal Segmentation in Surgical Robotics

DGX agent

arXiv:2602.24138v2 Announce Type: replace Abstract: Automated recognition of surgical phases and steps is a fundamental capability for intraoperative decision support, workflow automation, and skill a

model-releasesarxiv-cs-cv
21 May 2026
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Research

SpectralEarth-FM: Bringing Hyperspectral Imagery into Multimodal Earth Observation Pretraining

DGX agent

arXiv:2605.21075v1 Announce Type: new Abstract: Earth observation (EO) foundation models (FMs) are increasingly trained on multisensor data, spanning multispectral imagery (MSI), synthetic aperture ra

researcharxiv-cs-cv
21 May 2026
Model Releases

CRAFT: Critic-Refined Adaptive Key-Frame Targeting for Multimodal Video Question Answering

DGX agent

arXiv:2605.19075v1 Announce Type: cross Abstract: Grounded multi-video question answering over real-world news events requires systems to surface query-relevant evidence across heterogeneous video arc

model-releasesarxiv-cs-ai
20 May 2026
Research

MetaEarth-MM: Unified Multimodal Remote Sensing Image Generation with Scene-centered Joint Modeling

DGX agent

arXiv:2605.20090v1 Announce Type: new Abstract: Multi-modal remote sensing images are vital for Earth observation, yet complete paired observations are often scarce in practice. Existing generative me

researcharxiv-cs-cv
20 May 2026
Industry

Multimodal evaluators: MLLM-as-a-judge for image-to-text tasks in Strands Evals

DGX agent

If you’re building visual shopping, image or document understanding, or chart analysis, you need a way to verify whether your model’s response is actually grounded in the source image. A text-only eva

industryaws-ml-blog
20 May 2026
Applications

Multimodal system for skin cancer detection

DGX agent

arXiv:2601.14822v2 Announce Type: replace-cross Abstract: Melanoma detection is vital for early diagnosis and effective treatment. While deep learning models on dermoscopic images have shown promise,

applicationsarxiv-cs-ai
20 May 2026
Model Releases

PlantTraitNet: An Uncertainty-Aware Multimodal Framework for Global-Scale Plant Trait Inference from Citizen Science Data

DGX agent

arXiv:2511.06943v3 Announce Type: replace-cross Abstract: Global plant maps of plant traits, such as leaf nitrogen or plant height, are essential for understanding ecosystem processes, including the c

model-releasesarxiv-cs-ai
20 May 2026
Research

RoomPilot: Controllable Indoor Scene Synthesis via Multimodal Semantic Parsing

DGX agent

arXiv:2512.11234v2 Announce Type: replace Abstract: Generating controllable indoor scenes is fundamental to applications in game development, architectural visualization, and embodied AI. However, exi

researcharxiv-cs-cv
20 May 2026
Research

Dimension-Uniform Discretization Analysis of Preconditioned Annealed Langevin Dynamics for Multimodal Gaussian Mixtures

DGX agent

arXiv:2605.16473v1 Announce Type: cross Abstract: Obtaining stable diffusion-based samplers in high- and infinite-dimensional settings is challenging because errors can accumulate across high-frequenc

researcharxiv-cs-lg
19 May 2026
Research

EGI: A Multimodal Emotional AI Framework for Enhancing Scrum Master Real-time Self-Awareness

DGX agent

arXiv:2605.17684v1 Announce Type: new Abstract: While increasing research focuses on the emotional well-being of agile team members, a significant gap remains in emotion monitoring studies for Scrum M

researcharxiv-cs-ai
19 May 2026
Local Ai

MementoGUI: Learning Agentic Multimodal Memory Control for Long-Horizon GUI Agents

DGX agent

arXiv:2605.18652v1 Announce Type: new Abstract: Recent GUI agents have made substantial progress in visual grounding and action prediction, yet they remain brittle in long-horizon tasks that require m

local-aiarxiv-cs-cv
19 May 2026
Local Ai

Mining Forgery Traces from Reconstruction Error: A Weakly Supervised Framework for Multimodal Deepfake Temporal Localization

DGX agent

arXiv:2601.21458v2 Announce Type: replace Abstract: Modern deepfakes have evolved into localized and intermittent manipulations that require fine-grained temporal localization to mitigate severe digit

local-aiarxiv-cs-cv
19 May 2026
Safety

DeltaPrompts: Escaping the Zero-Delta Trap in Multimodal Distillation

DGX agent

arXiv:2605.15532v1 Announce Type: cross Abstract: Distillation enables compact Vision-Language Models (VLMs) to obtain strong reasoning capabilities, yet the prompts driving this process are typically

safetyarxiv-cs-ai
18 May 2026
Local Ai

GeoViSTA: Geospatial Vision-Tabular Transformer for Multimodal Environment Representation

DGX agent

arXiv:2605.14406v1 Announce Type: cross Abstract: Large-scale pretraining on Earth observation imagery has yielded powerful representations of the natural and built environment. However, most existing

local-aiarxiv-cs-cv
15 May 2026
Safety

Video-OPD: Efficient Post-Training of Multimodal Large Language Models for Temporal Video Grounding via On-Policy Distillation

DGX agent

arXiv:2602.02994v2 Announce Type: replace Abstract: Reinforcement learning has emerged as a principled post-training paradigm for Temporal Video Grounding (TVG) due to its on-policy optimization, yet

safetyarxiv-cs-cv
15 May 2026
Model Releases

Geospatial-Temporal Sensemaking of Remote Sensing Activity Detections with Multimodal Large Language Model

DGX agent

arXiv:2605.10739v1 Announce Type: cross Abstract: We introduce SMART-HC-VQA, a Sentinel-2-based visual question answering dataset derived from the IARPA SMART Heavy Construction dataset, designed for

model-releasesarxiv-cs-ai
12 May 2026
Research

High-Entropy Tokens as Multimodal Failure Points in Vision-Language Models

DGX agent

arXiv:2512.21815v2 Announce Type: replace Abstract: Vision-language models (VLMs) achieve remarkable performance but remain vulnerable to adversarial attacks. Entropy, as a measure of model uncertaint

researcharxiv-cs-cv
12 May 2026
Model Releases

Measuring What Matters: Benchmarking Generative, Multimodal, and Agentic AI in Healthcare

DGX agent

arXiv:2605.08445v1 Announce Type: new Abstract: AI models are increasingly deployed in live clinical environments where they must perform reliably across complex, high-stakes workflows that standard t

model-releasesarxiv-cs-ai
12 May 2026
Research

Breaking the Illusion: When Positive Meets Negative in Multimodal Decoding

DGX agent

arXiv:2605.06679v1 Announce Type: new Abstract: Vision-Language Models (VLMs) are frequently undermined by object hallucination, generating content that contradicts visual reality, due to an over-reli

researcharxiv-cs-lg
11 May 2026
Research

Reasoning-Guided Grounding: Elevating Video Anomaly Detection through Multimodal Large Language Models

DGX agent

arXiv:2605.02912v1 Announce Type: new Abstract: Video Anomaly Detection (VAD) has traditionally been framed as binary classification or outlier detection, providing neither interpretable reasoning nor

researcharxiv-cs-cv
6 May 2026
Safety

Divide and Conquer: Decoupled Representation Alignment for Multimodal World Models

DGX agent

arXiv:2605.01896v1 Announce Type: new Abstract: Emerging multi-modal world models attempt to jointly generate videos across diverse modalities (e.g., RGB, depth, and mask), yet they fail to fully expl

safetyarxiv-cs-cv
5 May 2026
Model Releases

When Audio-Language Models Fail to Leverage Multimodal Context for Dysarthric Speech Recognition

DGX agent

arXiv:2605.02782v1 Announce Type: cross Abstract: Automatic speech recognition (ASR) systems remain brittle on dysarthric and other atypical speech. Recent audio-language models raise the possibility

model-releasesarxiv-cs-cl
5 May 2026
Research

CBEN -- A Multimodal Machine Learning Dataset for Cloud Robust Remote Sensing Image Understanding

DGX agent

arXiv:2602.12652v2 Announce Type: replace Abstract: Clouds are a common phenomenon that distorts optical satellite imagery, which poses a challenge for remote sensing. However, in the literature cloud

researcharxiv-cs-cv
1 May 2026
Research

Simulating clinical interventions with a generative multimodal model of human physiology

DGX agent

arXiv:2604.27899v1 Announce Type: new Abstract: Understanding how human health changes over time, and why responses to interventions vary between individuals, remains a central challenge in medicine.

researcharxiv-cs-ai
1 May 2026
Research

A Multimodal Depth-Aware Method For Embodied Reference Understanding

DGX agent

arXiv:2510.08278v3 Announce Type: replace Abstract: Embodied Reference Understanding requires identifying a target object in a visual scene based on both language instructions and pointing cues. While

researcharxiv-cs-cv
30 Apr 2026
Model Releases

Benchmarking Complex Multimodal Document Processing Pipelines: A Unified Evaluation Framework for Enterprise AI

DGX agent

arXiv:2604.26382v1 Announce Type: cross Abstract: Most enterprise document AI today is a pipeline. Parse, index, retrieve, generate. Each of those stages has been studied to death on its own -- what's

model-releasesarxiv-cs-ai
30 Apr 2026
Model Releases

Multimodal LLMs are not all you need for Pediatric Speech Language Pathology

DGX agent

arXiv:2604.26568v1 Announce Type: new Abstract: Speech Sound Disorders (SSD) affect roughly five percent of children, yet speech-language pathologists face severe staffing shortages and unmanageable c

model-releasesarxiv-cs-cl
30 Apr 2026
Safety

ViTaPEs: Visuotactile Position Encodings for Cross-Modal Alignment in Multimodal Transformers

DGX agent

arXiv:2505.20032v3 Announce Type: replace Abstract: Tactile sensing provides local essential information that is complementary to visual perception, such as texture, compliance, and force. Despite rec

safetyarxiv-cs-cv
30 Apr 2026
Model Releases

Variational Neural Belief Parameterizations for Robust Dexterous Grasping under Multimodal Uncertainty

DGX agent

arXiv:2604.25897v1 Announce Type: cross Abstract: Contact variability, sensing uncertainty, and external disturbances make grasp execution stochastic. Expected-quality objectives ignore tail outcomes

model-releasesarxiv-cs-lg
29 Apr 2026
Model Releases

Affordance-R1: Reinforcement Learning for Generalizable Affordance Reasoning in Multimodal Large Language Model

DGX agent

arXiv:2508.06206v4 Announce Type: replace-cross Abstract: Affordance grounding focuses on predicting the specific regions of objects that are associated with the actions to be performed by robots. It

model-releasesarxiv-cs-cv
28 Apr 2026
Model Releases

ClawMark: A Living-World Benchmark for Multi-Turn, Multi-Day, Multimodal Coworker Agents

DGX agent

arXiv:2604.23781v1 Announce Type: new Abstract: Language-model agents are increasingly used as persistent coworkers that assist users across multiple working days. During such workflows, the surroundi

model-releasesarxiv-cs-cv
28 Apr 2026
Model Releases

DriVerse: Navigation World Model for Driving Simulation via Multimodal Trajectory Prompting and Motion Alignment

DGX agent

arXiv:2504.18576v2 Announce Type: replace Abstract: This paper presents DriVerse, a generative model for simulating navigation-driven driving scenes from a single image and a future trajectory. Previo

model-releasesarxiv-cs-ro
28 Apr 2026
Applications

Open-Vocabulary Semantic Segmentation Network Integrating Object-Level Label and Scene-Level Semantic Features for Multimodal Remote Sensing Images

DGX agent

arXiv:2604.24125v1 Announce Type: new Abstract: Semantic segmentation of multi-modal remote sensing imagery plays a pivotal role in land use/land cover (LULC) mapping, environmental monitoring, and pr

applicationsarxiv-cs-cv
28 Apr 2026
Model Releases

Leveraging Multimodal LLMs for Built Environment and Housing Attribute Assessment from Street-View Imagery

DGX agent

arXiv:2604.21102v1 Announce Type: cross Abstract: We present a novel framework for automatically evaluating building conditions nationwide in the United States by leveraging large language models (LLM

model-releasesarxiv-cs-ai
24 Apr 2026
Agents

Multimodal Bayesian Network for Robust Assessment of Casualties in Autonomous Triage

DGX agent

arXiv:2512.18908v2 Announce Type: replace Abstract: Mass Casualty Incidents can overwhelm emergency medical systems and resulting delays or errors in the assessment of casualties can lead to preventab

agentsarxiv-cs-ai
24 Apr 2026
Research

3D Smoke Scene Reconstruction Guided by Vision Priors from Multimodal Large Language Models

DGX agent

arXiv:2604.05687v2 Announce Type: replace Abstract: Reconstructing 3D scenes from smoke-degraded multi-view images is particularly difficult because smoke introduces strong scattering effects, view-de

researcharxiv-cs-cv
23 Apr 2026
Research

Mitigating Multimodal Hallucination via Phase-wise Self-reward

DGX agent

arXiv:2604.17982v1 Announce Type: cross Abstract: Large Vision-Language Models (LVLMs) still struggle with vision hallucination, where generated responses are inconsistent with the visual input. Exist

researcharxiv-cs-cl
21 Apr 2026
Model Releases

ScienceBoard: Evaluating Multimodal Autonomous Agents in Realistic Scientific Workflows

DGX agent

arXiv:2505.19897v3 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have extended their impact beyond Natural Language Processing, substantially fostering the development of interdi

model-releasesarxiv-cs-cl
21 Apr 2026
Model Releases

TriTS: Time Series Forecasting from a Multimodal Perspective

DGX agent

arXiv:2604.16748v1 Announce Type: new Abstract: Time series forecasting plays a pivotal role in critical sectors such as finance, energy, transportation, and meteorology. However, Long-term Time Serie

model-releasesarxiv-cs-cv
21 Apr 2026
Model Releases

What's Left Unsaid? Detecting and Correcting Misleading Omissions in Multimodal News Previews

DGX agent

arXiv:2601.05563v2 Announce Type: replace Abstract: Even when factually correct, social-media news previews (image-headline pairs) can induce interpretation drift: by selectively omitting crucial cont

model-releasesarxiv-cs-cv
21 Apr 2026
Model Releases

FineCog-Nav: Integrating Fine-grained Cognitive Modules for Zero-shot Multimodal UAV Navigation

DGX agent

arXiv:2604.16298v1 Announce Type: new Abstract: UAV vision-language navigation (VLN) requires an agent to navigate complex 3D environments from an egocentric perspective while following ambiguous mult

model-releasesarxiv-cs-cv
20 Apr 2026
Model Releases

neuralCAD-Edit: An Expert Benchmark for Multimodal-Instructed 3D CAD Model Editing

DGX agent

arXiv:2604.16170v1 Announce Type: new Abstract: We introduce neuralCAD-Edit, the first benchmark for editing 3D CAD models collected from expert CAD engineers. Instead of text conditioning as in prior

model-releasesarxiv-cs-cv
20 Apr 2026
Model Releases

ContractSkill: Repairable Contract-Based Skills for Multimodal Web Agents

DGX agent

arXiv:2603.20340v3 Announce Type: replace-cross Abstract: Self-generated skills for web agents are often unstable and can even hurt performance relative to direct acting. We argue that the key bottlen

model-releasesarxiv-cs-ai
17 Apr 2026
Model Releases

Edu-MMBias: A Three-Tier Multimodal Benchmark for Auditing Social Bias in Vision-Language Models under Educational Contexts

DGX agent

arXiv:2604.10200v1 Announce Type: new Abstract: As Vision-Language Models (VLMs) become integral to educational decision-making, ensuring their fairness is paramount. However, current text-centric eva

model-releasesarxiv-cs-ai
14 Apr 2026
Model Releases

EduIllustrate: Towards Scalable Automated Generation Of Multimodal Educational Content

DGX agent

arXiv:2604.05005v2 Announce Type: replace-cross Abstract: Large language models are increasingly used as educational assistants, yet evaluation of their educational capabilities remains concentrated o

model-releasesarxiv-cs-ai
14 Apr 2026
Safety

Multimodal Dataset Normalization and Perceptual Validation for Music-Taste Correspondences

DGX agent

arXiv:2604.10632v1 Announce Type: cross Abstract: Collecting large, aligned cross-modal datasets for music-flavor research is difficult because perceptual experiments are costly and small by design. W

safetyarxiv-cs-lg
14 Apr 2026
Research

STQuant: Spatio-Temporal Adaptive Framework for Optimizer Quantization in Large Multimodal Model Training

DGX agent

arXiv:2604.06836v2 Announce Type: new Abstract: Quantization is an effective way to reduce the memory cost of large-scale model training. However, most existing methods adopt fixed-precision policies,

researcharxiv-cs-lg
10 Apr 2026
Safety

Tool-MCoT: Tool Augmented Multimodal Chain-of-Thought for Content Safety Moderation

DGX agent

arXiv:2604.06205v1 Announce Type: cross Abstract: The growth of online platforms and user content requires strong content moderation systems that can handle complex inputs from various media types. Wh

safetyarxiv-cs-ai
10 Apr 2026
← Previous
1…5960616263…211
Next →