AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,119 results
30 Apr 2026

Attribution-Guided Multimodal Deepfake Detection via Cross-Modal Forensic Fingerprints

SafetyDGX agent

arXiv:2604.26453v1 Announce Type: new Abstract: Audio-visual deepfakes have reached a level of realism that makes perceptual detection unreliable, threatening media integrity and biometric security. W

CheXthought: A global multimodal dataset of clinical chain-of-thought reasoning and visual attention for chest X-ray interpretation

ApplicationsDGX agent

arXiv:2604.26288v1 Announce Type: cross Abstract: Chest X-ray interpretation is one of the most frequently performed diagnostic tasks in medicine and a primary target for AI development, yet current v

GoViG: Goal-Conditioned Visual Navigation Instruction Generation via Multimodal Reasoning

ApplicationsDGX agent
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

arXiv:2508.09547v2 Announce Type: replace-cross Abstract: We introduce Goal-Conditioned Visual Navigation Instruction Generation (GoViG), a new task that aims to generate contextually coherent navigat

M2R2: MultiModal Robotic Representation for Temporal Action Segmentation

ResearchDGX agent

arXiv:2504.18662v3 Announce Type: replace-cross Abstract: Temporal action segmentation (TAS) has long been a key area of research in both robotics and computer vision. In robotics, algorithms have pri

28 Apr 2026

QEVA: A Reference-Free Evaluation Metric for Narrative Video Summarization with Multimodal Question Answering

Model ReleasesDGX agent

arXiv:2604.24052v1 Announce Type: cross Abstract: Video-to-text summarization remains underexplored in terms of comprehensive evaluation methods. Traditional n-gram overlap-based metrics and recent la

27 Apr 2026

Multimodal Diffusion to Mutually Enhance Polarized Light and Low Resolution EBSD Data

TutorialsDGX agent

arXiv:2604.22212v1 Announce Type: cross Abstract: In spite of the utility of 3-D electron back-scattered diffraction (EBSD) microscopy, the data collection process can be time-consuming with serial-se

24 Apr 2026

Thinking Like a Botanist: Challenging Multimodal Language Models with Intent-Driven Chain-of-Inquiry

Model ReleasesDGX agent

arXiv:2604.20983v1 Announce Type: cross Abstract: Vision evaluations are typically done through multi-step processes. In most contemporary fields, experts analyze images using structured, evidence-bas

23 Apr 2026

CCTVBench: Contrastive Consistency Traffic VideoQA Benchmark for Multimodal LLMs

Model ReleasesDGX agent

arXiv:2604.20460v1 Announce Type: new Abstract: Safety-critical traffic reasoning requires contrastive consistency: models must detect true hazards when an accident occurs, and reliably reject plausib

VTouch++: A Multimodal Dataset with Vision-Based Tactile Enhancement for Bimanual Manipulation

ApplicationsDGX agent

arXiv:2604.20444v1 Announce Type: cross Abstract: Embodied intelligence has advanced rapidly in recent years; however, bimanual manipulation-especially in contact-rich tasks remains challenging. This

22 Apr 2026

Multimodal embodiment-aware navigation transformer

SafetyDGX agent

arXiv:2604.19267v1 Announce Type: new Abstract: Goal-conditioned navigation models for ground robots trained using supervised learning show promising zero-shot transfer, but their collision-avoidance

PuzzleWorld: A Benchmark for Multimodal, Open-Ended Reasoning in Puzzlehunts

Model ReleasesDGX agent

arXiv:2506.06211v2 Announce Type: replace-cross Abstract: Puzzlehunts are a genre of complex, multi-step puzzles lacking well-defined problem definitions. In contrast to conventional reasoning benchma

REVEAL: Multimodal Vision-Language Alignment of Retinal Morphometry and Clinical Risks for Incident AD and Dementia Prediction

SafetyDGX agent

arXiv:2604.18757v1 Announce Type: cross Abstract: The retina provides a unique, noninvasive window into Alzheimer's disease (AD) and dementia, capturing early structural changes through morphometric f

21 Apr 2026

A Discordance-Aware Multimodal Framework with Multi-Agent Clinical Reasoning

AgentsDGX agent

arXiv:2604.16333v1 Announce Type: new Abstract: Knee osteoarthritis frequently exhibits discordance between structural damage observed in imaging and patient-reported symptoms such as pain. This misma

BasketHAR: A Multimodal Dataset for Human Activity Recognition and Sport Analysis in Basketball Training Scenarios

Model ReleasesDGX agent

arXiv:2604.17065v1 Announce Type: new Abstract: Human Activity Recognition (HAR) involves the automatic identification of user activities and has gained significant research interest due to its broad

DGSSM: Diffusion guided state-space models for multimodal salient object detection

ResearchDGX agent

arXiv:2604.17585v1 Announce Type: new Abstract: Salient object detection (SOD) requires modeling both long-range contextual dependencies and fine-grained structural details, which remains challenging

EgoWalk: A Multimodal Dataset for Robot Navigation in the Wild

ApplicationsDGX agent

arXiv:2505.21282v2 Announce Type: replace Abstract: Data-driven navigation algorithms are critically dependent on large-scale, high-quality real-world data collection for successful training and robus

GoCoMA: Hyperbolic Multimodal Representation Fusion for Large Language Model-Generated Code Attribution

ResearchDGX agent

arXiv:2604.16377v1 Announce Type: new Abstract: Large Language Models (LLMs) trained on massive code corpora are now increasingly capable of generating code that is hard to distinguish from human-writ

MegaRAG: Multimodal Knowledge Graph-Based Retrieval Augmented Generation

ResearchDGX agent

arXiv:2512.20626v2 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) enables large language models (LLMs) to dynamically access external information, which is powerful for an

More Than Sum of Its Parts: Deciphering Intent Shifts in Multimodal Hate Speech Detection

Model ReleasesDGX agent

arXiv:2603.21298v2 Announce Type: replace Abstract: Combating hate speech on social media is critical for securing cyberspace, yet relies heavily on the efficacy of automated detection systems. As con

Multimodal Fusion of Histopathology Images and Electronic Health Records for Early Breast Cancer Diagnosis

ResearchDGX agent

arXiv:2604.17122v1 Announce Type: new Abstract: Breast cancer is a leading cause of cancer-related mortality worldwide, and timely accurate diagnosis is critical to improving survival outcomes. While

ZSG-IAD: A Multimodal Framework for Zero-Shot Grounded Industrial Anomaly Detection

ResearchDGX agent

arXiv:2604.17949v1 Announce Type: new Abstract: Deep learning-based industrial anomaly detectors often behave as black boxes, making it hard to justify decisions with physically meaningful defect evid

20 Apr 2026

ExoNet: Multimodal Deep Learning for TESS Exoplanet Candidate Identification via Phase-Folded Light Curves, Stellar Parameters, and Multi-Head Attention Fusion

Local AiDGX agent

arXiv:2604.15560v1 Announce Type: cross Abstract: NASA's Transiting Exoplanet Survey Satellite (TESS) has identified thousands of exoplanet candidates, yet many remain unconfirmed due to the limitatio

MM-Telco: Benchmarks and Multimodal Large Language Models for Telecom Applications

Model ReleasesDGX agent

arXiv:2511.13131v2 Announce Type: replace Abstract: Large Language Models (LLMs) have emerged as powerful tools for automating complex reasoning and decision-making tasks. In telecommunications, they

17 Apr 2026

Hoi! -- A Multimodal Dataset for Force-Grounded, Cross-View Articulated Manipulation

ResearchDGX agent

arXiv:2512.04884v3 Announce Type: replace Abstract: We present a dataset for force-grounded, cross-view articulated manipulation that couples what is seen with what is done and what is felt during rea

15 Apr 2026

MISID: A Multimodal Multi-turn Dataset for Complex Intent Recognition in Strategic Deception Games

Model ReleasesDGX agent

arXiv:2604.12700v1 Announce Type: new Abstract: Understanding human intent in complex multi-turn interactions remains a fundamental challenge in human-computer interaction and behavioral analysis. Whi

14 Apr 2026

OmniShow: Unifying Multimodal Conditions for Human-Object Interaction Video Generation

Model ReleasesDGX agent

arXiv:2604.11804v1 Announce Type: new Abstract: In this work, we study Human-Object Interaction Video Generation (HOIVG), which aims to synthesize high-quality human-object interaction videos conditio

OmniUMI: Towards Physically Grounded Robot Learning via Human-Aligned Multimodal Interaction

SafetyDGX agent

arXiv:2604.10647v1 Announce Type: new Abstract: UMI-style interfaces enable scalable robot learning, but existing systems remain largely visuomotor, relying primarily on RGB observations and trajector

13 Apr 2026

All You Need for Object Detection: From Pixels, Points, and Prompts to Next-Gen Fusion and Multimodal LLMs/VLMs in Autonomous Vehicles

AgentsDGX agent

arXiv:2510.26641v4 Announce Type: replace Abstract: Autonomous Vehicles (AVs) are transforming the future of transportation through advances in intelligent perception, decision-making, and control sys

Degradation-Robust Fusion: An Efficient Degradation-Aware Diffusion Framework for Multimodal Image Fusion in Arbitrary Degradation Scenarios

TutorialsDGX agent

arXiv:2604.08922v1 Announce Type: new Abstract: Complex degradations like noise, blur, and low resolution are typical challenges in real world image fusion tasks, limiting the performance and practica

Detection of Hate and Threat in Digital Forensics: A Case-Driven Multimodal Approach

ResearchDGX agent

arXiv:2604.08609v1 Announce Type: cross Abstract: Digital forensic investigations increasingly rely on heterogeneous evidence such as images, scanned documents, and contextual reports. These artifacts

10 Apr 2026

Analyzing Multimodal Interaction Strategies for LLM-Assisted Manipulation of 3D Scenes

TutorialsDGX agent

arXiv:2410.22177v2 Announce Type: replace-cross Abstract: As more applications of large language models (LLMs) for 3D content for immersive environments emerge, it is crucial to study user behaviour t

Interpretable Tau-PET Synthesis from Multimodal T1-Weighted and FLAIR MRI Using Partial Information Decomposition Guided Disentangled Quantized Half-UNet

ResearchDGX agent

arXiv:2602.22545v2 Announce Type: replace Abstract: Tau positron emission tomography (tau-PET) is an important in vivo biomarker of Alzheimer's disease, but its cost, limited availability, and acquisi

16 Oct 2026

A Flow-Theoretic Multimodal Control Framework Fusing Mental and Physical Engagement for Upper-Limb Rehabilitation

ResearchDGX agent

arXiv:2610.21590v1 Announce Type: new Abstract: While Assist-as-Needed (AAN) control aims to maximize user participation in robot-assisted training, existing methods relying solely on physical metrics

CogDrift-4D: Hierarchical Multimodal Modeling of Temporal Behavioral Decay for MCI Detection

Local AiDGX agent

arXiv:2610.20877v1 Announce Type: cross Abstract: Early detection of mild cognitive impairment remains a critical bottleneck in dementia care, demanding scalable tools capable of capturing subtle beha

Decoding Naturalistic Speech from fMRI with Temporal Modeling and Multimodal Alignment

SafetyDGX agent

arXiv:2610.22049v1 Announce Type: cross Abstract: Reconstructing what a person perceives from their brain activity is a stringent test of whether neural recordings carry meaningful information. Natura

Intern-Decision: Efficient Multimodal Decision Making with Autoregressive Masked Language Modeling

AgentsDGX agent

arXiv:2610.22131v1 Announce Type: new Abstract: Interactive agents repeatedly choose among a finite set of actions, labels, or ordinal outcomes. Generating a free-form response for each choice adds la

15 Oct 2026

ChemArgus: Automated Scientific Diagnostics for Lab-Grade Multimodal Chemistry Reasoning: A Frontier Benchmark

Model ReleasesDGX agent

arXiv:2610.20012v1 Announce Type: new Abstract: Chemistry evaluation has moved past multiple-choice probes toward open-ended expert problems, yet the benchmarks that define the current frontier still

On the Limits of Representation-Based Test-Time Adaptation for Multimodal LLMs

SafetyDGX agent

arXiv:2610.19892v1 Announce Type: cross Abstract: Vision-language models suffer significant accuracy drops under common corruptions. While test-time adaptation (TTA) successfully mitigates these shift

14 Oct 2026

A 35B multimodal model running on a phone with ~3GB memory? MiniCPM-V 4.7 demo is pretty wild

Model ReleasesDGX agent

Just saw this demo from OpenBMB for MiniCPM-V 4.7, and the on-device capability is pretty impressive. A 35B-A3B MoE vision-language model running locally on mobile devices is already interesting, but

Interpretable Multimodal EEG-ECG Framework for Neonatal Seizure Prediction and Patient-Adaptive Transfer Learning

Model ReleasesDGX agent

arXiv:2511.14110v2 Announce Type: replace-cross Abstract: Neonatal seizures carry substantial risks of acute brain injury and long-term neurodevelopmental impairment, motivating the need for timely id

Let the Mind Conceive, Let the Hand Achieve: Following Multimodal Instructions for Long-Horizon Robotic Manipulation

Model ReleasesDGX agent

arXiv:2610.18352v1 Announce Type: new Abstract: A robot following a multi-step instruction needs to act on the right objects in the right order, even as the scene changes. It must also maintain awaren

Merit: Making every modality earn its contribution in multimodal attention decoding

Model ReleasesDGX agent

arXiv:2610.17507v1 Announce Type: new Abstract: More than 1.5 billion people have hearing loss. When several people talk at once, hearing aids amplify every voice alike. Auditory attention decoding (A

Neuro-Symbolic Graph Transformers for Hierarchical Intention Recognition from Multimodal Human Activity Sequences

AgentsDGX agent

arXiv:2610.18176v1 Announce Type: cross Abstract: Proactive human-robot collaboration requires autonomous systems to infer not only immediate actions but also the underlying hierarchical intentions go

Toward a Multimodal Foundation Model for Plasma State Reconstruction

Model ReleasesDGX agent

arXiv:2610.15076v1 Announce Type: new Abstract: Plasma experiments observe coupled physical states through sparse, heterogeneous, and incomplete diagnostics. We present a proof of concept toward a mul

12 Oct 2026

SeoulMMOD: A Large-Scale Multimodal Origin-Destination Flow Benchmark

Model ReleasesDGX agent

arXiv:2610.13730v1 Announce Type: new Abstract: Origin-destination (OD) flow forecasting supports urban mobility decisions by predicting the volume and patterns of human movement across a city. Most e

Unsupervised Multimodal Reward Modeling

Model ReleasesDGX agent

arXiv:2610.12707v1 Announce Type: cross Abstract: Vision-language reward models are trained on annotated preference pairs, which are expensive to collect, can disagree, and are ranked by benchmark acc

9 Oct 2026

ActiveMedAgent: Cost-Aware Trajectory Learning for Multimodal Medical Diagnosis

SafetyDGX agent

arXiv:2610.11140v1 Announce Type: cross Abstract: Clinical diagnosis is inherently sequential: clinicians escalate from cheap to costly tests only when additional evidence is expected to resolve diagn

Humanity's Sixth Sense: Benchmarking Intuitive Visual Reasoning in Multimodal Models

Model ReleasesDGX agent

arXiv:2610.08966v2 Announce Type: replace Abstract: Humans perceive far more in a scene than what is explicitly depicted: a single glance captures past causes and future trajectories; a quick peek det

Improving Image-Based Nutrition Estimation Through Multimodal Food-Item Verification and Recovery

ResearchDGX agent

arXiv:2610.11144v1 Announce Type: cross Abstract: Single-image nutrition estimation can fail silently when visible foods are missed. Even when a food is correctly identified, its proposed region may n

8 Oct 2026

DiTS: Multimodal Diffusion Transformers Are Time Series Forecasters

SafetyDGX agent

arXiv:2602.06597v2 Announce Type: replace Abstract: While generative modeling facilitates probabilistic time series forecasting, incorporating heterogeneous exogenous information remains challenging.

GRC-Net: Global Representation Consistency Network for Unsupervised Multimodal Anomaly Detection

ApplicationsDGX agent

arXiv:2610.09329v1 Announce Type: new Abstract: Automated quality inspection is essential for ensuring product reliability in manufacturing.While image-based methods effectively capture appearance-rel

HarnessIR: Harnessing Multimodal Foundation Models for Universal Real-World Image Restoration

Model ReleasesDGX agent

arXiv:2610.10133v1 Announce Type: new Abstract: Real-world low-quality images suffer from complex mixed degradations, including but not limited to noise, blur, atmospheric effects, etc. Recent agentic

MultiFly: A Real-World Multimodal Aerial Dataset with Annotation-Efficient Label Transfer and Cross-Modal Semantic Consistency

Model ReleasesDGX agent

arXiv:2610.10359v1 Announce Type: cross Abstract: We introduce MultiFly, a real-world, low-altitude UAV dataset for semantic perception across RGB, thermal, LiDAR, and radar modalities. MultiFly provi

Zero-shot Video Moment Retrieval via Off-the-shelf Multimodal Large Language Models

Model ReleasesDGX agent

arXiv:2501.07972v2 Announce Type: replace-cross Abstract: The target of video moment retrieval (VMR) is predicting temporal spans within a video that semantically match a given linguistic query. Exist

7 Oct 2026

A Swarm-Coordinated Multi-Robot System for Early Stress Detection in Agricultural Rows Using Multimodal Leaf Sensing

AgentsDGX agent

arXiv:2610.08603v1 Announce Type: cross Abstract: Early stress detection in crops is a necessity today to improve efficiency and reduce waste of time, money, and effort. However, most modern technique

Attention from Above: A Multimodal Model for Drone-Based Object Localization

Local AiDGX agent

arXiv:2607.17669v2 Announce Type: replace Abstract: Drone-based object detection technology has advanced rapidly, becoming increasingly sophisticated and efficient. Recently, research trends have expa

DSV-Mem: Evaluating Multimodal Memory in Professional Workflows for MLLM Agents

Model ReleasesDGX agent

arXiv:2610.08102v1 Announce Type: new Abstract: Conversational MLLM agents are increasingly expected to assist in professional workflows, from AI research and engineering design to product management

ESP: Energy-Score Policy for One-Step Multimodal Action Generation

SafetyDGX agent

arXiv:2610.07696v1 Announce Type: new Abstract: Generative action models based on diffusion and flow matching have been increasingly adopted in vision-language-action (VLA) policies for their ability

Real-Time Generation of Game Video Commentary with Multimodal LLMs: Pause-Aware Decoding Approaches

Model ReleasesDGX agent

arXiv:2603.02655v2 Announce Type: replace-cross Abstract: Real-time video commentary generation provides textual descriptions of ongoing events in videos. It supports accessibility and engagement in d

Speak to a Protein: An Interactive Multimodal Co-Scientist

ResearchDGX agent

arXiv:2510.17826v2 Announce Type: replace-cross Abstract: Building a working mental model of a protein typically requires weeks of reading, cross-referencing crystal and predicted structures, and insp

← Previous
1…3738394041…169
Next →