AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
Human
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
9,441 results
Research

Simulating clinical interventions with a generative multimodal model of human physiology

DGX agent

arXiv:2604.27899v1 Announce Type: new Abstract: Understanding how human health changes over time, and why responses to interventions vary between individuals, remains a central challenge in medicine.

researcharxiv-cs-ai
1 May 2026
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Research

A Multimodal Depth-Aware Method For Embodied Reference Understanding

DGX agent

arXiv:2510.08278v3 Announce Type: replace Abstract: Embodied Reference Understanding requires identifying a target object in a visual scene based on both language instructions and pointing cues. While

researcharxiv-cs-cv
30 Apr 2026
Model Releases

Benchmarking Complex Multimodal Document Processing Pipelines: A Unified Evaluation Framework for Enterprise AI

DGX agent

arXiv:2604.26382v1 Announce Type: cross Abstract: Most enterprise document AI today is a pipeline. Parse, index, retrieve, generate. Each of those stages has been studied to death on its own -- what's

model-releasesarxiv-cs-ai
30 Apr 2026
Model Releases

Multimodal LLMs are not all you need for Pediatric Speech Language Pathology

DGX agent

arXiv:2604.26568v1 Announce Type: new Abstract: Speech Sound Disorders (SSD) affect roughly five percent of children, yet speech-language pathologists face severe staffing shortages and unmanageable c

model-releasesarxiv-cs-cl
30 Apr 2026
Safety

ViTaPEs: Visuotactile Position Encodings for Cross-Modal Alignment in Multimodal Transformers

DGX agent

arXiv:2505.20032v3 Announce Type: replace Abstract: Tactile sensing provides local essential information that is complementary to visual perception, such as texture, compliance, and force. Despite rec

safetyarxiv-cs-cv
30 Apr 2026
Model Releases

Variational Neural Belief Parameterizations for Robust Dexterous Grasping under Multimodal Uncertainty

DGX agent

arXiv:2604.25897v1 Announce Type: cross Abstract: Contact variability, sensing uncertainty, and external disturbances make grasp execution stochastic. Expected-quality objectives ignore tail outcomes

model-releasesarxiv-cs-lg
29 Apr 2026
Model Releases

Affordance-R1: Reinforcement Learning for Generalizable Affordance Reasoning in Multimodal Large Language Model

DGX agent

arXiv:2508.06206v4 Announce Type: replace-cross Abstract: Affordance grounding focuses on predicting the specific regions of objects that are associated with the actions to be performed by robots. It

model-releasesarxiv-cs-cv
28 Apr 2026
Model Releases

ClawMark: A Living-World Benchmark for Multi-Turn, Multi-Day, Multimodal Coworker Agents

DGX agent

arXiv:2604.23781v1 Announce Type: new Abstract: Language-model agents are increasingly used as persistent coworkers that assist users across multiple working days. During such workflows, the surroundi

model-releasesarxiv-cs-cv
28 Apr 2026
Model Releases

DriVerse: Navigation World Model for Driving Simulation via Multimodal Trajectory Prompting and Motion Alignment

DGX agent

arXiv:2504.18576v2 Announce Type: replace Abstract: This paper presents DriVerse, a generative model for simulating navigation-driven driving scenes from a single image and a future trajectory. Previo

model-releasesarxiv-cs-ro
28 Apr 2026
Applications

Open-Vocabulary Semantic Segmentation Network Integrating Object-Level Label and Scene-Level Semantic Features for Multimodal Remote Sensing Images

DGX agent

arXiv:2604.24125v1 Announce Type: new Abstract: Semantic segmentation of multi-modal remote sensing imagery plays a pivotal role in land use/land cover (LULC) mapping, environmental monitoring, and pr

applicationsarxiv-cs-cv
28 Apr 2026
Model Releases

Leveraging Multimodal LLMs for Built Environment and Housing Attribute Assessment from Street-View Imagery

DGX agent

arXiv:2604.21102v1 Announce Type: cross Abstract: We present a novel framework for automatically evaluating building conditions nationwide in the United States by leveraging large language models (LLM

model-releasesarxiv-cs-ai
24 Apr 2026
Agents

Multimodal Bayesian Network for Robust Assessment of Casualties in Autonomous Triage

DGX agent

arXiv:2512.18908v2 Announce Type: replace Abstract: Mass Casualty Incidents can overwhelm emergency medical systems and resulting delays or errors in the assessment of casualties can lead to preventab

agentsarxiv-cs-ai
24 Apr 2026
Research

3D Smoke Scene Reconstruction Guided by Vision Priors from Multimodal Large Language Models

DGX agent

arXiv:2604.05687v2 Announce Type: replace Abstract: Reconstructing 3D scenes from smoke-degraded multi-view images is particularly difficult because smoke introduces strong scattering effects, view-de

researcharxiv-cs-cv
23 Apr 2026
Research

Mitigating Multimodal Hallucination via Phase-wise Self-reward

DGX agent

arXiv:2604.17982v1 Announce Type: cross Abstract: Large Vision-Language Models (LVLMs) still struggle with vision hallucination, where generated responses are inconsistent with the visual input. Exist

researcharxiv-cs-cl
21 Apr 2026
Model Releases

ScienceBoard: Evaluating Multimodal Autonomous Agents in Realistic Scientific Workflows

DGX agent

arXiv:2505.19897v3 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have extended their impact beyond Natural Language Processing, substantially fostering the development of interdi

model-releasesarxiv-cs-cl
21 Apr 2026
Model Releases

TriTS: Time Series Forecasting from a Multimodal Perspective

DGX agent

arXiv:2604.16748v1 Announce Type: new Abstract: Time series forecasting plays a pivotal role in critical sectors such as finance, energy, transportation, and meteorology. However, Long-term Time Serie

model-releasesarxiv-cs-cv
21 Apr 2026
Model Releases

What's Left Unsaid? Detecting and Correcting Misleading Omissions in Multimodal News Previews

DGX agent

arXiv:2601.05563v2 Announce Type: replace Abstract: Even when factually correct, social-media news previews (image-headline pairs) can induce interpretation drift: by selectively omitting crucial cont

model-releasesarxiv-cs-cv
21 Apr 2026
Model Releases

FineCog-Nav: Integrating Fine-grained Cognitive Modules for Zero-shot Multimodal UAV Navigation

DGX agent

arXiv:2604.16298v1 Announce Type: new Abstract: UAV vision-language navigation (VLN) requires an agent to navigate complex 3D environments from an egocentric perspective while following ambiguous mult

model-releasesarxiv-cs-cv
20 Apr 2026
Model Releases

neuralCAD-Edit: An Expert Benchmark for Multimodal-Instructed 3D CAD Model Editing

DGX agent

arXiv:2604.16170v1 Announce Type: new Abstract: We introduce neuralCAD-Edit, the first benchmark for editing 3D CAD models collected from expert CAD engineers. Instead of text conditioning as in prior

model-releasesarxiv-cs-cv
20 Apr 2026
Model Releases

ContractSkill: Repairable Contract-Based Skills for Multimodal Web Agents

DGX agent

arXiv:2603.20340v3 Announce Type: replace-cross Abstract: Self-generated skills for web agents are often unstable and can even hurt performance relative to direct acting. We argue that the key bottlen

model-releasesarxiv-cs-ai
17 Apr 2026
Model Releases

Edu-MMBias: A Three-Tier Multimodal Benchmark for Auditing Social Bias in Vision-Language Models under Educational Contexts

DGX agent

arXiv:2604.10200v1 Announce Type: new Abstract: As Vision-Language Models (VLMs) become integral to educational decision-making, ensuring their fairness is paramount. However, current text-centric eva

model-releasesarxiv-cs-ai
14 Apr 2026
Model Releases

EduIllustrate: Towards Scalable Automated Generation Of Multimodal Educational Content

DGX agent

arXiv:2604.05005v2 Announce Type: replace-cross Abstract: Large language models are increasingly used as educational assistants, yet evaluation of their educational capabilities remains concentrated o

model-releasesarxiv-cs-ai
14 Apr 2026
Safety

Multimodal Dataset Normalization and Perceptual Validation for Music-Taste Correspondences

DGX agent

arXiv:2604.10632v1 Announce Type: cross Abstract: Collecting large, aligned cross-modal datasets for music-flavor research is difficult because perceptual experiments are costly and small by design. W

safetyarxiv-cs-lg
14 Apr 2026
Research

STQuant: Spatio-Temporal Adaptive Framework for Optimizer Quantization in Large Multimodal Model Training

DGX agent

arXiv:2604.06836v2 Announce Type: new Abstract: Quantization is an effective way to reduce the memory cost of large-scale model training. However, most existing methods adopt fixed-precision policies,

researcharxiv-cs-lg
10 Apr 2026
Safety

Tool-MCoT: Tool Augmented Multimodal Chain-of-Thought for Content Safety Moderation

DGX agent

arXiv:2604.06205v1 Announce Type: cross Abstract: The growth of online platforms and user content requires strong content moderation systems that can handle complex inputs from various media types. Wh

safetyarxiv-cs-ai
10 Apr 2026
Research

Proximal-Only Transmission Matrix Recovery of an Arbitrarily Deformed Graded-Index Multimode Fiber

DGX agent

arXiv:2609.14869v1 Announce Type: cross Abstract: The multimode fiber is among the thinnest imaging conduits available, carrying hundreds to thousands of spatial modes through a cross-section comparab

researcharxiv-cs-cv
15 Sept 2026
Model Releases

Qwen3.8-Omni: Towards Native Omni-Modal Agents

DGX agent

arXiv:2609.25611v1 Announce Type: new Abstract: We introduce Qwen3.8-Omni-Flash, a natively multimodal agentic model for real-world multimodal productivity. Compared with previous omni models, which p

model-releasesarxiv-cs-cl
23 Sept 2026
Safety

Twins: Learn to Predict Unified Representations with Focal Loss

DGX agent

arXiv:2607.22531v1 Announce Type: new Abstract: Unified multimodal models seek a shared visual token space that supports both multimodal understanding and image generation. Discrete methods unify the

safetyarxiv-cs-cv
27 Jul 2026
Applications

Affect-Prototype Guided Fusion for Open-Vocabulary Incomplete Multi-modal Emotion Recognition

DGX agent

arXiv:2609.16962v1 Announce Type: new Abstract: Open-vocabulary multimodal emotion recognition (OV-MER) aims to generate open natural-language emotion labels from multimodal affective cues. In real-wo

applicationsarxiv-cs-ai
16 Sept 2026
Research

CheXmix: Unified Generative Pretraining for Vision Language Models in Medical Imaging

DGX agent

arXiv:2604.22989v1 Announce Type: cross Abstract: Recent medical multimodal foundation models are built as multimodal LLMs (MLLMs) by connecting a CLIP-pretrained vision encoder to an LLM using LLaVA-

researcharxiv-cs-ai
28 Apr 2026
Research

AFMRL: Attribute-Enhanced Fine-Grained Multi-Modal Representation Learning in E-commerce

DGX agent

arXiv:2604.20135v1 Announce Type: new Abstract: Multimodal representation is crucial for E-commerce tasks such as identical product retrieval. Large representation models (e.g., VLM2Vec) demonstrate s

researcharxiv-cs-cl
23 Apr 2026
Safety

Hybrid Latent Reasoning with Decoupled Policy Optimization

DGX agent

arXiv:2604.20328v1 Announce Type: new Abstract: Chain-of-Thought (CoT) reasoning significantly elevates the complex problem-solving capabilities of multimodal large language models (MLLMs). However, a

safetyarxiv-cs-cv
23 Apr 2026
Model Releases

Benchmarking Large Vision-Language Models on Fine-Grained Image Tasks: A Comprehensive Evaluation

DGX agent

arXiv:2504.14988v3 Announce Type: replace Abstract: Recent advancements in Large Vision-Language Models (LVLMs) have demonstrated remarkable multimodal perception capabilities, garnering significant a

model-releasesarxiv-cs-cv
14 Apr 2026
Research

From Stages to States: Unified Iterative Reasoning for MLLMs

DGX agent

arXiv:2610.15620v1 Announce Type: new Abstract: Multimodal Chain-of-Thought (MCoT) substantially enhances the complex reasoning capabilities of Multimodal Large Language Models (MLLMs) by explicitly m

researcharxiv-cs-ai
15 Oct 2026
Model Releases

WeMM-Embedding: WeChat Multi-Modal Embedding Technical Report

DGX agent

arXiv:2608.24053v1 Announce Type: new Abstract: Universal multimodal embeddings are becoming a core component of modern AI systems, enabling heterogeneous content to be represented in a shared space f

model-releasesarxiv-cs-cv
26 Aug 2026
Safety

DOSE: Data Selection for Multi-Modal LLMs via Off-the-Shelf Models

DGX agent

arXiv:2604.16979v1 Announce Type: cross Abstract: High-quality and diverse multimodal data are essential for improving vision-language models (VLMs), yet existing datasets often contain noisy, redunda

safetyarxiv-cs-cl
21 Apr 2026
Model Releases

AudioX: A Unified Framework for Anything-to-Audio Generation

DGX agent

arXiv:2503.10522v4 Announce Type: replace-cross Abstract: Audio and music generation based on flexible multimodal control signals is a widely applicable topic, with the following key challenges: 1) a

model-releasesarxiv-cs-cv
16 Apr 2026
Model Releases

Seek-and-Solve: Benchmarking MLLMs for Visual Clue-Driven Reasoning in Daily Scenarios

DGX agent

arXiv:2604.14041v1 Announce Type: new Abstract: Daily scenarios are characterized by visual richness, requiring Multimodal Large Language Models (MLLMs) to filter noise and identify decisive visual cl

model-releasesarxiv-cs-cv
16 Apr 2026
Model Releases

Probing and Inducing Clinical Modality Grounding in Brain Tumor Segmentation

DGX agent

arXiv:2603.19844v3 Announce Type: replace Abstract: Multimodal MRI provides complementary information for brain tumor segmentation, but high accuracy alone does not reveal whether a model relies on cl

model-releasesarxiv-cs-cv
14 Oct 2026
Safety

OSPO: Object-Centric Self-Improving Preference Optimization for Text-to-Image Generation

DGX agent

arXiv:2506.02015v4 Announce Type: replace Abstract: Recent advances in Multimodal Large Language Models (MLLMs) have enabled unified multimodal understanding and generation. However, they still strugg

safetyarxiv-cs-cv
28 Sept 2026
Model Releases

GUIDE: Guiding Internal Evidence with Language Instructions

DGX agent

arXiv:2608.30712v1 Announce Type: new Abstract: Large multimodal models follow instructions about what to generate, but not necessarily about what evidence to rely on. Hence, models may continue to de

model-releasesarxiv-cs-cl
1 Sept 2026
Research

Think, Look, and Revise: Inconsistency-Aware Visual Self-Correction in MLLMs

DGX agent

arXiv:2608.29374v1 Announce Type: new Abstract: Tool-augmented multimodal reasoning integrates external tools (e.g., object detection, depth estimation) into multimodal large language models (MLLMs) t

researcharxiv-cs-cv
1 Sept 2026
Local Ai

Transient multimode heat transfer of an industrial automated tape laying process under rapidly changing conditions

DGX agent

arXiv:2608.25470v1 Announce Type: new Abstract: This work presents a transient heat-transfer model of an industrial automated tape laying (ATL) process designed to overcome the limitations of conventi

local-aiarxiv-cs-ro
27 Aug 2026
Model Releases

HMGCLIP: Heterogeneous Multi-Granularity Contrastive Learning for E-commerce Representation Learning

DGX agent

arXiv:2608.24467v1 Announce Type: new Abstract: Although recent Multimodal Large Language Models (MLLMs) have advanced general product understanding, they implicitly encode product information into gl

model-releasesarxiv-cs-ai
26 Aug 2026
Model Releases

KoViDoRe: Korean Visual Document Retrieval

DGX agent

arXiv:2608.20840v1 Announce Type: cross Abstract: Recent advances in multimodal retrieval have improved the ability to retrieve information from visually rich documents such as PDFs and reports. Howev

model-releasesarxiv-cs-cv
24 Aug 2026
Model Releases

TTSD-FAR: Test-Time Self-Distillation with Fisher-Anchored Restoration for Missing-Modality Emotion Recognition in LVLMs

DGX agent

arXiv:2608.18386v1 Announce Type: cross Abstract: Large video-language models (LVLMs) have shown remarkable performance on multimodal tasks like multimodal emotion recognition (ER) in the wild. ER is

model-releasesarxiv-cs-ai
20 Aug 2026
Model Releases

UniVideo: Unified Understanding, Generation, and Editing for Videos

DGX agent

arXiv:2510.08377v4 Announce Type: replace Abstract: Unified multimodal models have shown promising results in multimodal content generation and editing but remain largely limited to the image domain.

model-releasesarxiv-cs-cv
7 Jul 2026
Safety

Dual-Flow Reinforcement Learning with State-Aware Exploration

DGX agent

arXiv:2606.29820v1 Announce Type: cross Abstract: In complex continuous-control reinforcement learning tasks, multimodal optimal actions often coincide with uncertain, multimodal return distributions,

safetyarxiv-cs-ai
30 Jun 2026
← Previous
1…5758596061…197
Next →