AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,117 results
Agents

HiBerNAC: Hierarchical Brain-inspired Robotic Neural Agent Collective for Disentangling Complex Manipulation

DGX agent

arXiv:2506.08296v3 Announce Type: replace Abstract: Recent advances in multimodal vision-language-action (VLA) models have revolutionized traditional robot learning, enabling systems to interpret visi

agentsarxiv-cs-ro
22 Sept 2026
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Agents

Driving on Registers, Reasoning on Risk: Risk-Aware Occupancy for Register-Based End-to-End Autonomous Driving

DGX agent

arXiv:2609.21486v1 Announce Type: new Abstract: Multimodal trajectory prediction improves behavioral coverage in end-to-end autonomous driving, but existing methods remain limited by sparse scene repr

agentsarxiv-cs-ai
21 Sept 2026
Research

The Spoken Wikipedia Presentation Corpus

DGX agent

arXiv:2609.21676v1 Announce Type: cross Abstract: We present the Spoken Wikipedia Presentation Corpus, an extension of the Spoken Wikipedia Corpora featuring LLM-generated slide decks for multimodal A

researcharxiv-cs-cl
21 Sept 2026
Research

CoMa: Contextual Massing Generation with Vision-Language Models

DGX agent

arXiv:2601.08464v2 Announce Type: replace-cross Abstract: Context-aware building massing is an important early-stage design task: given a site for buildings, a generated massing should not only fit th

researcharxiv-cs-ai
18 Sept 2026
Model Releases

Guideline-grounded retrieval-augmented generation for ophthalmic clinical decision support

DGX agent

arXiv:2603.21925v2 Announce Type: replace Abstract: In this work, we propose Oph-Guid-RAG, a multimodal visual RAG system for ophthalmology clinical question answering and decision support. We treat e

model-releasesarxiv-cs-ai
18 Sept 2026
Agents

VLM-CAD: VLM-Optimized Collaborative Agent Design Workflow for Analog Circuit Sizing

DGX agent

arXiv:2601.07315v5 Announce Type: replace-cross Abstract: Vision Language Models (VLMs) have demonstrated remarkable potential in multimodal reasoning. However, they can have spatial blindness and log

agentsarxiv-cs-ai
18 Sept 2026
Safety

Can MiniMax-H3 Reason About the Physical World? An Evaluation of Omni-Modal Generative Model

DGX agent

arXiv:2609.18323v1 Announce Type: new Abstract: Recent Omni-Modal Generative Models (Omni-Models) have advanced content generation toward unified modeling of text, images, video, and audio. MiniMax-H3

safetyarxiv-cs-cv
17 Sept 2026
Model Releases

GRADE: Benchmarking Discipline-Informed Reasoning in Image Editing

DGX agent

arXiv:2603.12264v2 Announce Type: replace Abstract: Unified multimodal models target joint understanding, reasoning, and generation, but current image editing benchmarks are largely confined to natura

model-releasesarxiv-cs-cv
16 Sept 2026
Model Releases

MechReason: Benchmarking Multi-Image Multi-Hop Reasoning in Mechanical Engineering

DGX agent

arXiv:2609.16012v1 Announce Type: new Abstract: Despite significant progress in general visual question answering and cross-modal understanding, multimodal large language models still face a pronounce

model-releasesarxiv-cs-cv
16 Sept 2026
Safety

AdaVSkip: Adaptive Visual Token Skipping Across Layers For Efficient MLLMs Inference

DGX agent

arXiv:2609.15131v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) require substantial computation to process numerous visual tokens across all transformer layers. Most methods

safetyarxiv-cs-ai
15 Sept 2026
Model Releases

ATTRICITE: Training an Open 4B Model for Citation Recovery toward Faithful Attribution

DGX agent

arXiv:2609.14248v1 Announce Type: cross Abstract: Faithful citation attribution begins with identifying the intended source for a scientific claim. We study this source-identification capability throu

model-releasesarxiv-cs-ai
15 Sept 2026
Local Ai

Boosting Point-supervised Temporal Action Localization via Text Refinement and Alignment

DGX agent

arXiv:2602.01257v2 Announce Type: replace Abstract: Recently, point-supervised temporal action localization has gained significant attention for its effective balance between labeling costs and locali

local-aiarxiv-cs-cv
15 Sept 2026
Model Releases

BVB: Benchmarking Agentic Video Understanding via Programmatic Reconstruction in Blender

DGX agent

arXiv:2609.15478v1 Announce Type: new Abstract: Multimodal agents can create complex videos in software such as Blender by coding without relying on diffusion models. Yet video understanding benchmark

model-releasesarxiv-cs-cv
15 Sept 2026
Model Releases

Designing UNICORN: a Unified Benchmark for Imaging in Computational Pathology, Radiology, and Natural Language

DGX agent

arXiv:2603.02790v2 Announce Type: replace Abstract: Foundation models are changing the way we develop medical artificial intelligence. By learning broadly generalizable features across diverse data mo

model-releasesarxiv-cs-cv
15 Sept 2026
Hardware

LynnReal-Omni: Native multi-modal Video Generation for Agentic Visual Workflows

DGX agent

arXiv:2609.15863v1 Announce Type: new Abstract: Video diffusion models are stochastic and hard to control: precise content often requires repeated sampling without guaranteed success, and long-horizon

hardwarearxiv-cs-cv
15 Sept 2026
Agents

Selective Tool Use for Agentic Change Visual Question Answering in Remote Sensing

DGX agent

arXiv:2609.14523v1 Announce Type: new Abstract: Change visual question answering (Change VQA) requires understanding semantic changes across bi-temporal remote sensing images. Although vision language

agentsarxiv-cs-cv
15 Sept 2026
Research

SyRHM: Symbolic-Language-Enhanced Reasoning with Associative Retrieval for Zero-shot Harmful Meme Detection

DGX agent

arXiv:2609.13794v1 Announce Type: new Abstract: Detecting harmful memes is critical for maintaining safe online communities. However, harmful intent is often implicit, arising from visual-textual inco

researcharxiv-cs-cl
15 Sept 2026
Model Releases

ChitraMiti: Benchmarking Visual Grounding and Modality Reliance in Bengali Geometric Reasoning

DGX agent

arXiv:2609.12509v1 Announce Type: new Abstract: Evaluation of vision-language models (VLMs) for multimodal mathematical reasoning remains limited for low-resource languages and for geometry problems t

model-releasesarxiv-cs-cv
14 Sept 2026
Model Releases

LGFN: Lightweight Gated RGB-Polarization Fusion with Modality-Availability Conditioning for Camouflaged Object Detection

DGX agent

arXiv:2609.12798v1 Announce Type: new Abstract: Camouflaged object detection (COD) is an important engineering task in intelligent optical perception, but it remains challenging when targets closely r

model-releasesarxiv-cs-cv
14 Sept 2026
Model Releases

EMMI: Edge Multi-Modal Intelligence for Communication-Efficient MLLM Inference via Fused Representation Compression

DGX agent

arXiv:2609.11058v1 Announce Type: new Abstract: Recent advances in multimodal large language mod- els (MLLMs) have opened new opportunities for edge intelligence by enabling reasoning across heterogen

model-releasesarxiv-cs-lg
11 Sept 2026
Model Releases

Think Before You Link: Rarity, Reasoning, and Retrieval in Multilingual Entity Linking

DGX agent

arXiv:2609.10745v1 Announce Type: new Abstract: Multimodal entity linking grounds entity mentions in text and images to knowledge-base entries. These systems degrade on rare entities, but prior work m

model-releasesarxiv-cs-cl
11 Sept 2026
Research

Learning transferable human physiology from two million hours of sleep with SleepFM-2

DGX agent

arXiv:2609.06849v1 Announce Type: new Abstract: Sleep provides a nightly window into health by capturing coordinated activity across the brain, heart, muscles and respiratory system. We introduce Slee

researcharxiv-cs-ai
10 Sept 2026
Model Releases

LogiScope-VQA: Benchmarking Vision-Language Models for Logistics Hazard Identification in Industrial Scenarios

DGX agent

arXiv:2609.09790v1 Announce Type: cross Abstract: Large Multimodal Models (LMMs) large-scale deployment in industrial warehouse settings specifically necessitates that models exhibit human-expert-leve

model-releasesarxiv-cs-cl
10 Sept 2026
Model Releases

Dual-Latent Memory Routing for Vision-Language Reasoning

DGX agent

arXiv:2609.05539v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have recently made strong progress in vision-language reasoning, yet their performance often degrades as genera

model-releasesarxiv-cs-cv
9 Sept 2026
Safety

Scene Graph-Driven Haptic Feedback for Safety Enhancement in Robotic Ophthalmic Surgery via Physically Simulated iOCT

DGX agent

arXiv:2609.07857v1 Announce Type: cross Abstract: Robotic ophthalmic surgery offers high precision but introduces a 'sensory gap' by decoupling the surgeon from their instrument, resulting in a loss o

safetyarxiv-cs-cv
9 Sept 2026
Model Releases

MedQA-MM: Shortcuts Behind Medical Visual Reasoning

DGX agent

arXiv:2609.03261v1 Announce Type: cross Abstract: A benchmark score credits final answers, but not the route by which an item can be answered. In medical multimodal multiple-choice questions (MCQs), t

model-releasesarxiv-cs-cl
4 Sept 2026
Model Releases

MetaStructAtlas: A Grounded 3D Vision-Language Dataset and Benchmark for Functional and Structural Reasoning in Whole-Body PET/CT

DGX agent

arXiv:2609.03690v1 Announce Type: new Abstract: The joint interpretation of metabolic function and anatomical structure is essential for clinical diagnosis in whole-body PET/CT. Although recent advanc

model-releasesarxiv-cs-cv
4 Sept 2026
Model Releases

Urban Boundaries, Social Barriers: A Benchmark and Vision-Centric Framework for Mapping Gated Communities and Equity Implications

DGX agent

arXiv:2609.03804v1 Announce Type: new Abstract: Communities are fundamental spatial units that shape urban form and social life. Whether a residential compound is spatially open or enclosed affects mo

model-releasesarxiv-cs-cv
4 Sept 2026
Model Releases

DocHop: Benchmarking Out-of-domain Multi-hop Reasoning in Information-Dense Documents

DGX agent

arXiv:2609.02059v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have achieved strong performance on structured visual understanding tasks such as chart and document question a

model-releasesarxiv-cs-ai
3 Sept 2026
Research

DynaTokens: Controlling Token Dynamics for Continual Video-Language Understanding

DGX agent

arXiv:2603.06662v3 Announce Type: replace Abstract: Continual VideoQA with multimodal LLMs remains challenging because sequential adaptation induces task interference, while storing task-specific prom

researcharxiv-cs-cv
3 Sept 2026
Local Ai

InfraPatch: Cross-Task Targeted Grayscale Patch Attacks on Infrared-Adapted Vision-Language Models

DGX agent

arXiv:2609.02233v1 Announce Type: cross Abstract: Infrared vision-language models (IR-VLMs) have emerged as a promising paradigm for multimodal perception under low-visibility conditions, yet their ro

local-aiarxiv-cs-ai
3 Sept 2026
Model Releases

Video Object Segmentation-Aware Audio Generation

DGX agent

arXiv:2509.26604v2 Announce Type: replace Abstract: Existing multimodal audio generation models often lack precise user control, which limits their applicability in professional Foley workflows. In pa

model-releasesarxiv-cs-cv
3 Sept 2026
Model Releases

ClearText-Video: A Large-Scale Text-Centric Video Dataset Bridging Video Restoration and Scene-Text Enhancement

DGX agent

arXiv:2608.28784v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have recently made strong progress in visual--linguistic understanding. However, their performance on text-cent

model-releasesarxiv-cs-cv
1 Sept 2026
Research

Co-Evolutionary Prompt Optimization with Cross-Category Transfer for Zero-Shot Anomaly Detection

DGX agent

arXiv:2608.29467v1 Announce Type: new Abstract: Zero-shot anomaly detection (ZSAD) has gained significant attention for its practical value in industrial inspection. Recently, CLIP-based approaches ha

researcharxiv-cs-cv
1 Sept 2026
Model Releases

Defending Wearable VLMs Against Private Attribute Inference

DGX agent

arXiv:2608.28691v1 Announce Type: cross Abstract: Wearable VLM pipelines promise continuous multimodal assistance from egocentric visual capture: a user asks a task-driven question about the surroundi

model-releasesarxiv-cs-ai
1 Sept 2026
Model Releases

Evidence-Bounded Mental Health Reasoning from Heterogeneous Speech Protocols

DGX agent

arXiv:2608.31014v1 Announce Type: new Abstract: Computational mental health screening using multimodal speech and text has shown great promise. However, existing models often assume all clinical speec

model-releasesarxiv-cs-cl
1 Sept 2026
Model Releases

Guardrail-Agnostic Societal Bias Evaluation in Large Vision-Language Models

DGX agent

arXiv:2608.29590v1 Announce Type: new Abstract: We propose a societal bias evaluation method for large vision-language models (LVLMs) in the era of strong safety guardrails. Existing benchmarks rely o

model-releasesarxiv-cs-cv
1 Sept 2026
Safety

RAGDiffusion++: From Macro-Retrieval to Micro-Fidelity Alignment for Garment Generation

DGX agent

arXiv:2608.29280v1 Announce Type: cross Abstract: Standard clothing asset generation---restoring forward-facing flat-lay garment images from diverse real-world contexts---holds immense commercial valu

safetyarxiv-cs-ai
1 Sept 2026
Safety

Subtraction-Based Tumor Segmentation and Lesion-Centered pCR Prediction for the MAMA-MIA Challenge

DGX agent

arXiv:2608.29162v1 Announce Type: cross Abstract: We describe the submission of team FME to the MAMA-MIA Challenge, which evaluated primary tumor segmentation and prediction of pathological complete r

safetyarxiv-cs-ai
1 Sept 2026
Model Releases

TopoAgent: A Structure-Aware Perception-to-Reasoning Framework for Diagram-to-Graph Topology Extraction with Large Vision-Language Models

DGX agent

arXiv:2608.28701v1 Announce Type: new Abstract: Diagram-to-graph topology extraction aims to extract a graph of entities and their connections from a structural diagram. This task remains challenging

model-releasesarxiv-cs-cv
1 Sept 2026
Local Ai

XQDT: eXplainable and Quantitative Data-Text Alignment Metric with Feedback Signals

DGX agent

arXiv:2608.29948v1 Announce Type: new Abstract: Evaluating data-text alignment remains challenging: existing metrics often provide limited explanations for the scores, while prompt-based LLM-as-Judge

local-aiarxiv-cs-cl
1 Sept 2026
Model Releases

NL2AGBench: Benchmarking LLM Auto-Formalization for AlphaGeometry

DGX agent

arXiv:2608.28481v1 Announce Type: new Abstract: Recent advances in large language models (LLMs) have demonstrated strong capabilities in natural language understanding and mathematical reasoning. Howe

model-releasesarxiv-cs-cl
31 Aug 2026
Model Releases

AesCanvas: A Large-Scale Dataset and Benchmark for Aesthetic Critique and Contextual Suitability

DGX agent

arXiv:2608.26713v1 Announce Type: cross Abstract: Recent advances in Multimodal Large Language Models (MLLMs) have extended Image Aesthetic Assessment (IAA) beyond scalar scores toward interpretable c

model-releasesarxiv-cs-ai
28 Aug 2026
Research

AffectOmni: RL-Verifiable People-Centric Grounded Affective Reasoning for Social and Art-Related Scenes

DGX agent

arXiv:2608.26193v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) achieve strong performance on VQA and scene understanding, yet affective reasoning remains vulnerable to shortc

researcharxiv-cs-ai
28 Aug 2026
Model Releases

Ancient-Bench: A Comprehensive Multi-millennial, Multi-medium, and Multi-script Benchmark for Ancient Chinese Artifact Text Recognition

DGX agent

arXiv:2608.27169v1 Announce Type: new Abstract: Ancient Chinese artifact text recognition is fundamental to heritage digitization, and benchmarks for ancient texts are essential for evaluating current

model-releasesarxiv-cs-cv
28 Aug 2026
Applications

DOD-SA: Infrared-Visible Decoupled Object Detection with Single-Modality Annotations

DGX agent

arXiv:2508.10445v2 Announce Type: replace Abstract: Infrared-visible object detection has shown great potential in real-world applications, enabling robust all-day perception by leveraging the complem

applicationsarxiv-cs-cv
28 Aug 2026
Local Ai

Information-Guided Frontier Decoding: Contextual Utility-Driven Commitment in dMLLMs

DGX agent

arXiv:2608.26641v1 Announce Type: new Abstract: Decoding quality in diffusion multimodal language models (dMLLMs) depends heavily on the order in which masked tokens are committed. Existing confidence

local-aiarxiv-cs-cl
28 Aug 2026
Research

Multivariate Diffusion Transformer with Decoupled Attention for High-Fidelity Mask-Text Collaborative Facial Generation

DGX agent

arXiv:2511.12631v3 Announce Type: replace-cross Abstract: While significant progress has been achieved in multimodal facial generation using semantic masks and textual descriptions, conventional featu

researcharxiv-cs-ai
28 Aug 2026
← Previous
1…7374757677…211
Next →