AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
Human
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
9,441 results
Research

Spike-driven Vision-Language-Action Model

DGX agent

arXiv:2609.39514v1 Announce Type: new Abstract: Vision-language-action (VLA) models bridge multimodal understanding and robotic control, advancing the dominant paradigm for embodied intelligence. Howe

researcharxiv-cs-cl
1 Oct 2026
Research

TSMD: Temporal-Stream Modality Dropout for Robust Video Highlight Detection

DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
DGX agent

arXiv:2609.39051v1 Announce Type: new Abstract: Existing multimodal video highlight detectors typically assume that visual, audio, and textual streams are continuously available. In practice, however,

researcharxiv-cs-cv
1 Oct 2026
Model Releases

Beyond Pixels: A Vector-to-Graph Framework for Reliable Schematic Auditing

DGX agent

arXiv:2602.11678v2 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs) have shown remarkable progress in visual understanding, yet they suffer from a critical limitation: structu

model-releasesarxiv-cs-ai
30 Sept 2026
Safety

Language as the Interface: Foundation-Model Contrastive Learning Links Transcriptomes and Electrophysiology

DGX agent

arXiv:2609.37024v1 Announce Type: new Abstract: Integrating transcriptomic and electrophysiological data is essential for building multimodal foundation models for neuroscience. Patch-seq provides pai

safetyarxiv-cs-ai
30 Sept 2026
Applications

MG-Thinker: Bi-Axial Self-Reflection for Multi-Image Reasoning Grounding

DGX agent

arXiv:2609.37374v1 Announce Type: new Abstract: Reinforcement learning (RL) has recently delivered substantial gains in multimodal reasoning, opening a promising route for fine-grained visual percepti

applicationsarxiv-cs-cv
30 Sept 2026
Model Releases

VideoLoop: Looped Working Memory Against Semantic Thrashing in Long-Form Video Agents

DGX agent

arXiv:2609.38119v1 Announce Type: new Abstract: Long-form video understanding requires multimodal agents to iteratively gather evidence over many reasoning steps. However, most existing agentic method

model-releasesarxiv-cs-cv
30 Sept 2026
Model Releases

VISTA-Bench: Benchmarking Multilingual Image Translation with Image-Specific Rubrics

DGX agent

arXiv:2609.37287v1 Announce Type: cross Abstract: Image translation is a fundamental capability of multimodal models for multilingual applications, requiring visual understanding and meaning preservat

model-releasesarxiv-cs-ai
30 Sept 2026
Model Releases

ARCH-B: Architectural Representation, Comprehension and Hierarchy Benchmark

DGX agent

arXiv:2609.34047v1 Announce Type: new Abstract: Multimodal models increasingly interpret visual environments, but their ability to recognize the same building across photographs, floor plans, elevatio

model-releasesarxiv-cs-cv
29 Sept 2026
Tutorials

Distilling Visual Reasoning into Text Space

DGX agent

arXiv:2609.34408v1 Announce Type: new Abstract: Large Vision-Language Models (LVLMs) have shown strong promise for multimodal reasoning, yet often struggle with tasks requiring concepts beyond what is

tutorialsarxiv-cs-cv
29 Sept 2026
Model Releases

FlowTool: Controlling Tool Parameter in Image Retouching via Flow Matching

DGX agent

arXiv:2609.35673v1 Announce Type: new Abstract: Tool-based image editing (image retouching) is commonly formulated with autoregressive multimodal large language models (MLLMs) that sequentially genera

model-releasesarxiv-cs-cv
29 Sept 2026
Model Releases

Learning Through Game: Skewed Transfer of Tabular Knowledge to Strengthen Image Model

DGX agent

arXiv:2609.32272v1 Announce Type: cross Abstract: Multimodal tabular-image learning is gaining growing attention, yet it faces challenges due to tabular data unavailable at test time. A practical solu

model-releasesarxiv-cs-cv
29 Sept 2026
Model Releases

PalmLeaf-VQA: A Multi-Script Visual Question Answering Benchmark for Historical Palm-Leaf Manuscript Understanding Across Diverse Regions

DGX agent

arXiv:2609.31651v1 Announce Type: new Abstract: Historical manuscripts remain largely absent from modern vision-language benchmarks, leaving open how well multimodal large language models (MLLMs) hand

model-releasesarxiv-cs-cv
29 Sept 2026
Applications

STAR: Adaptive Spatial-Temporal Normalization for Unified Microservice Incident Management

DGX agent

arXiv:2609.31645v1 Announce Type: new Abstract: Automated incident management in large-scale microservice systems relies on learning robust representations from multimodal observability data, includin

applicationsarxiv-cs-lg
29 Sept 2026
Model Releases

SynDORBench: Evaluating LVLM Perceptual Robustness Under Physically Constrained Visibility Conditions

DGX agent

arXiv:2609.31823v1 Announce Type: new Abstract: Large vision-language models (LVLMs) have demonstrated remarkable performance on multimodal reasoning benchmarks, yet their perceptual reliability under

model-releasesarxiv-cs-cv
29 Sept 2026
Model Releases

TRACE: Expert-Aligned ECG Representation Learning with Rigorous Benchmarking and Real-World Validation in Acute Cardiac Care

DGX agent

arXiv:2609.34088v1 Announce Type: new Abstract: TRACE (Text-Reinforced Analysis of Cardio ECGs) is a multimodal electrocardiogram (ECG) representation model that learns clinically grounded signal embe

model-releasesarxiv-cs-lg
29 Sept 2026
Model Releases

CG-HAF: An Interpretable Global-Local Lesion-Burden Fusion Framework for Ordinal Acne Severity Grading in Agentic Skincare Support

DGX agent

arXiv:2609.31326v1 Announce Type: cross Abstract: Ordinal acne severity grading requires distinguishing visually similar neighboring grades while jointly weighing holistic facial appearance and locali

model-releasesarxiv-cs-ai
28 Sept 2026
Research

ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videos

DGX agent

arXiv:2609.30934v1 Announce Type: new Abstract: Rapid advances in AI-generated video (AIGV) have increased the risks posed by deceptive video manipulation. Unlike fully synthetic videos, manipulated v

researcharxiv-cs-cv
28 Sept 2026
Model Releases

Industrial Anomaly Detection via Defect-Grounded Reasoning in Visual Latent Space

DGX agent

arXiv:2609.29457v1 Announce Type: new Abstract: Industrial anomaly detection (IAD) is evolving beyond conventional detection and localization toward multimodal inspection systems that can describe, ex

model-releasesarxiv-cs-cv
25 Sept 2026
Model Releases

ChronoSteer: Bridging Large Language Model and Time Series Foundation Model via Synthetic Cross-Modal Alignment Dataset

DGX agent

arXiv:2505.10083v2 Announce Type: replace Abstract: Conventional forecasting methods are trained end-to-end on unimodal time series, which limits their ability to exploit textual information and under

model-releasesarxiv-cs-lg
24 Sept 2026
Research

VIVAS: Vitalizing Visual Perception in VLM Pre-training via Vision-language Unified Autoregressive Supervision

DGX agent

arXiv:2609.27948v1 Announce Type: new Abstract: While Vision-Language Models (VLMs) demonstrate strong capabilities, they continue to suffer from a critical limitation: insufficient fine-grained visua

researcharxiv-cs-cv
24 Sept 2026
Model Releases

Modality-Gated Deep Adapters: Adding a Modality to a Frozen Embedding Model with Exact Preservation

DGX agent

arXiv:2609.26182v1 Announce Type: new Abstract: Multimodal embedding models are deployed at scale: retrieval indices, benchmark results, and behavioral audits all depend on the base model's exact outp

model-releasesarxiv-cs-cl
23 Sept 2026
Applications

MultiViewDx: Evidence-Linked Multi-View Clinical Diagnosis

DGX agent

arXiv:2410.14948v2 Announce Type: replace Abstract: Medical multimodal large language models (MLLMs) can perform well on existing medical visual question answering (MedVQA) benchmarks, but their train

applicationsarxiv-cs-cl
23 Sept 2026
Research

One Domain, Many Tongues: Composing Domain and Language LoRAs for Cross-Lingual Remote-Sensing MLLMs without Paired Data

DGX agent

arXiv:2609.26097v1 Announce Type: new Abstract: Remote-sensing (RS) multimodal large language models (MLLMs) are trained and evaluated only in English, while text-only instruction data covers over 100

researcharxiv-cs-cl
23 Sept 2026
Model Releases

BackdoorVLM: A Benchmark for Backdoor Attacks and Defenses on Vision-Language Models

DGX agent

arXiv:2511.18921v2 Announce Type: replace Abstract: Backdoor attacks undermine the reliability and trustworthiness of machine learning systems by injecting hidden behaviors that can be maliciously act

model-releasesarxiv-cs-cv
22 Sept 2026
Agents

HiBerNAC: Hierarchical Brain-inspired Robotic Neural Agent Collective for Disentangling Complex Manipulation

DGX agent

arXiv:2506.08296v3 Announce Type: replace Abstract: Recent advances in multimodal vision-language-action (VLA) models have revolutionized traditional robot learning, enabling systems to interpret visi

agentsarxiv-cs-ro
22 Sept 2026
Agents

Driving on Registers, Reasoning on Risk: Risk-Aware Occupancy for Register-Based End-to-End Autonomous Driving

DGX agent

arXiv:2609.21486v1 Announce Type: new Abstract: Multimodal trajectory prediction improves behavioral coverage in end-to-end autonomous driving, but existing methods remain limited by sparse scene repr

agentsarxiv-cs-ai
21 Sept 2026
Research

The Spoken Wikipedia Presentation Corpus

DGX agent

arXiv:2609.21676v1 Announce Type: cross Abstract: We present the Spoken Wikipedia Presentation Corpus, an extension of the Spoken Wikipedia Corpora featuring LLM-generated slide decks for multimodal A

researcharxiv-cs-cl
21 Sept 2026
Research

CoMa: Contextual Massing Generation with Vision-Language Models

DGX agent

arXiv:2601.08464v2 Announce Type: replace-cross Abstract: Context-aware building massing is an important early-stage design task: given a site for buildings, a generated massing should not only fit th

researcharxiv-cs-ai
18 Sept 2026
Model Releases

Guideline-grounded retrieval-augmented generation for ophthalmic clinical decision support

DGX agent

arXiv:2603.21925v2 Announce Type: replace Abstract: In this work, we propose Oph-Guid-RAG, a multimodal visual RAG system for ophthalmology clinical question answering and decision support. We treat e

model-releasesarxiv-cs-ai
18 Sept 2026
Agents

VLM-CAD: VLM-Optimized Collaborative Agent Design Workflow for Analog Circuit Sizing

DGX agent

arXiv:2601.07315v5 Announce Type: replace-cross Abstract: Vision Language Models (VLMs) have demonstrated remarkable potential in multimodal reasoning. However, they can have spatial blindness and log

agentsarxiv-cs-ai
18 Sept 2026
Safety

Can MiniMax-H3 Reason About the Physical World? An Evaluation of Omni-Modal Generative Model

DGX agent

arXiv:2609.18323v1 Announce Type: new Abstract: Recent Omni-Modal Generative Models (Omni-Models) have advanced content generation toward unified modeling of text, images, video, and audio. MiniMax-H3

safetyarxiv-cs-cv
17 Sept 2026
Model Releases

GRADE: Benchmarking Discipline-Informed Reasoning in Image Editing

DGX agent

arXiv:2603.12264v2 Announce Type: replace Abstract: Unified multimodal models target joint understanding, reasoning, and generation, but current image editing benchmarks are largely confined to natura

model-releasesarxiv-cs-cv
16 Sept 2026
Model Releases

MechReason: Benchmarking Multi-Image Multi-Hop Reasoning in Mechanical Engineering

DGX agent

arXiv:2609.16012v1 Announce Type: new Abstract: Despite significant progress in general visual question answering and cross-modal understanding, multimodal large language models still face a pronounce

model-releasesarxiv-cs-cv
16 Sept 2026
Safety

AdaVSkip: Adaptive Visual Token Skipping Across Layers For Efficient MLLMs Inference

DGX agent

arXiv:2609.15131v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) require substantial computation to process numerous visual tokens across all transformer layers. Most methods

safetyarxiv-cs-ai
15 Sept 2026
Model Releases

ATTRICITE: Training an Open 4B Model for Citation Recovery toward Faithful Attribution

DGX agent

arXiv:2609.14248v1 Announce Type: cross Abstract: Faithful citation attribution begins with identifying the intended source for a scientific claim. We study this source-identification capability throu

model-releasesarxiv-cs-ai
15 Sept 2026
Local Ai

Boosting Point-supervised Temporal Action Localization via Text Refinement and Alignment

DGX agent

arXiv:2602.01257v2 Announce Type: replace Abstract: Recently, point-supervised temporal action localization has gained significant attention for its effective balance between labeling costs and locali

local-aiarxiv-cs-cv
15 Sept 2026
Model Releases

BVB: Benchmarking Agentic Video Understanding via Programmatic Reconstruction in Blender

DGX agent

arXiv:2609.15478v1 Announce Type: new Abstract: Multimodal agents can create complex videos in software such as Blender by coding without relying on diffusion models. Yet video understanding benchmark

model-releasesarxiv-cs-cv
15 Sept 2026
Model Releases

Designing UNICORN: a Unified Benchmark for Imaging in Computational Pathology, Radiology, and Natural Language

DGX agent

arXiv:2603.02790v2 Announce Type: replace Abstract: Foundation models are changing the way we develop medical artificial intelligence. By learning broadly generalizable features across diverse data mo

model-releasesarxiv-cs-cv
15 Sept 2026
Hardware

LynnReal-Omni: Native multi-modal Video Generation for Agentic Visual Workflows

DGX agent

arXiv:2609.15863v1 Announce Type: new Abstract: Video diffusion models are stochastic and hard to control: precise content often requires repeated sampling without guaranteed success, and long-horizon

hardwarearxiv-cs-cv
15 Sept 2026
Agents

Selective Tool Use for Agentic Change Visual Question Answering in Remote Sensing

DGX agent

arXiv:2609.14523v1 Announce Type: new Abstract: Change visual question answering (Change VQA) requires understanding semantic changes across bi-temporal remote sensing images. Although vision language

agentsarxiv-cs-cv
15 Sept 2026
Research

SyRHM: Symbolic-Language-Enhanced Reasoning with Associative Retrieval for Zero-shot Harmful Meme Detection

DGX agent

arXiv:2609.13794v1 Announce Type: new Abstract: Detecting harmful memes is critical for maintaining safe online communities. However, harmful intent is often implicit, arising from visual-textual inco

researcharxiv-cs-cl
15 Sept 2026
Model Releases

ChitraMiti: Benchmarking Visual Grounding and Modality Reliance in Bengali Geometric Reasoning

DGX agent

arXiv:2609.12509v1 Announce Type: new Abstract: Evaluation of vision-language models (VLMs) for multimodal mathematical reasoning remains limited for low-resource languages and for geometry problems t

model-releasesarxiv-cs-cv
14 Sept 2026
Model Releases

LGFN: Lightweight Gated RGB-Polarization Fusion with Modality-Availability Conditioning for Camouflaged Object Detection

DGX agent

arXiv:2609.12798v1 Announce Type: new Abstract: Camouflaged object detection (COD) is an important engineering task in intelligent optical perception, but it remains challenging when targets closely r

model-releasesarxiv-cs-cv
14 Sept 2026
Model Releases

EMMI: Edge Multi-Modal Intelligence for Communication-Efficient MLLM Inference via Fused Representation Compression

DGX agent

arXiv:2609.11058v1 Announce Type: new Abstract: Recent advances in multimodal large language mod- els (MLLMs) have opened new opportunities for edge intelligence by enabling reasoning across heterogen

model-releasesarxiv-cs-lg
11 Sept 2026
Model Releases

Think Before You Link: Rarity, Reasoning, and Retrieval in Multilingual Entity Linking

DGX agent

arXiv:2609.10745v1 Announce Type: new Abstract: Multimodal entity linking grounds entity mentions in text and images to knowledge-base entries. These systems degrade on rare entities, but prior work m

model-releasesarxiv-cs-cl
11 Sept 2026
Research

Learning transferable human physiology from two million hours of sleep with SleepFM-2

DGX agent

arXiv:2609.06849v1 Announce Type: new Abstract: Sleep provides a nightly window into health by capturing coordinated activity across the brain, heart, muscles and respiratory system. We introduce Slee

researcharxiv-cs-ai
10 Sept 2026
Model Releases

LogiScope-VQA: Benchmarking Vision-Language Models for Logistics Hazard Identification in Industrial Scenarios

DGX agent

arXiv:2609.09790v1 Announce Type: cross Abstract: Large Multimodal Models (LMMs) large-scale deployment in industrial warehouse settings specifically necessitates that models exhibit human-expert-leve

model-releasesarxiv-cs-cl
10 Sept 2026
Model Releases

Dual-Latent Memory Routing for Vision-Language Reasoning

DGX agent

arXiv:2609.05539v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have recently made strong progress in vision-language reasoning, yet their performance often degrades as genera

model-releasesarxiv-cs-cv
9 Sept 2026
← Previous
1…6970717273…197
Next →