AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,119 results
30 Sept 2026

VesselBench-800K: A Large-scale Perception Benchmark for Multimodal Vessel Detection, Counting, and Density Estimation

Model ReleasesDGX agent

arXiv:2609.37003v1 Announce Type: new Abstract: Vessel perception from space is crucial for a wide range of maritime applications, from traffic monitoring to environmental protection. However, most ex

Visual sensitivity is not claim retractability: persistence-aware credit assignment for multimodal reinforcement learning

Model ReleasesDGX agent

arXiv:2609.36572v1 Announce Type: new Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has been extended to Large Vision-Language Models (LVLMs), and perception-aware methods further en

29 Sept 2026

Admissible Diffusion for Multimodal Interventional Trajectories

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
ResearchDGX agent

arXiv:2609.34433v1 Announce Type: new Abstract: Generating a plausible clinical trajectory does not establish what would happen under a different treatment. We present ADMIT, a framework combining irr

Advancing Wildlife Conservation through Multimodal Animal Re-Identification with Environmental Metadata

ResearchDGX agent

arXiv:2609.34094v1 Announce Type: new Abstract: Identifying individual animals is crucial for effective wildlife monitoring and conservation efforts. Recent advancements in computer vision have shown

Multimodal LLMs Outperform Pathology Foundation Models in Cross-Domain Histological Similarity

Model ReleasesDGX agent

arXiv:2609.32876v1 Announce Type: new Abstract: State-of-the-art pathology foundation models, trained on millions of histology tiles, can fail to preserve tissue similarity when comparisons cross slid

SciGen-Verifier: A Multimodal Reasoner for Explainable Verification in Scientific Image Generation

Model ReleasesDGX agent

arXiv:2609.33399v1 Announce Type: new Abstract: In realistic education, a solution is often expressed not only in words but in a drawing--a circuit, a geometric construction, a function plot--and a te

SegBanana: Steering Unified Multimodal Models into Medical Segmenters

AgentsDGX agent

arXiv:2609.34235v1 Announce Type: new Abstract: Medical image segmentation remains challenging in practical deployment, as models often struggle to generalize beyond the distributions covered by their

25 Sept 2026

A Multimodal Dataset for Survival Prediction in Resected Pancreatic Ductal Adenocarcinoma

ResearchDGX agent

arXiv:2609.29726v1 Announce Type: new Abstract: Survival research in pancreatic ductal adenocarcinoma (PDAC) is limited by the scarcity of datasets linking whole-slide histology with clinical, molecul

C3M: Cross-Session Multimodal Memory Maintenance for Long-Horizon Tasks

ResearchDGX agent

arXiv:2609.29735v1 Announce Type: new Abstract: Long-horizon tasks require preserving and later recovering cross-session evidence under a bounded, query-blind memory budget. Existing compression can d

Implicit Behavior Coordination from Sub-Task Demonstrations by Exploiting Overlap-Induced Multimodality

SafetyDGX agent

arXiv:2607.09234v2 Announce Type: replace Abstract: Long-horizon robotic rearrangement is commonly formulated as a skill-sequencing problem, where distinct behaviors are explicitly represented and coo

24 Sept 2026

A Leakage-Aware Multimodal Evaluation Framework for Early Intraoperative Acute Kidney Injury Prediction

ResearchDGX agent

arXiv:2609.26848v1 Announce Type: cross Abstract: Postoperative acute kidney injury (AKI) after major non-cardiac surgery carries substantial morbidity, yet early intraoperative risk stratification re

22 Sept 2026

PRISM-RAG: Multimodal Hypergraph Retrieval-Augmented Generation for Tobacco Product and Legislative Policy Reasoning

SafetyDGX agent

arXiv:2609.23769v1 Announce Type: new Abstract: The disambiguation of semantically similar statutory text across jurisdictions is a retrieval problem that existing methods do not solve. This inter-con

RoboTalk: Learning Multi-Robot Communication and Coordination from Multimodal Demonstrations

Local AiDGX agent

arXiv:2609.23997v1 Announce Type: new Abstract: Multi-robot collaboration could enable more efficient and scalable solutions to complex robotic tasks, but collaboration under partial observability rem

TAC-Time: Texts as Channels For Multimodal Time Series Forecasting

SafetyDGX agent

arXiv:2609.24156v1 Announce Type: new Abstract: Most existing time series forecasting methods rely solely on numerical observations, overlooking rich contextual information from auxiliary texts. Recen

18 Sept 2026

E-AVI: Evidence-Grounded Multimodal Assessment for Automated Video Interviews

ResearchDGX agent

arXiv:2609.20001v1 Announce Type: new Abstract: Automated video interview assessment integrates verbal content, acoustic delivery, and visual behavior, yet numerical predictions alone provide limited

Integrating knowledge from case reports: a medical ontology based multimodal information system with structured summary

ResearchDGX agent

arXiv:2609.19775v1 Announce Type: new Abstract: Published medical case reports serve as a crucial medical information carrier, documenting discoveries in rare diseases, diagnostic methods, and innovat

Lens: Bringing the Right Semantic Perspective into Focus for Training-Free Multimodal Representation Learning

Model ReleasesDGX agent

arXiv:2609.20252v1 Announce Type: cross Abstract: High-quality representations are essential for a wide range of downstream tasks. Dedicated embedding models are explicitly optimized for representatio

OHRID-Retail: An Open Multimodal Dataset of Human Activity in Retail Environments

ResearchDGX agent

arXiv:2609.19302v1 Announce Type: new Abstract: Open datasets describing human behavior in environments shared with mobile robots remain limited, particularly for retail activities that combine locomo

To Memories and Beyond: From Remembering to Knowing You across Long-Term Multimodal Personal Archives

Model ReleasesDGX agent

arXiv:2609.19167v1 Announce Type: new Abstract: As AI systems evolve into personalized digital companions, a central capability is reasoning over a user's long-term personal history: not merely storin

17 Sept 2026

Divide and Conquer: A Hybrid Strategy Defeats Multimodal Large Language Models

Model ReleasesDGX agent

arXiv:2412.16555v4 Announce Type: replace Abstract: Large language models (LLMs) are widely applied in various fields of society due to their powerful reasoning, understanding, and generation capabili

Multi-Session Multimodal Underwater Mapping with Acoustic and Optical Imaging

SafetyDGX agent

arXiv:2609.17929v1 Announce Type: new Abstract: Accurate seafloor mapping is essential for marine science, archaeology, and environmental monitoring. However, integrating data from different sensors,

16 Sept 2026

A multimodal large language model for evidence-based autism spectrum disorder screening

ResearchDGX agent

arXiv:2609.16464v1 Announce Type: new Abstract: The clinical management of autism spectrum disorder (ASD) faces a bottleneck in early screening, mainly because trained specialists are scarce and conve

A Vision-Language Foundation Model for Precise and Comprehensive Brain Tumor Diagnosis from Preoperative Multimodal Data

ApplicationsDGX agent

arXiv:2609.16597v1 Announce Type: cross Abstract: Background Non-invasive presurgical diagnosis of brain tumor types from Magnetic Resonance Imaging (MRI) is essential but challenging due to overlappi

MUUNRiver-Bench: Diagnosing Relation-Dependent Music Retrieval with Multimodal Instructions

Model ReleasesDGX agent

arXiv:2609.16090v1 Announce Type: cross Abstract: Music retrieval is relation-dependent: given a reference track, a listener may seek its style with a new theme, a cover, or a comparable voice, and th

RepoAtlas: Guiding Coding Agents via Evolving Multimodal Repository Views

Local AiDGX agent

arXiv:2609.16936v1 Announce Type: cross Abstract: Large language model (LLM)-powered coding agents have made rapid progress in automating software engineering tasks, yet repository-level issue resolut

15 Sept 2026

Accurate and Scalable Multimodal Pathology Retrieval via Attentive Vision-Language Alignment

SafetyDGX agent

arXiv:2510.23224v2 Announce Type: replace Abstract: The rapid digitization of histopathology slides has opened new opportunities for computational tools in clinical and research workflows. Content-bas

EventVL: Understand Event Streams via Multimodal Large Language Model

SafetyDGX agent

arXiv:2501.13707v3 Announce Type: replace-cross Abstract: The event-based Vision-Language Model (VLM) recently has made good progress for practical vision tasks. However, most of these works just util

Global-Local Contextual Progressive Expansion Network for Martian Landslide Segmentation in Multimodal Remote Sensing Imagery

ResearchDGX agent

arXiv:2609.13332v1 Announce Type: new Abstract: Automated landslide segmentation on Mars is one of the important tasks for understanding its surface processes, and all will aid in future space explora

Multimodal deep learning from spectra for small-molecule structure identification: enhancing robustness with mixed-condition training

ResearchDGX agent

arXiv:2609.14360v1 Announce Type: new Abstract: In practical molecular characterization, small-molecule structure identification benefits from complementary spectroscopic evidence, but missing, degrad

Through the Eyes of the Beholder: Biometric and Demographic Conditioning for Multimodal Sexism Detection

Model ReleasesDGX agent

arXiv:2609.15608v1 Announce Type: cross Abstract: Detecting sexism on the internet is a fundamentally subjective task; our team, VANGUARD, addresses this challenge in the EXIST 2026 Task 2 by proposin

11 Sept 2026

Evaluating Time-Series Foundation Models and Multimodal Dietary Context for CGM Forecasting

ResearchDGX agent

arXiv:2609.11872v1 Announce Type: cross Abstract: Continuous glucose monitoring (CGM) provides high-frequency measurements of glucose dynamics and enables short-term glucose forecasting for diabetes m

Multimodal Taxonomic Conditioning for Generative Plankton Imagery

Model ReleasesDGX agent

arXiv:2609.11673v1 Announce Type: new Abstract: Automated plankton imaging produces severely long-tailed datasets, where the rare taxa of greatest ecological interest have too few images to train or e

ReGround: Grounding Reviewer Comments in Multimodal Evidence

ResearchDGX agent

arXiv:2609.11460v1 Announce Type: new Abstract: Reviewer comments naturally relate to specific parts of the reviewed paper, yet grounding these comments to the underlying evidence is difficult due to

Temporal and Multimodal Deep Learning for Cyberattack Detection in LEO Satellite Systems

ResearchDGX agent

arXiv:2609.10746v1 Announce Type: cross Abstract: The growing reliance on Low-Earth Orbit (LEO) satellite communication systems has increased the need for intelligent methods capable of detecting cybe

10 Sept 2026

Bridging the Semantic-Utility Gap in Multimodal RAG via Generator-in-the-Loop Alignment

SafetyDGX agent

arXiv:2609.08188v1 Announce Type: new Abstract: Vision-language models (VLMs) augmented with retrieval-augmented generation (RAG) benefit from access to external evidence. However, standard retrievers

OmniMed-FL: A Robust Multimodal Federated Learning Framework for Clinical Diagnosis

Local AiDGX agent

arXiv:2609.10364v1 Announce Type: new Abstract: Simultaneous assessment of medical imaging and patient records is often required in clinical diagnosis. However, standard machine learning algorithms ca

9 Sept 2026

Multimodal Resource-Exhaustion Attacks on Vision-Language Models via Joint Pixel-Prompt Optimization

ResearchDGX agent

arXiv:2609.05889v1 Announce Type: cross Abstract: Resource-exhaustion attacks against autoregressive vision-language models (VLMs) typically assume unimodal threat models, treating the image branch as

Segment Any Motion with Radar: Robust Multimodal Moving-Object Segmentation and Tracking

Model ReleasesDGX agent

arXiv:2609.08346v1 Announce Type: new Abstract: Moving-object perception must decide which image regions correspond to real motion and keep every instance identified over time. Methods that read motio

Stable-MM-R1: Anchoring Multimodal Reasoning Dynamics via Entropy-Guided Stratification

SafetyDGX agent

arXiv:2609.07148v1 Announce Type: cross Abstract: While Reinforcement Learning (RL) effectively incentivizes reasoning in Large Language Models, current pipelines are hindered by training instability

The Price of Consistency: Exploiting Visual Anchors for Multimodal Jailbreaking in Video Generation

Model ReleasesDGX agent

arXiv:2609.07216v1 Announce Type: new Abstract: The rapid evolution of video generation has shifted the paradigm from pure text-driven to multi-conditional controllable generation, with reference imag

VoT: Vision-of-Thought for Unified Multimodal Representation Alignment

SafetyDGX agent

arXiv:2609.07815v1 Announce Type: new Abstract: Current text-to-image systems typically employ a 'text encoder plus diffusion decoder' paradigm, in which text semantics directly modulate continuous la

7 Sept 2026

Explainable Multimodal Deep Learning Integrating Imaging and Clinical Data for Oral Potentially Malignant Disorder Detection

ApplicationsDGX agent

arXiv:2609.04512v1 Announce Type: cross Abstract: Oral potentially malignant disorders (OPMDs) are critical precursors to oral cancer, yet clinical detection remains challenging because of substantial

MEOX: Compact Multimodal Mixture-of-Experts for Earth Observation

Model ReleasesDGX agent

arXiv:2609.05351v1 Announce Type: new Abstract: Recent advances in Earth Observation representation learning accommodate heterogeneous sensors and missing observations, often through larger architectu

MMTClinic: Multimodal, Multilingual Time Series Question Answering and Reasoning Benchmark for Clinical Domain

Model ReleasesDGX agent

arXiv:2609.04842v1 Announce Type: cross Abstract: Time-series data in clinical settings is crucial for capturing dynamic changes in a patient's health over time, enabling timely diagnosis, personalize

SMILE: Self-Explainable Multimodal Information Bottleneck for Medical Diagnosis

SafetyDGX agent

arXiv:2609.05174v1 Announce Type: new Abstract: Explainability is increasingly seen as a crucial requirement in AI-based medical diagnosis, particularly in safety-critical clinical decision-making. Mo

YOLO with Kolmogorov-Arnold networks and vision-language foundation models for interpretable object detection with trustworthy multimodal AI in computer vision perception

AgentsDGX agent

arXiv:2603.23037v2 Announce Type: replace-cross Abstract: The trustworthy object detection capabilities of a novel Kolmogorov-Arnold network framework are examined here. The approach addresses a key l

4 Sept 2026

MulDP: Multimodal Diffusion Policy for Autonomous Quadruped Parkour Navigation across Complex Terrains

SafetyDGX agent

arXiv:2609.03984v1 Announce Type: new Abstract: Quadruped robots have demonstrated impressive agility in parkour locomotion across complex terrains. However, most systems still rely on human intervent

3 Sept 2026

PIVOTSBench: Evaluating Fine-Grained Interpersonal Relationship Reasoning in Multimodal Large Language Models

Model ReleasesDGX agent

arXiv:2606.23092v2 Announce Type: replace Abstract: Humans possess an innate ability to understand fine-grained interpersonal relationships, which is central to everyday social interactions. Although

2 Sept 2026

BrainDiff: Longitudinal Report Generation for Multimodal Brain MRI

ResearchDGX agent

arXiv:2609.00593v1 Announce Type: new Abstract: Neuroradiologists rarely read a brain MRI in isolation, yet automated brain-MRI report generation has been built almost entirely for single studies. Tem

Multimodal RGB-Infrared Combination for UAV-Based Wildfire Segmentation: A Comparative Study on FLAME3

ResearchDGX agent

arXiv:2609.01390v1 Announce Type: new Abstract: Unmanned Aerial Vehicles (UAVs) have emerged as a promising platform for firefighting operations due to their flexibility, low operational cost, and abi

Semantic-Guided Multimodal Preprocessing for Vision Transformer-Based Clear Cell Renal Cell Carcinoma Grading

ResearchDGX agent

arXiv:2609.01426v1 Announce Type: cross Abstract: Clear cell renal cell carcinoma (CCRCC) grading is essential for treatment planning, yet existing approaches either analyze patch-level images directl

1 Sept 2026

Lot Machine: Multimodal Lot Extraction from Auction Catalogs

Model ReleasesDGX agent

arXiv:2608.30510v1 Announce Type: cross Abstract: For provenance research and art market studies, auction catalogs are an essential resource to trace specific objects over time and space. While histor

Phantom-Insight: Adaptive Multi-cue Fusion for Video Camouflaged Object Detection with Multimodal LLM

TutorialsDGX agent

arXiv:2509.06422v2 Announce Type: replace Abstract: Video camouflaged object detection (VCOD) is challenging due to dynamic environments. Existing methods face two main issues: (1) SAM-based methods s

SurgSkill-Bench: A Benchmark for Multimodal Surgical Skill Assessment

Model ReleasesDGX agent

arXiv:2608.30872v1 Announce Type: new Abstract: Objective assessment of surgical technical skill is important for surgical training and structured feedback, but current workflows remain dependent on l

31 Aug 2026

FENCE: A Financial and Multimodal Jailbreak Detection Dataset

SafetyDGX agent

arXiv:2602.18154v3 Announce Type: replace Abstract: Jailbreaking poses a significant risk to the deployment of Large Language Models (LLMs) and Vision Language Models (VLMs). VLMs are particularly vul

Mixture of Multicenter Experts in Multimodal AI for Debiased Radiotherapy Target Delineation

Local AiDGX agent

arXiv:2410.00046v4 Announce Type: replace-cross Abstract: Clinical decision-making reflects diverse strategies shaped by regional patient populations and institutional protocols. However, most existin

27 Aug 2026

A Lightweight Multimodal Vision-Language Framework for Early-Stage Anatomical Green Fruit Classification in Commercial Orchards

Local AiDGX agent

arXiv:2608.24935v1 Announce Type: new Abstract: Accurate identification of early-stage apple fruitlet anatomical structures, including the calyx, fruitlet body, and peduncle, is essential for robotic

MObyGaze: a film dataset of multimodal objectification densely annotated by experts

Model ReleasesDGX agent

arXiv:2505.22084v2 Announce Type: replace Abstract: Characterizing and quantifying gender representation disparities in audiovisual storytelling contents is necessary to grasp how stereotypes may perp

25 Aug 2026

Action-Aligned Retrieval with Pairwise Multimodal Reranking for Text-Based Person Anomaly Search

ResearchDGX agent

arXiv:2608.23503v1 Announce Type: new Abstract: Text-based person anomaly search requires distinguishing individuals based on fine-grained, context-dependent behaviors rather than mere appearance. Exi

Modalities Should Talk to Each Other: Dual-Stream Multimodal Learning for Long-Horizon Influenza Forecasting

ResearchDGX agent

arXiv:2608.23373v1 Announce Type: new Abstract: Forecasting long-range influenza-like illness (ILI) matters for public health readiness. Publicly available surveillance datasets typically pair numeric

← Previous
1…3334353637…169
Next →