AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,117 results
Research

GestaltMML: Enhancing Rare Genetic Disease Diagnosis through Multimodal Machine Learning Combining Facial Images and Clinical Text

DGX agent

arXiv:2312.15320v3 Announce Type: replace-cross Abstract: Individuals with suspected rare genetic disorders often undergo multiple clinical evaluations, imaging studies, laboratory tests, and genetic

researcharxiv-cs-cv
7 Jul 2026
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Safety

H-OPD: Confidence Aware Heterogeneous Multi-Teacher Multimodal On-policy Distillation

DGX agent

arXiv:2607.02592v1 Announce Type: new Abstract: On-policy distillation (OPD) has recently emerged as an effective post-training paradigm by providing supervision on student-generated trajectories. How

safetyarxiv-cs-cv
7 Jul 2026
Research

Paired Uterine Whole-Slide Images and Pathology Reports for Multimodal Computational Pathology

DGX agent

arXiv:2607.04020v1 Announce Type: new Abstract: Uterine diseases represent an important category of gynecologic pathology and require accurate histopathological assessment for diagnosis and treatment

researcharxiv-cs-cv
7 Jul 2026
Research

PhenoNEST: A Neuro-Symbolic Framework for Ontology-Aware Multimodal Plant Phenotyping and Trait Discovery

DGX agent

arXiv:2607.03245v1 Announce Type: new Abstract: High-throughput plant phenotyping generates valuable data that often remains trapped in unstructured text and isolated RGB images. To bridge this semant

researcharxiv-cs-lg
7 Jul 2026
Model Releases

Triple-Phase Multimodal Knowledge Aggregation Framework for Microbial Keratitis Subtype Diagnosis on Slit-Lamp Photography

DGX agent

arXiv:2607.03740v1 Announce Type: cross Abstract: Microbial keratitis requires rapid pathogen identification to guide treatment, but culture- and PCR-based diagnostics are slow and resource-intensive.

model-releasesarxiv-cs-cv
7 Jul 2026
Model Releases

UniICL: Systematizing Unified Multimodal In-context Learning through a Capability-Oriented Taxonomy

DGX agent

arXiv:2603.24690v2 Announce Type: replace Abstract: In-context learning (ICL) enables fast task adaptation from demonstrations without per-task parameter updates but remains highly sensitive to exampl

model-releasesarxiv-cs-cv
7 Jul 2026
Research

Scaling to Multimodal and Multichannel Heart Sound Classification with Synthetic and Augmented Biosignals

DGX agent

arXiv:2509.11606v4 Announce Type: replace-cross Abstract: Cardiovascular diseases (CVDs) are the leading cause of death worldwide, accounting for approximately 17.9 million deaths each year. Early det

researcharxiv-cs-lg
3 Jul 2026
Research

Leveraging Multimodality for Real-Time Classification of Transients and Variables found by the Zwicky Transient Facility

DGX agent

arXiv:2607.00228v1 Announce Type: cross Abstract: Modern time-domain surveys such as the Zwicky Transient Facility (ZTF) generate hundreds of thousands of alerts each night, making real-time decisions

researcharxiv-cs-lg
2 Jul 2026
Research

Towards Developing a Multimodal Chat Assistant for University Stakeholders: RAG-based Approach

DGX agent

arXiv:2607.01115v1 Announce Type: cross Abstract: University stakeholders often face difficulties in accessing timely and reliable information, especially in developing countries, where there are very

researcharxiv-cs-ai
2 Jul 2026
Research

CoMet: Context and Multiplicity Decomposition for Multimodal Uncertainty Estimation

DGX agent

arXiv:2606.32012v1 Announce Type: cross Abstract: Uncertainty estimation has been a long-standing challenge in AI models; it amounts to 'knowing what you don't know,' and metacognition is notoriously

researcharxiv-cs-cv
1 Jul 2026
Research

GUI-AIMA: Aligning Intrinsic Multimodal Attention with a Context Anchor for GUI Grounding

DGX agent

arXiv:2511.00810v4 Announce Type: replace-cross Abstract: Graphical user interface (GUI) grounding is a key capability for computer-use agents, mapping natural-language instructions to actionable regi

researcharxiv-cs-ai
1 Jul 2026
Safety

IterCAD: An Iterative Multimodal Agent for Visually-Grounded CAD Generation and Editing

DGX agent

arXiv:2606.13368v2 Announce Type: replace Abstract: Computer-Aided Design is pivotal in modern manufacturing, yet existing automated methods predominantly rely on open-loop, one-shot generation, creat

safetyarxiv-cs-ai
1 Jul 2026
Model Releases

Multimodal Mathematical Reasoning with Diverse Solving Perspective

DGX agent

arXiv:2507.02804v2 Announce Type: replace Abstract: Recent progress in large-scale reinforcement learning (RL) has notably enhanced the reasoning capabilities of large language models (LLMs), especial

model-releasesarxiv-cs-cl
30 Jun 2026
Safety

Multimodal Representation Alignment for Cross-modal Information Retrieval

DGX agent

arXiv:2506.08774v2 Announce Type: replace-cross Abstract: Different machine learning models can represent the same underlying concept in different ways. This variability is particularly valuable for i

safetyarxiv-cs-ai
30 Jun 2026
Tutorials

See, Think, Learn: A Self-Taught Multimodal Reasoner

DGX agent

arXiv:2512.02456v2 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) have achieved remarkable progress in integrating visual perception with language understanding. However, effecti

tutorialsarxiv-cs-cl
30 Jun 2026
Model Releases

StarDojo: Benchmarking Open-Ended Behaviors of Agentic Multimodal LLMs in Production-Living Simulations with Stardew Valley

DGX agent

arXiv:2507.07445v3 Announce Type: replace Abstract: Autonomous agents navigating human society must master both production activities and social interactions, yet existing benchmarks rarely evaluate t

model-releasesarxiv-cs-ai
30 Jun 2026
Tutorials

Traffic-CBM: A Structurally Interpretable Multimodal Framework for Encrypted Traffic Classification

DGX agent

arXiv:2606.29909v1 Announce Type: new Abstract: Encrypted traffic classification has achieved strong performance, but its decision process remains difficult to interpret. Existing methods usually comb

tutorialsarxiv-cs-cv
30 Jun 2026
Agents

Dialogue to Detection: A Multimodal Hybrid NLP Pipeline for Insurance Fraud Detection

DGX agent

arXiv:2606.28002v1 Announce Type: cross Abstract: Insurance fraud imposes substantial financial losses and operational inefficiencies, raising premiums and impacting trust among legitimate policyholde

agentsarxiv-cs-ai
29 Jun 2026
Model Releases

DMV-Bench: Diagnosing Long-Horizon Multimodal Agents' Visual Memory with Incidental Cue Injection

DGX agent

arXiv:2606.27499v1 Announce Type: cross Abstract: Research on agent memory has matured rapidly, but almost entirely on the text side: few existing benchmarks ask, in an interactive environment, when a

model-releasesarxiv-cs-ai
29 Jun 2026
Research

HiMu: Hierarchical Multimodal Frame Selection for Long Video Question Answering

DGX agent

arXiv:2603.18558v2 Announce Type: replace-cross Abstract: Long-form video question answering requires reasoning over extended temporal contexts, making frame selection a critical bottleneck for multi-

researcharxiv-cs-ai
29 Jun 2026
Applications

Methane-Plume Segmentation From Hyperspectral Satellite Imagery Via Multimodal Deep Learning

DGX agent

arXiv:2606.26416v1 Announce Type: new Abstract: Efficient detection of methane plumes is crucial for understanding and mitigating global warming, as accurately identifying and segmenting them in earth

applicationsarxiv-cs-cv
26 Jun 2026
Safety

Risk-Aware Selective Multimodal Driver Monitoring with Driver-State World Modeling

DGX agent

arXiv:2606.26922v1 Announce Type: cross Abstract: Continuous driver monitoring in automated vehicles requires low-latency inference while avoiding unsafe decisions under uncertain driver states. Large

safetyarxiv-cs-ai
26 Jun 2026
Research

Cross-Attention Multimodal Learning for Predicting Response to Neoadjuvant Imatinib in Gastrointestinal Stromal Tumors: A Multicenter Retrospective Study

DGX agent

arXiv:2606.25579v1 Announce Type: cross Abstract: Background: Response to neoadjuvant imatinib in gastrointestinal stromal tumors (GISTs) is highly variable and cannot be reliably predicted using curr

researcharxiv-cs-cv
25 Jun 2026
Agents

MIL-LC: A Robust Magnetometer-Inertial-LiDAR Fusion Multimodal Localization Framework

DGX agent

arXiv:2606.25796v1 Announce Type: new Abstract: Localization in challenging environments, such as GNSS-denied, geometrically repetitive, or textureless scenes commonly found in offices, hotels, and un

agentsarxiv-cs-ro
25 Jun 2026
Applications

A Physics-Informed, Behavior-Aware Digital Twin for Robust Multimodal Forecasting of Core Body Temperature in Precision Livestock Farming

DGX agent

arXiv:2604.04098v2 Announce Type: replace Abstract: Precision livestock farming requires accurate and timely heat stress prediction to ensure animal welfare and optimize farm management. This study pr

applicationsarxiv-cs-cv
23 Jun 2026
Model Releases

Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Driving

DGX agent

arXiv:2606.22913v1 Announce Type: new Abstract: Recent Vision-Language-Action (VLA) models have advanced end-to-end autonomous driving by incorporating reasoning for better interpretability and planni

model-releasesarxiv-cs-cv
23 Jun 2026
Model Releases

Morphology-Aware Multimodal Representation Learning for Insect Phylogenetic Reconstruction

DGX agent

arXiv:2606.22077v1 Announce Type: new Abstract: Morphological traits provide important evidence for phylogenetic reconstruction and evolutionary relationship analysis. Recent image-based approaches ha

model-releasesarxiv-cs-cv
23 Jun 2026
Research

Odoriko: A Shape-Aware Multimodal Diffusion Framework for Human Motion

DGX agent

arXiv:2606.21135v1 Announce Type: new Abstract: Human motion generation has been widely studied across diverse input modalities, text, music, and video, and recent efforts have unified these into sing

researcharxiv-cs-cv
23 Jun 2026
Research

Predicting Immune Biomarkers with MultiModal Mixture-of-Expert Pathology Foundation Models Empowers Precision Oncology

DGX agent

arXiv:2606.18123v2 Announce Type: replace Abstract: Predicting immune biomarkers associated with the tumor immune microenvironment (TIME) is critical for advancing precision oncology, yet existing app

researcharxiv-cs-cv
23 Jun 2026
Applications

DeceptionX: Explainable Deception Detection with Multimodal Large Language Models

DGX agent

arXiv:2606.11385v1 Announce Type: new Abstract: Deception detection is a critical and highly challenging task within affective computing and behavioral analysis. Existing deep learning methods typical

applicationsarxiv-cs-cv
11 Jun 2026
Research

Decoding Multimodal Cues: Unveiling the Implicit Meaning Behind Hateful Videos

DGX agent

arXiv:2606.11953v1 Announce Type: new Abstract: Hateful videos have become prevalent on online platforms, highlighting an urgent need for effective detection. However, existing studies primarily focus

researcharxiv-cs-cl
11 Jun 2026
Agents

Data Journalist Agent: Transforming Data into Verifiable Multimodal Stories

DGX agent

arXiv:2606.11176v1 Announce Type: cross Abstract: Data tells stories that shape society; the data journalist's job is to turn raw information into stories non-experts can trust. A high-quality news fe

agentsarxiv-cs-cl
10 Jun 2026
Model Releases

AgroOmni: A Large-Scale Multi-view Agricultural Dataset for Cross-Scale Multimodal Reasoning

DGX agent

arXiv:2603.14342v2 Announce Type: replace-cross Abstract: Modern agricultural data is sourced from diverse platforms and spans multiple spatial scales, ranging from ground-level close-up photography t

model-releasesarxiv-cs-ai
9 Jun 2026
Safety

Aligned but Not Partner-Specific: Distinguishing How Multimodal LLM Agents Succeed in Reference Games Without Human-Like Conventions

DGX agent

arXiv:2606.08081v1 Announce Type: cross Abstract: Repeated reference games test whether interlocutors replace their initially long descriptions with shorter, partner-specific conventions grounded in s

safetyarxiv-cs-ai
9 Jun 2026
Safety

mllm-shap: A Shapley Value Explainability Platform for Text-Audio Multimodal Large Language Models

DGX agent

arXiv:2606.07531v1 Announce Type: cross Abstract: We introduce mllm-shap, an open-source Python framework designed to extend Shapley Value (SV) explainability from text-only Large Language Models to M

safetyarxiv-cs-ai
9 Jun 2026
Model Releases

NutriMLLM: Multimodal Large Language Models for Dietary Micronutrient Analysis

DGX agent

arXiv:2606.08948v1 Announce Type: cross Abstract: Comprehensive estimation of dietary micronutrients from food images could improve clinical nutrition care, but training such models requires large mul

model-releasesarxiv-cs-ai
9 Jun 2026
Local Ai

SMART: Shot-Aware Multimodal Video Moment Retrieval with Audio-Enhanced MLLM

DGX agent

arXiv:2511.14143v2 Announce Type: replace-cross Abstract: Video Moment Retrieval is a task in video understanding that aims to localize a specific temporal segment in an untrimmed video based on a nat

local-aiarxiv-cs-ai
9 Jun 2026
Applications

Evidence-Based Intelligent Diagnostic and Therapeutic Visualization System with Large Language Models: Multi-Turn Interaction and Multimodal Treatment Plan Generation

DGX agent

arXiv:2606.06869v1 Announce Type: new Abstract: Aim: Existing AI-assisted traditional Chinese medicine diagnostic tools suffer from opaque reasoning processes, passive interaction, and limited treatme

applicationsarxiv-cs-ai
8 Jun 2026
Model Releases

From Vision to Text: A Compact Multimodal Approach for Robust, Cross-Domain Presentation Attack Detection on ID Cards

DGX agent

arXiv:2606.06966v1 Announce Type: new Abstract: Cross-domain shifts challenge Presentation Attack Detection (PAD) on ID Cards, given the restricted data available due to privacy concerns. This work pr

model-releasesarxiv-cs-cv
8 Jun 2026
Safety

Teaching the Way, Not the Answer: Privileged Tutoring Distillation for Multimodal Policy Optimization

DGX agent

arXiv:2606.07000v1 Announce Type: new Abstract: Recent post-training methods, particularly Reinforcement Learning with Verifiable Rewards (RLVR), have significantly enhanced the reasoning ability of L

safetyarxiv-cs-ai
8 Jun 2026
Model Releases

Biomazon: A Multimodal Dataset for 3D Forest Structure and Biomass Modeling in the Amazon Basin

DGX agent

arXiv:2606.05368v1 Announce Type: new Abstract: Accurate, spatially explicit characterization of tropical forest structure is essential for carbon accounting and ecosystem monitoring, yet most ML pipe

model-releasesarxiv-cs-cv
5 Jun 2026
Model Releases

Do MLLMs Capture How Interfaces Guide User Behavior? A Benchmark for Multimodal UI/UX Design Understanding

DGX agent

arXiv:2505.05026v5 Announce Type: replace Abstract: User interface (UI) design goes beyond visuals to shape user experience (UX), underscoring the shift toward UI/UX as a unified concept. While recent

model-releasesarxiv-cs-cl
5 Jun 2026
Safety

ViCuR: Visual Cues as Recoverable Privilege for Multimodal On-Policy Distillation

DGX agent

arXiv:2606.05718v1 Announce Type: new Abstract: On-policy distillation (OPD) improves reasoning by training a student on trajectories sampled from its own policy under supervision from a teacher. In m

safetyarxiv-cs-cv
5 Jun 2026
Research

ViewMask-1-to-3: Multi-View Consistent Image Generation via Multimodal Discrete Diffusion Models

DGX agent

arXiv:2512.14099v3 Announce Type: replace Abstract: Motivated by discrete diffusion's success in language-vision modeling, we explore its potential for multi-view generation, a task dominated by conti

researcharxiv-cs-cv
4 Jun 2026
Research

Enhancing Protein-Protein Interaction Prediction with Hierarchical Motif-based Multimodal Protein Embedding

DGX agent

arXiv:2606.02629v1 Announce Type: cross Abstract: Protein-protein interactions (PPIs) are essential for many biological processes. However, existing PPI prediction approaches suffer from two major lim

researcharxiv-cs-ai
3 Jun 2026
Model Releases

Plan2Map: A Multimodal Benchmark for Document-Grounded Geospatial Boundary Reconstruction from Planning Records

DGX agent

arXiv:2606.02747v1 Announce Type: cross Abstract: Planning records define restrictions over geographic areas, but their source documents often provide only indirect spatial evidence rather than machin

model-releasesarxiv-cs-ai
3 Jun 2026
Safety

Interpretable Multimodal Gesture Recognition for Drone and Mobile Robot Teleoperation via Log-Likelihood Ratio Fusion

DGX agent

arXiv:2602.23694v3 Announce Type: replace-cross Abstract: Human operators are still frequently exposed to hazardous environments such as disaster zones and industrial facilities, where intuitive and r

safetyarxiv-cs-ai
2 Jun 2026
Safety

Longitudinal Multimodal Sensing of Physical Activity and Well-Being in Older Adults

DGX agent

arXiv:2606.00345v1 Announce Type: new Abstract: Wearable and mobile sensing technologies enable continuous monitoring of human behavior and health in real-world settings. However, predictive modeling

safetyarxiv-cs-lg
2 Jun 2026
← Previous
1…4445464748…211
Next →