AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,119 results
6 Oct 2026

Harnessing Multimodal Large Language Models for Training-Free Human-Object Interaction Detection

Model ReleasesDGX agent

arXiv:2610.06394v1 Announce Type: new Abstract: Human-object interaction (HOI) detection aims to localize human-object pairs and recognize their interactions. Traditional supervised methods perform st

PerCoV2: Ultra-Low Bit-Rate Perceptual Image Compression via Query-Based 1D Multimodal Image Tokens

ResearchDGX agent

arXiv:2503.09368v2 Announce Type: replace Abstract: Despite recent progress in learned image compression, current image codecs still struggle to maintain realistic reconstructions at low bit-rates, of

5 Oct 2026

How Robust Is Multimodal Claim Verification to LLM Rewriting?

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
ResearchDGX agent

arXiv:2610.02841v1 Announce Type: new Abstract: LLMs are known to introduce stylistic changes into generated text, yet how these stylistic shifts affect model decisions on scientific tasks remains und

MiDShip: Multimodal Dataset of Ship Cargo Hold Structures for Engineering Design

Model ReleasesDGX agent

arXiv:2610.02214v1 Announce Type: cross Abstract: Ship structures govern vessel strength, safety, and manufacturability, but their design must satisfy hundreds of classification society requirements,

Multimodal reasoning for broadly neutralizing antibody discovery from label-free human B cell repertoires across virus families

ResearchDGX agent

arXiv:2610.03160v1 Announce Type: cross Abstract: Discovering broadly neutralizing antibodies (bnAbs) from human natural immune repertoires remains a fundamental challenge in immunology, hindered by:

2 Oct 2026

Beyond Unimodal Bases: Pullback Geometry for Multimodal Data

ResearchDGX agent

arXiv:2610.00708v1 Announce Type: new Abstract: Data-driven Riemannian geometry provides nonlinear interpolation and geometric representations of high-dimensional data. For these operations to be stat

Paying for Too Many Tokens? Valid and Cost-Efficient Multimodal LLM Annotation with Simple Heuristics

ResearchDGX agent

arXiv:2610.00809v1 Announce Type: new Abstract: Vision-Language Models (VLMs) enable video annotation at scale, but costs accumulate quickly: processing a typical 60-second short-form video at one fra

TouchTherm: Building Multimodal Digital Twins of Objects for Tactile and Thermal Rendering

ApplicationsDGX agent

arXiv:2610.01943v1 Announce Type: new Abstract: Robotic simulation and virtual reality increasingly require object assets that capture not only visual geometry but also the physical cues underlying ta

1 Oct 2026

SimTrace: Grounded Multimodal User Trajectories Generation for Online User Modeling

AgentsDGX agent

arXiv:2609.38397v1 Announce Type: new Abstract: Virtual clients offer a cost-effective approach to support applications such as A/B testing, recommender system development, and interface evaluation. H

30 Sept 2026

Calibration-First Cross-Cohort Multimodal Temporal Learning for Transferable Asthma-Risk Forecasting

Model ReleasesDGX agent

arXiv:2609.35795v1 Announce Type: cross Abstract: Asthma deterioration forecasting must remain reli- able when patient populations, sensor ecosystems, and available modalities change across cohorts. E

Evaluating the Evaluators: Diagnosing Large Multimodal Models for AI-Generated Image Assessment

Model ReleasesDGX agent

arXiv:2609.37576v1 Announce Type: new Abstract: With the rapid advancement of text-to-image (T2I) generation, robust evaluation becomes critical yet challenging, as traditional metrics fail to capture

InsightMap: Structured Spatial Modeling for Embodied Multimodal Reasoning

ResearchDGX agent

arXiv:2609.37187v1 Announce Type: new Abstract: Language-guided navigation requires connecting partial observations to a persistent spatial reference and learning how actions change that representatio

29 Sept 2026

A Multimodal Autonomic Sensing Framework for Objective Assessment of Patient Responses to Dental Pulp Stimulation

ResearchDGX agent

arXiv:2609.35121v1 Announce Type: new Abstract: Patient responses to dental pulp testing, ranging from no sensation to intense pain, provide important information for assessing pulp status in endodont

Artificial Intelligence Across the Cardiac Amyloidosis Diagnostic and Management Pathway: From Single-Modality Detection to Multimodal Clinical Integration

ResearchDGX agent

arXiv:2607.09948v2 Announce Type: replace-cross Abstract: Cardiac amyloidosis (CA) is increasingly recognized but remains substantially underdiagnosed because its clinical and imaging phenotype overla

FOCUS: Benchmarking Retinal Model Generalization from Foundation Vision Encoders to Multimodal LLMs

Model ReleasesDGX agent

arXiv:2609.33158v1 Announce Type: new Abstract: Progress in AI-based retinal image analysis has advanced with foundation models, yet evaluating their reliability remains challenging. Performance repor

ForensicZoom: Adaptive Visual Inspection with Multimodal LLMs for Industrial-Grade Face Forgery Detection

ResearchDGX agent

arXiv:2609.31661v1 Announce Type: new Abstract: Reliable face forgery detection is critical to the security of online identity verification systems, where missed attacks compromise security and excess

How Condé Nast built multimodal video discovery with Amazon Bedrock

IndustryDGX agent

Condé Nast's editorial teams spent an average of 250 minutes per task searching a library of more than 140,000 videos using only titles and descriptions. Working with the AWS Generative AI Innovation

Progressive-View On-Policy Distillation for Regional-to-Global Transfer in Multimodal LLMs

SafetyDGX agent

arXiv:2609.32333v1 Announce Type: new Abstract: Regional-to-global distillation uses crop-conditioned guidance to improve full-image understanding. The challenge is to effectively transfer the teacher

SetOPD: From Few Visual Exemplars to Multimodal Candidate Sets for Remote-Sensing Open-Prompt Detection

ResearchDGX agent

arXiv:2609.32529v1 Announce Type: new Abstract: Open-prompt detectors allow users to specify targets with text, visual exemplars, or both. We argue that existing designs underuse the visual modality i

THEIA: A Multimodal Dataset and Benchmark for Vision-Language Analysis of Layout

Model ReleasesDGX agent

arXiv:2609.35035v1 Announce Type: new Abstract: The integration of artificial intelligence into computer-aided design frameworks has sparked a shift in the design of analog integrated circuits (ICs),

Weighting Schedules Govern What and When Score-Based Generative Models Learn from Multimodal Data

TutorialsDGX agent

arXiv:2609.35322v1 Announce Type: new Abstract: Score-based generative models generate new samples by integrating a time-dependent drift that carries Gaussian noise onto the target distribution. In pr

28 Sept 2026

EAServe: Encode-Aware Disaggregated Serving for Multimodal Large Language Models

HardwareDGX agent

arXiv:2609.31551v1 Announce Type: cross Abstract: Disaggregating the two stages, Prefill and Decode, onto separate GPU pools is now a standard optimization for (text-only) LLM serving. However, multim

Enhancing Photogrammetric Digital Surface Models with Pretrained Diffusion Models and Multimodal Conditioning

ResearchDGX agent

arXiv:2609.31199v1 Announce Type: cross Abstract: Large-scale Digital Surface Models (DSMs) can be produced cost-effectively from satellite images via stereo-photogrammetry. However, the resulting 3D

Skip the Talk, Re-Focus on Vision: Latent Reasoning for Reasoning Segmentation in Multimodal Large Language Models

SafetyDGX agent

arXiv:2609.30783v1 Announce Type: cross Abstract: Reasoning segmentation aims to interpret implicit textual queries and enable fine-grained visual perception, which is critical for applications such a

25 Sept 2026

SkinAgent AI: A Safety-Grounded Multimodal Agentic Framework for Non-Diagnostic Skincare Support

Model ReleasesDGX agent

arXiv:2609.29341v1 Announce Type: new Abstract: Consumer-facing skincare AI must coordinate visual evidence, product information, tool use, and user-facing actions within explicit evidence and safety

24 Sept 2026

AstraLOD3: Zero-shot multimodal agentic reconstruction of LOD3 building models

Model ReleasesDGX agent

arXiv:2609.28061v1 Announce Type: new Abstract: Automated LOD3 building modeling typically relies on purpose-built geometric or learning-based pipelines, limiting flexibility across heterogeneous buil

Geometry-anchored PET-aware multimodal pseudo-CT synthesis for whole-body attenuation correction: the BIC-MAC Challenge

ResearchDGX agent

arXiv:2609.27848v1 Announce Type: new Abstract: The BIC-MAC challenge targets whole-body pseudo-CT synthesis from NAC-PET, Dixon MRI, and a 2D topogram for CT-less PET attenuation correction. We propo

23 Sept 2026

A Multimodal Large Language Model-Driven Framework for Context-Aware UAV Emergency Landing Site Selection

Model ReleasesDGX agent

arXiv:2602.01163v2 Announce Type: replace Abstract: Safe UAV emergency landing requires more than just identifying flat terrain; it demands understanding complex semantic risks (e.g., crowds, temporar

Evidence-gated multimodal parsing and vectorization of architectural floor plans

Model ReleasesDGX agent

arXiv:2609.25615v1 Announce Type: new Abstract: Architectural floor plans remain a high-friction barrier to archive digitization and early design-model preparation because heterogeneous graphics encod

From Token Importance to Conditional Removability: Rethinking Visual Token Pruning in Multimodal Large Language Models

ResearchDGX agent

arXiv:2609.26484v1 Announce Type: new Abstract: Training-free visual-token pruning often uses token importance, redundancy, or related selection criteria as proxies for safe removal. We show that thes

Moving6DPoSe: A Multimodal Database for Monocular 6D Pose Estimation and Segmentation of Moving Objects

ApplicationsDGX agent

arXiv:2609.26161v1 Announce Type: new Abstract: Estimating the 6D pose of moving objects remains challenging due to motion blur and the limited temporal resolution of conventional frame-based cameras.

PartLLM: A Unified Multimodal Foundation for 3D Part Segmentation

ResearchDGX agent

arXiv:2609.25832v1 Announce Type: new Abstract: Part segmentation is a fundamental problem in computer graphics and 3D vision. Recent works have expanded 3D part segmentation beyond fixed taxonomies,

22 Sept 2026

An Affordable AI-Integrated Smart Cane for Multimodal Mobility Assistance of Visually Impaired Users

ResearchDGX agent

arXiv:2609.22277v1 Announce Type: cross Abstract: Visual impairment affects over 2.2 billion people worldwide, yet conventional white canes cannot detect elevated hazards or provide semantic environme

Benchmarking Off-the-Shelf Multimodal AI Models Against Dermatologists on Patient-Captured Skin Images

Model ReleasesDGX agent

arXiv:2609.24190v1 Announce Type: new Abstract: Artificial intelligence (AI) has advanced at a rapid pace in recent years. Initially, breakthroughs in large language models caught widespread attention

Detecting Phone-Induced Pedestrian Distraction via a Multimodal Fusion Transformer

AgentsDGX agent

arXiv:2609.23507v1 Announce Type: new Abstract: The increasing reliance on mobile phones has made phone-induced pedestrian distraction increasingly prevalent. Activities such as texting, watching vide

Document Retrieval-Aware Chunking (D-RAC): Universal Retrieval-Aware Ingestion of Enterprise Documents via PDF Normalization and Multimodal Markdown Conversion

Model ReleasesDGX agent

arXiv:2609.24220v1 Announce Type: new Abstract: Retrieval-Augmented Generation (RAG) systems over enterprise knowledge bases must ingest heterogeneous document formats -- PDFs, Word documents, present

Graded-Relevance Composed Multimodal Retrieval for E-commerce Visual Search at Scale

Model ReleasesDGX agent

arXiv:2609.24152v1 Announce Type: cross Abstract: Visual search on large e-commerce catalogs must serve both 'similarity' queries that ask for items resembling an uploaded image and 'modifier' queries

IDProxy: CTR Prediction with Multimodal LLMs for Cold-Start Recommendation at Xiaohongshu

ApplicationsDGX agent

arXiv:2603.01590v2 Announce Type: replace-cross Abstract: Content-driven platforms such as Xiaohongshu often leverage click-through rate (CTR) prediction models for recommendation. However, these mode

Learning to Drive on Mars: Visual Multimodal Traversability Estimation for Off-World Navigation

AgentsDGX agent

arXiv:2609.24952v1 Announce Type: new Abstract: Autonomous navigation on Mars requires vehicles to distinguish between traversable terrains across diverse and visually challenging environments. Howeve

MarsRecon: Self-Supervised and Multimodal Surface Representations for Mars

Local AiDGX agent

arXiv:2609.22379v1 Announce Type: new Abstract: High-resolution orbital imagery offers a rich record of the Martian surface, but sparse geological labels limit supervised representation learning. We p

21 Sept 2026

Beyond Final Answers: CRYSTAL Benchmark for Transparent Multimodal Reasoning Evaluation

Model ReleasesDGX agent

arXiv:2603.13099v3 Announce Type: replace Abstract: We introduce CRYSTAL (Clear Reasoning via Yielded Steps, Traceability, and Logic), a diagnostic benchmark with 6,372 instances that evaluates multim

HERMES: A Holistic End-to-End Risk-Aware Multimodal Embodied System with Vision-Language Models for Long-Tail Autonomous Driving

Model ReleasesDGX agent

arXiv:2602.00993v2 Announce Type: replace-cross Abstract: End-to-end autonomous driving models increasingly benefit from large vision-language models for semantic understanding, yet safe and reliable

ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulation

SafetyDGX agent

arXiv:2603.03279v2 Announce Type: replace-cross Abstract: Achieving autonomous and versatile whole-body loco-manipulation remains a central barrier to making humanoids practically useful. Yet existing

18 Sept 2026

A Unified Evaluation Framework for Trustworthy Large Language Models, Agentic AI, and Multimodal Systems

Model ReleasesDGX agent

arXiv:2609.19524v1 Announce Type: new Abstract: Benchmark scores alone provide an incomplete basis for assessing the trustworthiness of modern artificial intelligence systems. Large language models (L

17 Sept 2026

Donate or Create? Comparing Data Collection Strategies for Emotion-labeled Multimodal Social Media Posts

ApplicationsDGX agent

arXiv:2505.24427v2 Announce Type: replace Abstract: Accurate modeling of subjective phenomena such as emotion expression requires data annotated with authors' intentions. Commonly such data is collect

Future of general LLM work (interp/inference/alignment) vs agentic/physical AI (VLA, multimodal) for career [D]

SafetyDGX agent

I'm at a crossroads with two grad school options that would take me in somewhat different research directions, and I wanted some general advice on these fields, their growth, and industry alignment. I

Hypothesis-Driven Autonomous Materials Synthesis with Multimodal LLM Agents

AgentsDGX agent

arXiv:2609.18598v1 Announce Type: cross Abstract: Self-driving laboratories can explore synthesis conditions autonomously, but their decision-making layer is typically a black-box optimizer, and the o

Multimodal Behavior Tree Generation: A Small Vision-Language Model for Robot Task Planning

Model ReleasesDGX agent

arXiv:2603.06084v2 Announce Type: replace Abstract: Large language models have been widely used for robotic task planning, often taking advantage of representations such as Behavior Trees (BTs). Visio

Online Multimodal Workload Assessment in Contact-Rich Physical Human-Robot Interaction

ResearchDGX agent

arXiv:2609.18031v1 Announce Type: new Abstract: Contact-rich physical human--robot interaction (pHRI) imposes time-varying demands associated with physical interaction, motor regulation, and physiolog

16 Sept 2026

Robust Fault Detection in Mechanical Multimodal Time Series via Self-Supervised Cross-Modal Reconstruction

SafetyDGX agent

arXiv:2609.16314v1 Announce Type: new Abstract: Fault detection is essential in industrial systems, enabling early identification of abnormal behaviour and improving safety, reliability, and operation

15 Sept 2026

A Generative AI Integrated Multimodal Framework for Low-Latency Multi-Camera Person Re-Identification

ResearchDGX agent

arXiv:2609.14419v1 Announce Type: cross Abstract: Person re-identification (ReID) is essential for multi-camera surveillance and tracking, yet remains difficult due to viewpoint and illumination chang

Multimodal Foundation Models Adaptation based on Domain-Aware Relaxed Orthogonal Subspace for Remote Sensing

Model ReleasesDGX agent

arXiv:2609.13654v1 Announce Type: new Abstract: Pretrained foundation models (FMs) have achieved remarkable success in computer vision, yet their high fine-tuning cost limits practical deployment. Par

SlipSense: Multimodal Tactile Learning for Low-Latency and Generalized Slip Detection

ResearchDGX agent

arXiv:2609.15910v1 Announce Type: cross Abstract: Slip detection is fundamental to dexterous manipulation, yet existing systems often lack precise characterization of detection latency and cross-platf

11 Sept 2026

CARLAverse: A Highly Modular, Distributed, and Multimodal Framework for Human-in-the-Loop Simulation

AgentsDGX agent

arXiv:2609.11478v1 Announce Type: new Abstract: The development of autonomous driving demands comprehensive testing in mixed-traffic scenarios involving vulnerable road users (VRUs), where purely arti

ReactHuman: A Physics-Grounded Benchmark for Human-Like Reactive Decision-Making in Embodied Multimodal LLMs

Model ReleasesDGX agent

arXiv:2609.10895v1 Announce Type: new Abstract: Reacting to sudden physical hazards (catching a slipping plate, dodging a falling knife) is both a meaningful test of embodied intelligence and a hard r

Scale-Aware 3D Deep Learning for Robust Brain Metastasis Detection in Multimodal MRI

ResearchDGX agent

arXiv:2609.10825v1 Announce Type: cross Abstract: Detecting brain metastases in magnetic resonance imaging (MRI) remains challenging because lesions vary widely in size and appearance, with very small

10 Sept 2026

NormViz: A Benchmark and Framework for Grounding Multimodal Reasoning in Global Cultures

Model ReleasesDGX agent

arXiv:2609.06831v1 Announce Type: new Abstract: AI systems are used worldwide, but they struggle to serve the needs of culturally diverse populations. Prior work on cultural understanding evaluates AI

On-Policy Distillation for Vision-Language Model Adaptation, an Effective Paradigm on Low-Quality Multimodal Data

SafetyDGX agent

arXiv:2609.10321v1 Announce Type: new Abstract: Knowledge distillation offers an efficient route to transfer a task-adapted vision-language teacher to a compact student. The training target in current

9 Sept 2026

AAMBERS-UAV: Acquisition-Aware Multimodal Backbone Evaluation and Ranking for UAV Weedy Rice Segmentation

Model ReleasesDGX agent

arXiv:2609.05762v1 Announce Type: new Abstract: UAV image collections contain spatially and temporally related frames, yet semantic-segmentation benchmarks commonly split them at image level. Such spl

DYAD: A Multimodal Dataset of Co-Located Human Assistance

SafetyDGX agent

arXiv:2609.09023v1 Announce Type: new Abstract: An embodied assistant working beside a person must track task state, recognize help seeking, choose how to intervene, and produce an appropriate respons

← Previous
1…3839404142…169
Next →