AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,119 results
25 Sept 2026

Mind What Matters for Reasoning: Aligning Cross-Modal Attention via Selective Probability Mass Concentration

Model ReleasesDGX agent

arXiv:2609.29940v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) achieve strong performance on visual reasoning tasks, yet remain prone to hallucinations and over-reliance on

Pistis Technical Report

Model ReleasesDGX agent

arXiv:2609.28554v1 Announce Type: new Abstract: We introduce the Pistis model family, comprising 27B- and 9B-parameter multimodal large language models built on Qwen3.6 and Qwen3.5, respectively, and

22 Sept 2026

SLICEChat: Progressive In-Encoder Token Pruning for Whole-Slide Pathology Language Models

ResearchDGX agent
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

arXiv:2609.24894v1 Announce Type: cross Abstract: Whole-slide pathology images (WSIs) contain gigapixel-scale visual content, creating a major scalability challenge for slide-level multimodal large la

15 Sept 2026

Beyond Generation and Accuracy: Diagnosing and Enhancing Visual Chain-of-Thought for Geometry Problem Solving

Model ReleasesDGX agent

arXiv:2609.12606v2 Announce Type: replace Abstract: While multimodal reasoning has advanced rapidly, solving complex geometry problems critically hinges on active visual assistance, such as constructi

CapGeo-Bench: Decoupling Visual Perception from Reasoning and Evaluating Geometric Understanding

Model ReleasesDGX agent

arXiv:2510.09302v2 Announce Type: replace-cross Abstract: While Multimodal Large Language Models (MLLMs) have achieved remarkable success in difficult purely textual mathematical reasoning tasks, even

PACE: Progressive Angular-to-Norm Contrastive Embedding

Model ReleasesDGX agent

arXiv:2609.15152v1 Announce Type: cross Abstract: Multimodal embedding models encode heterogeneous inputs into a shared embedding space, enabling efficient similarity computation across modalities and

9 Sept 2026

ECOKV: Geometry-Aware KV Cache Eviction via Complementary Diversity Metrics

ResearchDGX agent

arXiv:2609.06663v1 Announce Type: cross Abstract: Although multimodal Large Language Models (MLLMs) excel in diverse tasks, their scalability remains limited by the memory and computational overhead o

GenPuzzle: Benchmarking Visual Reasoning in Image Generation Models

Model ReleasesDGX agent

arXiv:2609.05902v1 Announce Type: new Abstract: Recent image generation systems increasingly combine multimodal understanding, reasoning, and synthesis, suggesting that they may do more than render pl

Reason Through the Latent! Making Latent Visual Reasoning Necessary

ResearchDGX agent

arXiv:2609.06746v1 Announce Type: cross Abstract: Latent visual reasoning aims to perform multimodal reasoning through hidden-state computation rather than explicit textual chains of thought. However,

VDiff-Bench: A Challenging Benchmark for Fine-Grained Image Difference Identification

Model ReleasesDGX agent

arXiv:2609.06245v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) perform strongly on general visual understanding tasks such as visual question answering, yet they often strugg

VIS-DICT: A Visual Dictionary for Missing Modality Imputation in Social Network Depression Detection

ResearchDGX agent

arXiv:2609.05537v1 Announce Type: new Abstract: Tracking social media posts can help spot early signs of depression. Recent studies show that combining text and images works better for detecting depre

4 Sept 2026

ProAct: Harnessing Streaming Motion Generation and Agentic Reasoning for Real-Time Embodied Social Interaction

Model ReleasesDGX agent

arXiv:2602.14048v2 Announce Type: replace-cross Abstract: Real-time embodied social interaction places two equally demanding requirements on an agent: continuously generating fluent multimodal interac

3 Sept 2026

Rendering-in-the-Loop: An Execution-Driven Agent for Interactive Web Development

Model ReleasesDGX agent

arXiv:2609.02088v1 Announce Type: new Abstract: Multimodal large language models have achieved remarkable progress in front-end web development, generating interactive webpages from multimodal referen

2 Sept 2026

IntroConformal: Conformal Factuality Guarantees for Large Vision-Language Models via Introspective Signals

ResearchDGX agent

arXiv:2609.01375v1 Announce Type: cross Abstract: Large Vision-Language Models (LVLMs) have achieved strong multimodal performance, yet ensuring the factual correctness of generated content remains ch

1 Sept 2026

MedTVL: Harnessing Vision and Language for Medical Time Series Classification

ResearchDGX agent

arXiv:2608.28605v1 Announce Type: new Abstract: Recent advancements in multimodal learning for medical time series (MedTS) classification highlight the benefits of integrating complementary modalities

N_0-Foundation: Towards the Age of Tactile Intelligence

Model ReleasesDGX agent

arXiv:2608.29601v1 Announce Type: cross Abstract: We present N_0-Foundation, a paradigm for tactile-enabled embodied manipulation, which integrates tactile sensing hardware, large-scale multimodal dat

ReGraP-LLaVA: Reasoning enabled Graph-based Personalized Large Language and Vision Assistant

Model ReleasesDGX agent

arXiv:2505.03654v3 Announce Type: replace-cross Abstract: Multimodal Large Language Models have shown strong performance across multimodal tasks, and recent personalized MLLMs can recognize user-speci

SGPDFuse: Semantically-Guided Physics-Disentanglement General Multi-Modal Image Fusion

SafetyDGX agent

arXiv:2608.29220v1 Announce Type: new Abstract: Multimodal image fusion (MMIF) aims to integrate complementary sensor data into a single representation that preserves intrinsic scene reality while eli

31 Aug 2026

Dynamic Alignment Compensation for Hallucination Mitigation in Large Vision-Language Models

SafetyDGX agent

arXiv:2608.28058v1 Announce Type: new Abstract: Large Vision-Language Models (LVLMs) remain prone to hallucinations, producing responses that are irrelevant or inconsistent with the multimodal input.

Temporal Tree of Thought: Reasoning-Guided Visual Cue Search for Long-Video Understanding

Local AiDGX agent

arXiv:2608.27871v1 Announce Type: new Abstract: Long-video understanding remains challenging for Multimodal Large Language Models (MLLMs) due to limited context length. Uniform sampling may miss cruci

28 Aug 2026

Chart2SVG: Editable SVG Generation from Raster Chart Images

ResearchDGX agent

arXiv:2608.26544v1 Announce Type: new Abstract: We present Chart2SVG, a multimodal large language model that converts static raster charts into structurally organized, semantically enriched SVGs that

27 Aug 2026

Segmentation-Based Attention Entropy: Detecting and Mitigating Object Hallucinations in Large Vision-Language Models

ResearchDGX agent

arXiv:2603.16558v2 Announce Type: replace Abstract: Large Vision-Language Models (LVLMs) achieve strong performance on many multimodal tasks, but object hallucinations severely undermine their reliabi

25 Aug 2026

tencent/WeMM-Embedding 9B/4B/2B

Local AiDGX agent

WeMM-Embedding-9B is a universal multimodal embedding model built on Qwen3.5. It accepts text, images, videos, visual documents, and interleaved multimodal inputs, and returns a 4,096-dimensional L2-n

24 Aug 2026

Enhancing Localized Reasoning for Long Video Understanding via Efficient Segment-to-Video Supervision

Local AiDGX agent

arXiv:2608.20814v1 Announce Type: new Abstract: Though Multimodal Large Language Models (MLLMs) have shown impressive potential in video understanding, long video understanding (LVU) remains challengi

When Generated Images Look Right and Retrieve Wrong: Coverage-Guided Cross-Scale Re-Indexing for Knowledge-Faithful Generative Perception

Model ReleasesDGX agent

arXiv:2608.20810v1 Announce Type: cross Abstract: Multimodal information systems increasingly route generated visual content back through the same vision-language index that informed its production, s

20 Aug 2026

Breaking the weakest link to evade vision language models

Model ReleasesDGX agent

arXiv:2608.18938v1 Announce Type: new Abstract: Vision Language Models (VLMs) have recently emerged as a critical component of multimodal AI systems, enabling joint reasoning over visual and textual i

18 Aug 2026

FusionBERT: Multi-View Image--3D Retrieval via Cross-Attention Visual Fusion and Normal-Aware 3D Encoder

SafetyDGX agent

arXiv:2604.02583v2 Announce Type: replace Abstract: We propose FusionBERT, a novel multi-view visual fusion framework for image--3D multimodal retrieval. Existing image--3D representation learning met

Vision Language Models Cannot Plan, but Can They Formalize?

Model ReleasesDGX agent

arXiv:2509.21576v2 Announce Type: replace Abstract: The advancement of vision language models (VLMs) has empowered embodied agents to accomplish simple multimodal planning tasks, but not long-horizon

13 Aug 2026

AWARe: Mitigating Catastrophic Forgetting via Activation-Weighted Adaptive REtention

Model ReleasesDGX agent

arXiv:2608.11758v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) exhibit strong generalization and reasoning abilities due to large-scale multimodal pre-training. However, fine

Warping Earth Observations for better ice labeling in the Marginal Marginal Ice Zone

Model ReleasesDGX agent

arXiv:2608.11883v1 Announce Type: new Abstract: Multimodal satellite imagery provides complementary information for Earth Observation, but accurately combining heterogeneous sensors remains challengin

12 Aug 2026

CARE: Confidence-Aware Reasoning for Reliable Medical VQA

SafetyDGX agent

arXiv:2608.10964v1 Announce Type: cross Abstract: Reinforcement Fine-Tuning (RFT) has enabled medical Multimodal Large Language Models (MLLMs) to produce Chain-of-Thought (CoT) reasoning for visual qu

CohereLabs/North-Micro-Vision-Instruct · Hugging Face

Model ReleasesDGX agent

North Micro Vision Instruct is a 2.4B-parameter open-weight vision-language model with native-resolution image support, released under the Apache 2.0 license. It is designed as a compact foundation fo

LaViT: Aligning Latent Visual Thoughts for Multi-modal Reasoning

ResearchDGX agent

arXiv:2601.10129v2 Announce Type: replace-cross Abstract: Current multimodal latent reasoning often relies on external supervision (e.g., auxiliary images), ignoring intrinsic visual attention dynamic

StreamFlow: Dynamic Memory Flows for Streaming Video Understanding

ResearchDGX agent

arXiv:2608.10949v1 Announce Type: cross Abstract: Streaming video understanding requires multimodal large language models (MLLMs) to preserve relevant evidence from continuously evolving streams under

The Truth Stays in the Family: Enhancing Contextual Grounding via Inherited Truthful Heads in Model Lineages

Model ReleasesDGX agent

arXiv:2606.15821v2 Announce Type: replace-cross Abstract: Recent advances in large language models (LLMs) have produced many specialized multimodal LLMs (MLLMs) that share common foundational LLMs, fo

11 Aug 2026

DistMoE: Private-data Rehearsal-free Routing in Mixture-of-Experts for Distributed Instruction Tuning

Local AiDGX agent

arXiv:2608.09907v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have shown strong multimodal instruction-following ability, but adapting them to diverse visual-language domain

7 Aug 2026

RIG-RoPE: Relation- and Instance-Gated Rotary Positional Encoding with Duration-Aware Temporal Coordinates

ResearchDGX agent

arXiv:2608.05154v1 Announce Type: new Abstract: Rotary positional encoding (RoPE) is a core component of modern language models and has been extended to multimodal LLMs through multidimensional varian

StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding

Model ReleasesDGX agent

arXiv:2608.05703v1 Announce Type: new Abstract: Deploying autonomous multimodal agents in continuous, real-world environments requires them to ingest unbounded audio-visual streams and maintain hour-s

4 Aug 2026

SVGEval: A Vision-Grounded Framework for Perceptual-Quality Benchmarking and Evaluation in Text-to-SVG Generation

Model ReleasesDGX agent

arXiv:2608.01977v1 Announce Type: new Abstract: Multimodal large models are increasingly used to generate scalable vector graphics (SVG), but reliable evaluation remains underexplored. Existing protoc

31 Jul 2026

LAST: The Last Query Token Guides Visual Token Pruning for Edge-Cloud Collaborative MLLM Inference

ResearchDGX agent

arXiv:2607.27952v1 Announce Type: new Abstract: Multimodal foundation models are reshaping edge-cloud visual intelligence from task-specific feature pipelines into token-based interfaces, where edge d

28 Jul 2026

LanteRn: Latent Visual Structured Reasoning

ResearchDGX agent

arXiv:2603.25629v2 Announce Type: replace Abstract: While language reasoning models excel in many tasks, visual reasoning remains challenging for current large multimodal models (LMMs). As a result, m

Spatio-Temporal Conditional Denoising Transformer for Modality-Missing RGBT Tracking

Model ReleasesDGX agent

arXiv:2607.24701v1 Announce Type: new Abstract: Missing modalities in RGBT tracking often lead to incomplete and unstable multimodal feature representations that greatly degrade the performance. Exist

TextRich: A Multi-Domain Benchmark for Detecting AI-Generated Text-Rich Images from GPT-Image-2

Model ReleasesDGX agent

arXiv:2606.19259v2 Announce Type: replace-cross Abstract: Text-rich images often contain privacy-sensitive, transactional, or decision-relevant information. As recent multimodal image generation model

27 Jul 2026

Filling Before Advancing: Capability-Gap-Driven Post-Training for Scenario-Specialized Remote Sensing MLLMs

Model ReleasesDGX agent

arXiv:2607.22205v1 Announce Type: new Abstract: Remote sensing multimodal large language models (RS-MLLMs) have improved general aerial-image understanding. However, Earth observation applications req

Zero-Shot Mission-Level Evaluation for Aerial MLLM Agents

Model ReleasesDGX agent

arXiv:2607.22014v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) are emerging as core reasoning modules for embodied agents, yet it remains unclear how well general-purpose m

24 Jul 2026

MELLA: Bridging Linguistic Capability and Cultural Groundedness for Low-Resource Language MLLMs

SafetyDGX agent

arXiv:2508.05502v2 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) perform strongly in high-resource languages, yet often produce fluent but culturally 'thin' descripti

15 Jul 2026

Wiki Lint Report — 2026-07-15

SynthesesDGX agent

Automated lint: 26 errors, 6728 warnings, 3 info

UMSS: Towards Unsupervised Multi-modal Semantic Segmentation

TutorialsDGX agent

arXiv:2607.12372v1 Announce Type: new Abstract: Multimodal semantic segmentation (MSS) is essential for robust perception in complex environments, yet its potential remains largely untapped because of

7 Jul 2026

iFLYTEK-Embodied-Omni Technical Report

ResearchDGX agent

arXiv:2607.02542v1 Announce Type: new Abstract: General-purpose embodied agents must understand multimodal instructions, anticipate how their environment will evolve, and produce precise control actio

3 Jul 2026

An Efficient vLLM-Based Inference Pipeline for Unified Audio Understanding and Generation

HardwareDGX agent

arXiv:2607.02119v1 Announce Type: cross Abstract: While Large Multimodal Models excel in comprehension, high-throughput inference engines lack native support for multimodal generation. This is severe

1 Jul 2026

LOPA: Enhancing Spoken Language Assessment via Latent Ordinal Prototype Alignment

Model ReleasesDGX agent

arXiv:2606.31310v1 Announce Type: new Abstract: Fueled by increasing model scale and multimodal inputs, Multimodal Large Language Models (MLLMs) have emerged as a promising paradigm for Spoken Languag

RASR: Retrieval-Augmented Semantic Reasoning for Fake News Video Detection

ResearchDGX agent

arXiv:2604.06687v2 Announce Type: replace Abstract: Multimodal fake news video detection is a crucial research direction for maintaining the credibility of online information. Existing studies primari

30 Jun 2026

Before Thinking, Learn to Decide: Proactive Routing for Efficient Visual Reasoning

TutorialsDGX agent

arXiv:2606.30217v1 Announce Type: new Abstract: Large multimodal models have achieved strong reasoning on complex visual tasks, but their inference efficiency is often restricted by long chains of tho

Bridging VideoQA and Video-Guided Agentic Tasks via Generalized Keyframe Extraction

Model ReleasesDGX agent

arXiv:2606.29445v1 Announce Type: cross Abstract: Video understanding is a fundamental capability for multimodal intelligence, and recent Multimodal Large Language Models (MLLMs) have achieved remarka

26 Jun 2026

TOPS: First-Principles Visual Token Pruning via Constructing Token Optimal Preservation Sets for Efficient MLLM Inference

ResearchDGX agent

arXiv:2606.27161v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have achieved strong multimodal reasoning capabilities, but their efficiency is limited by the large number of

ViQ: Text-Aligned Visual Quantized Representations at Any Resolution

ResearchDGX agent

arXiv:2606.27313v1 Announce Type: new Abstract: A unified representation for text and vision is a natural pursuit, as it enables simpler multimodal modeling and more efficient training. However, repre

11 Jun 2026

Findings of the MAGMaR 2026 Shared Task

ResearchDGX agent

arXiv:2606.12295v1 Announce Type: cross Abstract: This overview paper presents the results of the shared task for the second workshop on Multimodal Augmented Generation via Multimodal Retrieval (MAGMa

MentisOculi: Revealing the Limits of Reasoning with Mental Imagery

ResearchDGX agent

arXiv:2602.02465v2 Announce Type: replace Abstract: Frontier models are transitioning from multimodal large language models (MLLMs) that merely ingest visual information to unified multimodal models (

10 Jun 2026

Kwai Keye-VL-2.0 Technical Report

Model ReleasesDGX agent

arXiv:2606.10651v1 Announce Type: new Abstract: We introduce Kwai Keye-VL-2.0-30B-A3B, an open-source Mixture-of-Experts (MoE) multimodal foundation model designed to advance long-video understanding

9 Jun 2026

Optical Reasoning: Rethinking Images as an Expressive Reasoning Medium Beyond Text

ResearchDGX agent

arXiv:2606.09585v1 Announce Type: new Abstract: Chain-of-Thought (CoT) improves the performance of Large Language Models (LLMs) and has been extended to Multimodal Large Language Models (MLLMs). More

← Previous
1…5152535455…169
Next →