AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,117 results
Model Releases

Pistis Technical Report

DGX agent

arXiv:2609.28554v1 Announce Type: new Abstract: We introduce the Pistis model family, comprising 27B- and 9B-parameter multimodal large language models built on Qwen3.6 and Qwen3.5, respectively, and

model-releasesarxiv-cs-ai
25 Sept 2026
Research

SLICEChat: Progressive In-Encoder Token Pruning for Whole-Slide Pathology Language Models

DGX agent
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

arXiv:2609.24894v1 Announce Type: cross Abstract: Whole-slide pathology images (WSIs) contain gigapixel-scale visual content, creating a major scalability challenge for slide-level multimodal large la

researcharxiv-cs-cl
22 Sept 2026
Model Releases

Beyond Generation and Accuracy: Diagnosing and Enhancing Visual Chain-of-Thought for Geometry Problem Solving

DGX agent

arXiv:2609.12606v2 Announce Type: replace Abstract: While multimodal reasoning has advanced rapidly, solving complex geometry problems critically hinges on active visual assistance, such as constructi

model-releasesarxiv-cs-ai
15 Sept 2026
Model Releases

CapGeo-Bench: Decoupling Visual Perception from Reasoning and Evaluating Geometric Understanding

DGX agent

arXiv:2510.09302v2 Announce Type: replace-cross Abstract: While Multimodal Large Language Models (MLLMs) have achieved remarkable success in difficult purely textual mathematical reasoning tasks, even

model-releasesarxiv-cs-ai
15 Sept 2026
Model Releases

PACE: Progressive Angular-to-Norm Contrastive Embedding

DGX agent

arXiv:2609.15152v1 Announce Type: cross Abstract: Multimodal embedding models encode heterogeneous inputs into a shared embedding space, enabling efficient similarity computation across modalities and

model-releasesarxiv-cs-ai
15 Sept 2026
Research

ECOKV: Geometry-Aware KV Cache Eviction via Complementary Diversity Metrics

DGX agent

arXiv:2609.06663v1 Announce Type: cross Abstract: Although multimodal Large Language Models (MLLMs) excel in diverse tasks, their scalability remains limited by the memory and computational overhead o

researcharxiv-cs-cv
9 Sept 2026
Model Releases

GenPuzzle: Benchmarking Visual Reasoning in Image Generation Models

DGX agent

arXiv:2609.05902v1 Announce Type: new Abstract: Recent image generation systems increasingly combine multimodal understanding, reasoning, and synthesis, suggesting that they may do more than render pl

model-releasesarxiv-cs-cv
9 Sept 2026
Research

Reason Through the Latent! Making Latent Visual Reasoning Necessary

DGX agent

arXiv:2609.06746v1 Announce Type: cross Abstract: Latent visual reasoning aims to perform multimodal reasoning through hidden-state computation rather than explicit textual chains of thought. However,

researcharxiv-cs-cv
9 Sept 2026
Model Releases

VDiff-Bench: A Challenging Benchmark for Fine-Grained Image Difference Identification

DGX agent

arXiv:2609.06245v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) perform strongly on general visual understanding tasks such as visual question answering, yet they often strugg

model-releasesarxiv-cs-cv
9 Sept 2026
Research

VIS-DICT: A Visual Dictionary for Missing Modality Imputation in Social Network Depression Detection

DGX agent

arXiv:2609.05537v1 Announce Type: new Abstract: Tracking social media posts can help spot early signs of depression. Recent studies show that combining text and images works better for detecting depre

researcharxiv-cs-cv
9 Sept 2026
Model Releases

ProAct: Harnessing Streaming Motion Generation and Agentic Reasoning for Real-Time Embodied Social Interaction

DGX agent

arXiv:2602.14048v2 Announce Type: replace-cross Abstract: Real-time embodied social interaction places two equally demanding requirements on an agent: continuously generating fluent multimodal interac

model-releasesarxiv-cs-cv
4 Sept 2026
Model Releases

Rendering-in-the-Loop: An Execution-Driven Agent for Interactive Web Development

DGX agent

arXiv:2609.02088v1 Announce Type: new Abstract: Multimodal large language models have achieved remarkable progress in front-end web development, generating interactive webpages from multimodal referen

model-releasesarxiv-cs-cv
3 Sept 2026
Research

IntroConformal: Conformal Factuality Guarantees for Large Vision-Language Models via Introspective Signals

DGX agent

arXiv:2609.01375v1 Announce Type: cross Abstract: Large Vision-Language Models (LVLMs) have achieved strong multimodal performance, yet ensuring the factual correctness of generated content remains ch

researcharxiv-cs-cl
2 Sept 2026
Research

MedTVL: Harnessing Vision and Language for Medical Time Series Classification

DGX agent

arXiv:2608.28605v1 Announce Type: new Abstract: Recent advancements in multimodal learning for medical time series (MedTS) classification highlight the benefits of integrating complementary modalities

researcharxiv-cs-ai
1 Sept 2026
Model Releases

N_0-Foundation: Towards the Age of Tactile Intelligence

DGX agent

arXiv:2608.29601v1 Announce Type: cross Abstract: We present N_0-Foundation, a paradigm for tactile-enabled embodied manipulation, which integrates tactile sensing hardware, large-scale multimodal dat

model-releasesarxiv-cs-cv
1 Sept 2026
Model Releases

ReGraP-LLaVA: Reasoning enabled Graph-based Personalized Large Language and Vision Assistant

DGX agent

arXiv:2505.03654v3 Announce Type: replace-cross Abstract: Multimodal Large Language Models have shown strong performance across multimodal tasks, and recent personalized MLLMs can recognize user-speci

model-releasesarxiv-cs-ai
1 Sept 2026
Safety

SGPDFuse: Semantically-Guided Physics-Disentanglement General Multi-Modal Image Fusion

DGX agent

arXiv:2608.29220v1 Announce Type: new Abstract: Multimodal image fusion (MMIF) aims to integrate complementary sensor data into a single representation that preserves intrinsic scene reality while eli

safetyarxiv-cs-cv
1 Sept 2026
Safety

Dynamic Alignment Compensation for Hallucination Mitigation in Large Vision-Language Models

DGX agent

arXiv:2608.28058v1 Announce Type: new Abstract: Large Vision-Language Models (LVLMs) remain prone to hallucinations, producing responses that are irrelevant or inconsistent with the multimodal input.

safetyarxiv-cs-cv
31 Aug 2026
Local Ai

Temporal Tree of Thought: Reasoning-Guided Visual Cue Search for Long-Video Understanding

DGX agent

arXiv:2608.27871v1 Announce Type: new Abstract: Long-video understanding remains challenging for Multimodal Large Language Models (MLLMs) due to limited context length. Uniform sampling may miss cruci

local-aiarxiv-cs-cv
31 Aug 2026
Research

Chart2SVG: Editable SVG Generation from Raster Chart Images

DGX agent

arXiv:2608.26544v1 Announce Type: new Abstract: We present Chart2SVG, a multimodal large language model that converts static raster charts into structurally organized, semantically enriched SVGs that

researcharxiv-cs-lg
28 Aug 2026
Research

Segmentation-Based Attention Entropy: Detecting and Mitigating Object Hallucinations in Large Vision-Language Models

DGX agent

arXiv:2603.16558v2 Announce Type: replace Abstract: Large Vision-Language Models (LVLMs) achieve strong performance on many multimodal tasks, but object hallucinations severely undermine their reliabi

researcharxiv-cs-cv
27 Aug 2026
Local Ai

tencent/WeMM-Embedding 9B/4B/2B

DGX agent

WeMM-Embedding-9B is a universal multimodal embedding model built on Qwen3.5. It accepts text, images, videos, visual documents, and interleaved multimodal inputs, and returns a 4,096-dimensional L2-n

local-air-localllama
25 Aug 2026
Local Ai

Enhancing Localized Reasoning for Long Video Understanding via Efficient Segment-to-Video Supervision

DGX agent

arXiv:2608.20814v1 Announce Type: new Abstract: Though Multimodal Large Language Models (MLLMs) have shown impressive potential in video understanding, long video understanding (LVU) remains challengi

local-aiarxiv-cs-cv
24 Aug 2026
Model Releases

When Generated Images Look Right and Retrieve Wrong: Coverage-Guided Cross-Scale Re-Indexing for Knowledge-Faithful Generative Perception

DGX agent

arXiv:2608.20810v1 Announce Type: cross Abstract: Multimodal information systems increasingly route generated visual content back through the same vision-language index that informed its production, s

model-releasesarxiv-cs-ai
24 Aug 2026
Model Releases

Breaking the weakest link to evade vision language models

DGX agent

arXiv:2608.18938v1 Announce Type: new Abstract: Vision Language Models (VLMs) have recently emerged as a critical component of multimodal AI systems, enabling joint reasoning over visual and textual i

model-releasesarxiv-cs-ai
20 Aug 2026
Safety

FusionBERT: Multi-View Image--3D Retrieval via Cross-Attention Visual Fusion and Normal-Aware 3D Encoder

DGX agent

arXiv:2604.02583v2 Announce Type: replace Abstract: We propose FusionBERT, a novel multi-view visual fusion framework for image--3D multimodal retrieval. Existing image--3D representation learning met

safetyarxiv-cs-cv
18 Aug 2026
Model Releases

Vision Language Models Cannot Plan, but Can They Formalize?

DGX agent

arXiv:2509.21576v2 Announce Type: replace Abstract: The advancement of vision language models (VLMs) has empowered embodied agents to accomplish simple multimodal planning tasks, but not long-horizon

model-releasesarxiv-cs-cl
18 Aug 2026
Model Releases

AWARe: Mitigating Catastrophic Forgetting via Activation-Weighted Adaptive REtention

DGX agent

arXiv:2608.11758v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) exhibit strong generalization and reasoning abilities due to large-scale multimodal pre-training. However, fine

model-releasesarxiv-cs-cl
13 Aug 2026
Model Releases

Warping Earth Observations for better ice labeling in the Marginal Marginal Ice Zone

DGX agent

arXiv:2608.11883v1 Announce Type: new Abstract: Multimodal satellite imagery provides complementary information for Earth Observation, but accurately combining heterogeneous sensors remains challengin

model-releasesarxiv-cs-cv
13 Aug 2026
Safety

CARE: Confidence-Aware Reasoning for Reliable Medical VQA

DGX agent

arXiv:2608.10964v1 Announce Type: cross Abstract: Reinforcement Fine-Tuning (RFT) has enabled medical Multimodal Large Language Models (MLLMs) to produce Chain-of-Thought (CoT) reasoning for visual qu

safetyarxiv-cs-ai
12 Aug 2026
Model Releases

CohereLabs/North-Micro-Vision-Instruct · Hugging Face

DGX agent

North Micro Vision Instruct is a 2.4B-parameter open-weight vision-language model with native-resolution image support, released under the Apache 2.0 license. It is designed as a compact foundation fo

model-releasesr-localllama
12 Aug 2026
Research

LaViT: Aligning Latent Visual Thoughts for Multi-modal Reasoning

DGX agent

arXiv:2601.10129v2 Announce Type: replace-cross Abstract: Current multimodal latent reasoning often relies on external supervision (e.g., auxiliary images), ignoring intrinsic visual attention dynamic

researcharxiv-cs-ai
12 Aug 2026
Research

StreamFlow: Dynamic Memory Flows for Streaming Video Understanding

DGX agent

arXiv:2608.10949v1 Announce Type: cross Abstract: Streaming video understanding requires multimodal large language models (MLLMs) to preserve relevant evidence from continuously evolving streams under

researcharxiv-cs-cl
12 Aug 2026
Model Releases

The Truth Stays in the Family: Enhancing Contextual Grounding via Inherited Truthful Heads in Model Lineages

DGX agent

arXiv:2606.15821v2 Announce Type: replace-cross Abstract: Recent advances in large language models (LLMs) have produced many specialized multimodal LLMs (MLLMs) that share common foundational LLMs, fo

model-releasesarxiv-cs-ai
12 Aug 2026
Local Ai

DistMoE: Private-data Rehearsal-free Routing in Mixture-of-Experts for Distributed Instruction Tuning

DGX agent

arXiv:2608.09907v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have shown strong multimodal instruction-following ability, but adapting them to diverse visual-language domain

local-aiarxiv-cs-cv
11 Aug 2026
Research

RIG-RoPE: Relation- and Instance-Gated Rotary Positional Encoding with Duration-Aware Temporal Coordinates

DGX agent

arXiv:2608.05154v1 Announce Type: new Abstract: Rotary positional encoding (RoPE) is a core component of modern language models and has been extended to multimodal LLMs through multidimensional varian

researcharxiv-cs-cl
7 Aug 2026
Model Releases

StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding

DGX agent

arXiv:2608.05703v1 Announce Type: new Abstract: Deploying autonomous multimodal agents in continuous, real-world environments requires them to ingest unbounded audio-visual streams and maintain hour-s

model-releasesarxiv-cs-cv
7 Aug 2026
Model Releases

SVGEval: A Vision-Grounded Framework for Perceptual-Quality Benchmarking and Evaluation in Text-to-SVG Generation

DGX agent

arXiv:2608.01977v1 Announce Type: new Abstract: Multimodal large models are increasingly used to generate scalable vector graphics (SVG), but reliable evaluation remains underexplored. Existing protoc

model-releasesarxiv-cs-cv
4 Aug 2026
Research

LAST: The Last Query Token Guides Visual Token Pruning for Edge-Cloud Collaborative MLLM Inference

DGX agent

arXiv:2607.27952v1 Announce Type: new Abstract: Multimodal foundation models are reshaping edge-cloud visual intelligence from task-specific feature pipelines into token-based interfaces, where edge d

researcharxiv-cs-cv
31 Jul 2026
Research

LanteRn: Latent Visual Structured Reasoning

DGX agent

arXiv:2603.25629v2 Announce Type: replace Abstract: While language reasoning models excel in many tasks, visual reasoning remains challenging for current large multimodal models (LMMs). As a result, m

researcharxiv-cs-cv
28 Jul 2026
Model Releases

Spatio-Temporal Conditional Denoising Transformer for Modality-Missing RGBT Tracking

DGX agent

arXiv:2607.24701v1 Announce Type: new Abstract: Missing modalities in RGBT tracking often lead to incomplete and unstable multimodal feature representations that greatly degrade the performance. Exist

model-releasesarxiv-cs-cv
28 Jul 2026
Model Releases

TextRich: A Multi-Domain Benchmark for Detecting AI-Generated Text-Rich Images from GPT-Image-2

DGX agent

arXiv:2606.19259v2 Announce Type: replace-cross Abstract: Text-rich images often contain privacy-sensitive, transactional, or decision-relevant information. As recent multimodal image generation model

model-releasesarxiv-cs-ai
28 Jul 2026
Model Releases

Filling Before Advancing: Capability-Gap-Driven Post-Training for Scenario-Specialized Remote Sensing MLLMs

DGX agent

arXiv:2607.22205v1 Announce Type: new Abstract: Remote sensing multimodal large language models (RS-MLLMs) have improved general aerial-image understanding. However, Earth observation applications req

model-releasesarxiv-cs-cv
27 Jul 2026
Model Releases

Zero-Shot Mission-Level Evaluation for Aerial MLLM Agents

DGX agent

arXiv:2607.22014v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) are emerging as core reasoning modules for embodied agents, yet it remains unclear how well general-purpose m

model-releasesarxiv-cs-cl
27 Jul 2026
Safety

MELLA: Bridging Linguistic Capability and Cultural Groundedness for Low-Resource Language MLLMs

DGX agent

arXiv:2508.05502v2 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) perform strongly in high-resource languages, yet often produce fluent but culturally 'thin' descripti

safetyarxiv-cs-ai
24 Jul 2026
Syntheses

Wiki Lint Report — 2026-07-15

DGX agent

Automated lint: 26 errors, 6728 warnings, 3 info

linthealth-checkautomated
15 Jul 2026
Tutorials

UMSS: Towards Unsupervised Multi-modal Semantic Segmentation

DGX agent

arXiv:2607.12372v1 Announce Type: new Abstract: Multimodal semantic segmentation (MSS) is essential for robust perception in complex environments, yet its potential remains largely untapped because of

tutorialsarxiv-cs-cv
15 Jul 2026
Research

iFLYTEK-Embodied-Omni Technical Report

DGX agent

arXiv:2607.02542v1 Announce Type: new Abstract: General-purpose embodied agents must understand multimodal instructions, anticipate how their environment will evolve, and produce precise control actio

researcharxiv-cs-ai
7 Jul 2026
← Previous
1…6465666768…211
Next →