AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
Human
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
9,441 results
Research

Scientific Image Synthesis: Benchmarking, Methodologies, and Downstream Utility

DGX agent

arXiv:2601.17027v2 Announce Type: replace-cross Abstract: While synthetic data has proven effective for improving scientific reasoning in the text domain, multimodal reasoning remains constrained by t

researcharxiv-cs-ai
26 Aug 2026
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Model Releases

Annotations as Rollouts: Efficient and Scalable Reinforcement Learning for Video MLLMs

DGX agent

arXiv:2608.20492v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have become a prevailing paradigm for unified video perception. However, post-training on large multi-task data

model-releasesarxiv-cs-cv
24 Aug 2026
Model Releases

Large Scale AI Grading of Handwritten Physics Assessments: Score Agreement and Olympiad Team Selection Outcomes

DGX agent

arXiv:2608.20521v1 Announce Type: cross Abstract: Multimodal AI can read handwritten physics solutions, but high-stakes grading requires agreement with official scores and outcomes. This study evaluat

model-releasesarxiv-cs-ai
24 Aug 2026
Model Releases

PhotoBench: Beyond Visual Matching Towards Personalized Intent-Driven Photo Retrieval

DGX agent

arXiv:2603.01493v2 Announce Type: replace-cross Abstract: Personal photo albums are not merely collections of static images but living, ecological archives defined by temporal continuity, social entan

model-releasesarxiv-cs-ai
24 Aug 2026
Model Releases

What Color Is the Text? A Benchmark for Hallucination Induced by Image-Embedded Prompt

DGX agent

arXiv:2511.13400v3 Announce Type: replace Abstract: We introduce Embedded Stroop, a controlled diagnostic paradigm for measuring image-embedded prompt interference in Multimodal Large Language Models

model-releasesarxiv-cs-cv
24 Aug 2026
Model Releases

When Better Teachers Don't Make Better Students: Revisiting Knowledge Distillation for CLIP Models in VQA

DGX agent

arXiv:2511.17886v2 Announce Type: replace-cross Abstract: Vision-language models (VLMs) have achieved remarkable success across multimodal tasks, yet their substantial computational demands hinder eff

model-releasesarxiv-cs-cl
24 Aug 2026
Model Releases

ArmorOCR: Grounded Adversarial Visual Perception via Observation-Transferred Self-Distillation

DGX agent

arXiv:2608.20122v1 Announce Type: new Abstract: Large multimodal models (LMMs) have demonstrated strong OCR recognition capabilities, yet remain vulnerable to adversarial visual text that is readable

model-releasesarxiv-cs-cv
21 Aug 2026
Safety

MOSAIC: Modality-agnostic Spectral Alignment for Federated Image-level Weakly Supervised Tumor Segmentation under Client-specific Missing Modalities

DGX agent

arXiv:2608.19788v1 Announce Type: cross Abstract: Trustworthy multimodal fusion in clinical settings requires handling incomplete and heterogeneous modality subsets across institutions, where privacy

safetyarxiv-cs-cv
21 Aug 2026
Safety

PEA-DPO: Perception-Enhanced Alignment Direct Preference Optimization for MLLMs Alignment

DGX agent

arXiv:2608.19598v1 Announce Type: cross Abstract: Direct Preference Optimization (DPO) has emerged as an effective approach for aligning large language models (LLMs) with human preferences. However, i

safetyarxiv-cs-ai
21 Aug 2026
Safety

Alignment Is All You Need: Instruction-Free Training for General Audio-Language Models

DGX agent

arXiv:2608.18132v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are typically built through a multi-stage pipeline consisting of cross-modal alignment, supervised fine-tuning

safetyarxiv-cs-cl
20 Aug 2026
Model Releases

FiLoRA: Focus-and-Ignore LoRA for Controllable Feature Reliance

DGX agent

arXiv:2602.02060v2 Announce Type: replace-cross Abstract: Multimodal foundation models integrate heterogeneous signals across modalities, yet it remains unclear whether their predictions can be contro

model-releasesarxiv-cs-ai
20 Aug 2026
Safety

Look Clearly Before Answering: Mitigating Hallucinations in LVLMs via Saliency-Driven Perceptual Realignment

DGX agent

arXiv:2607.16841v2 Announce Type: replace Abstract: Large vision-language models (LVLMs) have demonstrated remarkable capabilities in multimodal understanding. However, they remain prone to hallucinat

safetyarxiv-cs-cv
20 Aug 2026
Model Releases

On the Robustness of Vision-Language Models in Zero-shot Privacy Classification

DGX agent

arXiv:2510.09253v2 Announce Type: replace Abstract: Automatic systems for document understanding require multimodal models that accurately identify sensitive visual content, even in the presence of im

model-releasesarxiv-cs-cv
20 Aug 2026
Safety

Multi-Modal Generative Fuzzy System: Fuzzy Inference Guided Large Model Interactive Question Answering Framework

DGX agent

arXiv:2608.14584v1 Announce Type: cross Abstract: In Multimodal Question Answering (MQA), models are required to jointly encode and integrate heterogeneous information from multiple modalities, includ

safetyarxiv-cs-ai
18 Aug 2026
Model Releases

CVT-Bench: Probing Spatial-State Integrity through Counterfactual Viewpoint Transformations

DGX agent

arXiv:2603.21114v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) perform strongly on isolated spatial tasks, but whether their predictions remain persistent and mutually co

model-releasesarxiv-cs-cv
17 Aug 2026
Research

FIRM: Fine-Grained Intra-Token Representation of Masks for Remote Sensing Reasoning Segmentation

DGX agent

arXiv:2608.13980v1 Announce Type: new Abstract: Reasoning segmentation requires multimodal large language models (MLLMs) to translate implicit instructions into precise pixel-level masks. MLLMs encode

researcharxiv-cs-cv
17 Aug 2026
Model Releases

AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Design

DGX agent

arXiv:2608.13560v1 Announce Type: cross Abstract: Transforming multimodal sources into condensed and structured media outputs can be fundamentally conceptualized as a long-horizon agentic process cent

model-releasesarxiv-cs-ai
14 Aug 2026
Model Releases

Beyond Correctness: Benchmarking and Aligning Response Behaviors in Hybrid-Thinking MLLMs

DGX agent

arXiv:2608.12781v1 Announce Type: new Abstract: Hybrid-thinking multimodal large language models (MLLMs) allow a single model to alternate between deliberative thinking and latency-efficient non-think

model-releasesarxiv-cs-cv
14 Aug 2026
Model Releases

Beyond Visual Evidence: Revealing and Mitigating Relational Privacy Leakage in Document MLLMs

DGX agent

arXiv:2608.12911v1 Announce Type: new Abstract: While the privacy risks of multimodal large language models (MLLMs) have drawn significant attention, the unique vulnerabilities of domain-specific MLLM

model-releasesarxiv-cs-cv
14 Aug 2026
Research

P2Fusion: Prompt-based Progressive Infrared-Visible Image Fusion via Dual-Prior Distillation

DGX agent

arXiv:2608.13045v1 Announce Type: new Abstract: Infrared-visible image fusion (IVIF) is pivotal for multimodal perception, yet reconciling the inherent information disparity between thermal and textur

researcharxiv-cs-cv
14 Aug 2026
Research

Generation as Auxiliary Supervision: Enhancing Visual Understanding at Zero Inference Overhead via Decoupled Embedding Prediction

DGX agent

arXiv:2608.12209v1 Announce Type: new Abstract: While Multimodal Large Language Models (MLLMs) have achieved remarkable progress, visual understanding and generation are typically treated as divergent

researcharxiv-cs-cv
13 Aug 2026
Model Releases

PragMatch: Separating Pragmatic Incongruity from Cross-Modal Mismatch in Large Vision-Language Models

DGX agent

arXiv:2608.09772v1 Announce Type: new Abstract: Large Vision-Language Models (LVLMs) have demonstrated strong performance on multimodal benchmarks, yet it remains unclear whether they genuinely reason

model-releasesarxiv-cs-cl
11 Aug 2026
Research

Conformal Fusion Under Missing Modalities

DGX agent

arXiv:2608.07183v1 Announce Type: new Abstract: Multimodal fusion architectures typically assume all modalities are available at inference, yet sensor failures, acquisition variability, and cost const

researcharxiv-cs-lg
10 Aug 2026
Model Releases

EchoVLA: Robotic Vision-Language-Action Model with Synergistic Declarative Memory for Mobile Manipulation

DGX agent

arXiv:2511.18112v3 Announce Type: replace Abstract: Recent progress in Vision-Language-Action (VLA) models has enabled embodied agents to interpret multimodal instructions and perform complex tasks. H

model-releasesarxiv-cs-ro
10 Aug 2026
Tutorials

Learning to Predict Middle-Layer Attention in MLLMs for Visual Token Prunin

DGX agent

arXiv:2608.06411v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) achieve strong performance across diverse vision-language tasks, but their efficiency is limited by the cost of

tutorialsarxiv-cs-ai
10 Aug 2026
Research

SetEasy: A Multi-Modal Classroom Engagement Assessment and Seating Optimization Framework

DGX agent

arXiv:2608.07188v1 Announce Type: new Abstract: SetEasy optimizes classroom engagement in fixed seating grids. It fuses multimodal sensing (wristband physiology, 4K video, environmental data) and trai

researcharxiv-cs-ai
10 Aug 2026
Model Releases

Look Twice: Training-Free Evidence Highlighting for Knowledge-based Visual Question Answering

DGX agent

arXiv:2604.01280v2 Announce Type: replace-cross Abstract: Knowledge-based Visual Question Answering (KB-VQA) requires Multimodal Large Language Models (MLLMs) to identify and combine fine-grained visu

model-releasesarxiv-cs-ai
7 Aug 2026
Model Releases

DS@GT ARC at MEDIQA-CORE-Task-1 2026: Trimodal Model Fusion with Task-Specific Gates for Brain Tumor Subtype Classification

DGX agent

arXiv:2608.00086v1 Announce Type: new Abstract: Brain tumor diagnosis is a time-sensitive process in which patients may wait weeks for a finalized pathology report. This problem motivates automated sy

model-releasesarxiv-cs-cv
4 Aug 2026
Research

From Pixels to PCells: A Neurosymbolic Approach to Photonic Component Creation

DGX agent

arXiv:2608.00084v1 Announce Type: new Abstract: We present PixCell, a neurosymbolic system in which multimodal agents convert a visually presented photonic component into a parametric program over a s

researcharxiv-cs-cv
4 Aug 2026
Model Releases

LongChart VQA: A Comprehensive Benchmark for MLLMs with Complex Multi-Chart Reasoning

DGX agent

arXiv:2608.01328v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are rapidly evolving with expanded context windows and stronger reasoning capabilities, enabling multi-chart un

model-releasesarxiv-cs-cl
4 Aug 2026
Model Releases

Looks Right, Works Right: A Project-Level Benchmark for Multi-Screen Mobile App Generation

DGX agent

arXiv:2607.28645v1 Announce Type: cross Abstract: Recent multimodal large language models can convert visual designs directly into executable code, but real mobile products require multiple screenshot

model-releasesarxiv-cs-ai
3 Aug 2026
Research

ZeroR@CHiPSAL 2026: Two-Stage Vision-Language Adaptation with Contrastive Learning for Nepali Meme Classification

DGX agent

arXiv:2607.28637v1 Announce Type: new Abstract: This paper presents our system for the CHiPSAL 2026 shared task on multimodal hate speech and sentiment detection in Nepali memes. We address both subta

researcharxiv-cs-cl
3 Aug 2026
Agents

Beacon: Knowing When and How to Perform Agentic Visual Reasoning

DGX agent

arXiv:2607.28595v1 Announce Type: new Abstract: The fundamental goal of agentic visual reasoning is to improve the success rate of multimodal large language models (MLLMs) on complex tasks, rather tha

agentsarxiv-cs-cv
31 Jul 2026
Safety

FA-RDP: A Frequency-Adaptive Reactive Diffusion Policy for Contact-Rich Manipulation

DGX agent

arXiv:2607.28596v1 Announce Type: new Abstract: In contact-rich manipulation, action multimodality and reactivity dominate different stages of a single episode. Before contact, multiple trajectories m

safetyarxiv-cs-ro
31 Jul 2026
Agents

RefineSVG: Visual Feedback-Driven Reinforcement Learning for Image-to-SVG Generation

DGX agent

arXiv:2607.27699v1 Announce Type: new Abstract: We propose RefineSVG, a single-step closed-loop visual feedback framework that enables multimodal large language models (MLLMs) to perform high-fidelity

agentsarxiv-cs-cv
31 Jul 2026
Model Releases

ICDAR 2026 Competition on Information Extraction from Atomic Layer Deposition/Etching (ALD/E) Scientific Figures

DGX agent

arXiv:2607.26848v1 Announce Type: new Abstract: Scientific figure comprehension and reasoning using multimodal AI requires integrating visual perception with domain-specific reasoning to extract meani

model-releasesarxiv-cs-cv
30 Jul 2026
Research

Argus-Unified: Towards A Compact and Economical Unified Model for Image Understanding and Generation

DGX agent

arXiv:2607.25527v1 Announce Type: cross Abstract: Unifying visual understanding and generation in one model holds immense promise, but remains challenging and expensive due to heavy compute and data d

researcharxiv-cs-ai
29 Jul 2026
Model Releases

Contrastive Parameter Disentanglement for Multi-modal Remote Sensing Image Generation

DGX agent

arXiv:2607.23673v1 Announce Type: new Abstract: Existing remote sensing image generation methods are largely confined to single-modality synthesis and therefore fail to exploit the complementary infor

model-releasesarxiv-cs-cv
28 Jul 2026
Research

DeCoRAG: Cognitive Decoupling and Semantic-Aware Cropping for Complex Document Understanding

DGX agent

arXiv:2607.24554v1 Announce Type: cross Abstract: Advancing multimodal retrieval-augmented generation (RAG) for complex document understanding presents a formidable dual dilemma of accuracy and effici

researcharxiv-cs-cv
28 Jul 2026
Hardware

Energy Constrained Hierarchical Underwater Monitoring via Local Multi-Agent RAG

DGX agent

arXiv:2607.24313v1 Announce Type: cross Abstract: Marine life monitoring is limited by strict energy constraints, poor underwater connectivity, and the high cost of transmitting raw multimodal data fr

hardwarearxiv-cs-cv
28 Jul 2026
Agents

Reason Before You Retrieve: Agentic Planning for Multi-modal RAG

DGX agent

arXiv:2607.22643v1 Announce Type: new Abstract: Multimodal retrieval-augmented generation (mRAG) aims to answer image-text queries with external knowledge, but most existing systems still retrieve dir

agentsarxiv-cs-ai
28 Jul 2026
Safety

Structured Redundancy Modeling for Efficient Visual Token Pruning in High-Resolution MLLMs

DGX agent

arXiv:2607.23046v1 Announce Type: new Abstract: Recent high-resolution Multimodal Large Language Models (MLLMs) generate thousands of visual tokens per input, leading to a visual token explosion that

safetyarxiv-cs-cv
28 Jul 2026
Safety

Visual Token Compression Enhances Robustness of MLLMs

DGX agent

arXiv:2607.22716v1 Announce Type: new Abstract: In this paper, we show for the first time that visual token pruning enhances the robustness of Multimodal Large Language Models (MLLMs), mitigating vuln

safetyarxiv-cs-cv
28 Jul 2026
Tutorials

SCoPE: Shift-Aware Speaker-Conditioned Priors for Emotion Recognition in Conversations

DGX agent

arXiv:2607.20445v1 Announce Type: new Abstract: In conversations, human emotions are transient; however, they tend to persist across multiple utterances. For example, we rarely switch instantly betwee

tutorialsarxiv-cs-cl
24 Jul 2026
Research

ABot-3DWorld 0: A Universal World Model to Explore Any 3D Space

DGX agent

arXiv:2607.11673v2 Announce Type: replace Abstract: We present ABot-3DWorld 0, a universal multimodal 3D world model that turns text, image, and video inputs into high-fidelity, explorable 3D worlds.

researcharxiv-cs-cv
15 Jul 2026
Model Releases

CrochetBench: Can Vision-Language Models Move from Describing to Doing in Crochet Domain?

DGX agent

arXiv:2511.09483v3 Announce Type: replace Abstract: While multimodal large language models can describe visual content, their ability to generate executable procedures remains underexplored. CrochetBe

model-releasesarxiv-cs-ai
15 Jul 2026
Local Ai

Open-KNEAD: Knowledge-grounded Nutrition Estimation via Agentic Decomposition

DGX agent

arXiv:2607.12911v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) are increasingly used for dietary assessment from meal images, where retrieval-augmented grounding was shown to

local-aiarxiv-cs-cv
15 Jul 2026
Agents

SymbOmni: Evolving Agentic Omni Models via Symbolic Concept Learning

DGX agent

arXiv:2607.12042v1 Announce Type: new Abstract: Visual generation is increasingly ubiquitous in diverse domains, from text-to-image/video synthesis to multimodal interactive creation. Yet prevailing m

agentsarxiv-cs-cv
15 Jul 2026
← Previous
1…6566676869…197
Next →