AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,117 results
Research

MSR-IVA: Masked Structural Residual Independent Vector Analysis for State-Aware Fusion of Structural MRI and Dynamic Functional Network Connectivity

DGX agent

arXiv:2608.24978v1 Announce Type: new Abstract: Multimodal fusion of structural MRI (sMRI) and dynamic functional network connectivity (dFNC) can reveal how brain structure relates to changing functio

researcharxiv-cs-lg
27 Aug 2026
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Safety

PreResQ-R1: Response-Preference Disentangled Ranking-and-Scoring Reinforcement Optimization for Robust Visual Quality Assessment

DGX agent

arXiv:2511.05393v2 Announce Type: replace Abstract: Visual Quality Assessment (QA) seeks to predict human perceptual judgments of visual fidelity. While recent multimodal large language models (MLLMs)

safetyarxiv-cs-cv
27 Aug 2026
Safety

Why Does Graph Learning Fail to Fully Benefit from a Text Teacher?

DGX agent

arXiv:2608.25741v1 Announce Type: cross Abstract: Graph neural networks (GNNs) are widely used to represent complex interactions and relationships among entities. We investigate a multimodal model tha

safetyarxiv-cs-cl
27 Aug 2026
Model Releases

A Human-Factors Guided Cognitive Model of Visuospatial Complexity in Embodied Active Vision

DGX agent

arXiv:2608.23572v1 Announce Type: cross Abstract: We propose a novel framework for the analysis of multimodal data -- encompassing visual, auditory, and spatial stimuli -- foregrounding the role of co

model-releasesarxiv-cs-ai
26 Aug 2026
Applications

API is live on QwenCloud: https://www.qwencloud.com/models/qwen3.8-flash 🙌Let's build something!

DGX agent

API is live on QwenCloud: https://www.qwencloud.com/models/qwen3.8-flash 🙌Let's build something! ⚡Meet Qwen3.8-Flash, a multimodal MoE and an early preview of the Qwen4 architecture, now open-weight!

applicationsqwen--x
26 Aug 2026
Model Releases

BREAKING: GLM-5.3 Flash by @Zai_org debuts at 6th overall on Design Arena with a preliminary Elo of 1343. This places the MIT-licensed, nati…

DGX agent

BREAKING: GLM-5.3 Flash by @Zai_org debuts at 6th overall on Design Arena with a preliminary Elo of 1343. This places the MIT-licensed, natively multimodal model in the same performance band as GLM-5.

model-releaseszhipu-ai--x
26 Aug 2026
Research

PonderPounce: A Pretrained MLLM as an Episode Context Engine for Robot Control

DGX agent

arXiv:2608.24115v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) can integrate long visual histories, reason under partial observability, and infer behavior from a few exampl

researcharxiv-cs-ai
26 Aug 2026
Model Releases

Qwen3.8-Flash-Next

DGX agent

Qwen3.8-Flash-Next Another open weights model from Qwen. This one is 'a multimodal MoE model that also serves as an early preview of the architecture used in Qwen4'. It's pretty big: 125B tokens, but

model-releasessimon-willison
26 Aug 2026
Research

Scientific Image Synthesis: Benchmarking, Methodologies, and Downstream Utility

DGX agent

arXiv:2601.17027v2 Announce Type: replace-cross Abstract: While synthetic data has proven effective for improving scientific reasoning in the text domain, multimodal reasoning remains constrained by t

researcharxiv-cs-ai
26 Aug 2026
Model Releases

Annotations as Rollouts: Efficient and Scalable Reinforcement Learning for Video MLLMs

DGX agent

arXiv:2608.20492v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have become a prevailing paradigm for unified video perception. However, post-training on large multi-task data

model-releasesarxiv-cs-cv
24 Aug 2026
Model Releases

Large Scale AI Grading of Handwritten Physics Assessments: Score Agreement and Olympiad Team Selection Outcomes

DGX agent

arXiv:2608.20521v1 Announce Type: cross Abstract: Multimodal AI can read handwritten physics solutions, but high-stakes grading requires agreement with official scores and outcomes. This study evaluat

model-releasesarxiv-cs-ai
24 Aug 2026
Model Releases

PhotoBench: Beyond Visual Matching Towards Personalized Intent-Driven Photo Retrieval

DGX agent

arXiv:2603.01493v2 Announce Type: replace-cross Abstract: Personal photo albums are not merely collections of static images but living, ecological archives defined by temporal continuity, social entan

model-releasesarxiv-cs-ai
24 Aug 2026
Model Releases

What Color Is the Text? A Benchmark for Hallucination Induced by Image-Embedded Prompt

DGX agent

arXiv:2511.13400v3 Announce Type: replace Abstract: We introduce Embedded Stroop, a controlled diagnostic paradigm for measuring image-embedded prompt interference in Multimodal Large Language Models

model-releasesarxiv-cs-cv
24 Aug 2026
Model Releases

When Better Teachers Don't Make Better Students: Revisiting Knowledge Distillation for CLIP Models in VQA

DGX agent

arXiv:2511.17886v2 Announce Type: replace-cross Abstract: Vision-language models (VLMs) have achieved remarkable success across multimodal tasks, yet their substantial computational demands hinder eff

model-releasesarxiv-cs-cl
24 Aug 2026
Model Releases

ArmorOCR: Grounded Adversarial Visual Perception via Observation-Transferred Self-Distillation

DGX agent

arXiv:2608.20122v1 Announce Type: new Abstract: Large multimodal models (LMMs) have demonstrated strong OCR recognition capabilities, yet remain vulnerable to adversarial visual text that is readable

model-releasesarxiv-cs-cv
21 Aug 2026
Safety

MOSAIC: Modality-agnostic Spectral Alignment for Federated Image-level Weakly Supervised Tumor Segmentation under Client-specific Missing Modalities

DGX agent

arXiv:2608.19788v1 Announce Type: cross Abstract: Trustworthy multimodal fusion in clinical settings requires handling incomplete and heterogeneous modality subsets across institutions, where privacy

safetyarxiv-cs-cv
21 Aug 2026
Safety

PEA-DPO: Perception-Enhanced Alignment Direct Preference Optimization for MLLMs Alignment

DGX agent

arXiv:2608.19598v1 Announce Type: cross Abstract: Direct Preference Optimization (DPO) has emerged as an effective approach for aligning large language models (LLMs) with human preferences. However, i

safetyarxiv-cs-ai
21 Aug 2026
Safety

Alignment Is All You Need: Instruction-Free Training for General Audio-Language Models

DGX agent

arXiv:2608.18132v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are typically built through a multi-stage pipeline consisting of cross-modal alignment, supervised fine-tuning

safetyarxiv-cs-cl
20 Aug 2026
Model Releases

FiLoRA: Focus-and-Ignore LoRA for Controllable Feature Reliance

DGX agent

arXiv:2602.02060v2 Announce Type: replace-cross Abstract: Multimodal foundation models integrate heterogeneous signals across modalities, yet it remains unclear whether their predictions can be contro

model-releasesarxiv-cs-ai
20 Aug 2026
Safety

Look Clearly Before Answering: Mitigating Hallucinations in LVLMs via Saliency-Driven Perceptual Realignment

DGX agent

arXiv:2607.16841v2 Announce Type: replace Abstract: Large vision-language models (LVLMs) have demonstrated remarkable capabilities in multimodal understanding. However, they remain prone to hallucinat

safetyarxiv-cs-cv
20 Aug 2026
Model Releases

On the Robustness of Vision-Language Models in Zero-shot Privacy Classification

DGX agent

arXiv:2510.09253v2 Announce Type: replace Abstract: Automatic systems for document understanding require multimodal models that accurately identify sensitive visual content, even in the presence of im

model-releasesarxiv-cs-cv
20 Aug 2026
Safety

Multi-Modal Generative Fuzzy System: Fuzzy Inference Guided Large Model Interactive Question Answering Framework

DGX agent

arXiv:2608.14584v1 Announce Type: cross Abstract: In Multimodal Question Answering (MQA), models are required to jointly encode and integrate heterogeneous information from multiple modalities, includ

safetyarxiv-cs-ai
18 Aug 2026
Model Releases

CVT-Bench: Probing Spatial-State Integrity through Counterfactual Viewpoint Transformations

DGX agent

arXiv:2603.21114v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) perform strongly on isolated spatial tasks, but whether their predictions remain persistent and mutually co

model-releasesarxiv-cs-cv
17 Aug 2026
Research

FIRM: Fine-Grained Intra-Token Representation of Masks for Remote Sensing Reasoning Segmentation

DGX agent

arXiv:2608.13980v1 Announce Type: new Abstract: Reasoning segmentation requires multimodal large language models (MLLMs) to translate implicit instructions into precise pixel-level masks. MLLMs encode

researcharxiv-cs-cv
17 Aug 2026
Model Releases

AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Design

DGX agent

arXiv:2608.13560v1 Announce Type: cross Abstract: Transforming multimodal sources into condensed and structured media outputs can be fundamentally conceptualized as a long-horizon agentic process cent

model-releasesarxiv-cs-ai
14 Aug 2026
Model Releases

Beyond Correctness: Benchmarking and Aligning Response Behaviors in Hybrid-Thinking MLLMs

DGX agent

arXiv:2608.12781v1 Announce Type: new Abstract: Hybrid-thinking multimodal large language models (MLLMs) allow a single model to alternate between deliberative thinking and latency-efficient non-think

model-releasesarxiv-cs-cv
14 Aug 2026
Model Releases

Beyond Visual Evidence: Revealing and Mitigating Relational Privacy Leakage in Document MLLMs

DGX agent

arXiv:2608.12911v1 Announce Type: new Abstract: While the privacy risks of multimodal large language models (MLLMs) have drawn significant attention, the unique vulnerabilities of domain-specific MLLM

model-releasesarxiv-cs-cv
14 Aug 2026
Research

P2Fusion: Prompt-based Progressive Infrared-Visible Image Fusion via Dual-Prior Distillation

DGX agent

arXiv:2608.13045v1 Announce Type: new Abstract: Infrared-visible image fusion (IVIF) is pivotal for multimodal perception, yet reconciling the inherent information disparity between thermal and textur

researcharxiv-cs-cv
14 Aug 2026
Research

Generation as Auxiliary Supervision: Enhancing Visual Understanding at Zero Inference Overhead via Decoupled Embedding Prediction

DGX agent

arXiv:2608.12209v1 Announce Type: new Abstract: While Multimodal Large Language Models (MLLMs) have achieved remarkable progress, visual understanding and generation are typically treated as divergent

researcharxiv-cs-cv
13 Aug 2026
Model Releases

PragMatch: Separating Pragmatic Incongruity from Cross-Modal Mismatch in Large Vision-Language Models

DGX agent

arXiv:2608.09772v1 Announce Type: new Abstract: Large Vision-Language Models (LVLMs) have demonstrated strong performance on multimodal benchmarks, yet it remains unclear whether they genuinely reason

model-releasesarxiv-cs-cl
11 Aug 2026
Model Releases

Whoa, Meta released a new open-weight LLM yesterday, something that hasn't happened since the good old Llama days. Their Meta Muse Glimmer m…

DGX agent

Whoa, Meta released a new open-weight LLM yesterday, something that hasn't happened since the good old Llama days. Their Meta Muse Glimmer model is a 30B multimodal reasoning model with a Gemma-like a

model-releasessebastian-raschka--x
11 Aug 2026
Research

Conformal Fusion Under Missing Modalities

DGX agent

arXiv:2608.07183v1 Announce Type: new Abstract: Multimodal fusion architectures typically assume all modalities are available at inference, yet sensor failures, acquisition variability, and cost const

researcharxiv-cs-lg
10 Aug 2026
Model Releases

EchoVLA: Robotic Vision-Language-Action Model with Synergistic Declarative Memory for Mobile Manipulation

DGX agent

arXiv:2511.18112v3 Announce Type: replace Abstract: Recent progress in Vision-Language-Action (VLA) models has enabled embodied agents to interpret multimodal instructions and perform complex tasks. H

model-releasesarxiv-cs-ro
10 Aug 2026
Tutorials

Learning to Predict Middle-Layer Attention in MLLMs for Visual Token Prunin

DGX agent

arXiv:2608.06411v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) achieve strong performance across diverse vision-language tasks, but their efficiency is limited by the cost of

tutorialsarxiv-cs-ai
10 Aug 2026
Research

SetEasy: A Multi-Modal Classroom Engagement Assessment and Seating Optimization Framework

DGX agent

arXiv:2608.07188v1 Announce Type: new Abstract: SetEasy optimizes classroom engagement in fixed seating grids. It fuses multimodal sensing (wristband physiology, 4K video, environmental data) and trai

researcharxiv-cs-ai
10 Aug 2026
Model Releases

Look Twice: Training-Free Evidence Highlighting for Knowledge-based Visual Question Answering

DGX agent

arXiv:2604.01280v2 Announce Type: replace-cross Abstract: Knowledge-based Visual Question Answering (KB-VQA) requires Multimodal Large Language Models (MLLMs) to identify and combine fine-grained visu

model-releasesarxiv-cs-ai
7 Aug 2026
Model Releases

Unsloth's Gemma 4 mmproj silently broke vision & audio on newer llama.cpp builds — anyone else hit this?

DGX agent

So I had been building ScreenMind, kinda like local ai desktop assistant that uses Gemma 4 for screen analysis, voice memo transcription, and meeting transcription — all through llama-server. Everythi

model-releasesr-localllama
6 Aug 2026
Model Releases

DS@GT ARC at MEDIQA-CORE-Task-1 2026: Trimodal Model Fusion with Task-Specific Gates for Brain Tumor Subtype Classification

DGX agent

arXiv:2608.00086v1 Announce Type: new Abstract: Brain tumor diagnosis is a time-sensitive process in which patients may wait weeks for a finalized pathology report. This problem motivates automated sy

model-releasesarxiv-cs-cv
4 Aug 2026
Research

From Pixels to PCells: A Neurosymbolic Approach to Photonic Component Creation

DGX agent

arXiv:2608.00084v1 Announce Type: new Abstract: We present PixCell, a neurosymbolic system in which multimodal agents convert a visually presented photonic component into a parametric program over a s

researcharxiv-cs-cv
4 Aug 2026
Model Releases

LongChart VQA: A Comprehensive Benchmark for MLLMs with Complex Multi-Chart Reasoning

DGX agent

arXiv:2608.01328v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are rapidly evolving with expanded context windows and stronger reasoning capabilities, enabling multi-chart un

model-releasesarxiv-cs-cl
4 Aug 2026
Model Releases

Looks Right, Works Right: A Project-Level Benchmark for Multi-Screen Mobile App Generation

DGX agent

arXiv:2607.28645v1 Announce Type: cross Abstract: Recent multimodal large language models can convert visual designs directly into executable code, but real mobile products require multiple screenshot

model-releasesarxiv-cs-ai
3 Aug 2026
Local Ai

MiniMax-H3 now on huggingface

DGX agent

MiniMax H3 is a general-purpose, omni-modal generative system. It supports unified understanding of multimodal contexts composed of text, images, video, and audio, and can generate video with native s

local-air-localllama
3 Aug 2026
Research

ZeroR@CHiPSAL 2026: Two-Stage Vision-Language Adaptation with Contrastive Learning for Nepali Meme Classification

DGX agent

arXiv:2607.28637v1 Announce Type: new Abstract: This paper presents our system for the CHiPSAL 2026 shared task on multimodal hate speech and sentiment detection in Nepali memes. We address both subta

researcharxiv-cs-cl
3 Aug 2026
Agents

Beacon: Knowing When and How to Perform Agentic Visual Reasoning

DGX agent

arXiv:2607.28595v1 Announce Type: new Abstract: The fundamental goal of agentic visual reasoning is to improve the success rate of multimodal large language models (MLLMs) on complex tasks, rather tha

agentsarxiv-cs-cv
31 Jul 2026
Safety

FA-RDP: A Frequency-Adaptive Reactive Diffusion Policy for Contact-Rich Manipulation

DGX agent

arXiv:2607.28596v1 Announce Type: new Abstract: In contact-rich manipulation, action multimodality and reactivity dominate different stages of a single episode. Before contact, multiple trajectories m

safetyarxiv-cs-ro
31 Jul 2026
Agents

RefineSVG: Visual Feedback-Driven Reinforcement Learning for Image-to-SVG Generation

DGX agent

arXiv:2607.27699v1 Announce Type: new Abstract: We propose RefineSVG, a single-step closed-loop visual feedback framework that enables multimodal large language models (MLLMs) to perform high-fidelity

agentsarxiv-cs-cv
31 Jul 2026
Model Releases

ICDAR 2026 Competition on Information Extraction from Atomic Layer Deposition/Etching (ALD/E) Scientific Figures

DGX agent

arXiv:2607.26848v1 Announce Type: new Abstract: Scientific figure comprehension and reasoning using multimodal AI requires integrating visual perception with domain-specific reasoning to extract meani

model-releasesarxiv-cs-cv
30 Jul 2026
Research

Argus-Unified: Towards A Compact and Economical Unified Model for Image Understanding and Generation

DGX agent

arXiv:2607.25527v1 Announce Type: cross Abstract: Unifying visual understanding and generation in one model holds immense promise, but remains challenging and expensive due to heavy compute and data d

researcharxiv-cs-ai
29 Jul 2026
← Previous
1…6869707172…211
Next →