AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries123,303
  • Agents10,352
  • Applications7,013
  • Companies3
  • Concepts7
  • Hardware2,702
  • Industry6,776
  • Local Ai6,847
  • Model Releases35,469
  • Research28,731
  • Safety18,972
  • Syntheses30
  • Tools1,775
  • Tutorials4,626

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries123,303
  • Agents10,352
  • Applications7,013
  • Companies3
  • Concepts7
  • Hardware2,702
  • Industry6,776
  • Local Ai6,847
  • Model Releases35,469
  • Research28,731
  • Safety18,972
  • Syntheses30
  • Tools1,775
123,303Total entries
59Added by human
123,244Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
9,676 results
CompaniesToolsTechniques

Each lane shows up to 8 recent matching entries, ordered from earlier to later. Tracks load separately to keep the 75,000+ entry wiki fast.

Techniques

TechniqueRLHF / Alignment8 recent entries
12 Oct 2026MotionCoach: Constructing Multimodal Guidance for Video Professional Motion Editing

arXiv:2610.12963v1 Announce Type: cross Abstract: Video editing models achieve strong performance in modifying appearance, backgrounds, styles, and motions, empowered by large-scale training data. Bey

→12 Oct 2026Evidential Multimodal Transformers with Dempster-Shafer Fusion for Emotion Recognition

arXiv:2610.13013v1 Announce Type: new Abstract: Softmax-based multimodal emotion recognition methods often assign high confidence even when sensor data are corrupted or contradictory, for example when

Tutorials
4,626

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
→12 Oct 2026EmoGavel: Grounding-Aware Reinforcement Learning with Verifiable Rewards for Multimodal Emotion Preference Learning

arXiv:2610.13353v1 Announce Type: cross Abstract: Multimodal emotion preference learning uses pairwise comparisons to identify which open-ended emotion descriptions align more closely with human judgm

→12 Oct 2026Efficient Audio-Visual Speech Enhancement via Reinforcement Learning-Based Neural Architecture Search

arXiv:2610.12796v1 Announce Type: cross Abstract: Audio-visual speech enhancement (AVSE) improves speech intelligibility in noisy environments but often relies on computationally expensive models unsu

→12 Oct 2026Continually Post-training Small Models via Synthetic Self-distillation

arXiv:2610.13113v1 Announce Type: cross Abstract: Continual post-training faces a dual challenge of acquisition and retention: models must learn new capabilities while preserving prior knowledge. Whil

→12 Oct 2026CliQ-RRG: Clinical-Knowledge Guided Disease-aware Visual-Textual Alignment for QA-Style Radiology Report Generation

arXiv:2610.13059v1 Announce Type: new Abstract: Radiology reports are essential for diagnostic reasoning and patient care, yet their manual preparation is time-consuming and cognitively demanding. Aut

→12 Oct 2026Can Language Models Play the Wikipedia Game?

arXiv:2610.13948v1 Announce Type: new Abstract: Language models increasingly support or automate information retrieval from document collections too large to index. This task is difficult when it requ

→13 Oct 2026Cross-cloud conversational analytics made simple with open standards

The reality for most organizations is that data lives everywhere. As engineering teams expand and adopt specialized platforms for their workloads, enterprise data naturally disperses across multiple c

TechniqueRAG8 recent entries
12 Oct 2026Retrieval-Augmented Multimodal Language Model with Heterogeneous Evidence Integration for Clinical Prognosis

arXiv:2610.13510v1 Announce Type: new Abstract: Clinical prognosis requires integrating structured measurements, physiological waveforms, longitudinal history, and population context. We introduce PRI

→12 Oct 2026MHR-Router: Multimodal Heterogeneous Retrieval-Enhanced Adaptive Routing for VLM Inference

arXiv:2610.13278v1 Announce Type: new Abstract: Vision-language models (VLMs) exhibit complementary capabilities, yet selecting the most suitable expert for a given image-question query remains challe

→12 Oct 2026Locate, Judge, Read: Role-Specialized Tool Agents over a Knowledge-Point Index for Open-Domain Multimodal Document QA

arXiv:2610.13128v1 Announce Type: new Abstract: Question answering over large heterogeneous document collections requires first finding the right passages and then reading them, yet current retrieval-

→12 Oct 2026Introducing DigitalOcean Agent Data Services: The Data Foundation for Agents

Agents are only as capable as the context they can reach. An agent with reliable access to the right information makes decisions grounded in fact; one without it guesses. And the work agents produce i

→12 Oct 2026CliQ-RRG: Clinical-Knowledge Guided Disease-aware Visual-Textual Alignment for QA-Style Radiology Report Generation

arXiv:2610.13059v1 Announce Type: new Abstract: Radiology reports are essential for diagnostic reasoning and patient care, yet their manual preparation is time-consuming and cognitively demanding. Aut

→12 Oct 2026Can Language Models Play the Wikipedia Game?

arXiv:2610.13948v1 Announce Type: new Abstract: Language models increasingly support or automate information retrieval from document collections too large to index. This task is difficult when it requ

→12 Oct 2026A 'free' multi-modal 'embedding' model (already) included with your LLM: vLLM plugin + upstream PR

Disclaimer: I work for NuMind, the company behind this plugin. TLDR: Text/image (simili-)embeddings from the LLM you already have loaded :-) I've been working on making it easier to obtain embeddings

→13 Oct 2026Cross-cloud conversational analytics made simple with open standards

The reality for most organizations is that data lives everywhere. As engineering teams expand and adopt specialized platforms for their workloads, enterprise data naturally disperses across multiple c

TechniqueAgents8 recent entries
12 Oct 2026MotionCoach: Constructing Multimodal Guidance for Video Professional Motion Editing

arXiv:2610.12963v1 Announce Type: cross Abstract: Video editing models achieve strong performance in modifying appearance, backgrounds, styles, and motions, empowered by large-scale training data. Bey

→12 Oct 2026Locate, Judge, Read: Role-Specialized Tool Agents over a Knowledge-Point Index for Open-Domain Multimodal Document QA

arXiv:2610.13128v1 Announce Type: new Abstract: Question answering over large heterogeneous document collections requires first finding the right passages and then reading them, yet current retrieval-

→12 Oct 2026Large Language Models, Machine-Assisted Cultural Analytics, and the Agentic Turn

arXiv:2610.12792v1 Announce Type: cross Abstract: Technologies like large language models make it easier to convert cultural material into analyzable variables, while LLM-driven agentic systems extend

→12 Oct 2026JoyInside-VLM-Agent: Product-Conditioned Multimodal Policy Learning for Embodied Agents

arXiv:2610.12957v1 Announce Type: cross Abstract: Embodied agents must translate multimodal observations and user requests into executable actions while adapting to product constraints, changing goals

→12 Oct 2026Introducing DigitalOcean Agent Data Services: The Data Foundation for Agents

Agents are only as capable as the context they can reach. An agent with reliable access to the right information makes decisions grounded in fact; one without it guesses. And the work agents produce i

→12 Oct 2026EmbodiedCLBench: Evaluating Continual Learning for Self-Evolving Embodied Agents

arXiv:2610.13021v1 Announce Type: new Abstract: Continual learning requires models to accumulate past experience and transfer it to new tasks. Despite substantial research on continual learning, exist

→13 Oct 2026DigitalOcean Inference Router Enhancements: Performance Tuned Routing, No Rules to Write

Every few weeks, a new model steps up and claims best-in-class at something. The launch chart makes the case, the link makes the rounds, and your team is back to the question nobody has time for: shou

→13 Oct 2026Cross-cloud conversational analytics made simple with open standards

The reality for most organizations is that data lives everywhere. As engineering teams expand and adopt specialized platforms for their workloads, enterprise data naturally disperses across multiple c

TechniqueFine-tuning8 recent entries
12 Oct 2026Reinforcement Learning via Fixed-point Flow Matching

arXiv:2610.12848v1 Announce Type: new Abstract: In maximum entropy and behavior-constrained reinforcement learning (RL), the optimal policy is given by a Boltzmann distribution. Generating samples fro

→12 Oct 2026Monarch-MoE: Structured Experts for Multimodal Continual Instruction Tuning

arXiv:2610.13215v1 Announce Type: new Abstract: Learning new tasks in multimodal continual instruction tuning can cause catastrophic forgetting of previously acquired knowledge. Although multi-expert

→12 Oct 2026JoyInside-VLM-Agent: Product-Conditioned Multimodal Policy Learning for Embodied Agents

arXiv:2610.12957v1 Announce Type: cross Abstract: Embodied agents must translate multimodal observations and user requests into executable actions while adapting to product constraints, changing goals

→12 Oct 2026🚀 Introducing MiniCPM-V 4.7, our new open-source MLLM series! Advancing the Performance–Efficiency Pareto Frontier. It brings strong multim…

🚀 Introducing MiniCPM-V 4.7, our new open-source MLLM series! Advancing the Performance–Efficiency Pareto Frontier. It brings strong multimodal capabilities to iOS and Android devices with extreme eff

→12 Oct 2026EmoGavel: Grounding-Aware Reinforcement Learning with Verifiable Rewards for Multimodal Emotion Preference Learning

arXiv:2610.13353v1 Announce Type: cross Abstract: Multimodal emotion preference learning uses pairwise comparisons to identify which open-ended emotion descriptions align more closely with human judgm

→12 Oct 2026Continually Post-training Small Models via Synthetic Self-distillation

arXiv:2610.13113v1 Announce Type: cross Abstract: Continual post-training faces a dual challenge of acquisition and retention: models must learn new capabilities while preserving prior knowledge. Whil

→12 Oct 2026CliQ-RRG: Clinical-Knowledge Guided Disease-aware Visual-Textual Alignment for QA-Style Radiology Report Generation

arXiv:2610.13059v1 Announce Type: new Abstract: Radiology reports are essential for diagnostic reasoning and patient care, yet their manual preparation is time-consuming and cognitively demanding. Aut

→12 Oct 2026Auditing Prompt Injection Defenses Before They Reach Users: What Strong Adversaries Reveal

arXiv:2505.15738v3 Announce Type: replace-cross Abstract: Large language models are increasingly deployed in user-facing products that handle sensitive personal data while interacting with untrusted e

TechniqueMultimodal8 recent entries
12 Oct 2026Acoustic Biomarkers for Alzheimer's Disease Detection from Spontaneous Speech

arXiv:2610.12500v1 Announce Type: cross Abstract: Alzheimer's disease (AD) remains a major public health challenge, and early identification is crucial for timely intervention and care planning. Recen

→12 Oct 2026A Privileged Teacher That Only Scores Cannot Search: Critique-Conditioned On-Policy Self-Distillation for Reasoning

arXiv:2610.13744v1 Announce Type: new Abstract: On-policy self-distillation promises to replace the sparse outcome signal of verifiable-reward RL with dense token-level credit: a teacher conditioned o

→12 Oct 2026A 'free' multi-modal 'embedding' model (already) included with your LLM: vLLM plugin + upstream PR

Disclaimer: I work for NuMind, the company behind this plugin. TLDR: Text/image (simili-)embeddings from the LLM you already have loaded :-) I've been working on making it easier to obtain embeddings

→13 Oct 2026Running decision models: Picking quant, VRAM usage

Hi, I see that vllm released d3 (a family of decision models) and llama.cpp already has support for them. I want to try them out. Are decision models sensitive to quantization? I know that for autocom

→13 Oct 2026DigitalOcean Inference Router Enhancements: Performance Tuned Routing, No Rules to Write

Every few weeks, a new model steps up and claims best-in-class at something. The launch chart makes the case, the link makes the rounds, and your team is back to the question nobody has time for: shou

→13 Oct 2026Cross-cloud conversational analytics made simple with open standards

The reality for most organizations is that data lives everywhere. As engineering teams expand and adopt specialized platforms for their workloads, enterprise data naturally disperses across multiple c

→13 Oct 2026Building search across text, images, audio, and video? Multimodal search uses vector embeddings to retrieve content based on meaning, not ju…

Building search across text, images, audio, and video? Multimodal search uses vector embeddings to retrieve content based on meaning, not just keywords or metadata. Less manual tagging. More flexible

→13 Oct 20261M-token, multimodal decision models are here! But there is more to this one. You can classify, extract, and summarize with 1M tokens of tex…

1M-token, multimodal decision models are here! But there is more to this one. You can classify, extract, and summarize with 1M tokens of text and image input. ScaleDown's Constrained Decoding Models r

TechniqueSafety8 recent entries
12 Oct 2026RESCUE: Is This Alarm Worth Acting On? Counterfactual Evaluation of VLA Runtime Monitors

arXiv:2610.13516v1 Announce Type: cross Abstract: Runtime failure monitors for robot policies are typically evaluated by how accurately they distinguish failed from successful executions. Yet an accur

→12 Oct 2026Representation Alignment from a Few Paired Data via Distilled Optimal Transport

arXiv:2610.12781v1 Announce Type: new Abstract: Aligning two independently pretrained unimodal encoders typically demands millions of paired examples. In this paper, we study the regime where only N s

→12 Oct 2026Reinforcement Learning via Fixed-point Flow Matching

arXiv:2610.12848v1 Announce Type: new Abstract: In maximum entropy and behavior-constrained reinforcement learning (RL), the optimal policy is given by a Boltzmann distribution. Generating samples fro

→12 Oct 2026MotionCoach: Constructing Multimodal Guidance for Video Professional Motion Editing

arXiv:2610.12963v1 Announce Type: cross Abstract: Video editing models achieve strong performance in modifying appearance, backgrounds, styles, and motions, empowered by large-scale training data. Bey

→12 Oct 2026JoyInside-VLM-Agent: Product-Conditioned Multimodal Policy Learning for Embodied Agents

arXiv:2610.12957v1 Announce Type: cross Abstract: Embodied agents must translate multimodal observations and user requests into executable actions while adapting to product constraints, changing goals

→12 Oct 2026Evidential Multimodal Transformers with Dempster-Shafer Fusion for Emotion Recognition

arXiv:2610.13013v1 Announce Type: new Abstract: Softmax-based multimodal emotion recognition methods often assign high confidence even when sensor data are corrupted or contradictory, for example when

→12 Oct 2026CliQ-RRG: Clinical-Knowledge Guided Disease-aware Visual-Textual Alignment for QA-Style Radiology Report Generation

arXiv:2610.13059v1 Announce Type: new Abstract: Radiology reports are essential for diagnostic reasoning and patient care, yet their manual preparation is time-consuming and cognitively demanding. Aut

→13 Oct 2026Cross-cloud conversational analytics made simple with open standards

The reality for most organizations is that data lives everywhere. As engineering teams expand and adopt specialized platforms for their workloads, enterprise data naturally disperses across multiple c