AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries125,057
  • Agents10,448
  • Applications7,093
  • Companies3
  • Concepts7
  • Hardware2,728
  • Industry6,780
  • Local Ai6,925
  • Model Releases35,932
  • Research29,267
  • Safety19,340
  • Syntheses31
  • Tools1,775
  • Tutorials4,728

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries125,057
  • Agents10,448
  • Applications7,093
  • Companies3
  • Concepts7
  • Hardware2,728
  • Industry6,780
  • Local Ai6,925
  • Model Releases35,932
  • Research29,267
  • Safety19,340
  • Syntheses31
  • Tools1,775
125,057Total entries
60Added by human
124,997Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
9,881 results
CompaniesToolsTechniques

Each lane shows up to 8 recent matching entries, ordered from earlier to later. Tracks load separately to keep the 75,000+ entry wiki fast.

Tools

ToolClaude Code8 recent entries
10 Sept 2026DSAEval: Evaluating Data Science Agents on a Wide Range of Real-World Data Science Problems

arXiv:2601.13591v3 Announce Type: replace Abstract: Recent LLM-based data agents aim to automate data science tasks ranging from data analysis to deep learning. However, the open-ended nature of real-

→17 Sept 2026Planning or Improvisation? Stress-Testing the Poetry Planning Site on Open Models and Open Cross-Layer Transcoders

arXiv:2609.18440v1 Announce Type: new Abstract: Lindsey et al. (2025) report that Claude 3.5 Haiku plans rhymes: features for candidate rhyme words are active on the newline before a line is written,

Tutorials
4,728

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
→28 Sept 2026Introducing FireRouter with Opus. Our first router model. Routine tasks go to top open models, Claude Opus handles the rest. Cache and task-…

Introducing FireRouter with Opus. Our first router model. Routine tasks go to top open models, Claude Opus handles the rest. Cache and task-aware routing. Proven 98.1% of Opus accuracy with 57% lower

→1 Oct 2026GraphForge: Training Working Agents with Graph-Anchored Workspace Synthesis

arXiv:2609.38923v1 Announce Type: new Abstract: Working agents need to read diverse files, coordinate tools, and produce deliverables. Training such agents requires tasks built on many real files with

→1 Oct 2026From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoning

arXiv:2609.39566v1 Announce Type: new Abstract: Foundation models can serve as clinical agents through tool-use harnesses. However, conventional medical benchmarks assess reasoning over preselected ev

→2 Oct 2026Kepler: Auditable World Models for ARC-AGI-3

arXiv:2610.00834v1 Announce Type: new Abstract: ARC-AGI-3 evaluates agents in interactive environments whose rules and objectives must be inferred from observation. We present Kepler, an open-source h

→9 Oct 2026Can LLMs Fix It Without Code? Toward Automated Verification of No-Code Bug Fixes

arXiv:2610.11963v1 Announce Type: cross Abstract: A no-code fix resolves an invalid bug report by directing the user to change a setting, update to a version where the problem is already fixed, or adj

→14 Oct 2026PhySimCode: A Benchmark and Evaluation Method for Physics Video to Code Generation

arXiv:2610.15722v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are good at video understanding and code generation, but it remains unclear whether they can recover the physic

ToolCursor8 recent entries
23 Jul 2026Pathologist Attention-Aligned Report Generation for Prostate Histopathology

arXiv:2607.19624v1 Announce Type: new Abstract: The allocation of visual attention by pathologists during cancer diagnosis is a highly selective process that critically shapes the information extracte

→28 Aug 2026H3 - anatomical slider

Happy Friday! Ever had issues getting the anatomy right on your t2v generation? Just add a slider with your H3 Prompt! What have you all been building on your local AI studios? 384x448, int8, 20 steps

→9 Sept 2026Wiki Lint Report — 2026-09-09

Automated lint: 12 errors, 53990 warnings, 3 info

→13 Sept 2026Wiki Lint Report — 2026-09-13

Automated lint: 12 errors, 54839 warnings, 3 info

→20 Sept 2026Wiki Lint Report — 2026-09-20

Automated lint: 14 errors, 54840 warnings, 3 info

→22 Sept 2026Omni2Web: Benchmarking Audiovisual Website Development

arXiv:2609.23417v1 Announce Type: cross Abstract: Screen-recorded web editing requests contain weak deictic expressions such as ``this'' and ``there,'' whose referents depend on speech, cursor traject

→27 Sept 2026Wiki Lint Report — 2026-09-27

Automated lint: 17 errors, 59669 warnings, 3 info

→4 Oct 2026Wiki Lint Report — 2026-10-04

Automated lint: 19 errors, 64915 warnings, 3 info

ToolLangChain8 recent entries
26 Aug 2026RENDER: Controlling Reader-Facing Evidence in LLM Memory Evaluation

arXiv:2608.23568v1 Announce Type: new Abstract: Memory and RAG evaluations often treat the answering model's input as an implementation detail, even though systems may render the same history as a mem

→1 Sept 2026you can now build @LangChain agents w/ agentic video understanding! google is consistently at the forefront of multimodal processing; this i…

you can now build @LangChain agents w/ agentic video understanding! google is consistently at the forefront of multimodal processing; this is the video analog of 'agentic vision' token usage + cost is

→9 Sept 2026Wiki Lint Report — 2026-09-09

Automated lint: 12 errors, 53990 warnings, 3 info

→13 Sept 2026Wiki Lint Report — 2026-09-13

Automated lint: 12 errors, 54839 warnings, 3 info

→20 Sept 2026Wiki Lint Report — 2026-09-20

Automated lint: 14 errors, 54840 warnings, 3 info

→27 Sept 2026Wiki Lint Report — 2026-09-27

Automated lint: 17 errors, 59669 warnings, 3 info

→4 Oct 2026Wiki Lint Report — 2026-10-04

Automated lint: 19 errors, 64915 warnings, 3 info

→5 Oct 2026deep agents just shipped a round of multimodal upgrades! 1. broader file support on OpenAI Responses: docx, pptx, xlsx, csv, json, markdown,…

deep agents just shipped a round of multimodal upgrades! 1. broader file support on OpenAI Responses: docx, pptx, xlsx, csv, json, markdown, not just pdfs 2. opt-in binary offloading to keep big files

ToolOllama8 recent entries
11 Sept 2026US-hosted, with Zero Data Retention enabled by default https://lmstudio.ai/models/deepseek-v4.1-flash

LM Studio is a US‑hosted platform that enables “Zero Data Retention” by default, meaning user inputs are not stored after processing. It currently hosts the DeepSeek V4.1 Flash model—a 552 B multimoda

→18 Sept 20266 billion tokens for $65 Is it as good as Astra and Fable at hard stuff? No of course not. But you don't always need a genius and can just c…

6 billion tokens for $65 Is it as good as Astra and Fable at hard stuff? No of course not. But you don't always need a genius and can just call one for advice when you do. Extrapolate where this is go

→23 Sept 2026Which small model works best with Ollama on a Raspberry Pi 5?

I've been comparing and working on Gemma 4, Phi-4-Mini, and Qwen3-4B for local LLM use on an 8 GB Raspberry Pi 5. The results were indeed close, but each model has a different strength: Gemma 4 E2B: a

→28 Sept 2026Why your startup needs open models alongside frontier APIs

Every week, I talk with founders who are building at an unbelievable pace. Teams are moving from inception to product-market fit faster than ever, with foundation models wired deeply into their core p

→3 Oct 2026Clef Flash: https://ollama.com/library/clef-flash Clef: https://ollama.com/library/clef

Clef Flash (9 billion‑parameter) is a multimodal model hosted on Ollama that converts a given state and a schema of typed questions into actionable decisions. Its counterpart, Clef, is also available

→6 Oct 2026v0.40.0-rc6: model: add multimodal embeddings (#18820)

Implements the EmbeddingGemma2Model architecture on the MLX runner: 24-layer bidirectional text encoder with PLE, shared gemma4 vision/audio towers, mean-pool + L2 output. /api/embed accepts per-item

→6 Oct 2026.@GoogleDeepMind EmbeddingGemma 2 is now available on Ollama. Made for consumer devices and is multimodal. ollama pull embeddinggemma-2

.@GoogleDeepMind EmbeddingGemma 2 is now available on Ollama. Made for consumer devices and is multimodal. ollama pull embeddinggemma-2 Meet EmbeddingGemma 2, our first natively multimodal open model

→10 Oct 2026Mreaia v1.0.0: Universal Zero-Token Engine & Hardware-Locked Context Distillation for LLMs (>99.9% Reduction)

Hey everyone! 👋 Feeding multi-gigabyte files (SQL dumps, videos, audio, PDFs, and spreadsheets) directly into LLMs often causes context window overflow, GPU VRAM bottlenecks, massive token bills, and

ToolVercel AI8 recent entries
24 Aug 2026AEGIS: Preventing Cross-Domain Resource Abuse in MCP

arXiv:2608.20481v1 Announce Type: cross Abstract: The Model Context Protocol (MCP) is an open source JSON-RPC protocol that standardizes how large language models (LLMs) interact with external systems

→1 Sept 2026Lot Machine: Multimodal Lot Extraction from Auction Catalogs

arXiv:2608.30510v1 Announce Type: cross Abstract: For provenance research and art market studies, auction catalogs are an essential resource to trace specific objects over time and space. While histor

→4 Sept 2026Deploy a multimodal WhatsApp ordering assistant with Amazon Bedrock AgentCore

Learn how to deploy a multimodal WhatsApp ordering assistant that takes customer orders through text, voice notes, and real-time voice calls on a single business number, built on Amazon Bedrock AgentC

→9 Sept 2026Wiki Lint Report — 2026-09-09

Automated lint: 12 errors, 53990 warnings, 3 info

→13 Sept 2026Wiki Lint Report — 2026-09-13

Automated lint: 12 errors, 54839 warnings, 3 info

→20 Sept 2026Wiki Lint Report — 2026-09-20

Automated lint: 14 errors, 54840 warnings, 3 info

→27 Sept 2026Wiki Lint Report — 2026-09-27

Automated lint: 17 errors, 59669 warnings, 3 info

→4 Oct 2026Wiki Lint Report — 2026-10-04

Automated lint: 19 errors, 64915 warnings, 3 info

ToolHugging Face8 recent entries
6 Oct 2026Google expands EmbeddingGemma beyond text to images, audio and video

Google LLC today released EmbeddingGemma 2, an open multimodal embedding model small enough to run on a smartphone. The release takes the EmbeddingGemma line beyond text, which was all the first versi

→6 Oct 2026Google DeepMind launches EmbeddingGemma 2, a 740M-parameter model to map code, images, video, and audio in a shared embedding space, under an Apache 2.0 license (Google)

Google: Google DeepMind launches EmbeddingGemma 2, a 740M-parameter model to map code, images, video, and audio in a shared embedding space, under an Apache 2.0 license — EmbeddingGemma 2 is the most

→7 Oct 2026We’re open-sourcing pplx-embed-v2-late, multi-vector embeddings for text and images, 9B and 0.6B, in one shared embedding space. You can use…

We’re open-sourcing pplx-embed-v2-late, multi-vector embeddings for text and images, 9B and 0.6B, in one shared embedding space. You can use these to index multimodal data with 9B, and query on device

→8 Oct 2026PrismSSL: One Interface, Many Modalities; A Single-Interface Library for Multimodal Self-Supervised Learning

arXiv:2511.17776v2 Announce Type: replace Abstract: We present PrismSSL, a Python library that unifies state-of-the-art self-supervised learning (SSL) methods across audio, vision, graphs, and cross-m

→8 Oct 2026an open model just beat Jev outright on clinical decisions 🔥 pplx-decider v1.1 got 643 of 669 right vs 628 for Jev, at 42% less per decisio…

an open model just beat Jev outright on clinical decisions 🔥 pplx-decider v1.1 got 643 of 669 right vs 628 for Jev, at 42% less per decision and about the same speed. and you can download the weights

→10 Oct 2026Mreaia v1.0.0: Universal Zero-Token Engine & Hardware-Locked Context Distillation for LLMs (>99.9% Reduction)

Hey everyone! 👋 Feeding multi-gigabyte files (SQL dumps, videos, audio, PDFs, and spreadsheets) directly into LLMs often causes context window overflow, GPU VRAM bottlenecks, massive token bills, and

→11 Oct 2026OpenMed 3.0 is out: Apache-2.0 clinical AI that runs fully local and never falls back to the cloud. 422 open issues if you want in on 3.1

Hey r/LocalLLaMA! Maintainer here. Some of you might remember OpenMed from our 1.8 post a few months back. Quick recap: it's an open-source (Apache-2.0) medical AI toolkit with one rule we never break

→12 Oct 2026🚀 Introducing MiniCPM-V 4.7, our new open-source MLLM series! Advancing the Performance–Efficiency Pareto Frontier. It brings strong multim…

🚀 Introducing MiniCPM-V 4.7, our new open-source MLLM series! Advancing the Performance–Efficiency Pareto Frontier. It brings strong multimodal capabilities to iOS and Android devices with extreme eff