AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries125,187
  • Agents10,469
  • Applications7,096
  • Companies3
  • Concepts7
  • Hardware2,737
  • Industry6,795
  • Local Ai6,931
  • Model Releases35,992
  • Research29,272
  • Safety19,344
  • Syntheses31
  • Tools1,778
  • Tutorials4,732

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries125,187
  • Agents10,469
  • Applications7,096
  • Companies3
  • Concepts7
  • Hardware2,737
  • Industry6,795
  • Local Ai6,931
  • Model Releases35,992
  • Research29,272
  • Safety19,344
  • Syntheses31
  • Tools1,778
  • Tutorials4,732

Source
125,187Total entries
60Added by human
125,127Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
49+ results
Agents

Also please feel free to fight in the comments about 'pure LLMs' versus multimodal LLMs versus multimodal LLMs with tool use or whatever. I …

DGX agent

Ethan Mollick invited readers to discuss the distinctions between **pure large language models (LLMs)**, **multimodal LLMs** that process multiple data types (e.g., text, images), and **multimodal LLM

agentsethan-mollick--x
27 Sept 2026
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Model Releases

Brace yourselves. We just entered a new era of frontier multimodal models. DeepSeek-V4-Flash-Vision-Exp advances multimodal agent performanc…

DGX agent

Brace yourselves. We just entered a new era of frontier multimodal models. DeepSeek-V4-Flash-Vision-Exp advances multimodal agent performance. Also, pay attention to Ox Alpha 1M token contexts with te

model-releasesdair-ai--x
21 Aug 2026
Model Releases

👏👏 Introducing Qwen3.7-Plus — a multimodal agent model that unifies vision and language into one versatile agent foundation. ✅ Multimodal …

DGX agent

👏👏 Introducing Qwen3.7-Plus — a multimodal agent model that unifies vision and language into one versatile agent foundation. ✅ Multimodal interactive hybrid agent: unified GUI & CLI operation across v

model-releasesqwen--x
1 Jun 2026
Model Releases

VLM Performance:Qwen3.6 is natively multimodal, and Qwen3.6-35B-A3B showcases perception and multimodal reasoning capabilities that far exce…

DGX agent

VLM Performance:Qwen3.6 is natively multimodal, and Qwen3.6-35B-A3B showcases perception and multimodal reasoning capabilities that far exceed what its size would suggest, with only around 3 billion a

model-releasesqwen--x
16 Apr 2026
Model Releases

DeepSeek-V4-Flash-Vision-Exp is now live on the DeepSeek API Platform! 🚀 🔹 This experimental multimodal model matches DeepSeek-V4-Flash on…

DGX agent

DeepSeek-V4-Flash-Vision-Exp is now live on the DeepSeek API Platform! 🚀 🔹 This experimental multimodal model matches DeepSeek-V4-Flash on text capabilities—including agents, reasoning, and world know

model-releasesdeepseek--x
21 Aug 2026
Tutorials

Building search across text, images, audio, and video? Multimodal search uses vector embeddings to retrieve content based on meaning, not ju…

DGX agent

Building search across text, images, audio, and video? Multimodal search uses vector embeddings to retrieve content based on meaning, not just keywords or metadata. Less manual tagging. More flexible

tutorialspinecone--x
13 Oct 2026
Model Releases

What's better than an open-weight multimodal model release? Well, the technical report. I just love how these labs like Qwen and DeepSeek co…

DGX agent

What's better than an open-weight multimodal model release? Well, the technical report. I just love how these labs like Qwen and DeepSeek continue to drop gem after gem. Qwen3.8-Flash is the latest in

model-releasesdair-ai--x
26 Aug 2026
Model Releases

👀 Seeing is just the beginning. With Qwen-MM-Plugins, turn your favorite agent harness multimodal-native — read images, videos & documents,…

DGX agent

👀 Seeing is just the beginning. With Qwen-MM-Plugins, turn your favorite agent harness multimodal-native — read images, videos & documents, edit videos, work with 3D/CAD, and more. From multimodal mod

model-releasesqwen--x
10 Aug 2026
Local Ai

Bonsai 27B is a big step for local AI: 27B-class multimodal capability in a phone-class footprint. Congrats to @PrismML on the launch. Try T…

DGX agent

Bonsai 27B is a big step for local AI: 27B-class multimodal capability in a phone-class footprint. Congrats to @PrismML on the launch. Try Ternary Bonsai 27B on Together AI: https://www.together.ai/mo

local-aitogether-ai--x
14 Jul 2026
Local Ai

Huge if true! We are talking about a 27B multimodal model that runs locally on a phone. That's wild! Bonsai 27B reaches up to 163 tok/s in 1…

DGX agent

Huge if true! We are talking about a 27B multimodal model that runs locally on a phone. That's wild! Bonsai 27B reaches up to 163 tok/s in 1-bit and 134 tok/s in Ternary on an NVIDIA GeForce RTX 5090.

local-aidair-ai--x
14 Jul 2026
Local Ai

Today, we’re announcing Bonsai 27B: the first 27B-class model to run on a phone. Bonsai 27B is the new multimodal flagship of the Bonsai fam…

DGX agent

Today, we’re announcing Bonsai 27B: the first 27B-class model to run on a phone. Bonsai 27B is the new multimodal flagship of the Bonsai family. Based on Qwen3.6 27B, it brings a new capability tier t

local-aiclem-delangue--x
14 Jul 2026
Agents

Multimodal prompting is clearly the future. I love experimenting with new ways to interact with agents. As a researcher and engineer, I've f…

DGX agent

Multimodal prompting is clearly the future. I love experimenting with new ways to interact with agents. As a researcher and engineer, I've found that the richer the inputs to the agent and the richer

agentsdair-ai--x
3 Jul 2026
Agents

GLM-5V-Turbo Tech Report: Toward a Native Foundation Model for Multimodal Agents This report summarizes the main improvements behind GLM-5V-…

DGX agent

GLM-5V-Turbo Tech Report: Toward a Native Foundation Model for Multimodal Agents This report summarizes the main improvements behind GLM-5V-Turbo across model design, multimodal training, reinforcemen

agentszhipu-ai--x
7 May 2026
Local Ai

.@GoogleDeepMind EmbeddingGemma 2 is now available on Ollama. Made for consumer devices and is multimodal. ollama pull embeddinggemma-2

DGX agent

.@GoogleDeepMind EmbeddingGemma 2 is now available on Ollama. Made for consumer devices and is multimodal. ollama pull embeddinggemma-2 Meet EmbeddingGemma 2, our first natively multimodal open model

local-aiollama--x
6 Oct 2026
Model Releases

Multimodal API support 🔌 🔹 Set model='deepseek-v4-flash-vision-exp' 🔹 Images are tokenized for billing: up to 384 tokens each, at V4-Flas…

DGX agent

Multimodal API support 🔌 🔹 Set model='deepseek-v4-flash-vision-exp' 🔹 Images are tokenized for billing: up to 384 tokens each, at V4-Flash pricing 🔹 Supports Chat Completions, Messages & Responses 🔹 S

model-releasesdeepseek--x
21 Aug 2026
Applications

1M-token, multimodal decision models are here! But there is more to this one. You can classify, extract, and summarize with 1M tokens of tex…

DGX agent

1M-token, multimodal decision models are here! But there is more to this one. You can classify, extract, and summarize with 1M tokens of text and image input. ScaleDown's Constrained Decoding Models r

applicationsdair-ai--x
13 Oct 2026
Agents

Interested in designing and building agent harnesses for long-horizon, multimodal tasks? Nomic is hiring a Harness Engineer. We're post-trai…

DGX agent

Interested in designing and building agent harnesses for long-horizon, multimodal tasks? Nomic is hiring a Harness Engineer. We're post-training models and an agent harness that can perform most tasks

agentsnomic-ai--x
26 Aug 2026
Industry

[1/7] 🚨 We're releasing LAION-BVD: a 10-million-hour open video dataset for multimodal pre-training. - 1.3B video URLs from CommonCrawl - 8…

DGX agent

[1/7] 🚨 We're releasing LAION-BVD: a 10-million-hour open video dataset for multimodal pre-training. - 1.3B video URLs from CommonCrawl - 80M downloaded videos - 10M video hours - 55M captioned clips

industryemad-mostaque--x
26 Aug 2026
Agents

The mystery model Ox Alpha is now available in @AutoClawAIer by @Zai_org It's official name is GLM-5.3-Flash, a next-generation multimodal m…

DGX agent

The mystery model Ox Alpha is now available in @AutoClawAIer by @Zai_org It's official name is GLM-5.3-Flash, a next-generation multimodal model for vision-language understanding, code generation, and

agentszhipu-ai--x
26 Aug 2026
Tools

FLUX 3 is now live on Together AI. @bfl_ai’s new multimodal model generates video and synchronized audio together, with up to 20-second clip…

DGX agent

FLUX 3 is now live on Together AI. @bfl_ai’s new multimodal model generates video and synchronized audio together, with up to 20-second clips, multiple shots, and control from text, images, or keyfram

toolstogether-ai--x
6 Aug 2026
Tools

Inkling-Small is now live on Together AI. @thinkymachines’ new open-weight multimodal model delivers similar performance to Inkling at one-q…

DGX agent

Inkling-Small is now live on Together AI. @thinkymachines’ new open-weight multimodal model delivers similar performance to Inkling at one-quarter the size, built for coding, agents, and general multi

toolstogether-ai--x
31 Jul 2026
Research

Excited for our first general model Inkling -- open weights, 975B, natively multimodal (text, image, audio). Available on Tinker, HuggingFac…

DGX agent

Excited for our first general model Inkling -- open weights, 975B, natively multimodal (text, image, audio). Available on Tinker, HuggingFace and partners. It is yours to personalize and use openly. I

researchsoumith-chintala--x
15 Jul 2026
Agents

I guess image input is the big capability of the models, and tool use can be a substitute for non-omni model output. Still, multimodal voice…

DGX agent

Ethan Mollick notes that image input represents the primary advanced capability of current AI models, and that tool‑use can effectively replace outputs from non‑omni models. He observes that multimoda

agentsethan-mollick--x
13 Jul 2026
Tutorials

Multimodal prompting is clearly the future. How we interact with agents is evolving. I share a bit (including a video walkthrough) of how I …

DGX agent

This post discusses the evolution of multimodal prompting in AI agent interactions, highlighting how users can now communicate with AI systems using multiple input types beyond text. The author provid

tutorialsdair-ai--x
4 Jul 2026
Applications

Amazing deep dive from the @togethercompute team on serving MiniMax M3 in production. M3 with its 1M context, native multimodality and MiniM…

DGX agent

Amazing deep dive from the @togethercompute team on serving MiniMax M3 in production. M3 with its 1M context, native multimodality and MiniMax Sparse Attention requires real work across paged decode,

applicationstogether-ai--x
2 Jun 2026
Hardware

MiniMax-M3 combines 1M context, native multimodality, and MiniMax Sparse Attention. The next layer is serving it efficiently: KV-block-major…

DGX agent

MiniMax-M3 combines 1M context, native multimodality, and MiniMax Sparse Attention. The next layer is serving it efficiently: KV-block-major sparse attention, paged MSA decode, optimized index scoring

hardwaretogether-ai--x
2 Jun 2026
Model Releases

VLM Performance:Qwen3.6-27B is natively multimodal, supporting both vision-language thinking and non-thinking modes in a single unified chec…

DGX agent

VLM Performance:Qwen3.6-27B is natively multimodal, supporting both vision-language thinking and non-thinking modes in a single unified checkpoint — the same as Qwen3.6-35B-A3B. It handles images and

model-releasesqwen--x
22 Apr 2026
Model Releases

Gemma 4 31B brings dense multimodal reasoning to Together AI. Try Now: http://www.together.ai/models/gemma-4-31b

DGX agent

Google's Gemma 4 31B is a dense multimodal model from Google DeepMind now available on Together AI's serverless infrastructure via the endpoint `google/gemma-4-31B-it`. It features a 256K context ...

model-releasestogether-ai--x
9 Apr 2026
Industry

Introducing the largest open-source multilingual, multimodal RL environments 🌍 📄 OCR: 1M+ document pages in 22 languages 🎙️ ASR: speech i…

DGX agent

Introducing the largest open-source multilingual, multimodal RL environments 🌍 📄 OCR: 1M+ document pages in 22 languages 🎙️ ASR: speech in 102 languages 12M+ tasks across two OpenEnv Environments, ope

industryclem-delangue--x
14 Oct 2026
Industry

Introducing Decision 3.0: towards open multimodal foundation decision models ⚡ Open and state-of-the-art from 0.6B to 27B: #1 on both Jev De…

DGX agent

Introducing Decision 3.0: towards open multimodal foundation decision models ⚡ Open and state-of-the-art from 0.6B to 27B: #1 on both Jev Decision Index boards in our evaluation, on a new Pareto front

industryclem-delangue--x
11 Oct 2026
Model Releases

Meet Mistral Large 4, aka Le Chonk. • 1T parameters, natively multimodal. 49B active. It is the best open weights model from US or Europe on…

DGX agent

Meet Mistral Large 4, aka Le Chonk. • 1T parameters, natively multimodal. 49B active. It is the best open weights model from US or Europe on aggregated benchmarks. • State-of-the-art on critical workl

model-releasesclem-delangue--x
6 Oct 2026
Model Releases

pplx-decider-v1.1-27b, our updated open weights multimodal decision model, is now available. It scores the highest on the new @huggingface D…

DGX agent

pplx-decider-v1.1-27b, our updated open weights multimodal decision model, is now available. It scores the highest on the new @huggingface Decision Index 0.3 benchmark. pplx-decider-v1.1-27b costs hal

model-releasesperplexity--x
6 Oct 2026
Agents

deep agents just shipped a round of multimodal upgrades! 1. broader file support on OpenAI Responses: docx, pptx, xlsx, csv, json, markdown,…

DGX agent

deep agents just shipped a round of multimodal upgrades! 1. broader file support on OpenAI Responses: docx, pptx, xlsx, csv, json, markdown, not just pdfs 2. opt-in binary offloading to keep big files

agentsharrison-chase--x
5 Oct 2026
Model Releases

This is both fun and a useful measure of how much better multimodal AI has gotten In a short time.

DGX agent

This is both fun and a useful measure of how much better multimodal AI has gotten In a short time. Can AI tell if you've built your IKEA furniture wrong? Our new benchmark, the Furniture Assembly Benc

model-releasesethan-mollick--x
23 Sept 2026
Model Releases

you can now build @LangChain agents w/ agentic video understanding! google is consistently at the forefront of multimodal processing; this i…

DGX agent

you can now build @LangChain agents w/ agentic video understanding! google is consistently at the forefront of multimodal processing; this is the video analog of 'agentic vision' token usage + cost is

model-releasesharrison-chase--x
1 Sept 2026
Model Releases

125B/6B, 1M context, multimodal, now in OpenCode Go. ⚡ Happy coding with Qwen3.8-Flash!

DGX agent

Qwen 125B/6B models with a 1‑million‑token context window and multimodal support have been released on Alibaba’s OpenCode Go platform. The new Qwen3.8‑Flash variant is also now available in the same e

model-releasesqwen--x
28 Aug 2026
Model Releases

Gemini Omni 1.1 Flash is live in ComfyUI via Partner Nodes. Google's multimodal video model, one node, five task types: → text-to-video → im…

DGX agent

Gemini Omni 1.1 Flash is live in ComfyUI via Partner Nodes. Google's multimodal video model, one node, five task types: → text-to-video → image-to-video → reference-to-video → edit → extend Up to 4K.

model-releasescomfyui--x
28 Aug 2026
Model Releases

GLM 5.3 is now available in Perplexity Computer. Built for long-context, multimodal agent workloads, it beat GLM 5.2 on WANDR, our benchmark…

DGX agent

Perplexity AI has released its new language model GLM 5.3 on Perplexity Computer. Designed for long‑context, multimodal agent workloads, GLM 5.3 outperformed the previous GLM 5.2 on the company’s WAND

model-releasesperplexity--x
28 Aug 2026
Model Releases

Meet Gemini Omni 1.1 Flash ⚡️ Our newest multimodal model for video generation and editing. It now features your favorite creative controls …

DGX agent

Meet Gemini Omni 1.1 Flash ⚡️ Our newest multimodal model for video generation and editing. It now features your favorite creative controls from Veo, plus brand new capabilities. Enjoy features like 4

model-releasesgoogle-ai--x
27 Aug 2026
Model Releases

Introducing GLM-5.3-Flash - Leading capabilities at a highly competitive price - Natively multimodal with a 1M-token context window - A 320B…

DGX agent

Introducing GLM-5.3-Flash - Leading capabilities at a highly competitive price - Natively multimodal with a 1M-token context window - A 320B-A18B model released under the MIT License - Previously prev

model-releaseszhipu-ai--x
26 Aug 2026
Model Releases

⚡Meet Qwen3.8-Flash, a multimodal MoE and an early preview of the Qwen4 architecture, now open-weight! The production version Qwen3.8-Flash …

DGX agent

⚡Meet Qwen3.8-Flash, a multimodal MoE and an early preview of the Qwen4 architecture, now open-weight! The production version Qwen3.8-Flash will be available soon via QwenCloud API at just 0.16/1M inp

model-releasesclem-delangue--x
26 Aug 2026
Safety

Me, 2023, 2024, 2025…. Multimodal LLMs are going to have problems with maps. 2026: It’s ok, you live in Venecky. Not far Tounesseo.

DGX agent

Me, 2023, 2024, 2025…. Multimodal LLMs are going to have problems with maps. 2026: It’s ok, you live in Venecky. Not far Tounesseo. @GaryMarcus It keeps getting crazier “Mom, did you know that we live

safetygary-marcus--x
22 Aug 2026
Model Releases

We promised open weights for Qwen3.8. Now, time to meet them! 🎉 ⚡ Qwen3.8-27B: - A native multimodal dense model. With just 27B parameters,…

DGX agent

We promised open weights for Qwen3.8. Now, time to meet them! 🎉 ⚡ Qwen3.8-27B: - A native multimodal dense model. With just 27B parameters, it outperforms Qwen3.7-Plus overall and shines in real-world

model-releasesqwen--x
14 Aug 2026
Model Releases

Meta released Muse Glimmer 30B: multimodal model for your Claw/Pi setups 🔥 we tested and fine-tuned the model for you, and shipped day-0 su…

DGX agent

Meta released Muse Glimmer 30B: multimodal model for your Claw/Pi setups 🔥 we tested and fine-tuned the model for you, and shipped day-0 support in transformers and llama.cpp, including DFlash for 2-4

model-releasesgeorgi-gerganov--x
10 Aug 2026
Model Releases

Glad to see Google sharing data on how Gemini is being used. Especially interesting is that the usefulness of multimodal AI for manual labor…

DGX agent

Glad to see Google sharing data on how Gemini is being used. Especially interesting is that the usefulness of multimodal AI for manual labor may be greater than expected. https://blog.google/innovatio

model-releasesethan-mollick--x
24 Jul 2026
Research

Never too late for any company to get in on open models. Inkling is a MoE transformer with 975B (41B active). Native multimodal support. Con…

DGX agent

Never too late for any company to get in on open models. Inkling is a MoE transformer with 975B (41B active). Native multimodal support. Context lengths: 64K and 256K. Will be testing and providing th

researchdair-ai--x
15 Jul 2026
Model Releases

This is for pretraining based on nemotron nvp4 figures, mfu etc Large context, multimodal, long RL we are seeing now could make it a multipl…

DGX agent

This is for pretraining based on nemotron nvp4 figures, mfu etc Large context, multimodal, long RL we are seeing now could make it a multiple of this Worth noting how good the lite model is, similar t

model-releasesemad-mostaque--x
15 Jul 2026
Tutorials

Learn why multimodal prompting is a big deal when working with coding agents.

DGX agent

Multimodal prompting enhances coding agents by enabling them to process and integrate multiple types of input data—such as text, images, and code snippets—simultaneously, improving their ability to un

tutorialsdair-ai--x
4 Jul 2026
← Previous
1
Next →
287 results
← Previous
123…6
Next →