AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries126,600
  • Agents10,613
  • Applications7,144
  • Companies3
  • Concepts7
  • Hardware2,770
  • Industry6,809
  • Local Ai6,993
  • Model Releases36,508
  • Research29,590
  • Safety19,569
  • Syntheses31
  • Tools1,780
  • Tutorials4,783

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries126,600
  • Agents10,613
  • Applications7,144
  • Companies3
  • Concepts7
  • Hardware2,770
  • Industry6,809
  • Local Ai6,993
  • Model Releases36,508
  • Research29,590
  • Safety19,569
  • Syntheses31
  • Tools1,780
  • Tutorials4,783

Source
126,600Total entries
60Added by human
126,540Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
298 results
Model Releases

This is for pretraining based on nemotron nvp4 figures, mfu etc Large context, multimodal, long RL we are seeing now could make it a multipl…

DGX agent

This is for pretraining based on nemotron nvp4 figures, mfu etc Large context, multimodal, long RL we are seeing now could make it a multiple of this Worth noting how good the lite model is, similar t

model-releasesemad-mostaque--x
15 Jul 2026
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Tutorials

Learn why multimodal prompting is a big deal when working with coding agents.

DGX agent

Multimodal prompting enhances coding agents by enabling them to process and integrate multiple types of input data—such as text, images, and code snippets—simultaneously, improving their ability to un

tutorialsdair-ai--x
4 Jul 2026
Model Releases

We stress tested many frontier AI models for multimodal medical reasoning (including GPT-5, Claude 3.5, Gemini 2.5 Pro). They’re not ready. …

DGX agent

We stress tested many frontier AI models for multimodal medical reasoning (including GPT-5, Claude 3.5, Gemini 2.5 Pro). They’re not ready. Faulty reasoning, use of inappropriate shortcuts, hallucinat

model-releasesgary-marcus--x
26 Jun 2026
Tools

M3 brings sparse attention + 1M context + multimodality, and Together did the hard serving work to make it fast. Great collaboration with th…

DGX agent

Anthropic's Claude 3.5 Sonnet (M3) model features sparse attention mechanisms, 1 million token context length, and multimodal capabilities, with Together AI optimizing the serving infrastructure to en

toolstogether-ai--x
3 Jun 2026
Agents

Demo2: Multimodal Interactive Hybrid Agent

DGX agent

Demo2 showcases Qwen's multimodal interactive hybrid agent capabilities, likely demonstrating the integration of multiple data types (text, image, audio, video) with interactive features and hybrid pr

agentsqwen--x
1 Jun 2026
Model Releases

In May, we integrated 11 new models spanning image, 3D, audio, video, and multimodal. The highlights: → Krea 2 — style-first image generatio…

DGX agent

In May, we integrated 11 new models spanning image, 3D, audio, video, and multimodal. The highlights: → Krea 2 — style-first image generation, live as a Partner Node on day one. Competes on how the fr

model-releasescomfyui--x
1 Jun 2026
Research

Thinking Machines is impressive. In a couple hours I just fine tuned my own Qwen3.5-397B model this afternoon. Fast usable multimodal is als…

DGX agent

Thinking Machines is impressive. In a couple hours I just fine tuned my own Qwen3.5-397B model this afternoon. Fast usable multimodal is also going to enable very mind-blowing personal AI. People talk

researchsoumith-chintala--x
24 May 2026
Model Releases

I think people don't realize why Gemini Omni is different than other video AIs. It is fully multimodal, so it can edit video natively, too I…

DGX agent

I think people don't realize why Gemini Omni is different than other video AIs. It is fully multimodal, so it can edit video natively, too I took the famous 'train ' movie from 1896 & made it a bullet

model-releasesethan-mollick--x
22 May 2026
Agents

streaming from modern agents is pretty complex! especially with - parallel tools / subagents - multimodal content - human in the loop events…

DGX agent

streaming from modern agents is pretty complex! especially with - parallel tools / subagents - multimodal content - human in the loop events our new streaming primitives make all of this ergonomic! Ag

agentsharrison-chase--x
21 May 2026
Model Releases

Reference anything: Gemini Omni extends Gemini's native multimodality, allowing you to blend combinations of text, audio, image, and video i…

DGX agent

Gemini Omni is an extension of Google's Gemini model that enhances its multimodal capabilities by enabling seamless integration of text, audio, image, and video inputs and outputs. This advancement al

model-releasesgoogle-ai--x
19 May 2026
Industry

Introducing Starchild-1 from @odysseyml, the first ever real-time multimodal world model. This a model that can generate interactive simulat…

DGX agent

Introducing Starchild-1 from @odysseyml, the first ever real-time multimodal world model. This a model that can generate interactive simulations of the world that you can—for the first time ever—hear.

industryemad-mostaque--x
18 May 2026
Model Releases

Three new open-source models just landed in ComfyUI natively: → Gemma 4 (Google DeepMind) - multimodal LLM handling text, image, audio, and …

DGX agent

Three new open-source models just landed in ComfyUI natively: → Gemma 4 (Google DeepMind) - multimodal LLM handling text, image, audio, and video input with built-in step-by-step reasoning mode → VOID

model-releasescomfyui--x
15 May 2026
Agents

Introducing Qwen3.6-Plus from @Alibaba_Qwen, a 1M-context model built for real-world agents, agentic coding, and multimodal reasoning. AI na…

DGX agent

Introducing Qwen3.6-Plus from @Alibaba_Qwen, a 1M-context model built for real-world agents, agentic coding, and multimodal reasoning. AI natives can now use Qwen3.6-Plus on Together AI and benefit fr

agentstogether-ai--x
29 Apr 2026
Model Releases

@NVIDIA Nemotron 3 Nano Omni is now on Together AI. Enterprise multimodal AI — video, audio, image, documents & text — optimized for speed a…

DGX agent

@NVIDIA Nemotron 3 Nano Omni is now on Together AI. Enterprise multimodal AI — video, audio, image, documents & text — optimized for speed and scale. ✅ ~3B active params, 9x higher throughput ✅ Fully

model-releasestogether-ai--x
28 Apr 2026
Agents

Introducing Kimi K2.6 from @Kimi_Moonshot, a multimodal agentic model with Agent Swarm scaling to 300 sub-agents and long-horizon coding sta…

DGX agent

Introducing Kimi K2.6 from @Kimi_Moonshot, a multimodal agentic model with Agent Swarm scaling to 300 sub-agents and long-horizon coding stability. AI natives can now use Kimi K2.6 on Together AI and

agentstogether-ai--x
22 Apr 2026
Applications

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive *3D worlds* from text, im…

DGX agent

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive *3D worlds* from text, images, and videos. Outputs can be integrated into game engine

applicationsclem-delangue--x
16 Apr 2026
Agents

Highlights: 👉 Configurable thinking mode for step-by-step reasoning 👉 Multimodal understanding with text and image input, including docume…

DGX agent

Highlights: 👉 Configurable thinking mode for step-by-step reasoning 👉 Multimodal understanding with text and image input, including document parsing and OCR 👉 Native function calling with structured t

agentstogether-ai--x
9 Apr 2026
Local Ai

🚀 Introducing MiniCPM-V 4.7, our new open-source MLLM series! Advancing the Performance–Efficiency Pareto Frontier. It brings strong multim…

DGX agent

🚀 Introducing MiniCPM-V 4.7, our new open-source MLLM series! Advancing the Performance–Efficiency Pareto Frontier. It brings strong multimodal capabilities to iOS and Android devices with extreme eff

local-aiclem-delangue--x
12 Oct 2026
Model Releases

Today, our group at @Mila_Quebec and the lab of @francesarnold at @Caltech just released a new paper I contributed to, exploring how multimo…

DGX agent

Today, our group at @Mila_Quebec and the lab of @francesarnold at @Caltech just released a new paper I contributed to, exploring how multimodal generative modeling could accelerate protein sciences! ⬇

model-releasesyoshua-bengio--x
8 Apr 2026
Model Releases

Today, we are launching a preview of our new model, Mistral Large 4 (ML4), aka le Chonk 🐈. ML4 is a 1T-parameter model with 49B active para…

DGX agent

Today, we are launching a preview of our new model, Mistral Large 4 (ML4), aka le Chonk 🐈. ML4 is a 1T-parameter model with 49B active parameters, trained natively with multimodal capabilities. It is

model-releasesarthur-mensch--x
6 Oct 2026
Applications

API is live on QwenCloud: https://www.qwencloud.com/models/qwen3.8-flash 🙌Let's build something!

DGX agent

API is live on QwenCloud: https://www.qwencloud.com/models/qwen3.8-flash 🙌Let's build something! ⚡Meet Qwen3.8-Flash, a multimodal MoE and an early preview of the Qwen4 architecture, now open-weight!

applicationsqwen--x
26 Aug 2026
Model Releases

BREAKING: GLM-5.3 Flash by @Zai_org debuts at 6th overall on Design Arena with a preliminary Elo of 1343. This places the MIT-licensed, nati…

DGX agent

BREAKING: GLM-5.3 Flash by @Zai_org debuts at 6th overall on Design Arena with a preliminary Elo of 1343. This places the MIT-licensed, natively multimodal model in the same performance band as GLM-5.

model-releaseszhipu-ai--x
26 Aug 2026
Model Releases

Whoa, Meta released a new open-weight LLM yesterday, something that hasn't happened since the good old Llama days. Their Meta Muse Glimmer m…

DGX agent

Whoa, Meta released a new open-weight LLM yesterday, something that hasn't happened since the good old Llama days. Their Meta Muse Glimmer model is a 30B multimodal reasoning model with a Gemma-like a

model-releasessebastian-raschka--x
11 Aug 2026
Research

Not because Andrej is saying it but I think voice is goated. And you can mix it with other modalities for even richer prompting. I recorded …

DGX agent

Not because Andrej is saying it but I think voice is goated. And you can mix it with other modalities for even richer prompting. I recorded a session a few weeks back to demo the power of multimodal p

researchdair-ai--x
21 Jul 2026
Model Releases

Balanced Performance Across Artistic Styles: More uniform quality across diverse aesthetic domains, effectively reducing style-dependent qua…

DGX agent

Qwen's latest model improvements focus on achieving more consistent and uniform performance quality across different artistic styles and aesthetic domains, reducing the variability in output quality t

model-releasesqwen--x
25 Apr 2026
Agents

zero shot Kimi K2.6, go try it out its a good model sir! this is @Kimi_Moonshot running on @togethercompute, @opencode harness prompt below…

DGX agent

zero shot Kimi K2.6, go try it out its a good model sir! this is @Kimi_Moonshot running on @togethercompute, @opencode harness prompt below👇 Media Introducing Kimi K2.6 from @Kimi_Moonshot, a multimod

agentstogether-ai--x
23 Apr 2026
Model Releases

Introducing Gemma 4 31B from @GoogleDeepMind on Together AI. AI natives can now use Gemma 4 31B on Together and benefit from reliable infere…

DGX agent

Introducing Gemma 4 31B from @GoogleDeepMind on Together AI. AI natives can now use Gemma 4 31B on Together and benefit from reliable inference for multimodal reasoning, tool use, and agentic workflow

model-releasestogether-ai--x
9 Apr 2026
Model Releases

That one took some groundwork. Trained and served on our own compute, and RL shows no sign of saturation

DGX agent

That one took some groundwork. Trained and served on our own compute, and RL shows no sign of saturation Meet Mistral Large 4, aka Le Chonk. • 1T parameters, natively multimodal. 49B active. It is the

model-releasesarthur-mensch--x
6 Oct 2026
Model Releases

We’re so back.

DGX agent

We’re so back. Meet Mistral Large 4, aka Le Chonk. • 1T parameters, natively multimodal. 49B active. It is the best open weights model from US or Europe on aggregated benchmarks. • State-of-the-art on

model-releaseslm-studio--x
6 Oct 2026
Local Ai

Clef Flash: https://ollama.com/library/clef-flash Clef: https://ollama.com/library/clef

DGX agent

Clef Flash (9 billion‑parameter) is a multimodal model hosted on Ollama that converts a given state and a schema of typed questions into actionable decisions. Its counterpart, Clef, is also available

local-aiollama--x
3 Oct 2026
Model Releases

The era of omni agents is upon us. This is a great report by the Qwen Team on their omni-modal agents. They present Qwen3.8-Omni-Flash, a na…

DGX agent

The era of omni agents is upon us. This is a great report by the Qwen Team on their omni-modal agents. They present Qwen3.8-Omni-Flash, a natively multimodal model trained for long-horizon agent tasks

model-releasesdair-ai--x
25 Sept 2026
Model Releases

GLM-5.3-Flash is live in Hermes Agent via Nous Portal https://portal.nousresearch.com

DGX agent

GLM-5.3-Flash is live in Hermes Agent via Nous Portal https://portal.nousresearch.com Introducing GLM-5.3-Flash - Leading capabilities at a highly competitive price - Natively multimodal with a 1M-tok

model-releasesnous-research--x
26 Aug 2026
Applications

You can literally run Opus 4.6 Max-level intelligence on a MacBook Pro. Locally.

DGX agent

You can literally run Opus 4.6 Max-level intelligence on a MacBook Pro. Locally. We promised open weights for Qwen3.8. Now, time to meet them! 🎉 ⚡ Qwen3.8-27B: - A native multimodal dense model. With

applicationsclem-delangue--x
15 Aug 2026
Applications

One thing I am kind of surprised by is that full multi-modal (any-any) models have not become a bigger deal. It seems Google is the only Lab…

DGX agent

One thing I am kind of surprised by is that full multi-modal (any-any) models have not become a bigger deal. It seems Google is the only Lab releasing these, OpenAI uses selective multimodal capabilit

applicationsethan-mollick--x
13 Jul 2026
Hardware

First technical Deepdive on M3 on the internet😎

DGX agent

First technical Deepdive on M3 on the internet😎 MiniMax-M3 combines 1M context, native multimodality, and MiniMax Sparse Attention. The next layer is serving it efficiently: KV-block-major sparse atte

hardwaretogether-ai--x
2 Jun 2026
Model Releases

Can’t wait for Gemini Omni in @NotebookLM cinematic explainer videos 👀

DGX agent

Emad Mostaque expressed anticipation for the integration of Google's Gemini Omni multimodal AI model into NotebookLM's cinematic explainer video generation features. The post suggests potential upcomi

model-releasesemad-mostaque--x
19 May 2026
Model Releases

Google’s new Gemini 3.5 Flash is the clear leader on the Intelligence vs Speed Pareto frontier and makes large gains on GDPval-AA (real-worl…

DGX agent

Google’s new Gemini 3.5 Flash is the clear leader on the Intelligence vs Speed Pareto frontier and makes large gains on GDPval-AA (real-world agentic tasks), but is 5x the cost of Gemini 3 Flash @Goog

model-releasesjeremy-howard--x
19 May 2026
Model Releases

⚡ Meet Qwen3.6-35B-A3B:Now Open-Source!🚀🚀 A sparse MoE model, 35B total params, 3B active. Apache 2.0 license. 🔥 Agentic coding on par wi…

DGX agent

⚡ Meet Qwen3.6-35B-A3B:Now Open-Source!🚀🚀 A sparse MoE model, 35B total params, 3B active. Apache 2.0 license. 🔥 Agentic coding on par with models 10x its active size 📷 Strong multimodal perception an

model-releasesjeremy-howard--x
16 Apr 2026
Agents

@AIatMeta Together Serverless Inference gives developers a high-throughput, managed production path for running Muse Spark Open across agent…

DGX agent

@AIatMeta Together Serverless Inference gives developers a high-throughput, managed production path for running Muse Spark Open across agentic coding and multimodal workloads. Start building: https://

agentstogether-ai--x
15 Oct 2026
Local Ai

What if Spotlight actually understood the meaning inside your files? DigUp is an open-source macOS menu bar app powered by EmbeddingGemma 2 …

DGX agent

What if Spotlight actually understood the meaning inside your files? DigUp is an open-source macOS menu bar app powered by EmbeddingGemma 2 that brings 100% local, multimodal semantic search to your M

local-aigeorgi-gerganov--x
13 Oct 2026
Industry

We’re open-sourcing pplx-embed-v2-late, multi-vector embeddings for text and images, 9B and 0.6B, in one shared embedding space. You can use…

DGX agent

We’re open-sourcing pplx-embed-v2-late, multi-vector embeddings for text and images, 9B and 0.6B, in one shared embedding space. You can use these to index multimodal data with 9B, and query on device

industryclem-delangue--x
7 Oct 2026
Model Releases

deepseek v4.1 flash has arrived on together ai it beats gpt-5.6 sol on agentic benchmarks at one third the cost per task the model supports …

DGX agent

deepseek v4.1 flash has arrived on together ai it beats gpt-5.6 sol on agentic benchmarks at one third the cost per task the model supports a 1m context window and native multimodal input, with 552b t

model-releasestogether-ai--x
13 Sept 2026
Model Releases

an underrated part of glm-5.3 is its low hallucination rate claude fable 5 is over 2x higher, while gpt-5.6 luna is over 3x higher

DGX agent

GLM‑5.3 demonstrates a notably lower hallucination rate compared with other contemporary large language models. According to a report by Together AI at TogetherCompute (published August 30 2026), Clau

model-releasestogether-ai--x
30 Aug 2026
Model Releases

GLM-5.3-Flash by @Zai_org, aka Ox Alpha, is now live in LM Studio Bionic! This model surpasses GLM 5.2 in performance while being 9-10x chea…

DGX agent

GLM-5.3-Flash by @Zai_org, aka Ox Alpha, is now live in LM Studio Bionic! This model surpasses GLM 5.2 in performance while being 9-10x cheaper. It also supports image input. In Bionic, this model is

model-releaseslm-studio--x
26 Aug 2026
Safety

If the AI comes for us, maybe we can all hide in Venecky.

DGX agent

Gary Marcus notes that multimodal large‑language models are likely to struggle with map interpretation. In a tongue‑in‑cheek post he suggests that by 2026—if AI poses a threat—people could seek refuge

safetygary-marcus--x
22 Aug 2026
Agents

Together Serverless Inference gives developers a high-throughput, managed production path for running Muse Glimmer across agentic and multim…

DGX agent

Together Serverless Inference gives developers a high-throughput, managed production path for running Muse Glimmer across agentic and multimodal workloads. Start building: https://www.together.ai/mode

agentstogether-ai--x
10 Aug 2026
Agents

Together AI gives developers a high-throughput production path for running Inkling-Small on @NVIDIAAI Accelerated Infrastructure across mult…

DGX agent

Together AI gives developers a high-throughput production path for running Inkling-Small on @NVIDIAAI Accelerated Infrastructure across multimodal, coding, and agentic workloads. Start building: https

agentstogether-ai--x
31 Jul 2026
Hardware

Together AI gives developers a high-throughput production path for running Inkling-Small on NVIDIA Accelerated Infrastructure across multimo…

DGX agent

Together AI gives developers a high-throughput production path for running Inkling-Small on NVIDIA Accelerated Infrastructure across multimodal, coding, and agentic workloads. Start building: https://

hardwaretogether-ai--x
31 Jul 2026
← Previous
1234…7
Next →