AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries126,600
  • Agents10,613
  • Applications7,144
  • Companies3
  • Concepts7
  • Hardware2,770
  • Industry6,809
  • Local Ai6,993
  • Model Releases36,508
  • Research29,590
  • Safety19,569
  • Syntheses31
  • Tools1,780
  • Tutorials4,783

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries126,600
  • Agents10,613
  • Applications7,144
  • Companies3
  • Concepts7
  • Hardware2,770
  • Industry6,809
  • Local Ai6,993
  • Model Releases36,508
  • Research29,590
  • Safety19,569
  • Syntheses31
  • Tools1,780
  • Tutorials4,783

Source
126,600Total entries
60Added by human
126,540Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
298 results
Model Releases

This is a neat feature. I wrote an article a few weeks back about how I built this into my agent orchestrator: https://x.com/omarsar0/status…

DGX agent

This is a neat feature. I wrote an article a few weeks back about how I built this into my agent orchestrator: https://x.com/omarsar0/status/2073404610501329247?s=20 But I made it multimodal from the

model-releasesdair-ai--x
21 Jul 2026
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Tools

The best base model for training isn't about someone else's benchmarks. Excited to offer @thinkymachines' first open-weights model: Inkling.…

DGX agent

The best base model for training isn't about someone else's benchmarks. Excited to offer @thinkymachines' first open-weights model: Inkling. 975B MoE, multimodal, with Apache 2.0. A great foundation f

toolsfireworks-ai--x
15 Jul 2026
Industry

Grok 4.5 Review

DGX agent

Grok 4.5 is an AI language model developed by xAI, featuring improvements in reasoning, coding, and multimodal capabilities compared to earlier versions. The model demonstrates enhanced performance ac

industryelon-musk--x
11 Jul 2026
Research

What if a routine breast cancer H&E slide could help answer a hard question: how likely is this cancer to come back? Our @NatureComms paper …

DGX agent

What if a routine breast cancer H&E slide could help answer a hard question: how likely is this cancer to come back? Our @NatureComms paper introduces a multimodal AI test for recurrence risk across i

researchyann-lecun--x
6 Jul 2026
Model Releases

Gemini Omni Flash can swap objects, change environments, and make targeted edits to existing videos using simple text prompts. To try this w…

DGX agent

Gemini 2 Flash, Google's multimodal AI model, enables video editing capabilities including object swapping, environment changes, and targeted edits through simple text prompts. The feature allows user

model-releasescomfyui--x
1 Jul 2026
Agents

Everyone talks about 1M context. The harder part is making 1M context actually usable. Serving MiniMax M3 required optimizing for long-conte…

DGX agent

Everyone talks about 1M context. The harder part is making 1M context actually usable. Serving MiniMax M3 required optimizing for long-context, multimodal, and agentic workloads simultaneously. Excite

agentstogether-ai--x
2 Jun 2026
Agents

Step 3.7 Flash is now free for 30 days via Nous Portal It is a new MoE vision-language model focused on agent efficiency, coding, search, an…

DGX agent

Step 3.7 Flash is now free for 30 days via Nous Portal It is a new MoE vision-language model focused on agent efficiency, coding, search, and multimodal workflows — and Hermes Agent users have been lo

agentsnous-research--x
30 May 2026
Model Releases

Some fun Gemini Omni use cases from the community 🧵👇

DGX agent

This X thread from Google AI showcases community-created use cases and applications of Gemini Omni, Google's multimodal AI model. The post likely highlights practical and creative examples of how user

model-releasesgoogle-ai--x
29 May 2026
Model Releases

By now, you've probably heard about Gemini Omni, our new model designed to create anything from any input, starting with video. But... what'…

DGX agent

Google AI announced Gemini Omni, a new multimodal model capable of generating diverse content types from various input formats, with initial focus on video generation capabilities. The model represent

model-releasesgoogle-ai--x
19 May 2026
Model Releases

Some fun Gemini Omni use cases from the community👇🧵 (We’ll keep updating this thread throughout the day)

DGX agent

This X thread from Google AI showcases practical and creative applications of Gemini Omni, Google's multimodal AI model, as demonstrated and shared by the user community. The thread appears to be a cu

model-releasesgoogle-ai--x
19 May 2026
Agents

Technical highlights: CogViT Vision Encoder - Built with dual-teacher distillation: SigLIP2 for semantics, DINOv3 for texture. A two-stage r…

DGX agent

Technical highlights: CogViT Vision Encoder - Built with dual-teacher distillation: SigLIP2 for semantics, DINOv3 for texture. A two-stage recipe, masked modeling, then contrastive pretraining, with Q

agentszhipu-ai--x
7 May 2026
Agents

Highlights: 👉 1M context for long-horizon agentic workflows 👉 Stronger agentic coding across frontend, repo-level, and terminal-based task…

DGX agent

Highlights: 👉 1M context for long-horizon agentic workflows 👉 Stronger agentic coding across frontend, repo-level, and terminal-based tasks 👉 Multimodal reasoning across text, image, and video inputs

agentstogether-ai--x
29 Apr 2026
Model Releases

Excited to support @NVIDIA Nemotron 3 Nano Omni, now available on Fireworks. It's the first open model that handles vision, audio, video, an…

DGX agent

Excited to support @NVIDIA Nemotron 3 Nano Omni, now available on Fireworks. It's the first open model that handles vision, audio, video, and text in a single inference loop. Built for multimodal sub-

model-releasesfireworks-ai--x
28 Apr 2026
Model Releases

Read the blog: https://www.together.ai/blog/together-ai-brings-nvidia-nemotron-3-nano-omni-to-developers-on-day-0#

DGX agent

Together AI announced the availability of NVIDIA Nemotron-3 Nano Omni models to developers on day zero of release, enabling early access to these multimodal AI models through their platform. The annou

model-releasestogether-ai--x
28 Apr 2026
Model Releases

Try now: https://www.together.ai/models/nvidia-nemotron-3-nano-omni#

DGX agent

NVIDIA Nemotron-3 Nano Omni is now available to try through Together AI's platform, offering access to a compact multimodal model capable of processing both text and audio inputs. This announcement hi

model-releasestogether-ai--x
28 Apr 2026
Model Releases

Comprehensive Multilingual Text Rendering: Better glyph accuracy, more consistent typography, and cleaner layouts even in complex compositio…

DGX agent

Comprehensive Multilingual Text Rendering: Better glyph accuracy, more consistent typography, and cleaner layouts even in complex compositions. It handles mixed-language scenarios more gracefully as w

model-releasesqwen--x
25 Apr 2026
Industry

Grok 4.3 can Take in Video and Extract Audio files

DGX agent

Grok 4.3, an AI model by xAI, has been updated with multimodal capabilities enabling it to process video input and extract audio from video files. This enhancement expands Grok's functionality beyond

industryelon-musk--x
17 Apr 2026
Industry

Grok 4.3 is still an early beta that will improve almost every day, but try it out! We will publish release notes as we fix bugs and add fun…

DGX agent

Grok 4.3 is still an early beta that will improve almost every day, but try it out! We will publish release notes as we fix bugs and add functionality. Grok 4.3 beta is natively multimodal, and the fr

industryelon-musk--x
17 Apr 2026
Local Ai

Cool mlx-vlm segmentation demo by @Prince_Canuma at @aiDotEngineer You can do so much with it

DGX agent

Prince Canuma (GitHub: Blaizzy) demonstrated image segmentation capabilities using mlx-vlm at the AI Engineer event, showcasing the library's versatility beyond standard vision-language tasks. mlx-...

local-aiswyx--x
10 Apr 2026
Model Releases

Share your Gemma 4 builds or the model variants you’re training in the replies below!

DGX agent

Google released Gemma 4 in April 2025 as its most capable open-weight model family to date, built on the same research as Gemini 3 and licensed under Apache 2.0 for unrestricted commercial use, fin...

model-releasesgoogle-ai--x
10 Apr 2026
Model Releases

Meet NVIDIA Nemotron 3.5 Super VL Our new open model combines reasoning and tool use with text, image, document, and video understanding for…

DGX agent

Meet NVIDIA Nemotron 3.5 Super VL Our new open model combines reasoning and tool use with text, image, document, and video understanding for long-running AI agents. 120B total parameters with 12B acti

model-releasesclem-delangue--x
15 Oct 2026
Model Releases

Mistral 4 is pretty good at lawyer bench and cyber security bench, but give it's European heritage, one can only assume it's also good at re…

DGX agent

Mistral 4 is pretty good at lawyer bench and cyber security bench, but give it's European heritage, one can only assume it's also good at regulation bench Meet Mistral Large 4, aka Le Chonk. • 1T para

model-releasesdylan-patel--x
6 Oct 2026
Model Releases

Super excited about this and I know weights are coming (https://huggingface.co/mistralai/Mistral-Large-4.0-1T05-A52B) but just to be fair, y…

DGX agent

Super excited about this and I know weights are coming (https://huggingface.co/mistralai/Mistral-Large-4.0-1T05-A52B) but just to be fair, you can't be the best open-weight model if you're not open-we

model-releasesclem-delangue--x
6 Oct 2026
Agents

We analyzed a year of agent research across 4 tasks: deep research, RAG indexing, agentic search and coding. Found that first asking ‘Is thi…

DGX agent

We analyzed a year of agent research across 4 tasks: deep research, RAG indexing, agentic search and coding. Found that first asking ‘Is this task verifiable?’ exposed inefficiencies in the agent arch

agentsai21-labs--x
6 Oct 2026
Model Releases

Cool to see classification models resurge in the era of agents. The effects of Jev are insane. Also very cool to see our emotion dataset bui…

DGX agent

Cool to see classification models resurge in the era of agents. The effects of Jev are insane. Also very cool to see our emotion dataset built at @dair_ai used to test this new model, Julia-1. I spent

model-releasesdair-ai--x
27 Sept 2026
Research

One hope for Tinker is that it can handle all the ML infra for posttraining for (approximately) everyone. So, curious, what prevents you fro…

DGX agent

One hope for Tinker is that it can handle all the ML infra for posttraining for (approximately) everyone. So, curious, what prevents you from using Tinker for all your posttraining needs? Speed? Cost?

researchsoumith-chintala--x
21 Sept 2026
Model Releases

Banger release from NVIDIA. They just published a report on NeMo Data Designer, their open-source synthetic data tool. It's a declarative co…

DGX agent

Banger release from NVIDIA. They just published a report on NeMo Data Designer, their open-source synthetic data tool. It's a declarative config which makes a synthetic data pipeline easy to review, s

model-releasesdair-ai--x
17 Sept 2026
Model Releases

Another goated release by DeepSeek. Open weight, btw. Outperforms Opus 5 on key benchmarks, btw. Lower prices too. Looks like an extremely e…

DGX agent

Another goated release by DeepSeek. Open weight, btw. Outperforms Opus 5 on key benchmarks, btw. Lower prices too. Looks like an extremely efficient model. What a legendary run. 🚀 Introducing DeepSeek

model-releasesdair-ai--x
10 Sept 2026
Industry

MINT is now open source. From first-person RGB video, MINT reconstructs 3D camera trajectories and bimanual hand motion in a shared world co…

DGX agent

MINT is now open source. From first-person RGB video, MINT reconstructs 3D camera trajectories and bimanual hand motion in a shared world coordinate system. Reconstructed human hand motion can also be

industryemad-mostaque--x
10 Sept 2026
Model Releases

Jensen Huang says that AGI has been achieved. I strongly disagree. GPT-6 performs really well on benchmarks, including ARC-AGI-3. But benchm…

DGX agent

Jensen Huang says that AGI has been achieved. I strongly disagree. GPT-6 performs really well on benchmarks, including ARC-AGI-3. But benchmark performance is not the same as general intelligence. GPT

model-releasesgary-marcus--x
7 Sept 2026
Model Releases

Don't count out Gemini just yet. Feels like a new era of model releases. Models are so powerful that they now come with cyber variants. Love…

DGX agent

Don't count out Gemini just yet. Feels like a new era of model releases. Models are so powerful that they now come with cyber variants. Love the pricing on Gemini 3.8 Flash. Performance not bad. Gemin

model-releasesdair-ai--x
2 Sept 2026
Model Releases

DeepSeek V4 Flash now comes with native vision on Fireworks. Available now on serverless and priority tiers. Better benchmarks than the text…

DGX agent

DeepSeek V4 Flash now comes with native vision on Fireworks. Available now on serverless and priority tiers. Better benchmarks than the text-only 0731 version at the same low price: 0.22 input / 0.66

model-releasesfireworks-ai--x
1 Sept 2026
Applications

Impressive new work from Google DeepMind showing real-world applications of agents for scientific research.

DGX agent

Impressive new work from Google DeepMind showing real-world applications of agents for scientific research. Impressive new paper from Google DeepMind. (bookmark it) It takes Co-Scientist out of simula

applicationsdair-ai--x
28 Aug 2026
Hardware

Amazing! 🥳 Thanks @vllm_project for getting Qwen3.8-Flash-Next running on NVIDIA and AMD from day 0.

DGX agent

Amazing! 🥳 Thanks @vllm_project for getting Qwen3.8-Flash-Next running on NVIDIA and AMD from day 0. Qwen3.8-Flash-Next from @Alibaba_Qwen has day-0 support in vLLM, verified on NVIDIA and AMD GPUs. 🎉

hardwareqwen--x
26 Aug 2026
Research

Brilliant new paper from Meta. LLM judges get validated on accuracy against golden data. That says nothing about whether the verdict survive…

DGX agent

Brilliant new paper from Meta. LLM judges get validated on accuracy against golden data. That says nothing about whether the verdict survives when questioned. The Wiggle Framework stress-tests 9 front

researchdair-ai--x
14 Aug 2026
Agents

Max-level intelligence, one API call away. Qwen3.8-2.4T-A95B is now live on DeepInfra, ready for your creative builds. 🥳 Take a deep dive o…

DGX agent

Max-level intelligence, one API call away. Qwen3.8-2.4T-A95B is now live on DeepInfra, ready for your creative builds. 🥳 Take a deep dive on DeepInfra! @DeepInfra New on DeepInfra: Qwen3.8-2.4T-A95B 🚀

agentsqwen--x
14 Aug 2026
Model Releases

Meta returns to open weights: Muse Glimmer, its first open-weights release since Llama 4, scores 35 on the Artificial Analysis Intelligence …

DGX agent

Meta returns to open weights: Muse Glimmer, its first open-weights release since Llama 4, scores 35 on the Artificial Analysis Intelligence Index. It is a 30B-parameter model, and the first from Meta

model-releasesyann-lecun--x
10 Aug 2026
Agents

A quick snapshot of where Qwen3.8-Max stands today: Qwen3.8-Max now ranks #5 on the Artificial Analysis Intelligence Index, and #1 on the Ag…

DGX agent

Qwen 3.8‑Max, Alibaba’s latest large language model, was reported on August 6 2026 to rank **#5** on the Artificial Analysis Intelligence Index and **#1** on the Agentic Index. These rankings position

agentsqwen--x
6 Aug 2026
Model Releases

Harness choice is a big deal. So much room to advance and improve results across the board with agent harnesses. Great paper highlighting th…

DGX agent

Harness choice is a big deal. So much room to advance and improve results across the board with agent harnesses. Great paper highlighting this. New research releases DataSpace, a benchmark where data

model-releasesdair-ai--x
5 Aug 2026
Model Releases

Your design, your model. Create with your pick of the world's leading models, including Claude, GPT-5, Gemini, Kimi, and GLM. Compare output…

DGX agent

Your design, your model. Create with your pick of the world's leading models, including Claude, GPT-5, Gemini, Kimi, and GLM. Compare outputs across model families and keep the result that nails it. O

model-releasesreplit--x
1 Aug 2026
Agents

Since launching Qwen3.8-Max-Preview, we've received valuable feedback from developers! To help users better explore Qwen3.8's agentic capabi…

DGX agent

Since launching Qwen3.8-Max-Preview, we've received valuable feedback from developers! To help users better explore Qwen3.8's agentic capabilities, we're officially launching the #QwenGrowthPlan today

agentsqwen--x
28 Jul 2026
Tutorials

// Global Workspace in LLMs // arXiv paper for the popular J-space work from Anthropic. (bookmark it) The short recap: If you build on chain…

DGX agent

// Global Workspace in LLMs // arXiv paper for the popular J-space work from Anthropic. (bookmark it) The short recap: If you build on chain-of-thought or steering vectors, this work provides a mechan

tutorialsdair-ai--x
20 Jul 2026
Tutorials

New research from Google DeepMind on effective model routing. LLM routers get judged on accuracy and cost. Both can look great while the rou…

DGX agent

New research from Google DeepMind on effective model routing. LLM routers get judged on accuracy and cost. Both can look great while the router is meaningless. If every model in your society responds

tutorialsdair-ai--x
14 Jul 2026
Model Releases

Standard RL benchmarks are episodic and stationary, so they don't capture the the characteristics of real-world deployment. Morpheus is a ne…

DGX agent

Standard RL benchmarks are episodic and stationary, so they don't capture the the characteristics of real-world deployment. Morpheus is a new benchmark for continual learning that provides persistent

model-releasesfrancois-chollet--x
13 Jul 2026
Agents

Most agentic retrieval demos assume clean, well-structured documents. Enterprise reality is often different, consisting of messy PDFs where …

DGX agent

Most agentic retrieval demos assume clean, well-structured documents. Enterprise reality is often different, consisting of messy PDFs where critical information is buried across tables, figures, and c

agentsjerry-liu--x
6 Jul 2026
Model Releases

Thrilled to announce the Wearable AI Workshop at ECCV 2026 🎉 that we're organizing with an awesome group of folks across Meta Reality Labs,…

DGX agent

Thrilled to announce the Wearable AI Workshop at ECCV 2026 🎉 that we're organizing with an awesome group of folks across Meta Reality Labs, AMI Labs, HKUST, Georgia Tech, UCF, and U. of Edinburgh. If

model-releasesyann-lecun--x
30 Jun 2026
Model Releases

In this episode, @OpenAI Chief Research Officer @markchen90 joins @allenpark to flambé shrimp, cook Korean stew, and chat about being at the…

DGX agent

In this episode, @OpenAI Chief Research Officer @markchen90 joins @allenpark to flambé shrimp, cook Korean stew, and chat about being at the frontier of AI research: why scaling laws and pre-training

model-releasesswyx--x
25 Jun 2026
Applications

Lem & Douglas Adams got AI right Presciently Golem XIV (from 1981) has an illustration of the jagged frontier as explained by an AI, Golem (…

DGX agent

Lem & Douglas Adams got AI right Presciently Golem XIV (from 1981) has an illustration of the jagged frontier as explained by an AI, Golem (GENERAL OPERATOR, LONG-RANGE, ETHICALLY STABILIZED, MULTIMOD

applicationsethan-mollick--x
28 May 2026
← Previous
12345…7
Next →