AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,119 results
16 Oct 2026

Perception or Reasoning? Diagnosing and Tackling Reinforcement Learning Bottlenecks in VLMs

Model ReleasesDGX agent

arXiv:2610.21380v1 Announce Type: new Abstract: Reinforcement learning has brought strong gains to language model reasoning, but its improvements on visual tasks remain less consistent. One difficulty

Realtime-Bench: Can Frontier Models Solve Real-time Interactive Problems?

ResearchDGX agent

arXiv:2610.22155v1 Announce Type: new Abstract: Real-time interaction requires agents to perceive evolving environments and act under temporal constraints, yet existing evaluations of real-time stream

Reinforcement Learning-driven Diffusion Models: Language, Vision, and Beyond

AgentsDGX agent

arXiv:2610.21539v1 Announce Type: new Abstract: Diffusion models (DMs) have steadily demonstrated outstanding performance in high-fidelity, controllable generation across diverse scenarios, following

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

Semantic Alignment of EEG and Text: A Contrastive Learning Framework for Decoding Imagined Speech

SafetyDGX agent

arXiv:2610.20766v1 Announce Type: new Abstract: Imagined speech decoding from EEG offers a promising route toward naturalistic brain-computer interfaces. Traditional closed-set classifiers treat seman

Sub-Millisecond Reflexes for Continuous Physical Human-Robot Interaction

SafetyDGX agent

arXiv:2610.21913v1 Announce Type: new Abstract: Continuous physical human-robot interaction requires robots to rapidly adapt their control behaviour without interrupting task execution. However, exist

Text-to-Image Synthesis: A Decade Survey

SafetyDGX agent

arXiv:2411.16164v2 Announce Type: replace Abstract: Text-to-image synthesis (T2I) focuses on generating high-quality images from textual descriptions In this survey, we review 490 papers on T2I spanni

Tool-Augmented Large Language Models for Reliable Medical Calculation from Patient Notes

Model ReleasesDGX agent

arXiv:2610.21477v1 Announce Type: new Abstract: Medical calculators translate raw patient observations into clinically actionable values and scores. However, applying these calculators directly to fre

VELD-QA: A Large-Scale Dataset for Visual Evidence Grounding and Question Answering in Long Documents

Model ReleasesDGX agent

arXiv:2610.20964v1 Announce Type: cross Abstract: Existing long-document QA benchmarks rarely combine large-scale human-authored questions with detailed visual evidence annotations, limiting diagnosis

Visual Sanad: Auditing Vision-Language Models for False Acceptance of Qur'anic Citations

Model ReleasesDGX agent

arXiv:2610.22009v1 Announce Type: new Abstract: Vision-language models (VLMs) are increasingly used to interpret religious, educational, and culturally sensitive visual content, yet their reliability

VisualTrust: Video Reasoning under On-Screen Claim Framing

Model ReleasesDGX agent

arXiv:2610.21159v1 Announce Type: new Abstract: On-screen text can describe what a video shows, or it can frame what the video is supposed to mean. Current benchmarks treat both alike, testing whether

What Should Robot Policies Learn to Predict? Rethinking Supervision Targets in Vision-Language-Action Learning

SafetyDGX agent

arXiv:2610.21915v1 Announce Type: new Abstract: Vision-language-action (VLA) policies are typically trained with action prediction as the primary supervision signal, since robots ultimately execute ac

15 Oct 2026

A big Google strength in AI has always been finding interesting uses for the models they have. They pioneered deep research, podcasting-from…

Model ReleasesDGX agent

A big Google strength in AI has always been finding interesting uses for the models they have. They pioneered deep research, podcasting-from-information and all of NotebookLM etc. With Gemini 4, haven

ADAPT: Audio-Depth Action Planning with Transition-Aware Rewards for Lights-Out Industrial Navigation

Model ReleasesDGX agent

arXiv:2610.15956v1 Announce Type: new Abstract: Vision-language-action models for embodied navigation typically rely on RGB observations, limiting their applicability in lights-out industrial environm

AlignPoison: Conditional Targeted Poisoning of Generative Recommenders via Decoding-Aligned Prefixes

SafetyDGX agent

arXiv:2610.14487v1 Announce Type: new Abstract: Generative recommendation models based on autoregressive decoding have been adopted as alternatives to classical ranking-based systems. While their mode

BFHD: Bidirectional Feature Harmonization Decomposition for Heterogeneous Clinical Assessments

ResearchDGX agent

arXiv:2610.19352v1 Announce Type: new Abstract: Clinical assessments are often collected using heterogeneous assessment systems across centers and time, leading to records that mix different but relat

Can Learning to Answer Spatial Questions Improve Novel-View Generation?

ResearchDGX agent

arXiv:2610.20610v1 Announce Type: new Abstract: Generating novel views from limited observations requires preserving both the appearance and spatial structure of a scene. Although recent approaches ex

Cortex: Consolidating Context into Parametric Memory

ResearchDGX agent

arXiv:2610.20399v1 Announce Type: new Abstract: Context can improve large language model performance, but these gains may be lost after context removal. Inspired by biological systems consolidation, w

Customers love choice! @AIatMeta Muse Spark Open and @nvidia Nemotron 3.5 Super VL are now available on the Dell Enterprise Hub with @huggin…

Model ReleasesDGX agent

Customers love choice! @AIatMeta Muse Spark Open and @nvidia Nemotron 3.5 Super VL are now available on the Dell Enterprise Hub with @huggingface 🤗 https://dell.huggingface.co/updates/muse-spark-open-

DecisionRobust: Benchmarking Robustness for JEV Style Decision Models Across Text and Vision

Model ReleasesDGX agent

arXiv:2610.19118v1 Announce Type: new Abstract: Emerging decision models such as JEV provide typed interfaces that map task instructions and observations directly to choices, judgments, and scores. As

Eigen-Agent: Adaptive Multi-Agent Scientific Reasoning with Monitor-Based RAG

AgentsDGX agent

arXiv:2509.21193v2 Announce Type: replace Abstract: Large language models (LLMs) have recently shown strong progress on scientific reasoning, yet two major bottlenecks remain. First, explicit retrieva

Empowering Edge Agents: A Systematic Analysis of Edge-Cloud Collaboration in LLM Agent Execution

Model ReleasesDGX agent

arXiv:2610.17816v1 Announce Type: new Abstract: Edge-cloud collaboration combines the lower inference overhead and greater data locality of edge-side execution with the stronger capabilities of cloud-

EvoWeb: A Benchmark for Coding Agents on Evolving Web Applications

Model ReleasesDGX agent

arXiv:2610.16402v1 Announce Type: new Abstract: Web application development often proceeds through successive requests that extend an existing implementation. Yet web-generation benchmarks primarily e

FLUX 3 Image Klein: Open weights image generation and editing

Model ReleasesDGX agent

Black Forest Labs (BFL), the frontier AI research lab building visual intelligence, today announced the open weights release of FLUX 3 Image Klein, its most capable open weights image model to date. F

From Triage to Impact: A Multi-Hop Reasoning Benchmark for Explainable Persian Hate Speech

Model ReleasesDGX agent

arXiv:2610.20370v1 Announce Type: new Abstract: Hate speech has become increasingly prevalent on social media, raising concerns about its detection, interpretation, and moderation. Persian, a relative

Geometric Alignment without Functional Equivalence: A Layer-wise Analysis of the Speech-Text Modality Gap

SafetyDGX agent

arXiv:2603.01502v2 Announce Type: replace Abstract: End-to-end speech large language models (LLMs) often answer the same question less accurately from speech than from text, even when the spoken conte

Geospatial Vector Geometry as a Native Spatial Modality for Vision-Language Models

ApplicationsDGX agent

arXiv:2610.16769v1 Announce Type: new Abstract: Geospatial reasoning links VLMs to real-world action and decision making. Reliable reasoning requires accurate spatial information and effective spatial

Joint Discrete and SE(3) Diffusion for Protein Interface Design

ResearchDGX agent

arXiv:2610.14699v1 Announce Type: new Abstract: The design of high-affinity, target-specific protein binders is central to the development of modern therapeutics. However, existing protein-generation

Learning Adaptive Deliberation Control for Reliable Recognition with Multi-Agent Language Models

SafetyDGX agent

arXiv:2610.17840v1 Announce Type: new Abstract: Multi-agent deliberation can improve recognition by criticizing and revising candidate answers, but fixed controls cannot respond to changes in disagree

Learning How to Remember: Memory Modality Selection for GUI Agents

TutorialsDGX agent

arXiv:2610.17928v1 Announce Type: new Abstract: Recent advances in vision-language models (VLMs) have substantially improved the capabilities of GUI agents, while memory augmentation has emerged as a

Long-Horizon-Terminal-Bench: Testing the Limits of Agents on Long-Horizon Terminal Tasks with Dense Reward-Based Grading

Model ReleasesDGX agent

arXiv:2607.08964v3 Announce Type: replace Abstract: AI agents have become capable of autonomously completing short, well-specified tasks. However, existing terminal benchmarks largely focus on simple

LURE: a Phase-Labelled Synthetic Corpus of Online-Grooming Exchanges

Model ReleasesDGX agent

arXiv:2610.15908v1 Announce Type: new Abstract: Phase-annotated conversational data is essential for studying the progression of online grooming of minors and for developing early warning tools. Howev

MADDIE: Multi-Agent Drug Discovery Engine

AgentsDGX agent

arXiv:2610.16975v1 Announce Type: new Abstract: Drug discovery remains a resource-intensive and time-consuming process, involving billions of dollars and a decade of development to advance a drug to m

MagicGarment: Benchmarking Single-Image Standalone 3D Garment Reconstruction

Model ReleasesDGX agent

arXiv:2610.19623v1 Announce Type: new Abstract: Single-image 3D reconstruction has advanced rapidly, yet standalone garments remain challenging due to thin-shell geometry, open boundaries, and layered

MemeLogos: Knowledge-Driven Retrieval-Augmented Reasoning for Harmful Meme Detection

TutorialsDGX agent

arXiv:2610.15463v1 Announce Type: new Abstract: With the rapid proliferation of social media, harmful memes have become a growing threat to online ecosystems. Their harmfulness is often implicitly con

MIRAGE: Metric Inference and Reliability-Aware Gaussian Estimation from Feed-Forward Vision

Model ReleasesDGX agent

arXiv:2610.12568v2 Announce Type: replace Abstract: Feed-forward 3D priors enable high-quality reconstruction from image streams but often lack reliable metric scale and suffer from long-term trajecto

Multi-Horizon Explainable Queue Forecasting and Resource-Aware Decision Support for Intelligent Border Control Using LightGBM

ResearchDGX agent

arXiv:2610.15930v1 Announce Type: new Abstract: Border crossing points are stochastic service systems in which traffic demand, traveler categories, registration status, inspection requirements, staffi

NVIDIA Nemotron 3.5 Super VL is now available on Ollama This model combines reasoning and visual understanding across a range of agent workf…

Model ReleasesDGX agent

NVIDIA Nemotron 3.5 Super VL is now available on Ollama This model combines reasoning and visual understanding across a range of agent workflows. On a single GPU, this model delivers up to 5x higher t

@nvidia Run Nemotron 3.5 Super VL on Together AI Start building: https://www.together.ai/models/nemotron-3-5-super-vl

Model ReleasesDGX agent

NVIDIA’s Nemotron 3.5 Super VL is now available to run on the Together AI compute platform through an API. The model page—providing pricing, benchmarks, and documentation—is hosted at together.ai/mode

Player-1: Learning to Play from Synthetic Experience

AgentsDGX agent

arXiv:2610.20584v1 Announce Type: new Abstract: Computer-use agents have demonstrated strong capabilities in interpreting screens and executing keyboard and mouse actions. However, games, with their v

Read, Parse, Describe: Unified Document Parsing with Visual Element Description Generation

Model ReleasesDGX agent

arXiv:2610.20335v1 Announce Type: new Abstract: Document understanding systems are typically evaluated as separate components via layout analysis, optical text recognition, reading-order prediction, a

Recall What Is Missing: Composing Evidence from Long-Term Agent Memory

AgentsDGX agent

arXiv:2610.15642v1 Announce Type: new Abstract: Under a limited context budget, a long-term agent must recall not merely memories that are individually relevant, but evidence that is collectively suff

Reels-RSI: Program-Level Self-Improvement for Code-Rendered Explainer Videos

Model ReleasesDGX agent

arXiv:2610.14495v1 Announce Type: new Abstract: Explainer videos -- a worked geometry problem, why the sky is blue, how a dynasty fell -- are usually one more target for pixel video generation. We arg

Robust Real-Time Monocular Human Pose Estimation with Insole-Based Sensor Fusion

ResearchDGX agent

arXiv:2610.19494v1 Announce Type: new Abstract: Real-time monocular human pose estimation is an important sensing component for human-centered intelligent systems. While recent camera-based methods ha

SAM3RL: Memory Control via Reinforcement Learning for Visual Object Tracking

ResearchDGX agent

arXiv:2610.19931v1 Announce Type: new Abstract: Segment Anything Model 3 (SAM 3) is a foundation model for image and video segmentation that sets the state of the art in visual object tracking. Its tr

Self-Representation Alignment in Diffusion Models for Video Background Music Generation

Model ReleasesDGX agent

arXiv:2610.15575v1 Announce Type: new Abstract: Diffusion models have been widely used for various generative tasks. However, recent studies have demonstrated that the internal representations learned

SMI: Ontology-Grounded Semantic IDs for Hierarchy-Aware Medical Concept Representation

ResearchDGX agent

arXiv:2610.18672v1 Announce Type: cross Abstract: Biomedical language models (LMs) provide strong representations for clinical tasks, but they often fail to capture the hierarchical structure among me

State Representation Shapes Long-Horizon Agent Learning and Transfer: An Empirical Study

Model ReleasesDGX agent

arXiv:2610.15407v1 Announce Type: new Abstract: An end-to-end success rate alone cannot distinguish failure to learn an action from failure to apply it as task state changes. We study this distinction

STP-GUI: Spatially-Aware Token Pruning for Efficient Web-GUI Agents

Local AiDGX agent

arXiv:2610.20390v1 Announce Type: new Abstract: With the rapid development of vision-language models (VLMs), Web-GUI agents have achieved promising performance in interacting with real-world interface

Text-Informed Training Data Filtering for Enhanced Virtual Flow Meter Performance

ResearchDGX agent

arXiv:2610.19860v1 Announce Type: cross Abstract: In sectors such as energy, aquaculture and chemical processing, the effectiveness of both mechanistic and data-driven models is frequently limited by

The Anatomy of a Blind Spot: What an LLM Judge Must Be Shown, and How Much

ResearchDGX agent

arXiv:2610.15938v1 Announce Type: new Abstract: Evaluation of text generated by large language models (LLMs) is increasingly delegated to LLMs acting as judges, yet what such a judge must be shown rem

Today we’re releasing Muse Spark Open, the most capable US open-weight model to date. Built for coding and agentic work, it excels at long-h…

Model ReleasesDGX agent

Today we’re releasing Muse Spark Open, the most capable US open-weight model to date. Built for coding and agentic work, it excels at long-horizon tasks, complex software engineering, and multi-step r

UltraBERT: Beyond the Limit of BERT Pre-Training

ResearchDGX agent

arXiv:2610.15028v1 Announce Type: cross Abstract: Recent bidirectional encoders have been modernized with innovations from causal large language models (LLMs). However, the pretraining recipe itself r

v0.40.5

Model ReleasesDGX agent

NVIDIA Nemotron 3.5 Super NVIDIA Nemotron 3.5 Super is a vision-language model for coding, reasoning, tool use, and document understanding. It pairs a 120B-parameter hybrid Mamba-2/Transformer mixture

VEDA: Generation of 3D Molecules via Variance-Exploding Diffusion with Annealing

ResearchDGX agent

arXiv:2511.09568v3 Announce Type: replace-cross Abstract: Diffusion models show promise for 3D molecular generation, but face a fundamental trade-off between sampling efficiency and conformational acc

VideoHarness-SRSI: Structured Recursive Self-Improvement for Video Understanding Harness

AgentsDGX agent

arXiv:2610.19424v1 Announce Type: new Abstract: LLM system capabilities depend not only on model parameters but also on the executable harnesses that organize information acquisition, tool use, reason

What Does LALM Post-training Learn? Rethinking Audio Understanding and Reasoning Capabilities

TutorialsDGX agent

arXiv:2610.19476v1 Announce Type: cross Abstract: Post-training often improves the performance of large audio-language models on audio understanding and reasoning benchmarks. However, these improvemen

What makes NVIDIA Nemotron 3.5 Super VL different? → Text, image, document, and video understanding in one model → Reasoning and tool use wi…

Model ReleasesDGX agent

What makes NVIDIA Nemotron 3.5 Super VL different? → Text, image, document, and video understanding in one model → Reasoning and tool use with visual context preserved across steps → 120B hybrid MoE (

Why Do VLMs Fail at Remote Physiological Measurement? Rethinking with Physiological Grounding and Numerical Alignment

Model ReleasesDGX agent

arXiv:2610.19052v1 Announce Type: new Abstract: Video-based remote physiological measurement (RPM) has broad applications, while Vision-Language Models (VLMs) provide a promising opportunity to enable

Why Generate a Click? Plug-in Decision Heads for Web Agents

ResearchDGX agent

arXiv:2610.20107v1 Announce Type: new Abstract: Web agents built on vision language models decide every action by generating text such as click(12), although most of that text encodes a choice among a

Words to World: Benchmarking LLMs in Interactive Physical Environments

Model ReleasesDGX agent

arXiv:2610.15228v1 Announce Type: new Abstract: Words are increasingly becoming an interface for action: large language models (LLMs) can now invoke tools, operate devices, and make decisions that aff

← Previous
1…114115116117118…169
Next →