AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,119 results
10 Apr 2026

UniversalVTG: A Universal and Lightweight Foundation Model for Video Temporal Grounding

Model ReleasesDGX agent

arXiv:2604.08522v1 Announce Type: new Abstract: Video temporal grounding (VTG) is typically tackled with dataset-specific models that transfer poorly across domains and query styles. Recent efforts to

8 Apr 2026

Building intelligent audio search with Amazon Nova Embeddings: A deep dive into semantic audio understanding

TutorialsDGX agent

This post walks you through understanding audio embeddings, implementing Amazon Nova Multimodal Embeddings, and building a practical search system for your audio content. You'll learn how embeddings r

17 Oct 2026

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Some strong embeddings models have been released recently. Ours is still better. We benchmarked Embed 5 Fast against Google's EmbeddingGemma…
Model ReleasesDGX agent

Some strong embeddings models have been released recently. Ours is still better. We benchmarked Embed 5 Fast against Google's EmbeddingGemma 2 across 163 datasets using RCP-nDCG@10. Embed 5 Fast leads

16 Oct 2026

APRiL: An Open-ended Benchmark for Chinese Social Awareness in Large Language Models

Model ReleasesDGX agent

arXiv:2610.20785v1 Announce Type: new Abstract: Large language models are increasingly used in social interactions, where appropriate responses require recognizing implicit cues, inferring mental stat

Cross-Embodiment Causal Transfer from Human Videos to Robot Manipulation

Local AiDGX agent

arXiv:2610.21798v1 Announce Type: cross Abstract: Scaling robot manipulation models requires large amounts of interaction data, yet collecting diverse real-robot experience remains costly. Human manip

MOSS: Mode-Oriented Source Shaping for Robot Flow Matching Policies

Local AiDGX agent

arXiv:2610.22193v1 Announce Type: new Abstract: In robotic manipulation, the same observation often admits multiple feasible actions. Generative policies such as diffusion and flow matching naturally

OmicsBench: a long-horizon multi-turn benchmark of AI agents on research-study-scale bioinformatics

Model ReleasesDGX agent

arXiv:2610.21074v1 Announce Type: new Abstract: Computational biologists increasingly delegate substantial analyses to AI agents in long-horizon, multi-turn sessions, yet most benchmarks of agents' bi

Optimal Hydra: Model Heterogeneous Federated Learning for LLMs using Data-Informed Hydra-Nets

Local AiDGX agent

arXiv:2610.20753v1 Announce Type: cross Abstract: Large language models (LLMs) trained on vast amounts of data have demonstrated impressive performance over a range of tasks, but future performance ga

Twice Upon a Time: Complementary Representations for Time-Series Reasoning

SafetyDGX agent

arXiv:2610.22327v1 Announce Type: cross Abstract: Time Series Language Models (TSLMs) enable language-based understanding and reasoning over temporal data, yet a fundamental question remains: what inf

15 Oct 2026

AesCode: Aesthetic Code Generation with Decoupled Cross-Modal Rewards

Model ReleasesDGX agent

arXiv:2610.18860v1 Announce Type: new Abstract: Generating information-rich visual artifacts such as slides, posters, and dashboards as code is appealing because the outputs are structured, editable,

AlignAudio: A Unified Dual-Alignment Framework for Noise-Robust Speech-Conditioned Generation

SafetyDGX agent

arXiv:2610.14697v1 Announce Type: cross Abstract: Speech-conditioned generation maps speech signals to target audio outputs. Prior end-to-end speech-conditioned generative models achieve high fidelity

An Initial Study of Physiological Markers for Deepfake Speech Detection

ApplicationsDGX agent

arXiv:2610.18934v1 Announce Type: cross Abstract: Conventional deepfake speech detectors primarily target synthesis artifacts and often degrade under unseen attacks or recording conditions. Human spee

Articulation Upper Bounds for Language Models

ResearchDGX agent

arXiv:2610.19721v1 Announce Type: cross Abstract: Language captures only a subset of the perceptions, intuitions and intents that form meaning between speakers. What, then, are the limits of language?

Certifying Almost-Sure Reachability in Unknown MDPs

SafetyDGX agent

arXiv:2610.18119v1 Announce Type: cross Abstract: {em Specification-Guided Reinforcement Learning (RL)} has largely concerned itself with learning an optimal policy against a formal specification in a

Constructed regional photovoltaic generation fields improve ultra-short-term distributed solar forecasting

ResearchDGX agent

arXiv:2610.16110v1 Announce Type: new Abstract: Ultra-short-term forecasting of densely distributed photovoltaic (PV) systems remains challenging because external meteorological and satellite products

Frame Evidence:A Benchmark for Reference Frames and Visual Evidence in Multi-Image Spatial Reasoning

Model ReleasesDGX agent

arXiv:2610.19564v1 Announce Type: new Abstract: A spatial answer depends on the reference frame specified in language and its supporting visual evidence. Item accuracy alone obscures whether correctne

GenState-AI: State-Aware Dataset for Text-to-Video Retrieval on AI-Generated Videos

Model ReleasesDGX agent

arXiv:2603.14426v2 Announce Type: replace Abstract: Existing text-to-video retrieval benchmarks often permit matching from static appearance, making it difficult to determine whether models capture st

Horizon Scans can be accelerated using novel information retrieval and artificial intelligence tools

ApplicationsDGX agent

arXiv:2504.01627v2 Announce Type: replace-cross Abstract: Introduction: Horizon scanning in healthcare assesses early signals of innovation, crucial for timely adoption. Current horizon scanning faces

How Should a Camera-First AI Agent Work?

AgentsDGX agent

arXiv:2610.14772v2 Announce Type: new Abstract: Camera-first agents must act on the visual world as it unfolds. We argue that the central obstacle for future camera-first agents is not recognition abi

HyWe: Unifying Search and Operation for Real-World Hybrid Web Tasks

Model ReleasesDGX agent

arXiv:2610.16319v1 Announce Type: new Abstract: Real-world hybrid web tasks need both information gathering and page interaction, yet search-based and operation-based agents are developed and evaluate

Imaging-anchored Multiomics in Cardiovascular Disease: Integrating Cardiac Imaging, Bulk, Single-cell, and Spatial Transcriptomics

SafetyDGX agent

arXiv:2601.07871v2 Announce Type: replace-cross Abstract: Cardiovascular disease arises from interactions between inherited risk, molecular programmes, and tissue-scale remodelling that are observed c

Into the LidarVerse: A Real-Time Unified LiDAR World Model Across Tasks and Sensors

HardwareDGX agent

arXiv:2610.19201v1 Announce Type: new Abstract: We present LidarVerse, a real-time unified LiDAR world model for sensor simulation across tasks and sensors. Existing LiDAR simulators largely follow on

LED-BENCH: A Benchmark for Large-format Engineering Drawing Understanding

Model ReleasesDGX agent

arXiv:2610.19571v1 Announce Type: new Abstract: Real-world engineering drawings are often large-format and information-dense. Answering practical engineering questions therefore requires both fine-gra

Loose Lips: Understanding Privacy Leakage in Agentic Dialogue

Model ReleasesDGX agent

arXiv:2610.14071v1 Announce Type: cross Abstract: As LLM agents are increasingly deployed in high-stakes enterprise settings, understanding how they handle sensitive information in agentic dialogue ha

Lost in Translation: Why Lower Bias Scores Don't Mean Fairer Models

SafetyDGX agent

arXiv:2610.20479v1 Announce Type: new Abstract: Bias audits of multilingual language models usually compare a model's average stereotype score in English with its average in another language and read

MakSafe: A Spatiotemporal Semantic Framework for Formal Specification and Compliance Checking of Road Vehicle Safety Rules

Model ReleasesDGX agent

arXiv:2610.19735v1 Announce Type: new Abstract: Scenario-based validation is essential for automated road vehicles but cannot cover the full variability of openworld traffic. We present MakSafe, a for

MedHarnessBench: A Unified Benchmark for Healthcare Agent Evaluation

Model ReleasesDGX agent

arXiv:2610.15714v1 Announce Type: new Abstract: Healthcare agents must transform longitudinal clinical evidence into reliable actions through heterogeneous tools and stateful workflows, conditions und

Meet NVIDIA Nemotron 3.5 Super VL Our new open model combines reasoning and tool use with text, image, document, and video understanding for…

Model ReleasesDGX agent

Meet NVIDIA Nemotron 3.5 Super VL Our new open model combines reasoning and tool use with text, image, document, and video understanding for long-running AI agents. 120B total parameters with 12B acti

Meta Muse Spark Open is live on Together AI

Model ReleasesDGX agent

Meta’s Muse Spark Open, a high‑capacity US open‑weight model for agentic software engineering, is now live on Together AI as a Day 0 launch partner. The model supports a 1‑million‑token context window

Mitigating Cross-Modal Hallucinations by Correcting Modality Misrouting in Omnimodal LLMs

ResearchDGX agent

arXiv:2610.18141v1 Announce Type: new Abstract: Omnimodal large language models (OLLMs) are susceptible to cross-modal hallucinations under audio-visual interference. We find that, for a substantial f

MobiGuide: Vocabulary-Guided Online Recovery for Mobile Manipulation

Local AiDGX agent

arXiv:2604.01567v2 Announce Type: replace Abstract: A central challenge in mobile manipulation is preserving multiple plausible action modes while remaining reactive during execution. For example, gra

Nudge the Judge: Uncovering Program Decision Hijacking in Real-World Jev Applications

ApplicationsDGX agent

arXiv:2610.18612v1 Announce Type: cross Abstract: System One models such as Jev change how software makes decisions by mapping open-ended semantic contexts into structured judgments that directly driv

OneLA: Learning Many Worlds from Latent Actions

SafetyDGX agent

arXiv:2610.20160v1 Announce Type: new Abstract: Learning world models across diverse domains calls for a unified control space, yet ac- tion interfaces vary across domains and action annotations are o

Open From Data Center to Desktop: NVIDIA Expands Nemotron Family With Highest Efficiency Super VL and Bolt Models

Model ReleasesDGX agent

NVIDIA today released Nemotron 3.5 Super VL, an open 120-billion-parameter model that delivers the fastest task completion and highest accuracy for specialized always-on agents. Joining it are two new

PANINI-DR: Controlled Deep Research through Generative Semantic Workspaces

AgentsDGX agent

arXiv:2610.15208v1 Announce Type: cross Abstract: Deep research requires connecting multiple steps of search, reasoning, and computation, with intermediate findings guiding what to investigate next. A

Polyrating: A Cost-Effective and Bias-Aware Rating System for LLM Evaluation

Model ReleasesDGX agent

arXiv:2409.00696v4 Announce Type: replace-cross Abstract: Rating-based human evaluation has become an essential tool to accurately evaluate the impressive performance of large language models (LLMs).

Quantifying privacy risks in foundation model representations of brain MRI

Model ReleasesDGX agent

arXiv:2610.20494v1 Announce Type: new Abstract: Pretrained representations are increasingly used to share and reuse information from medical images without exposing the original scans, but it is uncle

Recognizing Dialogue Ambiguity via Candidate Set Visual Grounding

Model ReleasesDGX agent

arXiv:2610.19723v1 Announce Type: new Abstract: Interpreting an ambiguous utterance in real-world interactions often requires context beyond a single utterance. When the utterance refers to objects in

RoTA-Bench: Evaluating 3D Spatial Reasoning through Interactive Projection Alignment

Model ReleasesDGX agent

arXiv:2610.17665v2 Announce Type: new Abstract: Can vision-language models turn 2D observations into 3D understanding that supports precise action? This requires inferring object geometry, anticipatin

ScholarQuest: A Taxonomy-Guided Benchmark for Agentic Academic Paper Search in Open Literature Environments

Model ReleasesDGX agent

arXiv:2606.20235v2 Announce Type: replace-cross Abstract: Academic paper search is a core step in scientific research, and LLM-based search agents are emerging as a promising paradigm for iterative, i

Semantics as a Shield: Label Disguise Defense (LDD) against Prompt Injection in LLM Sentiment Classification

ApplicationsDGX agent

arXiv:2511.21752v3 Announce Type: replace-cross Abstract: Prompt injection can cause large language models (LLMs) to deviate from their intended tasks by following instructions embedded in untrusted i

SimInter: Evidence-Grounded User Simulation with Interview-Based Profile Enrichment for Conversational Recommender Systems

AgentsDGX agent

arXiv:2610.18308v1 Announce Type: cross Abstract: Conversational Recommender Systems (CRSs) require reliable user simulators for cost-effective evaluation. LLM-based simulators have made realistic sim

Spectral World Renderer: Unified 3D Hyperspectral Unmixing

AgentsDGX agent

arXiv:2610.19520v1 Announce Type: new Abstract: Cameras and the foundation models built on them recognize what a 3D scene contains, but not what it is made of: surfaces of the same colour can be diffe

TacClaw-Infinity: A Large-Scale Vision-Tactile-Language-Action Dataset for Dexterous Manipulation

ResearchDGX agent

arXiv:2610.20320v1 Announce Type: new Abstract: Large-scale robot learning increasingly relies on diverse human demonstrations, yet tactile manipulation data remain difficult to scale, and existing mu

Vela: User Behavior as Supervision Sparks LLM Intelligence

ApplicationsDGX agent

arXiv:2610.14709v1 Announce Type: cross Abstract: Large language models are increasingly deployed in applications that act on users' long-term behavior histories, from personal assistants to recommend

W-JEPA: Wavelet Joint-Embedding Predictive Architecture for Wearable Activity Recognition

ResearchDGX agent

arXiv:2610.19411v1 Announce Type: new Abstract: A major challenge in wearable device activity recognition is the heterogeneity across datasets in sensor placement, channel count, sampling rate and sub

What Is a Clarification? Estimating Model-Dependent Input Ambiguity

ResearchDGX agent

arXiv:2610.20052v1 Announce Type: new Abstract: Ambiguous inputs can admit multiple interpretations, each potentially yielding a different answer. Existing work largely treats this ambiguity as a prop

What Makes a Social Agent's Interactions Effective? Learning from Verifiable Outcomes in Paired Worlds

Model ReleasesDGX agent

arXiv:2610.20195v1 Announce Type: new Abstract: Effective social interaction requires more than fluent responses: agents must reach plans that fit the participants' needs and circumstances. Existing e

What the Model Cannot See: Covert and Provable Text Invisibility in LLMs

Model ReleasesDGX agent

arXiv:2610.15883v1 Announce Type: cross Abstract: Text wrapped in a trigger can be made behaviorally invisible to a language model: omitted from summaries and quotations, ignored in question answering

14 Oct 2026

A Concept-informed Interpretable Artificial Intelligence Framework for Breast Ultrasound Diagnosis

SafetyDGX agent

arXiv:2610.16128v1 Announce Type: new Abstract: Most existing artificial intelligence systems for breast ultrasound rely primarily on image-driven prediction, with limited incorporation of the knowled

A Multi-Task Deep Learning Framework for Pose-Invariant Face Recognition and Facial Landmark Localization

Model ReleasesDGX agent

arXiv:2610.16849v1 Announce Type: new Abstract: Face recognition systems often experience performance degradation under large pose variations due to changes in facial appearance and visibility of disc

AffectWorld: Benchmarking Emotion-Driven Future World Prediction

Model ReleasesDGX agent

arXiv:2610.18305v1 Announce Type: new Abstract: The world encompasses both physical environments and human actors. Predicting its evolution requires understanding both physical laws and how emotions s

Anomaly-Guided Observation and Two-Level Semantic Feedback for Training-Free Video Anomaly Analysis

Local AiDGX agent

arXiv:2610.16324v1 Announce Type: new Abstract: Training-free language-based video anomaly detection (VAD) uses frozen vision--language models (VLMs) and large language models (LLMs) to localize abnor

Answer It or Not? Towards Prompt-Adapted Adversarial Images on Vision Language Models

ResearchDGX agent

arXiv:2610.16622v1 Announce Type: new Abstract: With the advancement in language modeling, research on adversarial images has recently shifted from image classifiers to vision-language models (VLMs).

APT: Feedback-Driven Agentic Post-Training for Text-to-Image Generation

Model ReleasesDGX agent

arXiv:2610.18097v1 Announce Type: new Abstract: Post-training is crucial for improving text-to-image models, yet existing pipelines typically rely on manually curated training data and fixed training

Beyond a Better Score: Long-Horizon Agentic ML Development and Evaluation Protocol for Physics Time Series

Model ReleasesDGX agent

arXiv:2610.14024v1 Announce Type: new Abstract: Physics time-series data are central to fundamental discoveries involving dark matter, neutrinos, and gravitational waves. Machine learning has shown st

BrainAid: Efficient Brain Tumor Detection Using Lightweight CNNs and Explainable AI for Resource-Constrained Environments

ApplicationsDGX agent

arXiv:2610.15077v1 Announce Type: new Abstract: A brain tumor is an unusual growth of cells in the brain that can be cancerous or not, affecting normal brain function and causing serious risk to healt

CAPTOR: a vision-language foundation model for Chest-Abdomen-Pelvis Oncologic CT

ResearchDGX agent

arXiv:2610.14226v1 Announce Type: new Abstract: Purpose : To develop and evaluate CAPTOR, a deep-learning vision-language foundation model for oncologic chest-abdomen-pelvis (CAP) CT interpretation. M

CFG-Policy: Unified Diffusion Policy Learning Framework via Classifier-free Guidance

SafetyDGX agent

arXiv:2610.14936v1 Announce Type: cross Abstract: Diffusion policies are increasingly used in robotic control and manipulation, vision-language-action models, and world-model-based agents. Their abili

Cross-Material Magnetic Core Loss Prediction via Operating-Condition Matching and Partial Optimal Transport

SafetyDGX agent

arXiv:2610.14964v1 Announce Type: new Abstract: Cross-material magnetic core loss prediction requires adapting to new material responses with limited measurements. Global feature alignment overlooks d

← Previous
1…8485868788…169
Next →