AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,119 results
28 Sept 2026

MoTop: Motion-Topological Model For Micro AU Detection

ResearchDGX agent

arXiv:2609.31285v1 Announce Type: new Abstract: Facial micro-expressions are spontaneous, brief, and subtle facial movements that reveal suppressed emotions in high-stakes environments. In contrast to

Robust Graph Clustering Network for Multiple Missing Data

SafetyDGX agent

arXiv:2609.31033v1 Announce Type: new Abstract: Clustering on graphs where both node attributes and structural links are partially missing remains a challenging task. Existing methods typically rely o

STORM-Bench: Evaluating Online Video QA under Evolving and Incomplete Evidence

Model ReleasesDGX agent

arXiv:2609.30981v1 Announce Type: new Abstract: Reliable online video question answering requires tracking state transitions while selectively abstaining when visual evidence is insufficient. Existing

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

Timo: extbf{T}aming Multextbf{i}modal Diffusion Transformer for Human extbf{Mo}tion Generation

Model ReleasesDGX agent

arXiv:2609.30761v1 Announce Type: new Abstract: Most existing human motion generation (HMG) methods use cross-attention modules to inject text semantics, but ignore the importance of bidirectional mod

Training-Free Pronunciation Transcription via Text-Constrained Acoustic Rescoring

ResearchDGX agent

arXiv:2609.30924v1 Announce Type: new Abstract: Accurate and efficient pronunciation transcription is essential for preparing text-to-speech training data at scale. Existing approaches have different

When Does Advection-Aware Graph Nowcasting Help? A Controlled Study of Distributed Solar Ramp Forecasting with a Self-Supervised Cloud-Motion Estimator

ResearchDGX agent

arXiv:2609.30286v1 Announce Type: cross Abstract: Short-term forecasting of cloud-induced power ramps across a network of distributed photovoltaic (PV) or irradiance sensors is a recognised pain point

Why your startup needs open models alongside frontier APIs

Model ReleasesDGX agent

Every week, I talk with founders who are building at an unbelievable pace. Teams are moving from inception to product-market fit faster than ever, with foundation models wired deeply into their core p

27 Sept 2026

Cool to see classification models resurge in the era of agents. The effects of Jev are insane. Also very cool to see our emotion dataset bui…

Model ReleasesDGX agent

Cool to see classification models resurge in the era of agents. The effects of Jev are insane. Also very cool to see our emotion dataset built at @dair_ai used to test this new model, Julia-1. I spent

25 Sept 2026

AV-GRPO: Modality-Anchored Decoupling Diffusion Reinforcement Learning for Joint Audio-Video Generation

SafetyDGX agent

arXiv:2609.29816v1 Announce Type: new Abstract: Recent years have witnessed major progress in joint audio-video generation. Existing models still suffer from limited per-modality fidelity, insufficien

FoCal: Frequency-Oriented Cross-Modal Interaction and Spectral Calibration for Aerial Visible-Infrared Object Detection

ResearchDGX agent

arXiv:2609.29125v1 Announce Type: new Abstract: In aerial RGB--IR object detection, effectively exploiting complementary information across modalities is critical for robust perception under complex i

IronViT: Toward Efficient Generalist Visual Representation Learning

ResearchDGX agent

arXiv:2609.29252v1 Announce Type: new Abstract: A generalist vision encoder must capture semantic, spatial, language-aligned, and action-relevant cues within a unified representation, yet softmax atte

SARFusion: Scene-Aware Routing Fusion for Robust Camera-LiDAR 3D Object Detection

AgentsDGX agent

arXiv:2609.29235v1 Announce Type: cross Abstract: Camera-LiDAR fusion has become a prevailing paradigm for 3D object detection in autonomous driving. However, existing fusion detectors often establish

Scaling MoE reinforcement learning on Amazon EKS with EFA and DeepEP with 40% more throughput

TutorialsDGX agent

Learn how to scale Mixture-of-Experts (MoE) reinforcement learning on Amazon EKS using Elastic Fabric Adapter (EFA) and DeepEP. This post presents an architecture that combines Amazon EKS, EFA, and Am

24 Sept 2026

EnSIMem: Entity-Structured Indexing for Long-Term Agent Memory

AgentsDGX agent

arXiv:2609.27279v1 Announce Type: new Abstract: An agent that interacts with users over long periods must recall facts, preferences, events, and changes from a continuously growing interaction history

model : add Ling 3.0 VL support by aetherbird · Pull Request #29151 · ggml-org/llama.cpp

Model ReleasesDGX agent

Model Overview Ling-3.0-flash-VL inherits the language, reasoning, and long-context capabilities of Ling-3.0-flash, while extending them with native image and video understanding. The model has 124B t

Omni-Decision: Evidence-Ledger Planning for Omni-Modal Agents

Model ReleasesDGX agent

arXiv:2607.11433v2 Announce Type: replace Abstract: Omni-modal agents must seek evidence across video, audio, web pages, and computation to answer questions. Their main bottleneck is planning: noisy m

Parameter Importance-Driven Continual Learning for Foundation Models

Model ReleasesDGX agent

arXiv:2511.15375v2 Announce Type: replace-cross Abstract: Domain-specific post-training often causes catastrophic forgetting, making foundation models lose their general reasoning ability and limiting

Silent Failures in Agent-Tool Interaction: An Audit of ToolUniverse

AgentsDGX agent

arXiv:2609.26836v1 Announce Type: new Abstract: Agentic AI systems are increasingly adopting automated pipelines that integrate multiple tools. While prior research and benchmarks have studied about t

Using Vision Language Foundation Models to Generate Plant Simulation Configurations via In-Context Learning

Model ReleasesDGX agent

arXiv:2603.08930v2 Announce Type: replace-cross Abstract: This paper introduces a benchmark for evaluating whether vision-language models (VLMs) can generate plant simulation configurations from image

23 Sept 2026

Exposing Blind Spots in Deep Imbalanced Regression Evaluation

Model ReleasesDGX agent

arXiv:2609.25152v1 Announce Type: new Abstract: Deep Imbalanced Regression (DIR) addresses a common failure mode of regression models: target distributions are highly non-uniform, causing models to pe

FireWorldBench: Benchmarking Complex Physical World Intelligence through Coupled-Field Fire Dynamics

Model ReleasesDGX agent

arXiv:2609.23064v1 Announce Type: new Abstract: Understanding the physical world requires more than object recognition, scene description, and short-term visual prediction, as real-world physical syst

VLM-in-Sandbox: Visual Workspaces for Agentic Visual Reasoning

Model ReleasesDGX agent

arXiv:2609.24362v1 Announce Type: new Abstract: Sandboxed computer environments support multi-step reasoning with tools, executable programs, and persistent files, yet their extension from language mo

Vorch-Human: Unified Multi-Task Human-Centric Generation via Long-Horizon Continuation

ResearchDGX agent

arXiv:2609.26117v1 Announce Type: new Abstract: Human-centric audio-visual generation spans several closely related tasks: animating a person from driving speech, jointly generating speech and video f

22 Sept 2026

Assessing Adversarial Robustness of Latent Reasoning Models

ResearchDGX agent

arXiv:2609.22228v1 Announce Type: new Abstract: Large language models increasingly rely on long chain-of-thought (CoT) trajectories for complex reasoning, but autoregressive generation brings substant

ContactDP: Contact-Guided Diffusion Policy for Tight Insertion Tasks

SafetyDGX agent

arXiv:2609.23800v1 Announce Type: new Abstract: High-precision connector insertion remains challenging for robotic systems due to tight mechanical tolerances, partial observability during contact, and

DeCo: Efficient Decouple-to-Couple Learning for Multi-Task Visual Grounding

ResearchDGX agent

arXiv:2609.24409v1 Announce Type: new Abstract: Multi-task visual grounding requires models to jointly understand linguistic semantics and perform accurate visual localization and segmentation. Despit

MambaX: Image Super-Resolution with State Predictive Control

ResearchDGX agent

arXiv:2511.18028v2 Announce Type: replace Abstract: Image super-resolution (SR) is a critical technology for overcoming the inherent hardware limitations of sensors. However, existing approaches mainl

MAROON: A Dataset for the Joint Characterization of Near-Field High-Resolution Radio-Frequency and Optical Depth Imaging Techniques

AgentsDGX agent

arXiv:2411.00527v5 Announce Type: replace-cross Abstract: Utilizing the complementary strengths of wavelength-specific range or depth sensors is crucial for robust computer-assisted tasks such as auto

Open Source: Ming-Image-0.1-Design family: Ming-Image-0.1-Design, 6B & Ming-Image-0.1-Design-Layer, 6B

Model ReleasesDGX agent

Ming-Image-0.1-Design creates complete UIs, dashboards, infographics, and posters from structured prompts of up to 8K tokens, with consistent layouts, typography, colors, and imagery. It can also nati

PADiff: Predictive and Adaptive Diffusion Policies for Ad Hoc Teamwork

SafetyDGX agent

arXiv:2511.07260v3 Announce Type: replace-cross Abstract: Ad hoc teamwork (AHT) requires agents to collaborate with previously unseen teammates, which is crucial for many real-world applications. The

Vision-Wireless Fusion for Multi-User Localization: A Cross-Modal Transformer Approach

Local AiDGX agent

arXiv:2609.23372v1 Announce Type: new Abstract: Accurate multi-user localization is challenging in complex urban environments, where wireless measurements can become ambiguous under noise, blockage, a

21 Sept 2026

AgentVidBench: A Multi-Hop Video Question Answering Benchmark for Evaluating MLLM Agents

Model ReleasesDGX agent

arXiv:2609.21386v1 Announce Type: cross Abstract: Comprehensive video understanding is crucial for advancing artificial intelligence toward the intricate dynamics of the physical world. While recent a

ECG Mirage: Revealing and Mitigating the Underutilisation of ECGs in Vision-Language Models for Clinical Prediction

ResearchDGX agent

arXiv:2609.21755v1 Announce Type: new Abstract: Emergency department (ED) decision-making relies on heterogeneous clinical information, including patient history, vital signs, laboratory results, and

One hope for Tinker is that it can handle all the ML infra for posttraining for (approximately) everyone. So, curious, what prevents you fro…

ResearchDGX agent

One hope for Tinker is that it can handle all the ML infra for posttraining for (approximately) everyone. So, curious, what prevents you from using Tinker for all your posttraining needs? Speed? Cost?

PSR: Predictive Sensorimotor Representation Learning for Contact-Rich Manipulation

SafetyDGX agent

arXiv:2609.21753v1 Announce Type: new Abstract: Contact-rich manipulation requires policies to generate precise actions by reasoning over contact forces, robot configurations, and interaction historie

Touvigation: Embodied Adaptive Object Acquisition for Blind and Low-Vision Users in Unfamiliar Indoor Environments

Local AiDGX agent

arXiv:2609.21828v1 Announce Type: cross Abstract: Blind and low-vision users often face challenges when locating and physically acquiring objects in unfamiliar indoor environments. Existing vision-lan

18 Sept 2026

Affective Shared Autonomy: Temporal Affect Dynamics and Subjective Evaluation in Bimanual Teleoperation Tasks

Model ReleasesDGX agent

arXiv:2609.19802v1 Announce Type: new Abstract: Physical teleoperation integrates human cognitive flexibility with robotic precision, yet demanding manipulation tasks frequently induce severe cognitiv

Agile-WAM: An Agile Tactile World Action Model for Contact-Rich Robot Control

SafetyDGX agent

arXiv:2609.20761v1 Announce Type: cross Abstract: World Action Models (WAMs) advance beyond conventional visuomotor policies by jointly predicting future world states and robot actions, enabling the p

Announcing Native BM25 Ranking in AlloyDB and Cloud SQL

AgentsDGX agent

Vector search is a critical component of generative AI, retrieval-augmented generation (RAG), and data agent architectures, but sometimes vector search alone isn't enough. While vector embeddings are

BINDER: A Latent Variable Model for Probabilistic Medical Image Registration

ResearchDGX agent

arXiv:2609.19875v1 Announce Type: new Abstract: We propose a new probabilistic model for general-purpose medical image registration that builds upon the mutual information registration criterion. It c

FlipToSee: A Probabilistic Stable Placement Prior for Active Visual Exploration via Regrasping

TutorialsDGX agent

arXiv:2609.20078v1 Announce Type: new Abstract: Active visual exploration of tabletop objects often requires reorienting an unknown resting object onto a different stable support face to expose occlud

Grounded Product Understanding in Livestream Videos

Model ReleasesDGX agent

arXiv:2609.20508v1 Announce Type: new Abstract: E-commerce livestreams have emerged as an important channel for presenting products to online consumers, containing multiple products whose information

Modality Discrepancy Transformer for Ambivalence and Hesitancy Recognition

HardwareDGX agent

arXiv:2609.19148v1 Announce Type: new Abstract: Ambivalence and hesitancy (A/H) are affective states in which individuals express contradictory signals across facial, vocal, and linguistic channels. A

17 Sept 2026

Banger release from NVIDIA. They just published a report on NeMo Data Designer, their open-source synthetic data tool. It's a declarative co…

Model ReleasesDGX agent

Banger release from NVIDIA. They just published a report on NeMo Data Designer, their open-source synthetic data tool. It's a declarative config which makes a synthetic data pipeline easy to review, s

CoAtNet-DeepMoE: A Convolution-Attention Hybrid with DeepSeek Mixture-of-Experts for Parameter-Efficient Tomato Disease Classification

Model ReleasesDGX agent

arXiv:2609.18038v1 Announce Type: new Abstract: The world population is growing rapidly, and technology is improving in parallel. Meeting the huge demand for food for these 7 billion people not only d

Correlation-Guided Encoder Selection for Multi-Encoder Large Audio-Language Models

Model ReleasesDGX agent

arXiv:2609.18041v1 Announce Type: cross Abstract: Multi-encoder fusion extends Large Audio-Language Models (LALMs) beyond speech-centric recognition, but selecting encoders via intuition or exhaustive

Disentangling Long-Term Memory via Latent Neuro-Symbolic Reasoning

ResearchDGX agent

arXiv:2609.18461v1 Announce Type: new Abstract: Personalized agents are required to reason over long-term history interactions to infer both explicit preferences and implicit behavioral evidence. Whil

Dreaming the Sound of Contact: Leveraging Video and Audio Generation for Zero-Shot Force-Aware Manipulation and Data Generation

TutorialsDGX agent

arXiv:2609.19137v1 Announce Type: cross Abstract: Recent advances in video generation allow robots to learn manipulation trajectories from generated videos. However, these approaches produce purely ki

GazeDiT: Gaze-Accurate Diffusion Image Generation for Eye Tracking via Spatial Conditioning

Local AiDGX agent

arXiv:2609.17814v1 Announce Type: new Abstract: Diffusion models are increasingly used to generate synthetic training data, but precise label control remains difficult when the conditioning signal is

HearInContext: A Benchmark for Implicit Context in Speech Recognition

Model ReleasesDGX agent

arXiv:2609.18680v1 Announce Type: new Abstract: Contextual ASR can benefit from semantic cues or from target words explicitly provided in the context. We introduce HearInContext, a Mandarin--English b

Lecture notes on Physics Informed Neural Networks, Neural Operators, and their applications

HardwareDGX agent

arXiv:2609.17638v1 Announce Type: cross Abstract: This is the set of lecture notes for the PhD course href{https://www.unibz.it/en/faculties/engineering/phd-computer-science/study-course-offering/2025

Planning or Improvisation? Stress-Testing the Poetry Planning Site on Open Models and Open Cross-Layer Transcoders

Model ReleasesDGX agent

arXiv:2609.18440v1 Announce Type: new Abstract: Lindsey et al. (2025) report that Claude 3.5 Haiku plans rhymes: features for candidate rhyme words are active on the newline before a line is written,

Probabilistic Linear Explanations

ResearchDGX agent

arXiv:2609.19077v1 Announce Type: cross Abstract: Formal explainability provides mathematically grounded justifications for individual predictions. However, abductive explanations often exceed human c

Reasoning through Evolution: Automatic Meta-path Discovery for LLM-based Fake News Detection

AgentsDGX agent

arXiv:2609.18597v1 Announce Type: new Abstract: Propagation structures provide crucial evidence for fake news detection, yet existing approaches primarily rely on supervised GNN-based models, which re

REPAIR: Resolving Long-Tail Confusion in Scientific Retrievers via Fact-Verified Iterative Refinement

ResearchDGX agent

arXiv:2609.18262v1 Announce Type: new Abstract: Precise retrieval of scientific information is fundamentally constrained by long-tailed concepts and high fact-sensitivity of scientific corpora. These

Robust and Efficient AI Frameworks for Scalable Material Design and Property Prediction

ResearchDGX agent

arXiv:2609.17646v1 Announce Type: cross Abstract: This thesis develops robust and efficient AI frameworks for accelerating crystalline materials discovery by addressing both major stages of the materi

ShotFinder: Imagination-Driven Open-Domain Video Shot Retrieval via Web Search

Model ReleasesDGX agent

arXiv:2601.23232v4 Announce Type: replace-cross Abstract: In recent years, large language models (LLMs) have made rapid progress in information retrieval, yet existing research has mainly focused on t

T-SANDHI: Tone Sandhi-aware Adaptive Network with Decoupled Hybrid Injection for Low-resource Taiwanese Hokkien Speech Recognition

Model ReleasesDGX agent

arXiv:2609.18194v1 Announce Type: new Abstract: In Taiwanese Hokkien automatic speech recognition (ASR), prior studies often treat tone sandhi as a major challenge under the assumption that models fai

Towards Generalizable Deepfake Detection via Real Distribution Bias Correction

SafetyDGX agent

arXiv:2603.14005v2 Announce Type: replace Abstract: To generalize deepfake detectors to future unseen forgeries, most existing methods attempt to simulate the dynamically evolving forgery types using

TRIPROBE: Probing Task Separability Beyond Classification for XAI

Model ReleasesDGX agent

arXiv:2609.18525v1 Announce Type: new Abstract: Modern evaluation of learning pipelines often reduces to downstream accuracy, leaving open the question of why tasks succeed or fail. TriProbe addresses

← Previous
1…8990919293…169
Next →