AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,119 results
20 Apr 2026

Upload single or multi-view images to ComfyUI’s HY 3D 3.0 nodes for high-fidelity 3D assets—from product displays to game dev, done in minut…

Local AiDGX agent

ComfyUI's HY 3D 3.0 nodes enable rapid 3D asset generation from single or multi-view images, producing high-fidelity 3D models suitable for applications including product visualization and game develo

Where Do Vision-Language Models Fail? World Scale Analysis for Image Geolocalization

Local AiDGX agent

arXiv:2604.16248v1 Announce Type: new Abstract: Image geolocalization has traditionally been addressed through retrieval-based place recognition or geometry-based visual localization pipelines. Recent

19 Apr 2026

At the Beijing half-marathon, several humanoid robots beat human winners by 10+ minutes; a robot made by Honor beat the human world record held by Jacob Kiplimo (Reuters)

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
AgentsDGX agent

Reuters: At the Beijing half-marathon, several humanoid robots beat human winners by 10+ minutes; a robot made by Honor beat the human world record held by Jacob Kiplimo — Dozens of Chinese-made human

Video of my opening keynote for the 2026 World Modeling Workshop at Mila, Quebec AI Institute: simple but powerful ways of using world model…

ResearchDGX agent

Video of my opening keynote for the 2026 World Modeling Workshop at Mila, Quebec AI Institute: simple but powerful ways of using world models and their latent space (sorry for sound problem 0:20-0:43)

17 Apr 2026

CART: Context-Aware Terrain Adaptation using Temporal Sequence Selection for Legged Robots

TutorialsDGX agent

arXiv:2604.14344v1 Announce Type: new Abstract: Animals in nature combine multiple modalities, such as sight and feel, to perceive terrain and develop an understanding of how to walk on uneven terrain

ControlFoley: Unified and Controllable Video-to-Audio Generation with Cross-Modal Conflict Handling

Model ReleasesDGX agent

arXiv:2604.15086v1 Announce Type: cross Abstract: Recent advances in video-to-audio (V2A) generation enable high-quality audio synthesis from visual content, yet achieving robust and fine-grained cont

DEX-Mouse: A Low-cost Portable and Universal Interface with Force Feedback for Data Collection of Dexterous Robotic Hands

ResearchDGX agent

arXiv:2604.15013v1 Announce Type: new Abstract: Data-driven dexterous hand manipulation requires large-scale, physically consistent demonstration data. Simulation and video-based methods suffer from s

Domain-Adaptive Model Merging Across Disconnected Modes

ResearchDGX agent

arXiv:2603.05957v2 Announce Type: replace-cross Abstract: Learning across domains is challenging when data cannot be centralized due to privacy or heterogeneity, which limits the ability to train a si

EchoAgent: Towards Reliable Echocardiography Interpretation with 'Eyes','Hands' and 'Minds'

AgentsDGX agent

arXiv:2604.05541v2 Announce Type: replace Abstract: Reliable interpretation of echocardiography (Echo) is crucial for assessing cardiac function, which demands clinicians to synchronously orchestrate

Explain the Flag: Contextualizing Hate Speech Beyond Censorship

ResearchDGX agent

arXiv:2604.14970v1 Announce Type: new Abstract: Hate, derogatory, and offensive speech remains a persistent challenge in online platforms and public discourse. While automated detection systems are wi

Finetuning-Free Diffusion Model with Adaptive Constraint Guidance for Inorganic Crystal Structure Generation

ResearchDGX agent

arXiv:2604.13354v1 Announce Type: cross Abstract: The discovery of inorganic crystal structures with targeted properties is a significant challenge in materials science. Generative models, especially

Flow of Truth: Proactive Temporal Forensics for Image-to-Video Generation

ResearchDGX agent

arXiv:2604.15003v1 Announce Type: new Abstract: The rapid rise of image-to-video (I2V) generation enables realistic videos to be created from a single image but also brings new forensic demands. Unlik

HAMSA: Scanning-Free Vision State Space Models via SpectralPulseNet

ResearchDGX agent

arXiv:2604.14724v1 Announce Type: new Abstract: Vision State Space Models (SSMs) like Vim, VMamba, and SiMBA rely on complex scanning strategies to adapt sequential SSMs to process 2D images, introduc

Hierarchical Retrieval Augmented Generation for Adversarial Technique Annotation in Cyber Threat Intelligence Text

SafetyDGX agent

arXiv:2604.14166v1 Announce Type: new Abstract: Mapping Cyber Threat Intelligence (CTI) text to MITRE ATT&CK technique IDs is a critical task for understanding adversary behaviors and automating threa

Improved Multiscale Structural Mapping with Supervertex Vision Transformer for the Detection of Alzheimer's Disease Neurodegeneration

ResearchDGX agent

arXiv:2604.14837v1 Announce Type: new Abstract: Alzheimer's disease (AD) confirmation often relies on positron emission tomography (PET) or cerebrospinal fluid (CSF) analysis, which are costly and inv

in 1996 mitzenmacher showed that sampling two backends and picking the better one drops max load exponentially vs. random selection one extr…

SafetyDGX agent

in 1996 mitzenmacher showed that sampling two backends and picking the better one drops max load exponentially vs. random selection one extra comparison. that's the whole trick we built pinecone assis

JoyVASA: Portrait and Animal Image Animation with Diffusion-Based Audio-Driven Facial Dynamics and Head Motion Generation

ResearchDGX agent

arXiv:2411.09209v5 Announce Type: replace Abstract: Audio-driven portrait animation has made significant advances with diffusion-based models, improving video quality and lipsync accuracy. However, th

Listening Alone, Understanding Together: Collaborative Context Recovery for Privacy-Aware AI

ResearchDGX agent

arXiv:2604.13348v1 Announce Type: new Abstract: We introduce CONCORD, a privacy-aware asynchronous assistant-to-assistant (A2A) framework that leverages collaboration between proactive speech-based AI

Multi-Modal Manipulation via Multi-Modal Policy Consensus

SafetyDGX agent

arXiv:2509.23468v3 Announce Type: replace-cross Abstract: Effectively integrating diverse sensory modalities is crucial for robotic manipulation. However, the typical approach of feature concatenation

Optimize video semantic search intent with Amazon Nova Model Distillation on Amazon Bedrock

TutorialsDGX agent

In this post, we show you how to use Model Distillation, a model customization technique on Amazon Bedrock, to transfer routing intelligence from a large teacher model (Amazon Nova Premier) into a muc

Q-MambaIR: Accurate Quantized Mamba for Efficient Image Restoration

ResearchDGX agent

arXiv:2503.21970v3 Announce Type: replace Abstract: State-Space Models (SSMs) have attracted considerable attention in Image Restoration (IR) due to their ability to scale linearly sequence length whi

Sharing my current setup to run Qwen3.6 locally in a good agentic setup (Pi + llama.cpp). Should give you a good overview of how good local …

Model ReleasesDGX agent

Sharing my current setup to run Qwen3.6 locally in a good agentic setup (Pi + llama.cpp). Should give you a good overview of how good local agents are today: # Start llama.cpp server: llama-server -hf

TableNet A Large-Scale Table Dataset with LLM-Powered Autonomous

AgentsDGX agent

arXiv:2604.13041v1 Announce Type: cross Abstract: Table Structure Recognition (TSR) requires the logical reasoning ability of large language models (LLMs) to handle complex table layouts, but current

Time-RA: Towards Time Series Reasoning for Anomaly Diagnosis with LLM Feedback

Model ReleasesDGX agent

arXiv:2507.15066v5 Announce Type: replace Abstract: Time series anomaly detection (TSAD) has traditionally focused on binary classification and often lacks the fine-grained categorization and explanat

TurboTalk: Progressive Distillation for One-Step Audio-Driven Talking Avatar Generation

ApplicationsDGX agent

arXiv:2604.14580v1 Announce Type: new Abstract: Existing audio-driven video digital human generation models rely on multi-step denoising, resulting in substantial computational overhead that severely

Vision-Based Safe Human-Robot Collaboration with Uncertainty Guarantees

SafetyDGX agent

arXiv:2604.15221v1 Announce Type: cross Abstract: We propose a framework for vision-based human pose estimation and motion prediction that gives conformal prediction guarantees for certifiably safe hu

WaveSFNet: A Wavelet-Based Codec and Spatial--Frequency Dual-Domain Gating Network for Spatiotemporal Prediction

ResearchDGX agent

arXiv:2603.23284v2 Announce Type: replace Abstract: Spatiotemporal predictive learning aims to forecast future frames from historical observations in an unsupervised manner, and is critical to a wide

Why Do Vision Language Models Struggle To Recognize Human Emotions?

SafetyDGX agent

arXiv:2604.15280v1 Announce Type: new Abstract: Understanding emotions is a fundamental ability for intelligent systems to be able to interact with humans. Vision-language models (VLMs) have made trem

World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems

TutorialsDGX agent

arXiv:2604.14732v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have emerged as a promising paradigm for building embodied agents that ground perception and language into action.

16 Apr 2026

Beyond Static Personas: Situational Personality Steering for Large Language Models

Model ReleasesDGX agent

arXiv:2604.13846v1 Announce Type: new Abstract: Personalized Large Language Models (LLMs) facilitate more natural, human-like interactions in human-centric applications. However, existing personalizat

CLIP Architecture for Abdominal CT Image-Text Alignment and Zero-Shot Learning: Investigating Batch Composition and Data Scaling

SafetyDGX agent

arXiv:2604.13561v1 Announce Type: new Abstract: Vision-language models trained with contrastive learning on paired medical images and reports show strong zero-shot diagnostic capabilities, yet the eff

Designing synthetic datasets for the real world: Mechanism design and reasoning from first principles

ApplicationsDGX agent

This Google Research work presents guidelines for synthetic data mechanism design and provides insights into generating and evaluating synthetic data at scale. The research introduces a reasoning-driv

Frozen Forecasting: A Unified Evaluation

ResearchDGX agent

arXiv:2507.13942v2 Announce Type: replace Abstract: Forecasting future events is a fundamental capability for general-purpose systems that plan or act across different levels of abstraction. Yet, eval

Go from blank slate to analysis with BigQuery Studio notebook gallery templates

Model ReleasesDGX agent

For many data professionals, the most daunting part of a new project isn't the complexity of the data or the sophistication of the model, it’s the 'blank slate.' Staring at an empty notebook while cre

Google’s DeepMind just released new 4B and 27B MedGemma models!

Model ReleasesDGX agent

Google DeepMind released MedGemma, a collection of medical vision-language foundation models based on Gemma 3 in 4B and 27B parameter sizes, demonstrating advanced medical understanding and reasoning

Learning Probabilistic Responsibility Allocations for Multi-Agent Interactions

SafetyDGX agent

arXiv:2604.13128v1 Announce Type: cross Abstract: Human behavior in interactive settings is shaped not only by individual objectives but also by shared constraints with others, such as safety. Underst

LEO-RobotAgent: A General-purpose Robotic Agent for Language-driven Embodied Operator

AgentsDGX agent

arXiv:2512.10605v2 Announce Type: replace Abstract: We propose LEO-RobotAgent, a general-purpose language-driven intelligent agent framework for robots. Under this framework, LLMs can operate differen

Med-CAM: Minimal Evidence for Explaining Medical Decision Making

SafetyDGX agent

arXiv:2604.13695v1 Announce Type: new Abstract: Reliable and interpretable decision-making is essential in medical imaging, where diagnostic outcomes directly influence patient care. Despite advances

Most Physical AI models recognize patterns. They don’t understand the world. That’s why they fail on edge cases. BADAS 2.0 is a V-JEPA2 worl…

ApplicationsDGX agent

Most Physical AI models recognize patterns. They don’t understand the world. That’s why they fail on edge cases. BADAS 2.0 is a V-JEPA2 world model trained by @getnexar on real-world videos. We used t

MSGS: Multispectral 3D Gaussian Splatting

ApplicationsDGX agent

arXiv:2604.13340v1 Announce Type: new Abstract: We present a multispectral extension to 3D Gaussian Splatting (3DGS) for wavelength-aware view synthesis. Each Gaussian is augmented with spectral radia

Native Hybrid Attention for Efficient Sequence Modeling

ResearchDGX agent

arXiv:2510.07019v3 Announce Type: replace Abstract: Transformers excel at sequence modeling but face quadratic complexity, while linear attention offers improved efficiency but often compromises recal

One Token per Highly Selective Frame: Towards Extreme Compression for Long Video Understanding

Local AiDGX agent

arXiv:2604.14149v1 Announce Type: new Abstract: Long video understanding is inherently challenging for vision-language models (VLMs) because of the extensive number of frames. With each video frame ty

Optimized Human-Robot Co-Dispatch Planning for Petro-Site Surveillance under Varying Criticalities

AgentsDGX agent

arXiv:2602.07924v2 Announce Type: replace Abstract: Securing petroleum infrastructure requires balancing autonomous system efficiency with human judgment for threat escalation, a challenge unaddressed

PostureObjectstitch: Anomaly Image Generation Considering Assembly Relationships in Industrial Scenarios

ApplicationsDGX agent

arXiv:2604.13863v1 Announce Type: new Abstract: Image generation technology can synthesize condition-specific images to supplement real-world industrial anomaly data and enhance anomaly detection mode

Qwen 3.6 is here, and open-source! Run it locally with improved agentic coding capabilities. Try it with Claude Code: ollama launch claude -…

Model ReleasesDGX agent

Qwen 3.6 is here, and open-source! Run it locally with improved agentic coding capabilities. Try it with Claude Code: ollama launch claude --model qwen3.6 Try it with OpenClaw: ollama launch openclaw

انتهت حجة 'ما عندي كرت شاشة قوي عشان أشغل ذكاء اصطناعي محلي'. علي بابا نزلت موديل Qwen3.6 بهندسة MoE. حجمه الكلي 35B (يعطيك ذكاء عالي جداً)،…

AgentsDGX agent

انتهت حجة 'ما عندي كرت شاشة قوي عشان أشغل ذكاء اصطناعي محلي'. علي بابا نزلت موديل Qwen3.6 بهندسة MoE. حجمه الكلي 35B (يعطيك ذكاء عالي جداً)، لكن وقت الـ Inference يستهلك 3B فقط! يعني أداء Enterprise ع

Rethinking Uncertainty in Segmentation: From Estimation to Decision

SafetyDGX agent

arXiv:2604.13262v1 Announce Type: new Abstract: In medical image segmentation, uncertainty estimates are often reported but rarely used to guide decisions. We study the missing step: how uncertainty m

SEDTalker: Emotion-Aware 3D Facial Animation Using Frame-Level Speech Emotion Diarization

ResearchDGX agent

arXiv:2604.13335v1 Announce Type: new Abstract: We introduce SEDTalker, an emotion-aware framework for speech-driven 3D facial animation that leverages frame-level speech emotion diarization to achiev

Sorry for the long wait, everyone! As I said, Qwen is going to keep open-sourcing!

Model ReleasesDGX agent

Sorry for the long wait, everyone! As I said, Qwen is going to keep open-sourcing! ⚡ Meet Qwen3.6-35B-A3B:Now Open-Source!🚀🚀 A sparse MoE model, 35B total params, 3B active. Apache 2.0 license. 🔥 Agen

Target-Bench: Can Video World Models Achieve Mapless Path Planning with Semantic Targets?

Model ReleasesDGX agent

arXiv:2511.17792v2 Announce Type: replace Abstract: While recent video world models can generate highly realistic videos, their ability to perform semantic reasoning and planning remains unclear and u

The PR you would have opened yourself

ToolsDGX agent

This blog post discusses how the Hugging Face team ported the Transformers library to Apple's MLX framework, detailing the process and considerations for adapting machine learning models to run effici

this is wild. take this to the extreme and you can just shoot entire life experiences directly into the brain like in… the matrix 🫠

AgentsDGX agent

this is wild. take this to the extreme and you can just shoot entire life experiences directly into the brain like in… the matrix 🫠 A Smell Simulator That Uses Ultrasonic Waves Through Your Skull To T

Towards Patient-Specific Deformable Registration in Laparoscopic Surgery

ResearchDGX agent

arXiv:2604.13186v1 Announce Type: new Abstract: Unsafe surgical care is a critical health concern, often linked to limitations in surgeon experience, skills, and situational awareness. Integrating pat

TRIM: Hybrid Inference via Targeted Stepwise Routing in Multi-Step Reasoning Tasks

SafetyDGX agent

arXiv:2601.10245v2 Announce Type: replace-cross Abstract: Multi-step reasoning tasks like mathematical problem solving are vulnerable to cascading failures, where a single incorrect step leads to comp

VRAG-DFD: Verifiable Retrieval-Augmentation for MLLM-based Deepfake Detection

SafetyDGX agent

arXiv:2604.13660v1 Announce Type: new Abstract: In Deepfake Detection (DFD) tasks, researchers proposed two types of MLLM-based methods: complementary combination with small DFD detectors, or static f

Why dynamically routing multi-timescale advantages in PPO causes policy collapse (and a simple decoupled fix) [R]

SafetyDGX agent

This Reddit post discusses a known instability in PPO when advantage estimates operating across different temporal scales (e.g., short-horizon and long-horizon returns) are dynamically routed or mixed

Why Your Agents Can’t Read Enterprise Documents — and How to Fix It

TutorialsDGX agent

AI agents struggle to effectively process and extract information from complex enterprise documents due to limitations in context windows, reasoning capabilities, and handling of unstructured data for

15 Apr 2026

A Dataset and Evaluation for Complex 4D Markerless Human Motion Capture

SafetyDGX agent

arXiv:2604.12765v1 Announce Type: new Abstract: Marker-based motion capture (MoCap) systems have long been the gold standard for accurate 4D human modeling, yet their reliance on specialized hardware

A document is worth a structured record: Principled inductive bias design for document recognition

SafetyDGX agent

arXiv:2507.08458v2 Announce Type: replace-cross Abstract: Many document types use intrinsic, convention-driven structures that serve to encode precise and structured information, such as the conventio

Agentic Control in Variational Language Models

Local AiDGX agent

arXiv:2604.12513v1 Announce Type: new Abstract: We study whether a variational language model can support a minimal and measurable form of agentic control grounded in its own internal evidence. Our mo

← Previous
1…109110111112113…169
Next →