AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,119 results
22 Sept 2026

Bimanual 3D Hand Motion and Articulation Forecasting in Everyday Images

ResearchDGX agent

arXiv:2510.06145v2 Announce Type: replace Abstract: We tackle the problem of forecasting bimanual 3D hand motion and articulation from a single image in everyday settings. To address the lack of 3D ha

ChartJudgeBench: Evaluating LMM Judges for Chart-to-Code Generation

Model ReleasesDGX agent

arXiv:2609.24210v1 Announce Type: new Abstract: Building strong chart-to-code systems increasingly relies on reinforcement learning, whose effectiveness depends critically on the quality of the reward

CLIP-Powered Domain Generalization and Domain Adaptation: A Comprehensive Survey

SafetyDGX agent

arXiv:2504.14280v2 Announce Type: replace Abstract: As machine learning evolves, domain generalization (DG) and domain adaptation (DA) have become crucial for improving model robustness across diverse

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

Dissecting Agentic Forensics: The Role of Triage, Prompting, and Evidence Arbitration in Open-World Fake Image Detection

Local AiDGX agent

arXiv:2609.24359v1 Announce Type: new Abstract: Image forensics is increasingly an open-world problem: manipulations range from fully synthetic images to localized edits, splicing and swapping, while

FeasibleFlow: One-Step Joint Transport of Configuration Feasibility and Trajectories for End-to-End Driving

Model ReleasesDGX agent

arXiv:2609.23488v1 Announce Type: new Abstract: End-to-end autonomous driving maps current observations directly to future trajectories, yet those trajectories must remain valid as the scene evolves.

Financial Language Models as Applied Artificial Intelligence Systems for News-Based Trading under Market Frictions

ResearchDGX agent

arXiv:2609.23703v1 Announce Type: new Abstract: Financial language models can transform unstructured firm-specific news into structured decision signals, but financial AI research lacks an integrated

From Content Generation to Learning Support: Pedagogy-Guided Generative Video Tutors for STEM Learning

TutorialsDGX agent

arXiv:2609.24083v1 Announce Type: new Abstract: Generative AI enables scalable production of educational videos, but current systems largely focus on producing visually coherent content rather than su

ME-Brain-1.0: Memory, Cognition and Action for Evolving Embodied Intelligence

Local AiDGX agent

arXiv:2609.24271v1 Announce Type: new Abstract: Current embodied systems largely rely on pretrained capabilities that remain fixed after deployment, limiting their ability to learn from physical inter

Mira-Scene: Pixel-Aligned Layouts for Generative 3D Scene

SafetyDGX agent

arXiv:2609.23796v1 Announce Type: new Abstract: Single-image 3D object generation can now produce high-fidelity assets, yet accurately placing them into a coherent scene layout remains an open challen

NAVIR: Neuromorphic Audio-Visual Speech Recognition for Robust Human-Robot Interaction on Edge Hardware

Model ReleasesDGX agent

arXiv:2609.24391v1 Announce Type: new Abstract: Voice-controlled interaction in industrial settings is hampered by acoustic noise, which severely degrades audio-only speech recognition. Audio-visual s

NVIDIA Isaac ROS 5.0 Advances Agentic, Open Source Robotics Development

Model ReleasesDGX agent

To build and deploy sophisticated robotics applications that can perceive, reason and act in dynamic environments, developers need new physical AI models and tools. The ROS open framework is a project

Omni2Web: Benchmarking Audiovisual Website Development

Model ReleasesDGX agent

arXiv:2609.23417v1 Announce Type: cross Abstract: Screen-recorded web editing requests contain weak deictic expressions such as ``this'' and ``there,'' whose referents depend on speech, cursor traject

PackLab: A Comprehensive Framework for Developing, Training, and Evaluating MLLMs in Robotic Bin Packing

Model ReleasesDGX agent

arXiv:2609.23784v1 Announce Type: new Abstract: Robotic bin packing requires long-horizon sequential decision-making, as each object placement affects the available space for subsequent packing. Exist

QwenVLConnector: A Fast, Unified Medical VLM Chatbot for Fine-Grained Clinical Perception and Text Generation

ResearchDGX agent

arXiv:2609.23139v1 Announce Type: new Abstract: Most medical vision-language models (VLMs) excel at open-ended report generation and VQA but provide limited support for structured, fine-grained clinic

Recommended if you work on agent memory. Retrieval is the hardest memory problem in most harnesses because agents keep pulling stale context…

AgentsDGX agent

Recommended if you work on agent memory. Retrieval is the hardest memory problem in most harnesses because agents keep pulling stale context. AML tests this with a coding track of 150 software tasks,

Safe Learning for Contact-Rich Robot Tasks: A Survey from Classical Learning-Based Methods to Safe Foundation Models

SafetyDGX agent

arXiv:2512.11908v3 Announce Type: replace Abstract: Contact-rich tasks pose significant challenges for robotic systems due to inherent uncertainty, complex dynamics, and the high risk of damage during

SalQ-VLM: Fine-Grained Saliency-Guided Quantization for Vision-Language Models

Model ReleasesDGX agent

arXiv:2508.03351v3 Announce Type: replace-cross Abstract: Large language models (LLMs) have demonstrated remarkable capabilities across diverse language tasks, motivating their extension to vision-lan

SALSA: Semi-Autonomous Literature Summarization Assistant

AgentsDGX agent

arXiv:2609.22210v1 Announce Type: new Abstract: SALSA (Semi-Autonomous Literature Summarization Assistant) is an open- source, human-in-the-loop platform for extracting structured scientific datasets

Structured World-State Reasoning for Agentic Robotic Search

AgentsDGX agent

arXiv:2609.23841v1 Announce Type: new Abstract: Long-horizon robotic search must resolve natural language against heterogeneous, incomplete, and often ambiguous evidence: textual information, prior ma

Task aware Dynamic Movement Primitives for failure detection and recovery in contact rich manipulation

SafetyDGX agent

arXiv:2609.23151v1 Announce Type: cross Abstract: Assembly remains a challenging robotic manipulation task in presence of tight tolerances and complex contact interactions. While Learning from Demonst

VideoGen-Agent: Reinforcing Video Generation Agents

Model ReleasesDGX agent

arXiv:2609.24997v1 Announce Type: new Abstract: Recent advances in video generative models have enabled high-fidelity, temporally coherent video generation. However, these models often struggle to sat

What do VLM-Based Vision-Language Navigation Models Rely on: Interpreting and Steering Policy Behavior

SafetyDGX agent

arXiv:2609.24576v1 Announce Type: cross Abstract: Modern Vision-Language Navigation (VLN) models rely mostly on pre-trained large Vision-Language Models (VLMs) to predict navigation actions. While thi

WorldScape Policy 2.0: Empowering Steerable World Action Modeling with Reasoning-Augmented Memory and In-Context Learning

SafetyDGX agent

arXiv:2607.18840v2 Announce Type: replace Abstract: World Action Models (WAMs) offer a promising paradigm for robotic manipulation by jointly modeling visual state transitions and robot actions. Howev

21 Sept 2026

A Generative Grammar Underlying the Voynich Manuscript, the Pastiche Hypothesis: Evidence from Large Language Models

SafetyDGX agent

arXiv:2609.20835v1 Announce Type: new Abstract: Background: The Voynich Manuscript is a fifteenth-century codex written in an unknown script whose content remains undeciphered. Previous studies sugges

AVT-Fabric: Active Visuo-Tactile Perception via Adaptive Evidence Selection for Efficient Robotic Fabric Comparison

ResearchDGX agent

arXiv:2609.21377v1 Announce Type: new Abstract: Robotic fabric comparison needs to actively combine visual appearance and tactile cues. Here, we present AVT-Fabric, an RGB-first framework that allocat

Beyond Exact Match: Task-Aware GRPO for Cross-Domain PCBA Visual Question Answering

SafetyDGX agent

arXiv:2609.21276v1 Announce Type: cross Abstract: In automated Printed Circuit Board Assembly (PCBA) inspection, standards-guided decisions require systems to jointly reason over fine-grained visual c

DEXTERA: From a Single Image to Deployable Dexterous Manipulation via Real-to-Sim-to-Real

SafetyDGX agent

arXiv:2609.21045v1 Announce Type: new Abstract: Collecting real-world robot data for dexterous manipulation is costly and time-consuming. While high-fidelity physics simulators enable scalable data sy

ForeTac-VLA: A Forecasting-Based Tactile-Vision-Language-Action Model for Contact-Rich Robotic Manipulation

TutorialsDGX agent

arXiv:2609.20980v1 Announce Type: new Abstract: Vision-language-action (VLA) models have demonstrated strong capabilities in robotic manipulation, yet their reliance on visual perception limits robust

From Retrieval to Recognition:How Vision--Language Models Become OCR Specialists

ResearchDGX agent

arXiv:2609.21543v1 Announce Type: new Abstract: Does a general vision--language model acquire specialized OCR ability by developing a new reading circuit or by reusing an existing mechanism? We addres

KnowDemo: Knowledge-Guided Robot Demonstration Generation from Human Videos

SafetyDGX agent

arXiv:2609.21229v1 Announce Type: cross Abstract: Learning robot manipulation policies typically requires substantial demonstration data, which are costly to collect on real robots. Recent methods gen

LLM-Generated Feature Pools for Time Series Anomaly Detection

ResearchDGX agent

arXiv:2609.21801v1 Announce Type: new Abstract: We study how far a simple statistical pipeline can go on univariate time series anomaly detection under a strict selection protocol. The method extracts

MemeTAG: Keyword-Driven Meme Classification through Tag Embedding Reconstruction

TutorialsDGX agent

arXiv:2609.20962v1 Announce Type: new Abstract: The proliferation of harmful internet memes poses a significant societal threat, yet their automated classification remains a formidable algorithmic cha

MultiHU-TD: Multifeature Hyperspectral Unmixing Based on Tensor Decomposition

ResearchDGX agent

arXiv:2310.03860v1 Announce Type: cross Abstract: Hyperspectral unmixing allows representing mixed pixels as a set of pure materials weighted by their abundances. Spectral features alone are often ins

OverThink: Slowdown Attacks on Reasoning LLMs

SafetyDGX agent

arXiv:2502.02542v5 Announce Type: replace Abstract: A reasoning language model (RLM) generates costly reasoning tokens, often hidden from the users, that help it excel at many tasks. Our Overthink att

ProTracer: Proprioception-Guided Failure Diagnosis in Robot Manipulation

Model ReleasesDGX agent

arXiv:2609.21369v1 Announce Type: cross Abstract: This paper presents a comprehensive framework for robot manipulation failure analysis that includes binary failure detection, failure categorization,

Simplifying Model Serving Across Multiple GPUs with NVIDIA TensorRT Multi-Device Integration in NVIDIA Dynamo-Triton

HardwareDGX agent

NVIDIA TensorRT’s multi‑device inference lets a single TensorRT network span multiple GPUs using NCCL‑backed collectives, preserving all standard optimizations and supported from TensorRT 11.0 onward.

SIRA: Reasoning-Aware Surgical Instrument Segmentation via Query-Anchored Alignment

Model ReleasesDGX agent

arXiv:2609.21402v1 Announce Type: new Abstract: Surgical instrument segmentation (SIS) plays a critical role in robotic assistance and surgical workflow analysis. However, most existing SIS methods fo

When Should Robots Intervene? Balancing Engagement and Intrusiveness in Human-Robot Interaction

TutorialsDGX agent

arXiv:2609.21734v1 Announce Type: new Abstract: Designing effective Human-Robot Interaction in task-oriented settings requires carefully balancing user engagement with socially acceptable levels of ro

20 Sept 2026

I said 'auto-regressive LLMs, in and of themselves, will not lead human-level AI' That statement is still totally true. First, the reasoning…

TutorialsDGX agent

I said 'auto-regressive LLMs, in and of themselves, will not lead human-level AI' That statement is still totally true. First, the reasoning abilities of current AI systems are based non-auto-regressi

Yes, you can make up some of the difference by giving Claude API access but (1) most people will never do this, (2) it means additional expe…

Model ReleasesDGX agent

Yes, you can make up some of the difference by giving Claude API access but (1) most people will never do this, (2) it means additional expense or difficulty, and (3) the real gain isn't from image ge

19 Sept 2026

Meet Qwen3.8-LiveTranslate, Qwen's next-generation real-time simultaneous interpretation model! 📢 Built on an Interleave architecture, it i…

Model ReleasesDGX agent

Meet Qwen3.8-LiveTranslate, Qwen's next-generation real-time simultaneous interpretation model! 📢 Built on an Interleave architecture, it improves faithfulness, fluency, and conciseness while reducing

18 Sept 2026

4D Radar Perception Algorithms for Autonomous Driving: A Review

AgentsDGX agent

arXiv:2609.19216v1 Announce Type: cross Abstract: Research on 4D millimeter-wave radar perception algorithms has flourished in recent years, extending from signal processing and object detection to se

6 billion tokens for $65 Is it as good as Astra and Fable at hard stuff? No of course not. But you don't always need a genius and can just c…

Model ReleasesDGX agent

6 billion tokens for $65 Is it as good as Astra and Fable at hard stuff? No of course not. But you don't always need a genius and can just call one for advice when you do. Extrapolate where this is go

AI Smart Glasses for Wearable Intelligence: From Egocentric Sensing to Agentic Personalization

AgentsDGX agent

arXiv:2609.19793v1 Announce Type: new Abstract: Recent advances in artificial intelligence (AI) are reshaping smart glasses from egocentric capture and display devices into platforms for wearable inte

AntiGrounding: Executable Robot Trajectories as Visual Prompts for VLM-Guided Manipulation

SafetyDGX agent

arXiv:2506.12374v3 Announce Type: replace-cross Abstract: Natural-language manipulation instructions specify the task goal but leave the underlying robot trajectory unspecified. We present AntiGroundi

AURA: Adaptive Uncertainty-Routed Analysis for Email Threat Detection

ApplicationsDGX agent

arXiv:2609.19873v1 Announce Type: new Abstract: Email spam and phishing attacks remain a critical security threat. Adversaries increasingly exploit large language models to craft contextually convinci

BinoGen: Scaling egocentric binocular data for embodied visual perception and learning

ApplicationsDGX agent

arXiv:2609.19881v1 Announce Type: new Abstract: Embodied visual perception relies on temporally coherent visual experience accumulated through continuous engagement with the environment. However, coll

CitySTAR: Structured and Topology-Aware Reasoning for Open-Vocabulary Urban 3D Grounding

Model ReleasesDGX agent

arXiv:2609.19911v1 Announce Type: new Abstract: 3D grounding aims to localize target entities in complex scenes from natural language and plays a fundamental role in embodied perception and spatial re

DeliveryGym: An RL Environment for Long-Horizon Embodied Agent Planning with Adaptive Curriculum

SafetyDGX agent

arXiv:2609.19801v1 Announce Type: new Abstract: Executable environments enable LLM agents to learn from the consequences of their actions. For embodied agents, those consequences extend beyond whether

Detecting Deceptive Recruitment: A Signal-theoretic Machine Learning Framework for Early Identification of Labour Exploitation

ApplicationsDGX agent

arXiv:2609.20336v1 Announce Type: cross Abstract: Deceptive online job advertisements have emerged as a primary pathway into forced labour, yet systematic detection methods remain underdeveloped due t

DocAttriBench: Benchmarking Answer Grounding in Document Visual Question Answering

Model ReleasesDGX agent

arXiv:2609.20574v1 Announce Type: new Abstract: Answer grounding in document visual question answering remains an open challenge: most benchmarks lack grounding annotations or provide limited-quality

FASA: Feedback-Aware Sampling Adaptation for Efficient Diffusion-Based VLA Models

ResearchDGX agent

arXiv:2609.19475v1 Announce Type: new Abstract: Diffusion-based Vision-Language-Action (VLA) models achieve strong performance in embodied tasks, but their iterative sampling imposes heavy computation

FORGE: Forensic Reasoning with Grounded Evidence

Local AiDGX agent

arXiv:2503.15867v4 Announce Type: replace-cross Abstract: Forensic deepfake analysis demands more than binary classification: investigators need region-grounded natural language explanations they can

Improving Generalization and Robustness in Offline Reinforcement Learning via Boundary-Aware Data Augmentation

SafetyDGX agent

arXiv:2609.20300v1 Announce Type: new Abstract: Current offline reinforcement learning (ORL) algorithms tend to overfit the training dataset and exhibit poor in-distribution generalization and robustn

Learn Before You Judge: Progressive Knowledge-to-Decision Alignment for Explainable Hateful Meme Detection

SafetyDGX agent

arXiv:2609.19778v1 Announce Type: new Abstract: Hateful memes spread abusive content through implicit interactions between images and text, posing serious threats to the safety of online communities.

PosteriorBench: From Point Estimates to Posterior Matching in Evaluating Generative Inverse Solvers

Model ReleasesDGX agent

arXiv:2609.20794v1 Announce Type: new Abstract: Generative models are increasingly used to solve scientific inverse problems, but existing evaluations still focus primarily on whether a method can pro

Redemption Score: A Multi-Modal Evaluation Framework for Image Captioning via Distributional, Perceptual, and Linguistic Signal Triangulation

Model ReleasesDGX agent

arXiv:2505.16180v3 Announce Type: replace-cross Abstract: Evaluating image captions requires cohesive assessment of both visual semantics and language pragmatics, which is often not entirely captured

Scientific Image Quality Assessment via Multi-modal Retrieval-Augmented Generation

ResearchDGX agent

arXiv:2609.19634v1 Announce Type: cross Abstract: This paper proposes a Retrieval-Augmented Generation (RAG) framework for scientific image quality assessment, designed to simultaneously address both

Stress Tests REVEAL Fragile Temporal and Visual Grounding in Video-Language Models

Model ReleasesDGX agent

arXiv:2602.11244v2 Announce Type: replace Abstract: Video-Language Models (VidLMs) achieve strong benchmark scores, yet these scores often hide whether models use the video at all. We show that VidLM

WZPlanner: Safe End-to-End Path Planning for Autonomous Driving in Work Zones

AgentsDGX agent

arXiv:2609.19393v1 Announce Type: new Abstract: Work zones alter lane geometry through temporary traffic controls and closures that may be absent from on-board maps, challenging autonomous vehicle (AV

← Previous
1…123124125126127…169
Next →