AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,119 results
16 Sept 2026

AquiLLM: Evaluating Faithfulness in Open-Weight RAG-LLM Systems for Scientific Research

Model ReleasesDGX agent

arXiv:2609.16519v1 Announce Type: new Abstract: Scientific research increasingly relies on large, heterogeneous data sources, motivating interest in retrieval-augmented generation (RAG) systems that p

CLASH: Counterfactual Auditing of Lexical and Prosodic Reliance in Spoken Sarcasm Detection

ResearchDGX agent

arXiv:2609.16582v1 Announce Type: cross Abstract: Spoken sarcasm detectors may exploit lexical content, prosody, or their interaction, yet conventional evaluation cannot reveal which cues drive their

DiaWhisper-DPO: Role-Attributed Transcription of Clinical Interviews via Failure-Mined Preference Optimization

ResearchDGX agent
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

arXiv:2609.16661v1 Announce Type: new Abstract: Automated depression screening from clinical interviews requires attribution of utterances to the clinician or patient. We evaluate two datasets: DAIC-W

From Momentary Emotion Inference to Sustained Emotion Support: Evaluating a Companion Agent in a Longitudinal Study

AgentsDGX agent

arXiv:2609.16344v1 Announce Type: cross Abstract: Sustained emotional support is a long-horizon interaction task closely tied to human well-being. Recent research demonstrates generative agents' capac

From Pixels to Images: A Structural Survey of Deep Learning Paradigms in Remote Sensing Image Semantic Segmentation

Local AiDGX agent

arXiv:2505.15147v3 Announce Type: replace Abstract: Remote sensing images (RSIs) capture both natural and human-induced changes on the Earth's surface. Semantic segmentation (SS) of RSIs enables the f

I built a native Vulkan training backend for 143 modern Transformer architectures — no CUDA or PyTorch required

Model ReleasesDGX agent

I've been working on something that started as the training backend for my Hierarchos architecture, but it has grown into a much broader project: https://github.com/necat101/Hierarchos-Native Hierarch

Intelligent Interaction Techniques (IIxT) - Proposal

ResearchDGX agent

arXiv:2609.16295v1 Announce Type: cross Abstract: Interaction techniques (IxTs) are the low-level, reusable components out of which user interfaces are designed, including menus, scroll bars, text inp

Japanese Stroke LLM Evaluation: A Conversational Benchmark for Safe Stroke Care in Japanese Using Large Language Models

Model ReleasesDGX agent

arXiv:2609.16739v1 Announce Type: new Abstract: Background: Large language models (LLMs) have achieved physician-comparable performance on multiple-choice medical knowledge examinations, but their cap

MLPerf Inference v6.1: pioneering agent, VLM benchmarks

AgentsDGX agent

MLPerf Inference v6.1 introduced the first agentic workload run on datacenter hardware and evaluated a model with more than one trillion parameters (Kimi K2), setting a new benchmark for scale. The te

Neuro-Symbolic Hierarchical Intention Anticipation in Human Behavior

Model ReleasesDGX agent

arXiv:2609.17064v1 Announce Type: new Abstract: Assistive autonomous systems must anticipate human goals before an observed behavior is complete. This article formulates anticipation as goal inference

Not Another Text Benchmark: Putting the 'Visual' Back in Visual Question Answering for Large Video Models

Model ReleasesDGX agent

arXiv:2609.17112v1 Announce Type: new Abstract: Large video models have exhibited impressive performance on a wide range of visual question answering tasks, owing to the rise of powerful, pretrained t

PhysStream: Streaming Physics-Grounded Video Generation with Structured Scene Memory and Fine-Grained Motion Control

TutorialsDGX agent

arXiv:2609.17521v1 Announce Type: cross Abstract: Interactive control for video generation is moving from coarse prompts toward fine-grained, physically meaningful manipulation of dynamic scenes. Yet

ProtoLIP: From Sentence-Level to Object-Level Evidence Disentanglement

Local AiDGX agent

arXiv:2609.16284v1 Announce Type: cross Abstract: Query-conditioned vision--language models enable fine-grained interpretation by revealing how visual evidence changes with textual queries. However, e

PunGraph: Retrieval-Enhanced Phonetic-Semantic Graph Reasoning for Pun Understanding

ResearchDGX agent

arXiv:2609.16557v1 Announce Type: new Abstract: Puns are a challenging form of figurative language that exploit phonetic similarity and semantic ambiguity to convey multiple meanings. Although large l

SceneBench: A Hierarchical Benchmark for Vision-Language Understanding of 3D Scenes

Model ReleasesDGX agent

arXiv:2609.16233v1 Announce Type: cross Abstract: Vision-language models excel at 2D image understanding but remain limited in 3D spatial reasoning. Progress is hindered by limitations in current benc

Sparse MLLM Anchors, Dense Adaptation: Breaking the Self-Referential Loop in Wild Test-Time Adaptation

Model ReleasesDGX agent

arXiv:2609.17040v1 Announce Type: new Abstract: Wild test-time adaptation (WTTA) updates a source model online under small test batches, concurrent distribution shifts, and time-varying class imbalanc

SPEAR NeXT Causal Latent Forecasting Across Multiple Horizons for Spectral Temporal Earth Representation Learning

ResearchDGX agent

arXiv:2609.16871v1 Announce Type: new Abstract: Earth observation is inherently dynamic, yet temporal information in many foundation models is learned through reconstruction, invariance, or retrospect

TEDi: Temporal Memory-Enhanced and Denoising Transformer for Surgical Instrument Segmentation

Model ReleasesDGX agent

arXiv:2609.16797v1 Announce Type: new Abstract: Query-based segmentation methods have shown promising potential for surgical instrument segmentation and recognition, which is essential for scene under

15 Sept 2026

3D Gait-Based Autism Classification Using Attention-Enhanced Deep Learning with Cross-Fold Statistical Stability Analysis

Model ReleasesDGX agent

arXiv:2609.14159v1 Announce Type: new Abstract: Autism Spectrum Disorder (ASD) is a neurodevelopmental condition whose early diagnosis remains challenging because conventional clinical assessments are

An Incomplete Loop: Deductive, Inductive, and Abductive Reasoning in Language Models

Model ReleasesDGX agent

arXiv:2404.03028v4 Announce Type: replace Abstract: Modern language models (LMs) can learn to perform new tasks in different ways: in instruction following, the target task is described explicitly in

Bellman Policy Optimization

SafetyDGX agent

arXiv:2609.15987v1 Announce Type: cross Abstract: Reinforcement learning with verifiable rewards (RLVR) improves the reasoning capabilities of large language models (LLMs). We introduce Bellman Policy

Bench2Dex: Benchmarking Visuo-Tactile Bimanual Dexterous Manipulation Across Dexterous Hands

Model ReleasesDGX agent

arXiv:2609.15726v1 Announce Type: cross Abstract: Tactile sensing provides contact information that can be difficult to infer from vision alone, but tactile hardware for dexterous hands has not conver

Beyond Accuracy: Robustness, Cost, and Governance Trade-offs for Vision-Language Models in Templated Document Extraction

Model ReleasesDGX agent

arXiv:2609.15706v1 Announce Type: new Abstract: Vision-language models (VLMs) are increasingly used to extract structured fields from business documents, yet most evaluations report accuracy on clean

Bridging the Modality Gap in Long-Form Clinical Audio: A Comparative Study of Lightweight and Heavyweight End-to-End SOAP Generation

ResearchDGX agent

arXiv:2609.14467v1 Announce Type: cross Abstract: Automating clinical documentation from long-form doctor-patient conversations remains challenging for modern audio-language models. While cascaded ASR

CITECHOICE: A Causal Audit of How Document Presentation Redistributes Citation Credit in Agentic Search

AgentsDGX agent

arXiv:2609.15164v1 Announce Type: new Abstract: When several retrieved sources support the same claim, an answer engine cites some but not others. We call this decision citation allocation and introdu

Clinical Reasoning Under a Partially Observed Objective in Cone Beam CT Report Generation

Model ReleasesDGX agent

arXiv:2609.13238v1 Announce Type: new Abstract: Maxillofacial report generation from cone beam computed tomography is scored here by a composite objective placing 80% of its weight on a large language

Convergent Emergence of In-Context Learning Across Modalities

ResearchDGX agent

arXiv:2609.14011v1 Announce Type: new Abstract: Few-shot in-context learning (ICL), the capacity of a model to infer abstract patterns from input-output examples provided in its prompt and apply them

Diagnosing Temporal Misalignment in Multichannel Time-Series Classification with Minimum Description Length

SafetyDGX agent

arXiv:2609.14595v1 Announce Type: cross Abstract: Multichannel time-series classification commonly assumes synchronized sensor streams, although latency, clock drift, and preprocessing can introduce r

Don't Send What You Don't Need: Question-Guided Token Pruning as a Privacy Defense for Vision-Language Models

Local AiDGX agent

arXiv:2609.15671v1 Announce Type: cross Abstract: Visual Question Answering (VQA) with Vision-Language Models (VLMs) is increasingly used in privacy-sensitive and bandwidth-constrained settings. Feder

Empirical Evaluation of Open-Source Large Language Models for Retrieval-Augmented Generation in ESG Domain

Model ReleasesDGX agent

arXiv:2609.15242v1 Announce Type: new Abstract: Environmental, Social, and Governance (ESG) reporting is critical for corporate accountability, with Large Language Models (LLMs) and Retrieval-Augmente

ESAFusion: LiDAR--4-D Radar Fusion via Local Geometric Complementation and Multiscale Adaptive Interaction for 3-D Object Detection

ResearchDGX agent

arXiv:2609.14619v1 Announce Type: new Abstract: LiDAR--4-D radar fusion combines accurate spatial geometry with motion and reflectivity cues from radar, offering a promising solution for 3-D object de

From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivity

AgentsDGX agent

arXiv:2609.10714v1 Announce Type: cross Abstract: The ambitious requirements of sixth-generation (6G) networks are driving communication systems from reliable bit delivery toward meaning-aware and tas

GRIN+: Towards Fast Yet Effective Machine Unlearning for Imbalanced Medical Data

Model ReleasesDGX agent

arXiv:2609.15571v1 Announce Type: new Abstract: As deep learning models become fundamental to modern healthcare, the 'Right to be Forgotten' mandated by privacy regulations like GDPR and HIPAA necessi

Language-Guided Representation Learning for Robust Cross-Sensor Material Recognition

Model ReleasesDGX agent

arXiv:2609.14783v1 Announce Type: cross Abstract: Robots need touch to manipulate objects safely and reliably, as many properties, such as softness, texture, and contact stability, are hard to infer f

LPA-CWM: A Learned Physical Adjudicator for Motion Reasoning with Counterfactual World Models

Model ReleasesDGX agent

arXiv:2609.14073v1 Announce Type: cross Abstract: Counterfactual world models (CWM) extract motion from pretrained video predictors by comparing factual and intervened predictions. However, responses

Mind2Cloud: EEG-to-Point Cloud Generation with Two-Granularity Diffusion Decoding

Model ReleasesDGX agent

arXiv:2609.13991v1 Announce Type: new Abstract: Reconstructing 3D objects from brain signals offers a promising avenue for understanding human visual cognition. While prior work has shown initial succ

NoteVQA: Benchmarking VLMs on Real-Life Questions from Human Communities

AgentsDGX agent

arXiv:2609.15695v1 Announce Type: new Abstract: Vision-language models (VLMs) increasingly power consumer-facing AI search, yet evaluating them on the diversity of everyday visual questions remains ch

Perceive, Refine, Reason: A Calibrated Pipeline for Measuring Indicators in Strategic Visual Communication on Social Media

ResearchDGX agent

arXiv:2609.14699v1 Announce Type: new Abstract: Visual content shapes audience perception and opinion on social media, and computational social science increasingly relies on automated tools to analyz

ProtoCAM: Interpretable Few-Shot Mask-Guided Prototypical Learning for Breast Lesion Classification in Ultrasound Imaging

TutorialsDGX agent

arXiv:2609.13340v1 Announce Type: cross Abstract: Breast ultrasound imaging plays an important role in the early detection and diagnosis of breast cancer, particularly for patients with dense breast t

Quantum-Gated LiteSSD: A Parameter-Efficient Lightweight Hybrid Quantum-Classical Framework for Forward-Looking Sonar Object Detection

Model ReleasesDGX agent

arXiv:2609.14025v1 Announce Type: new Abstract: Forward-looking sonar object detection is essential for underwater perception, yet deployment on embedded platforms requires highly compact models. To a

RA-CoA: Training-free Fashion Image Captioning via Retrieval-Augmented Chain-of-Attributes

ApplicationsDGX agent

arXiv:2609.14100v1 Announce Type: cross Abstract: Fashion Image Captioning (FIC) plays a vital role in enhancing user experience and product search in e-commerce platforms. Unlike natural scene image

Rank-Consistent Set Reasoning for Co-Salient Object Detection

ResearchDGX agent

arXiv:2609.13706v1 Announce Type: new Abstract: Co-salient object detection (Co-SOD) requires a model to find foreground regions that are salient in individual images and supported by the image group.

Scalability and Performance Evaluation of Federated Learning Frameworks: A Comparative Analysis

ApplicationsDGX agent

arXiv:2609.15681v1 Announce Type: cross Abstract: This paper presents a systematic examination and experimental comparison of the prominent Federated Learning (FL) frameworks FedML, Flower, Substra, a

Scaling Federated Learning Across Docker, Kubernetes, and Slurm with NVIDIA FLARE

HardwareDGX agent

NVIDIA FLARE separates persistent federation services from dynamically launched job workers, allowing each participating site to deploy federated learning jobs on Docker, Kubernetes, or Slurm without

Similar Accuracy, Unequal Evidence: Search APIs as Decision Surfaces for Tool-Using Agents

Model ReleasesDGX agent

arXiv:2607.10198v2 Announce Type: replace Abstract: Search APIs expose ranked snippets, URLs, and metadata on which agents decide whether to answer, search again, or fetch pages. We evaluate these int

Sparsity-Adaptive Sharpness-Aware Minimization

ApplicationsDGX agent

arXiv:2609.14274v1 Announce Type: new Abstract: Deploying deep neural networks in real-world settings requires models that are both compact and robust to common corruptions. However, at deployment-rel

STAGE: Diagnosing Semantic Transfer at Grounded Execution in Embodied Agents

Model ReleasesDGX agent

arXiv:2609.13458v1 Announce Type: cross Abstract: Embodied language grounding requires more than identifying the referent of an instruction: recovered semantics must also control the action an agent e

TestHallVQA: Exploring LVLMs' Document-Level Reasoning under Redundant Contexts from Scientific Exams

Model ReleasesDGX agent

arXiv:2609.13158v1 Announce Type: new Abstract: Large Vision--Language Models (LVLMs) are increasingly expected to perform visual question answering (VQA) over planar media. However, existing planar V

Toward Self-Adaptive Physical AI: Can LLM Agents Manage Long-Horizon Physical Tasks?

AgentsDGX agent

arXiv:2609.13436v1 Announce Type: new Abstract: Large Language Model (LLM) agents offer a promising path toward autonomously managing long-term physical tasks without human intervention. However, phys

TypiCore: A Hybrid Active Query Strategy for Class-Incremental Learning on Time Series

Model ReleasesDGX agent

arXiv:2607.17632v2 Announce Type: replace-cross Abstract: Time series data play a pivotal role across numerous domains, including healthcare and manufacturing. In real-world environments, models must

Verifiable by Construction: Claim-Level Evaluation of Verbatim Citation in Clinical Question Answering

Model ReleasesDGX agent

arXiv:2609.15964v1 Announce Type: new Abstract: Large language models (LLMs) have been widely adopted for clinical question answering (QA). Current systems can attach citations to their answers, but t

Zero-shot video highlight detection based on text descriptions and synthetic images

ResearchDGX agent

arXiv:2609.14790v1 Announce Type: new Abstract: Detecting video highlights, the most informative or engaging moments in a video, is important for applications such as video summarization and content r

14 Sept 2026

CoralscapesV2: Panoptic and Fine-Grained Visual Scene Understanding in Coral Reefs

Model ReleasesDGX agent

arXiv:2609.12826v1 Announce Type: new Abstract: In order to design conservation and restoration strategies to counter the global decline of coral reefs, ecological monitoring of reefs needs to be scal

DynSHAP: Towards Explainable Dynamic Survival Analysis

ApplicationsDGX agent

arXiv:2609.13042v1 Announce Type: new Abstract: Deep learning models for dynamic survival analysis (DSA) achieve strong predictive performance by incorporating longitudinal patient data, but their bla

ESTS at WMT26: Routing-Informed Expert Pruning for Model Compression

Model ReleasesDGX agent

arXiv:2609.12310v1 Announce Type: new Abstract: We describe six submissions under the team name ESTS to the unconstrained WMT26 Model Compression Shared Task for English--Simplified Chinese and Englis

Explainable Prediction from Mobile Sensing Data through LLM-guided Concept Integration

ResearchDGX agent

arXiv:2609.11995v1 Announce Type: new Abstract: Mobile sensing enables longitudinal monitoring of behavioral and physiological patterns in everyday settings. However, accurate prediction remains chall

Inferring Dislocation Microstructures from X-ray Diffraction via Cross-Modal Contrastive Learning

SafetyDGX agent

arXiv:2609.12713v1 Announce Type: cross Abstract: Understanding and inferring dislocation microstructures from diffraction patterns remains an open challenge in materials characterization, as diffract

LG-PF: Lightweight Confidence-Guided Polarization Image Fusion

Local AiDGX agent

arXiv:2609.12787v1 Announce Type: new Abstract: Polarization image fusion combines the stable luminance and structural information of the total- intensity image S0 with the material-sensitive details

OphBiWSSD: Scaling Temporal Action Localization in Ophthalmic Surgeries with Bidirectional Weight-tied State Space Duality

Model ReleasesDGX agent

arXiv:2609.12409v1 Announce Type: new Abstract: High-frequency surgical maneuvers in ophthalmology necessitate high-fidelity temporal modeling, yet characterizing long-range procedural dependencies re

Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization

AgentsDGX agent

arXiv:2609.13006v1 Announce Type: new Abstract: Video diffusion models (VDMs) have demonstrated remarkable capabilities in synthesizing high-fidelity, photorealistic video content. However, they funda

← Previous
1…9091929394…169
Next →