AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “multimodal”

GridTimelineEvolution
10,119 results
29 Sept 2026

Evidence Before Accuracy: A MRI-PET Fusion Network for Alzheimer Disease Classification with Causal Regional Validation

ResearchDGX agent

arXiv:2609.34520v1 Announce Type: new Abstract: Deep learning models for Alzheimer disease (AD) classification routinely report near-perfect discrimination, yet few are shown to rest on AD-relevant ne

EyeVQA: Benchmarking Ophthalmic Vision-Language Models from Recognition to Spatial Grounding

Model ReleasesDGX agent

arXiv:2609.32352v1 Announce Type: new Abstract: Vision-language models (VLMs) have shown increasing potential for medical image understanding, yet their capabilities in ophthalmic imaging remain insuf

Federated Subspace Guided Vision-Language-Action Policy Distillation for Non-IID Multi-Robot Manipulation

Model Releases
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
DGX agent

arXiv:2609.32239v1 Announce Type: cross Abstract: Federated learning offers a natural way for multiple robots to jointly improve manipulation policies without requiring centralized access to training

FocusDrive: Reasoning with Visual Focus for Autonomous Driving

AgentsDGX agent

arXiv:2609.33190v1 Announce Type: new Abstract: Driving decisions depend on both where to focus and how to act on what is seen. Effective driving reasoning must establish which objects matter, where t

G^3-LoRA: Organizing Reward-Weighted Video Data with Gradient-Guided Grouped LoRA

SafetyDGX agent

arXiv:2609.35189v1 Announce Type: new Abstract: Post-training foundation video models on heterogeneous reward-weighted data usually assume that all data categories induce compatible updates. This assu

Guava: Distilling Frontier VLM Agents into a Compact Model with a Manipulation Harness

AgentsDGX agent

arXiv:2606.18363v2 Announce Type: replace Abstract: Language models trained on large-scale vision-language data have demonstrated strong potential for embodied agents. Harnessing models through embodi

HeroFrame-Bench: Reference-Anchored Evaluation via Rubric--Ranking Co-Evolution for Movie Hero Frame Selection

SafetyDGX agent

arXiv:2609.32280v1 Announce Type: new Abstract: Hero frames are in-film stills used as source imagery for theatrical posters, streaming cover art, film database listings, and other promotional placeme

InterTab: Interleaved Visual-Structure Alignment for Multi-Modal Table Reasoning

Model ReleasesDGX agent

arXiv:2609.32660v1 Announce Type: new Abstract: Table images preserve structural information that are often lost in text serialization, and reasoning over them requires locating relevant rows, columns

LEGAU: Learning Semantic Gaussian Priors for Scalable Category-level Pose Estimation

Local AiDGX agent

arXiv:2609.35046v1 Announce Type: new Abstract: Category-level 6D pose estimation from a single RGB-D observation is inherently under-constrained, since partial visible geometry must be interpreted to

Look Before You Select: Rethinking Vocabulary Sparsification in On-Policy Distillation

Model ReleasesDGX agent

arXiv:2609.34386v1 Announce Type: cross Abstract: On-policy distillation (OPD) uses teacher correction on student-generated responses. Full-vocabulary correction can provide important corrections even

Modernising the Compressed-Domain Video Captioner: A Controlled Study of SigLIP2 and GPT-2 Substitutions

ResearchDGX agent

arXiv:2609.31700v1 Announce Type: new Abstract: Compressed-domain video captioning avoids full video decoding by operating directly on I-frames, motion vectors and residuals, trading a small amount of

MoGround: Measuring and Mitigating Modality Distraction in Vision-Language Models

ResearchDGX agent

arXiv:2609.33431v1 Announce Type: new Abstract: We release MoGround, a vision-language dataset spanning four visual domains in which the answer to every question is guaranteed to be available from exa

MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Space

ResearchDGX agent

arXiv:2609.34190v1 Announce Type: new Abstract: Recent advances in diffusion and flow models have substantially improved text-driven human motion generation. Yet most methods generate in low-dimension

NutriVision: Ingredient-Conditioned Fusion and Prediction for Single-Image Food Nutrition Estimation

ResearchDGX agent

arXiv:2609.33076v1 Announce Type: new Abstract: Nutrition estimation is a fundamental task in consumer diet tracking, clinical dietetics, chronic disease management, sports and hospital nutrition, and

OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoning

Model ReleasesDGX agent

arXiv:2603.24458v3 Announce Type: replace Abstract: While proprietary systems such as Seedance-2.0 have achieved remarkable success in omni-capable video generation, the academic research community la

One Sensor, Whole Body - 3D Body Pose from a Single Consumer Earbud IMU

Model ReleasesDGX agent

arXiv:2609.34978v1 Announce Type: new Abstract: Consumer earbuds already stream inertial motion data from the head, one of the most widely worn sensor locations on the body. We ask how much of the 3D

Optimal Transport Dropout for Structured Predictive Uncertainty

TutorialsDGX agent

arXiv:2609.33377v1 Announce Type: new Abstract: Deterministic neural networks and neural operators provide point predictions with no intrinsic measure of reliability. Yet, predictive uncertainty may s

Optimal transport meets speech: a tutorial review

SafetyDGX agent

arXiv:2609.31787v1 Announce Type: cross Abstract: Optimal Transport (OT) provides a principled framework for comparing and transforming probability distributions while preserving geometric structure.

PlaylistEval: Can Video-Language Judges Be Trusted at Day Scale and Beyond?

Model ReleasesDGX agent

arXiv:2609.34314v1 Announce Type: new Abstract: Video-language models are increasingly used as judges of video understanding, both for evaluating model outputs and for training reward models. Whether

Rethinking Causal Action Tokenization with Conditional Annealing in Flow Matching

ApplicationsDGX agent

arXiv:2609.35469v1 Announce Type: cross Abstract: Autoregressive Vision-Language-Action (VLA) models offer a scalable path to robot learning, yet existing action tokenizers treat tokenization as a com

ReVision3D: Attribution-Guided Recursive Self-Improvement for 3D Medical Perception

ResearchDGX agent

arXiv:2609.32984v1 Announce Type: new Abstract: Recursive self-improvement (RSI) offers a promising path for overcoming the limited visual capability of current medical imaging agents. Yet applying RS

RLE-Bench: A Qualifying Exam for Coding Agents as Robot Learning Engineers

Model ReleasesDGX agent

arXiv:2609.34210v1 Announce Type: new Abstract: Coding agents are beginning to move beyond purely digital tasks to tackle physical-world challenges, particularly in robotics. Existing robotics benchma

Safe Score Matching: Diffusion Policies with Hamilton-Jacobi Reachability for Online Safe Reinforcement Learning

SafetyDGX agent

arXiv:2609.33337v1 Announce Type: new Abstract: Online safe reinforcement learning (RL) seeks policies that maximize reward while satisfying safety constraints. A popular line of research in safe RL r

T-SNN: Temporal Simplicial Neural Network for EEG Decoding

ResearchDGX agent

arXiv:2609.34002v1 Announce Type: new Abstract: Decoding brain states requires models that capture both the evolution of neural activity and interactions among groups of brain regions. Existing EEG me

Token-Disentangled Latent Test-Time Scaling for Vision-Language Reasoning

Model ReleasesDGX agent

arXiv:2609.35228v1 Announce Type: new Abstract: Latent test-time scaling improves reasoning by refining hidden states during inference, but existing methods typically apply a single scalar reward to a

TTRSD: Test-Time Reinforcement Learning with Self-Distillation for Vision-Language Models

SafetyDGX agent

arXiv:2609.33414v1 Announce Type: new Abstract: Test-time reinforcement learning enables vision-language models (VLMs) to adapt using unlabeled inputs. However, repeated sampling under fixed visual co

Uni-VLaT: Whole-Body Tactile Adaptation of VLA Policies for Humanoid Loco-Manipulation

TutorialsDGX agent

arXiv:2609.35450v1 Announce Type: new Abstract: Physical contact often determines how a humanoid should respond during loco-manipulation, yet vision and proprioception alone are often insufficient to

Vision-Language Agents for Active Perception in Optics Laboratories

AgentsDGX agent

arXiv:2609.32918v1 Announce Type: cross Abstract: Vision-language models (VLMs) are increasingly being used in scientific workflows, but their ability as agents to directly control laboratory experime

VL-AcneSeg: A Vision-Language Framework for Region-Aware Acne Lesion Segmentation

ResearchDGX agent

arXiv:2609.34472v1 Announce Type: new Abstract: Acne assessment is crucial for clinical decision-making, yet traditional grading and counting are subjective and fail to account for lesion size. While

WSM-Aware HRI: An IoT-Enhanced Framework for Early Detection and Norm-Guided Repair of Failures with LLM Guidance

SafetyDGX agent

arXiv:2609.32336v1 Announce Type: new Abstract: Human-robot interaction (HRI) failures remain a major barrier to deploying robots in real-world environments. Prior work often treats failures as isolat

28 Sept 2026

Amplify What You Gaze At: Target Saliency Boosting in Text-to-Image Generation

SafetyDGX agent

arXiv:2609.30733v1 Announce Type: new Abstract: Text-to-image generation has advanced in controlling what, where, and how objects appear, yet how visual attention is distributed among objects remains

BAT-CLIP: Trimodal Alignment of Brain, Audio and Text

Model ReleasesDGX agent

arXiv:2609.31180v1 Announce Type: cross Abstract: Decoding and interpreting naturalistic speech from the brain increasingly relies on alignment to pretrained speech and language representation spaces.

Block Sparse Attention with Log-Linear Complexity

ResearchDGX agent

arXiv:2609.31093v1 Announce Type: new Abstract: Scaling language models to long contexts is limited by the quadratic cost of self-attention. Block sparse attention offers an efficient alternative, but

CCRV-Bench: Constraint-Based Evaluation of Causal Reasoning in Vision-Language Models

Model ReleasesDGX agent

arXiv:2609.30979v1 Announce Type: new Abstract: Vision-language models (VLMs) have demonstrated excellent performance in visual tasks, but their visual causal reasoning capabilities still lack reliabl

CG-Probes: Recovering Guardrail Directions from Patient Query Embeddings

SafetyDGX agent

arXiv:2609.31062v1 Announce Type: new Abstract: Patient-facing AI assistants promise valuable support to patients, but incoming queries can pose medical risks. To create guardrails, we work with oncol

EmoZone-Talker: Regional Semantic Control of Audio-Driven 3DGS Talking Heads via Facial Action Units

Model ReleasesDGX agent

arXiv:2606.15848v2 Announce Type: replace Abstract: 3D Gaussian Splatting (3DGS) has shown strong potential for high-fidelity talking head synthesis. However, enabling fine-grained, interpretable, and

From Reward Signal to Visual Utility: A Controlled Audit of Medical VLM Post-Training

Model ReleasesDGX agent

arXiv:2609.31450v1 Announce Type: cross Abstract: Medical vision-language model (VLM) post-training is commonly evaluated through answer accuracy. We examine how changes in accuracy and training objec

HybridInfer: Thermal-Aware Reinforcement-Learning Tier Routing for On-Device, Edge, and Cloud LLM Inference

Model ReleasesDGX agent

arXiv:2609.30270v1 Announce Type: new Abstract: On-device inference with small language models keeps user data local, works offline, and incurs no per-query cost, so the on-device tier is preferred wh

Introducing FireRouter with Opus. Our first router model. Routine tasks go to top open models, Claude Opus handles the rest. Cache and task-…

Model ReleasesDGX agent

Introducing FireRouter with Opus. Our first router model. Routine tasks go to top open models, Claude Opus handles the rest. Cache and task-aware routing. Proven 98.1% of Opus accuracy with 57% lower

MDSkin-Net: Multi-Task Skin Lesion Analysis Driven by Pattern Analysis Priors and Spatial Alignment Regularization

Model ReleasesDGX agent

arXiv:2609.30855v1 Announce Type: new Abstract: Reliable skin lesion segmentation and classification are central to dermoscopic computer-aided diagnosis. Existing multi-task frameworks couple the two

MexHat: A Dataset for Hate Speech Detection in Mexican Spanish Videos

SafetyDGX agent

arXiv:2609.31553v1 Announce Type: new Abstract: Ensuring online safety through content monitoring had raised Hate Speech Detection as a crucial task to be addressed. By essence the task demands the ca

Peer Review as Structured Commentary: Immutable Identity, Public Dialogue, and Reproducible Scholarship

ResearchDGX agent

arXiv:2506.22497v2 Announce Type: replace-cross Abstract: This paper reconceptualises peer review as structured public commentary. Traditional academic validation is hindered by anonymity, latency, an

PHASE: Compliance-Enabled Tactile Phase Retrieval for Few-Shot Insertion Learning

SafetyDGX agent

arXiv:2609.30889v1 Announce Type: new Abstract: Contact-rich assembly tasks such as peg-in-hole insertion remain difficult to learn from limited demonstrations. While retrieval-augmented imitation lea

PixSim: a calibrated open-source simulator of instant-payment fraud, recovery and interdiction under analyst capacity constraints

Model ReleasesDGX agent

arXiv:2609.30684v1 Announce Type: new Abstract: Brazil's Pix settles about 5.9 billion instant, irreversible transfers a month. A fraudulent transfer can be recovered only while the funds remain in a

Policy-Calibrated DAgger: Offline Calibrated Noise Injection for Imitation Learning

SafetyDGX agent

arXiv:2609.30462v1 Announce Type: new Abstract: Policies trained with imitation learning can accumulate errors over time, causing the robot to drift outside the training distribution. Existing methods

Preserve-and-Compose Training for Composed Image Retrieval

ResearchDGX agent

arXiv:2609.31202v1 Announce Type: new Abstract: Composed image retrieval (CIR) aims to retrieve images that satisfy a user-specified modification while preserving relevant visual content from a refere

ProCAP: Probabilistic Cross-Attentive Prompt Learning for Vision-Language Models

ResearchDGX agent

arXiv:2609.30434v1 Announce Type: new Abstract: Pre-trained vision-language models such as CLIP can recognize new categories via prompting, but they often struggle when labeled data are scarce or the

Prompt-Based Continual Compositional Zero-Shot Learning

Model ReleasesDGX agent

arXiv:2512.09172v3 Announce Type: replace-cross Abstract: We tackle continual adaptation of vision-language models to new attributes, objects, and their compositions in Compositional Zero-Shot Learnin

SciHorizon-eLab: An Agentic Protocol-to-Task Compiler for Scalable Benchmarking of Scientific Embodied Agents

Model ReleasesDGX agent

arXiv:2609.30971v1 Announce Type: new Abstract: Embodied agents offer a promising route to automating scientific experimentation, yet their progress is constrained by the lack of reliable and systemat

Stepwise Intrinsic Rewards for Reasoning in Large Language Models

SafetyDGX agent

arXiv:2602.01034v2 Announce Type: replace Abstract: Reinforcement learning (RL) has become a widely used paradigm for improving the reasoning abilities of large language models (LLMs) and Vision-langu

The Linear Representation Hypothesis for Vision-Language-Action Models

Model ReleasesDGX agent

arXiv:2609.30996v1 Announce Type: cross Abstract: The linear representation hypothesis (LRH) has become a standard lens for measuring and intervening on semantic information through the internal repre

UniAR: A Unified Framework for Autism Recognition Enhanced by Multi-View Prompt Learning

SafetyDGX agent

arXiv:2609.31298v1 Announce Type: cross Abstract: Autism Spectrum Disorder (ASD) is a complex neurodevelopmental disorder for which early and accurate diagnosis is critical to improving long-term deve

27 Sept 2026

b11223

Model ReleasesDGX agent

server : allow RANK pooling batch splitting for causal LLM rerankers (ie. Qwen3 and Qwen3-VL) (#28876) server : allow splitting RANK pooling for causal LLM rerankers Rerank models fall into two catego

25 Sept 2026

A Rapid Pipeline for Training and Deploying ML Models on WeBe Band

Local AiDGX agent

arXiv:2609.29084v1 Announce Type: new Abstract: Developing optimized machine-learning algorithms for edge devices with limited computational and memory resources is challenging, time-consuming, and hi

Benchmarking and Domain Adaptation of Automatic Speech Recognition (ASR) for Adolescent Health Communication in Ghanaian Languages

Model ReleasesDGX agent

arXiv:2609.29798v1 Announce Type: cross Abstract: This paper presents an end-to-end study of automatic speech recognition (ASR) for adolescent health communication in three Ghanaian languages (Twi, Da

Deep learning of longitudinal visual fields predicts glaucoma progression rate and identifies fast progressors

ResearchDGX agent

arXiv:2609.29256v1 Announce Type: cross Abstract: Glaucoma is the leading cause of irreversible blindness, and timely identification of fast progressors is essential to prevent disability. Current pra

Edge AI on Constrained Devices for Binary Sleep-Wake Classification in Dynamic Environments

Local AiDGX agent

arXiv:2609.29163v1 Announce Type: new Abstract: This paper presents an Edge AI-based system for detecting sleep and wake states in non-stationary mobile environments using resource-constrained embedde

Faster Visuomotor Policy Learning on Action Manifolds via Riemannian MeanFlow

SafetyDGX agent

arXiv:2609.30127v1 Announce Type: new Abstract: Visuomotor policies learn a direct map from raw sensory observations to robot action sequences. Policies based on Diffusion and Flow Matching capture th

From Target Selection to Digging: A Learning-Based Framework for Continuous Autonomous Excavation

SafetyDGX agent

arXiv:2609.29750v1 Announce Type: new Abstract: Repeated excavation continuously reshapes pile geometry, requiring an autonomous excavator to adapt its digging targets and coordinate motion across suc

From Text Decisions to Pixels: An Study of Jev-Style Visual Choice Model

Model ReleasesDGX agent

arXiv:2609.29283v1 Announce Type: new Abstract: Visual software often needs a decision over supplied alternatives rather than a generated explanation. We present PixelJev, a native-image decision inte

← Previous
1…121122123124125…169
Next →