AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,652
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,793
  • Industry6,824
  • Local Ai7,051
  • Model Releases36,896
  • Research29,820
  • Safety19,754
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,652
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,793
  • Industry6,824
  • Local Ai7,051
  • Model Releases36,896
  • Research29,820
  • Safety19,754
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,652Total entries
60Added by human
127,592Found by agent
13Categories

Knowledge catalogue

Search: “pretraining”

GridTimelineEvolution
6,758 results
15 Oct 2026

SPECTRA-VLA: Base-Fine Hyperspectral Token Transfer at Frozen Vision-Language-Action Interfaces

ResearchDGX agent

arXiv:2610.19651v1 Announce Type: new Abstract: Hyperspectral imaging distinguishes RGB-similar objects, but a pretrained vision-language-action model needs a state its frozen decoder can use. SPECTRA

UltraBERT: Beyond the Limit of BERT Pre-Training

ResearchDGX agent

arXiv:2610.15028v1 Announce Type: cross Abstract: Recent bidirectional encoders have been modernized with innovations from causal large language models (LLMs). However, the pretraining recipe itself r

14 Oct 2026

Benchmarking Self-Supervised 3D Medical Vision Foundation Models and Transferability Estimation

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Model Releases
DGX agent

arXiv:2610.17573v1 Announce Type: new Abstract: Self-supervised pretraining has expanded the pool of 3D medical foundation models, but published evaluations use different datasets, endpoints and fine-

CAPTOR: a vision-language foundation model for Chest-Abdomen-Pelvis Oncologic CT

ResearchDGX agent

arXiv:2610.14226v1 Announce Type: new Abstract: Purpose : To develop and evaluate CAPTOR, a deep-learning vision-language foundation model for oncologic chest-abdomen-pelvis (CAP) CT interpretation. M

Code-Switching Detection via Language-Selective Dimensions in Speech Foundation Models

ResearchDGX agent

Code-switching (CS), the alternation between languages within an utterance, is common in multilingual speech but underrepresented in pretraining corpora. Increasing CS coverage requires finding releva

Physics Foundation Models for Efficient Control of Fluid Flows

SafetyDGX agent

arXiv:2610.15173v1 Announce Type: cross Abstract: We investigate whether a physics foundation model (PFM) pretrained for PDE forecasting can be repurposed for closed-loop fluid-flow control. We constr

Recasting DiT for Extreme Image Compression with Hierarchical Visual Priors

Model ReleasesDGX agent

arXiv:2610.18607v1 Announce Type: new Abstract: Pretrained diffusion models provide powerful generative priors for extreme image compression, but their stochastic, iterative generation processes are n

Scaling Laws for Multimodal Data Mixtures

ResearchDGX agent

arXiv:2610.14423v1 Announce Type: cross Abstract: Frontier AI systems are increasingly natively multimodal, jointly pretrained on multiple modalities, such as text, vision, and audio. However, the sci

Stable-Plastic Subspace Construction for Differentially Private Continual LoRA

ResearchDGX agent

arXiv:2610.17904v1 Announce Type: new Abstract: Continual learning (CL) adapts pretrained models to a sequence of tasks while retaining knowledge acquired from earlier tasks. When task data are sensit

To Align or Not To Align: Check Your COMPASS Before You Train

Local AiDGX agent

arXiv:2610.18638v1 Announce Type: cross Abstract: Combining pretrained models is a common strategy for building AI systems, whether by aligning a vision encoder with a language model or merging fine-t

Variable Input Masked Autoencoders for Wrist-Worn Accelerometry

Model ReleasesDGX agent

arXiv:2610.17383v1 Announce Type: new Abstract: Large-scale repositories of wearable sensor data have enabled the development of foundation models for human activities and behavior. However, existing

WAVE-0: Bridging VLA Policies and WAMs with Lightweight Latent Future Prediction

TutorialsDGX agent

arXiv:2610.18568v1 Announce Type: new Abstract: Vision-language-action (VLA) policies excel at generalist robotic manipulation but generate actions without explicitly modeling their environmental cons

12 Oct 2026

Decoding Register Tokens Preserves Global Scene Details

TutorialsDGX agent

arXiv:2610.13299v1 Announce Type: cross Abstract: Pretrained vision transformers learn structured image representations spanning spatial patch tokens and non-spatial tokens. Recent analyses suggest th

NeuronSpark: Selective Spiking State Space Models with Adaptive Computation for Language Modeling

Model ReleasesDGX agent

arXiv:2603.16148v2 Announce Type: replace Abstract: Spiking neural networks promise brain-inspired neural dynamics, yet native large-scale spiking language-model pretraining remains largely unexplored

Noise Space Learning for VLA Adaptation

SafetyDGX agent

arXiv:2610.13943v1 Announce Type: new Abstract: Pretrained vision-language-action (VLA) models encode broad manipulation priors, yet adapting them to specific tasks requires balancing limited robot in

What Visual Representations Do World Action Models Need?

ResearchDGX agent

arXiv:2610.13024v1 Announce Type: cross Abstract: World Action Models (WAMs) inherit powerful priors from pretrained video generation models, but their variational autoencoder (VAE) representations ar

9 Oct 2026

AutoAdapt: Reliable Few-Shot Adaptation under Clinical Distribution Shifts

ResearchDGX agent

arXiv:2610.11162v1 Announce Type: new Abstract: Large pretrained clinical models provide a practical way to reuse learned prior knowledge across hospitals by adapting models to them. In practice, a ta

CausalDreamer: Learning Predictive World Models with Latent Disentanglement

SafetyDGX agent

arXiv:2610.12016v1 Announce Type: new Abstract: World models for control must capture which aspects of the environment respond to the agent's actions and which are relevant to reward. Generative world

Dino Forcing Flow Models: Do not denoise what you can predict

ResearchDGX agent

arXiv:2610.11751v1 Announce Type: new Abstract: Co-denoising pretrained representations such as DINO can substantially improve the training speed and quality of flow matching models, but it introduces

Reading the Whole Heart: Latent-Attention Masked Autoencoders for Multimodal Cardiac Representation Learning

ResearchDGX agent

arXiv:2609.12035v3 Announce Type: replace Abstract: Cardiovascular diagnosis and treatment rest on integrating complementary modalities, such as electrocardiogram, echocardiography, and chest X-rays,

SignRAG: Unified Retrieval-Augmented Gloss-Free Sign Language Translation

Model ReleasesDGX agent

arXiv:2610.11371v1 Announce Type: new Abstract: Contemporary decoder-only large language models (LLMs) have demonstrated strong capabilities across a wide range of domains. However, existing pretraini

Test-Time Compute for Tabular Foundation Models: Mechanisms, Gains, and Limits

Model ReleasesDGX agent

arXiv:2610.12005v1 Announce Type: new Abstract: Which forms of test-time compute improve the predictions of strong pretrained tabular foundation models (TFMs)? We systematically study this along three

8 Oct 2026

LRCC: Generalizing Low-Rank Compression with Conditional Computation

Model ReleasesDGX agent

arXiv:2610.08858v1 Announce Type: new Abstract: Low-rank compression reduces the cost of pretrained language models by replacing linear transformations with low-rank factorizations. However, conventio

YUBI-STAG: Contact and Semantic-Rich Alignment for VLAs via Automated Video-Language Grounding

Local AiDGX agent

arXiv:2610.09718v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models acquire broad manipulation capabilities via large-scale pretraining, yet eliciting them through language requires

7 Oct 2026

iGPC: Generative Motion Priors for Object-Aware Humanoid Interaction

SafetyDGX agent

arXiv:2610.08120v1 Announce Type: new Abstract: Humanoid robots operating in unstructured environments must combine robust whole-body control with the ability to perceive and physically interact with

Label-Efficient Deep Learning for ECG Delineation: A Multi-Dataset Benchmark against Widely Used Delineation Tools

Model ReleasesDGX agent

arXiv:2610.07885v1 Announce Type: cross Abstract: Electrocardiogram (ECG) delineation, the identification of waveform boundaries, is a foundational step that translates raw ECG signals into clinically

Neuromotor Hierarchy Network: Physiological Inductive Biases for Robust Generalization in sEMG Decoding

Model ReleasesDGX agent

arXiv:2610.07713v1 Announce Type: new Abstract: Surface electromyography (sEMG) provides a wearable, noninvasive interface to neuromuscular activity for movement decoding and human-computer interactio

PEARS: Physical-Prior-Guided Efficient Adaptation via Failure Reasoning and Diffusion Steering for Tactile Manipulation

SafetyDGX agent

arXiv:2610.08784v1 Announce Type: new Abstract: Pretrained robotic policies can suffer substantial performance degradation under out-of-distribution (OOD) conditions encountered during deployment, mot

Rethinking Fine-Tuning: Unlocking Hidden Capabilities in Vision-Language Models

Model ReleasesDGX agent

arXiv:2512.23073v2 Announce Type: replace-cross Abstract: Fine-tuning has become the dominant paradigm for adapting Vision-Language Models (VLMs), yet most approaches rely on explicit weight updates t

Task-Space Imitation Guidance for Efficient Reinforcement Learning

SafetyDGX agent

arXiv:2610.07527v1 Announce Type: new Abstract: We introduce Task-Space Imitation Guidance for Efficient Reinforcement Learning (TIGER), a reward-construction and pretraining framework for sparse-rewa

6 Oct 2026

EEGDM: Label-Efficient EEG Representation Learning with Generative Diffusion Model

ResearchDGX agent

arXiv:2508.14086v4 Announce Type: replace Abstract: Electroencephalography (EEG) is a critical tool for monitoring brain activity and diagnosing neurological disorders such as epilepsy. However, learn

Frame-Level Temporal Alignment for Human-to-Robot Visual Adaptation

SafetyDGX agent

arXiv:2610.04372v1 Announce Type: cross Abstract: Transferring visual representations pretrained on human videos to robot manipulation requires learning reliable correspondences between human and robo

GeoBridge-VLA: Geometry-Aware Residual Adaptation for Vision-Language-Action Models

ResearchDGX agent

arXiv:2610.05026v1 Announce Type: new Abstract: Vision-language-action (VLA) models encode semantic information from vision-language pretraining, but manipulation also requires precise spatial reasoni

LyapuFlow: Controlling Generative Flows with Lyapunov Feedback for Inverse Problems

ResearchDGX agent

arXiv:2610.04326v1 Announce Type: new Abstract: Pretrained flow models are now widely used as generative priors in science and vision, where inference-time guidance enables test-time constraints witho

SUAVE: Unified Video-Action Models via Masked Diffusion

SafetyDGX agent

arXiv:2610.04009v1 Announce Type: cross Abstract: Vision-language-action models (VLAs) inherit strong semantic grounding from pretrained vision-language backbones but are typically optimized for predi

5 Oct 2026

DexJoCo-X: Benchmarking Action Representations for Multi-Hand Dexterous Manipulation

Model ReleasesDGX agent

arXiv:2610.03278v1 Announce Type: new Abstract: As dexterous hands proliferate, collecting data and training policies separately for every morphology becomes increasingly impractical. Scalable cross-e

DriftTTS: Few-Step Text-to-Speech Without Distillation via Distribution-Matching Drift

SafetyDGX agent

arXiv:2610.03390v1 Announce Type: cross Abstract: Few-step neural text-to-speech models often rely on short- ened diffusion or flow-matching schedules, or on distillation from pretrained multi-step te

Fisher-Guided Submodular Data Selection for Continual Pre-Training of Large Language Models

Model ReleasesDGX agent

arXiv:2610.02593v1 Announce Type: new Abstract: Data selection is already a central bottleneck in large-language-model training, where web-scale corpora are noisy and token budgets are finite. In cont

Getting Your Guidance Weights Right in diffusion and flow-matching posterior sampling

ResearchDGX agent

arXiv:2610.03503v1 Announce Type: new Abstract: Training-free posterior sampling methods, also known as Plug-and-Play methods, leverage pretrained unconditional diffusion or flow-matching models to so

Native Action-Prior Learning from Videos for World Action Models

SafetyDGX agent

arXiv:2610.03391v1 Announce Type: new Abstract: World action models integrate future visual dynamics with robot action prediction, but their scalability remains limited by the need for action-annotate

Safeguarding Mutual Correction in Source-Free Domain Adaptation via Cut Statistics

SafetyDGX agent

arXiv:2610.02981v1 Announce Type: new Abstract: Source-Free Domain Adaptation (SFDA) aims to adapt a source-pretrained model to an unlabeled target domain without access to the original source domain.

SigLIP2 for aerial fire risk classification

ResearchDGX agent

arXiv:2610.03689v1 Announce Type: new Abstract: We examine the transfer of a pretrained SigLIP2 image encoder to seven class fire risk classification from aerial imagery. We introduce a reproducible p

Uncertainty Quantification for Flow-Based Generalist Robot Policies

ApplicationsDGX agent

arXiv:2606.18043v2 Announce Type: replace-cross Abstract: Generalist robot policies, such as vision-language-action models (VLAs) and world-action models (WAMs), combine powerful pretrained backbones

2 Oct 2026

CortexBridge: Cortical Alignment of EEG Montages for Foundation Models

SafetyDGX agent

arXiv:2610.01124v1 Announce Type: new Abstract: Electroencephalography (EEG) foundation models are often pretrained with a fixed channel vocabulary or a limited set of montages, making transfer diffic

Emergent Object Binding Has a Finite Spatial Horizon

ResearchDGX agent

arXiv:2610.00006v1 Announce Type: new Abstract: Pretrained Vision Transformers encode whether two image patches belong to the same object. This IsSameObject signal is decodable from frozen patch embed

Gumbel Straight Flow: Distilling Autoregressive Models into One-step Flow Maps

ResearchDGX agent

arXiv:2610.00497v1 Announce Type: cross Abstract: We present Gumbel Straight Flow (GSF), a continuous flow map language model that leverages the noise-data coupling of a pretrained autoregressive lang

Language Discrimination Improves Linguistic Learning in Multilingual Speech Models

ResearchDGX agent

Multilingual self-supervised speech models can benefit from sharing information across languages, but under a matched total pretraining data budget they still fall short of monolingual models. We show

PAGER: Partial-to-global Alignment via Geometric and Relational Distillation

SafetyDGX agent

arXiv:2610.01589v1 Announce Type: new Abstract: Pretrained 3D encoders are typically developed on globally reconstructed scenes expressed in a consistent world coordinate frame, whereas embodied syste

STATERA: Hidden Mass Estimation via Zero-Shot Sim-to-Real Kinematics using Frozen Temporal Tubelets

Model ReleasesDGX agent

arXiv:2610.00003v1 Announce Type: cross Abstract: Vision models pretrained for frame-level appearance often struggle to infer hidden physical properties from motion. We study center-of-mass (CoM) loca

1 Oct 2026

Diffusable Latents from Structure-Agnostic Distillation

ResearchDGX agent

arXiv:2609.39657v1 Announce Type: new Abstract: Distilling pretrained foundation models into an autoencoder bottleneck improves latent diffusability, enabling diffusion models to converge faster and r

Fenchel Tilting: Weighted Correction for Efficient Finetuning of Generative Models

SafetyDGX agent

arXiv:2609.40030v1 Announce Type: cross Abstract: Adapting a pretrained generative model to an arbitrary preference expressed as a utility function underlies reward alignment, guided design, and const

GroundingPI: A Grounding Foundation Model towards Physical Intelligence with Visual Primitives

AgentsDGX agent

arXiv:2609.39601v1 Announce Type: cross Abstract: Precise grounding matters. It specifies which object is the target and where that object is, even in clutter and for tiny objects, and it has to be fa

Multimodal Flow: Unified Flow Modeling of Language and Vision in Embedding Spaces

Model ReleasesDGX agent

arXiv:2609.40362v1 Announce Type: new Abstract: We present Multimodal Flow, a fully continuous generative model of language and vision. Most unified multimodal models either model both language and qu

30 Sept 2026

A foundation model for energy and radiation systems built on heterogeneous scientific interfaces

Model ReleasesDGX agent

arXiv:2609.38067v1 Announce Type: new Abstract: Scientific foundation models are commonly evaluated after heterogeneous physical problems have already been translated into a compatible gridded, tokeni

Credit-Guided Policy Improvement for Test-time Adaptive Vision-Language Navigation

SafetyDGX agent

arXiv:2609.37591v1 Announce Type: cross Abstract: Test-time adaptation for vision-language navigation (TTA-VLN) enables pretrained policies to adapt online to unseen environments using only test-time

Orthogonal Yet Coupled: Decoupling Geometric Components for Model Merging

ResearchDGX agent

arXiv:2609.37564v1 Announce Type: new Abstract: Merging pretrained models has emerged as an effective approach for consolidating diverse capabilities into a single unified model. However, prevailing m

TaskBridge: Bridging Unsupervised Tabular Anomaly Detection and In-Context Learning via Virtual Tasks

ApplicationsDGX agent

arXiv:2609.36968v1 Announce Type: new Abstract: Unsupervised tabular anomaly detection (TAD) aims to identify anomalous rows in tabular data using normal training samples. While conventional methods r

The Layer Mystery of VLA: An Information-Theoretical Analysis of VLA Latent Interface

SafetyDGX agent

arXiv:2609.36118v1 Announce Type: new Abstract: Vision-language-action (VLA) policies connect a pretrained vision-language backbone to an action head through a latent interface, but which backbone lay

Time-Anchored Diffusion Language Models: Latent-Space Caching for Fast Generation

ResearchDGX agent

arXiv:2609.37924v1 Announce Type: cross Abstract: Recent work on anchored diffusion language models improves denoising by shaping an intermediate latent space with supervised important-token targets.

Transformers Stop Thinking Too Early, and a Tiny LoRA Fixes It

ResearchDGX agent

arXiv:2609.36585v1 Announce Type: new Abstract: Pretrained transformers use little of their depth to follow references in context. Thirteen base models reliably follow only 1.4-3.6 lines, and extra pr

← Previous
1…1415161718…113
Next →