Search: “pretraining”

DiffWAM: A Fast and Efficient Navigation World Action Model

arXiv:2609.39763v1 Announce Type: cross Abstract: Pretrained video foundation models encode rich semantic and spatiotemporal priors for embodied navigation, yet converting these priors into UAV motion

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DynaHarness: A Dynamic Physical Harness for Self-Evolving Robot Agents

DGX agent

arXiv:2609.40306v1 Announce Type: cross Abstract: Pretrained robot policies provide useful action priors, but long-horizon manipulation still requires coordination between semantic reasoning and physi

safetyarxiv-cs-ai

1 Oct 2026

Image Classifiers are Efficient Self-Supervised Video Representation Learners

arXiv:2609.40347v1 Announce Type: new Abstract: We introduce VideoMSN, a Masked Siamese Network framework for efficient self-supervised spatio-temporal representation learning in videos. Instead of re

Inductive Visual Logic for Few-Shot Out-Of-Distribution Adaptation in VLMs

model-releasesarxiv-cs-cv

arXiv:2609.38362v1 Announce Type: new Abstract: Generative vision-language models (VLMs) such as Qwen-VL and LLaVA achieve strong zero-shot performance on tasks overlapping with their pretraining dist

PEG-Tab: Sampling-Time Record Repair and Release Control for Tabular Synthesis

arXiv:2609.39630v1 Announce Type: new Abstract: Pretrained tabular generators can reproduce training records even when aggregate utility remains high. When retraining is unavailable or too costly, sam

PrefPI: Preference-Guided Steering into Out-of-Distribution Behaviors

arXiv:2609.40165v1 Announce Type: cross Abstract: We present PrefPI (Preference-Guided Policy Iteration), an iterative framework for steering pretrained generative robot policies using only relative p

safetyarxiv-cs-ai

Hardware

Sparse-WAM: Accelerating World Action Models via Action-Guided Sparse Imagination

arXiv:2609.38984v1 Announce Type: cross Abstract: World-action models (WAMs) leverage pretrained video models to improve generalization in robot control by jointly predicting future visual states and

hardwarearxiv-cs-ai

Synthetic Data Characterization via Training Dynamics

arXiv:2609.39447v1 Announce Type: new Abstract: Interpreting properties of LLM-generated data is important for understanding its utility and limitations across learning tasks. In this work, we charact

researcharxiv-cs-cl

T-Router: Learning Thalamic Routing for Reasoning with Parameter-Efficient Reinforcement Learning

arXiv:2609.39109v1 Announce Type: cross Abstract: Parameter-efficient reinforcement learning aims to improve reasoning with a compact trainable interface to a pretrained model. We introduce the Thalam

VOSSA: Voiceprint Optimization for Streaming Speech Architectures

arXiv:2609.38887v1 Announce Type: cross Abstract: Real-time voice conversion (VC) systems commonly rely on pretrained speaker embeddings from automatic speaker verification (ASV) models. While effecti

researcharxiv-cs-cl

Adapting Linear-Time Architectures for Tabular In-Context Learning

arXiv:2609.36337v1 Announce Type: new Abstract: Tabular foundation models achieve strong performance by conditioning on labelled examples in context, but softmax attention limits their use on large da

CoRe-VLA: Preserving Cross-View Coordination in VLAs under Camera Shifts

arXiv:2609.37150v1 Announce Type: new Abstract: VLAs combine pretrained vision-language representations with action generation to enable language-guided control across diverse tasks, becoming a mainst

safetyarxiv-cs-ro

GeoSET: Generalist Foundation Model for SAR-to-EO Image Translation

arXiv:2609.37496v1 Announce Type: new Abstract: Paired synthetic aperture radar (SAR) and electro-optical (EO) imagery is increasingly available across sensors, resolutions, and geographic regions. Ye

HiRAE: Hierarchical Representation Autoencoding with Residual Budgets

arXiv:2609.37775v1 Announce Type: cross Abstract: Pretrained visual representations support image generation, but may not fully preserve the fine-grained details needed for faithful reconstruction. Me

safetyarxiv-cs-ai

Interacting particle guidance for sampling reward-tilted generative priors

arXiv:2609.37227v1 Announce Type: new Abstract: Inference-time steering adapts pretrained diffusion and flow-based models to new tasks, e.g., to generate samples from a conditional distribution or sam

safetyarxiv-cs-lg

MoTIF-X: A Multimodal Tokenized Framework for Interpretable and Extensible Molecular Representation Learning

arXiv:2609.37384v1 Announce Type: new Abstract: Molecular representation learning is central to computer-aided drug discovery. Molecular graphs, SMILES strings, and 3D conformations provide complement

Local Ai

MVG-WAM: Multiple View Geometry-Aware World-Action Modeling for Robotic Manipulation

arXiv:2609.37793v1 Announce Type: new Abstract: World-Action Models (WAMs) couple visual dynamics with action prediction, bringing the rich priors of pretrained video models to robotic manipulation. H

local-aiarxiv-cs-ro

Principled MAP estimation for inverse problems: bridging the gap between convergence and performance

arXiv:2609.37529v1 Announce Type: new Abstract: Pretrained denoisers provide a powerful way to incorporate image priors into restoration algorithms. Plug-and-Play and RED approaches exploit fixed-nois

Reprogramming Vision-Language Models via Structured Prompt Reparameterization

arXiv:2609.36680v1 Announce Type: new Abstract: Visual reprogramming adapts pretrained models to downstream tasks by modifying their input and output interfaces while keeping the backbone fixed. In vi

Rethinking Soft Tokens for Parallel Decoding in Diffusion Language Models

arXiv:2609.37391v1 Announce Type: new Abstract: Diffusion language models (DLMs) enable parallel generation by predicting and committing multiple tokens at each denoising step, yet they can generate i

Local Ai

Scalable Diffusion SBI for Compositional Inference under Simulator Misspecification

arXiv:2609.36950v1 Announce Type: new Abstract: Simulation-based inference is challenging when many heterogeneous observations must be composed, hierarchical latent structure must be preserved, and th

local-aiarxiv-cs-lg

Scouting the Dynamics Gap: Test-Time Policy Adaptation via Action-Outcome Feedback

arXiv:2609.36107v1 Announce Type: new Abstract: While pretrained robotic policies exhibit impressive capabilities in controlled environments, unobserved physical properties and dynamics require these

safetyarxiv-cs-ro

TabFM-Auto: Self-Evolving Pipelines for Tabular Foundation Models

arXiv:2609.37989v1 Announce Type: new Abstract: Tabular foundation models achieve strong zero-shot accuracy on structured data by pretraining on synthetic tables, but they ignore the column names, tas

Trajectory Soup: Pushing the Compute-Scaling Frontier of LLM Mid-training via Diverse Trajectories

arXiv:2609.37169v1 Announce Type: cross Abstract: Mid-training equips pretrained large language models with specialized and reasoning capabilities, but the returns of this stage are bounded since addi

V-Engram: Trigger-Indexed External Memory for Modular Text-to-Image Personalization

arXiv:2609.37198v1 Announce Type: new Abstract: Pretrained text-to-image models contain broad visual knowledge, yet they cannot reliably acquire or refine a specific visual identity from only a few re

researcharxiv-cs-ai

An End-to-End Latent-Rollout Approach for Pushing Few-Step ImageNet-256 Generation to FID 1.11 without Frechet Losses

arXiv:2609.32376v1 Announce Type: new Abstract: Iterative generation poses a joint optimization problem across steps, as intermediate predictions shape subsequent computations and ultimately determine

CAESAR: Clustering via Autonomous Embedding-Space Agglomerative Reorganization

arXiv:2609.32570v1 Announce Type: new Abstract: Clustering algorithms that operate on nearest-neighbor graphs, such as FINCH (First Integer Neighbor Clustering Hierarchy), depend heavily on the qualit

CARVE: Breaking Data Barriers in Chip Placement by Harnessing Reusable Expertise

arXiv:2609.33106v1 Announce Type: new Abstract: Pretrained macro-placement policies can reduce repeated optimization across circuits, but deployment often exposes them to unfamiliar designs when the o

safetyarxiv-cs-lg

Constrained Edit Fields for Training-Free Flow Editing

arXiv:2609.33735v1 Announce Type: new Abstract: Text-guided image editing aims to perform a desired edit while preserving source content unrelated to it. Pretrained rectified-flow models enable traini

safetyarxiv-cs-cv

Continual Learning via Self-Probe Gradients

arXiv:2609.32771v1 Announce Type: new Abstract: Adapting pretrained models to new data can cause catastrophic forgetting of previously learned behavior. When only a few past samples remain, they give

DimPO: Dimensionality Reduction for Attention using Preference Optimization

arXiv:2609.32579v1 Announce Type: new Abstract: A linear projection can reduce the dimension of query and key vectors without updating the pretrained model, but it remains unclear which training objec

GeoCR: Learning a Generalist Cloud Removal Prior from Heterogeneous Observations

arXiv:2609.32510v1 Announce Type: new Abstract: Cloud removal methods are typically specialized to individual datasets and input configurations, limiting reuse across sensors, spectral bands, and obse

Tutorials

Hierarchical Response Preservation for Continual Adaptation of Zero-Shot Graph-Text Models

arXiv:2609.33607v1 Announce Type: new Abstract: Pretrained graph-text models align graph representations with textual semantics, enabling recognition of unseen classes and transfer across graph domain

tutorialsarxiv-cs-lg

Applications

In-Token Learning for High-Fidelity Image Restoration via Diffusion Transformers

arXiv:2609.33523v1 Announce Type: new Abstract: We present In-Token Learning, an image restoration framework that adapts a pretrained diffusion transformer using conditional rectified flow matching. C

applicationsarxiv-cs-cv

Local Ai

JET: Justification Evaluation in Transformer

arXiv:2609.33874v1 Announce Type: new Abstract: JET uses pretrained language and vision-language models to select among a finite set of answers without additional training. It evaluates candidate like

local-aiarxiv-cs-lg

Hardware

LionMuon: Alternating Spectral and Sign Descent for Efficient Training

arXiv:2609.35297v1 Announce Type: new Abstract: Pretraining a language model takes enormous compute, and the right optimizer can save a good part of it. Muon's spectral step gives a stronger direction

hardwarearxiv-cs-lg

Patch Rebirth: Toward Fast and Transferable Model Inversion of Vision Transformers

arXiv:2509.23235v2 Announce Type: replace Abstract: Model inversion is a widely adopted technique in data-free learning that reconstructs synthetic inputs from a pretrained model through iterative opt

Agents

Pre-registered tests of solid-state-physics-inspired LLM compression: a cluster-level negative result at small-language-model scale

arXiv:2609.34292v1 Announce Type: cross Abstract: We report a three-month autonomous research-agent program testing five solid-state-physics-inspired compression mappings on pretrained language models

agentsarxiv-cs-lg

Quantile Head for Vision-Language-Action Models

arXiv:2609.34061v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models integrate pretrained Vision-Language Models (VLMs) with action heads for robot control. Common action heads have d

safetyarxiv-cs-cv

Representation Editing for Multimodal Test-Time Adaptation

arXiv:2609.32263v1 Announce Type: new Abstract: Multimodal test-time adaptation (TTA) aims to adapt a pretrained multimodal model online to distribution shift across modalities using unlabeled test da

safetyarxiv-cs-lg

SAMBAR: Selective Anchoring via Method of Multipliers for Balanced Knowledge Acquisition and Retention in Vision-Language-Action Models

arXiv:2609.32108v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models leverage large-scale pretraining to ultimately achieve generalist manipulation. Deployed VLA policies must support c

Theoretical Refinement of CLIP by Utilizing Linear Structure of Optimal Similarity

arXiv:2510.15508v2 Announce Type: replace Abstract: In this study, we propose an enhancement to the similarity computation mechanism in multimodal contrastive pretraining frameworks such as CLIP. Prio

Tilted Schrodinger Bridge Matching

arXiv:2609.34642v1 Announce Type: new Abstract: Schrodinger bridges provide an entropy-regularized framework and a principled solution for unpaired domain translation. In practice, a pretrained bridge

Transferable Mass Spectrum Prediction via Reference-Guided Test-time Specialization

arXiv:2609.35649v1 Announce Type: new Abstract: Tandem mass spectrum prediction supports compound identification across metabolomics, natural-product discovery, and environmental analysis. However, pr

When Does Geometric View Synthesis Help Wine Label Retrieval? A Public One-Shot Benchmark Across Self-Supervised and Vision-Language Backbones

model-releasesarxiv-cs-cv

arXiv:2609.33359v1 Announce Type: new Abstract: Geometric view synthesis can expand a single wine-label photograph into a training set, but its value with pretrained image encoders is unclear. We stud

Achieving Tokenizer Flexibility in Language Models through Heuristic Adaptation and Supertoken Learning

arXiv:2505.09738v2 Announce Type: replace-cross Abstract: Pretrained language models (LLMs) are often constrained by their fixed tokenization schemes, leading to inefficiencies and performance limitat

researcharxiv-cs-ai

28 Sept 2026

BeatGraph: Self-Supervised Heartbeat Graphs for Infant ECG Representations from the Home Environment

arXiv:2609.31546v1 Announce Type: new Abstract: Electrocardiogram (ECG) foundation models typically tokenize the signal into fixed-length patches that ignore cardiac structure, so a patch may split a

28 Sept 2026

Can Linguistic Reasoning Vectors Enhance Multimodal Reasoning Ability?

arXiv:2609.31140v1 Announce Type: new Abstract: Most Vision-Language Models (VLMs) are built by extending pretrained Large Language Models (LLMs) with visual modules and multimodal alignment. However,