Search: “pretraining”

Novel View Synthesis using DDIM Inversion

arXiv:2508.10688v3 Announce Type: replace Abstract: Single-image novel view synthesis requires viewpoint-dependent structural changes while retaining source-scene information and inferring unobserved

Resample the Answer: Where to Spend Test-Time Compute in Recursive Reasoning

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2610.16427v1 Announce Type: new Abstract: Recursive reasoning models such as the Tiny Recursive Model (TRM) iteratively refine two latent states: an answer state y, decoded into the output, and

researcharxiv-cs-lg

14 Oct 2026

RoboFQE: Rollout-Free Evaluation of Visual Robot Policies from Offline Trajectories

arXiv:2610.18699v1 Announce Type: new Abstract: Evaluating robot policies before deployment typically requires producing new trajectories through real-world execution, simulators, or learned world mod

safetyarxiv-cs-ro

S^3-PnP: Plug-and-Play Denoising for Scientific Imaging with Self-Supervised Score Priors

arXiv:2610.18458v1 Announce Type: new Abstract: Modern image restoration methods increasingly rely on large-scale supervised training, yet clean targets are often prohibitively difficult to obtain in

SPLICE: Sparse Physics Library Identification and Compositional Expansion

arXiv:2610.17029v1 Announce Type: new Abstract: Neural operator splitting composes a library of neural operators, one per physical mechanism, into zero-shot simulators of new equations. Existing appro

Steertuning Policies from a Few Human Videos

model-releasesarxiv-cs-ro

arXiv:2610.18711v1 Announce Type: new Abstract: Current recipes for robot learning require massive amounts of robot demonstrations to obtain robust and adaptive policies. In this work, we introduce St

TabGift: A Context-Efficient Foundation Model for Tabular Data Generation

arXiv:2610.16990v1 Announce Type: new Abstract: Tabular data generation aims to synthesize realistic samples from limited observations while faithfully capturing the underlying data distribution. Tabu

Applications

TabMosaic: Unified In-Context Diffusion for Tabular Generative Tasks

arXiv:2610.15699v1 Announce Type: new Abstract: Generative modeling for tabular data has advanced to the point where models can synthesize realistic records, recover missing values, and generate sampl

applicationsarxiv-cs-lg

VETime: Vision Enhanced Zero-Shot Time Series Anomaly Detection

arXiv:2602.16681v2 Announce Type: replace Abstract: Time-series anomaly detection (TSAD) requires identifying both immediate Point Anomalies and long-range Context Anomalies. However, existing foundat

safetyarxiv-cs-cv

What Really Works for Universal Multimodal Embeddings? A Controlled Study of Contrastive Training Strategies

arXiv:2610.15035v1 Announce Type: new Abstract: Contrastive learning has become the standard paradigm for multimodal representation learning, aligning semantically matched pairs while separating misma

Designing Protein Structures from Natural Language

arXiv:2610.13917v1 Announce Type: new Abstract: A central challenge in de novo protein design is generating proteins with desired structural and functional properties. Existing design models typically

GIST: Generator-state-Informed Supervision for Tabular Foundation Models

arXiv:2610.12904v1 Announce Type: new Abstract: Tabular foundation models (TFMs) based on prior-data fitted networks typically use sampled hard query labels, leaving avoidable sampling variability in

How Well Do Prior-Data Fitted Networks Amortize Bayesian Inference?

arXiv:2610.13764v1 Announce Type: cross Abstract: Prior-data fitted networks (PFNs) are trained to approximate the Bayesian posterior predictive distribution (PPD) of a synthetic prior, yet results ab

Knowing Is Not Telling: Identity Ossification in LLM Representations of Trans-border Communities

arXiv:2610.12610v1 Announce Type: cross Abstract: Ethnic and cultural identities rarely align with political borders, a tension made sharper by migration and long-standing cross-border ties. Communiti

Localized Generative Design of Ship Hulls with Diffusion Models and High-Fidelity Assessment

model-releasesarxiv-cs-ai

arXiv:2610.12870v1 Announce Type: cross Abstract: Practical ship design requires localized refinement and performance evaluation. This paper presents a reward-directed diffusion framework for localize

Machine Learning and Time-Series Foundation Models for Day-Ahead Electricity Forecasting in a University Building

model-releasesarxiv-cs-ai

arXiv:2610.12638v1 Announce Type: cross Abstract: Day-ahead electricity forecasts can help building operators schedule heating, ventilation, and other services around anticipated demand. Choosing a fo

Rethinking the Roles of Diffusion and Decoding: Predictive-State Flows for Parallel Language Generation

arXiv:2610.12898v1 Announce Type: new Abstract: In continuous diffusion language models (DLMs), latents generated by the diffusion prior are mapped almost deterministically to tokens, either by a deco

TabMF: Learning Dataset Representations with Tabular Foundation Models

model-releasesarxiv-cs-lg

arXiv:2610.13818v1 Announce Type: new Abstract: Representations of supervised datasets support higher-level machine-learning tasks such as dataset retrieval and distribution-shift monitoring. However,

Understanding Mamba-3 Through Oscillatory Dynamics

arXiv:2610.13341v1 Announce Type: new Abstract: Mamba-3 introduces input-dependent rotations into recurrent state updates, but their contribution beyond state retention remains unclear. We interpret t

Cross-Embodiment Robot Foundation World Models with Latent Actions

model-releasesarxiv-cs-ro

arXiv:2610.10846v1 Announce Type: new Abstract: The diversity of robot embodiments and action spaces makes it challenging to build robot world models that generalize across different embodiments. We i

Hardware

Language Models as AI Research World Models

arXiv:2610.12235v1 Announce Type: new Abstract: AI research agents automate the cycle of proposing, implementing, and evaluating experiments, opening a path toward recursive self-improvement. Yet thei

hardwarearxiv-cs-cl

MatLat: Material Latent Space for PBR Texture Generation

arXiv:2512.17302v2 Announce Type: replace Abstract: We propose a generative framework for producing high-quality PBR textures on a given 3D mesh. As large-scale PBR texture datasets are scarce, our ap

RAGenome: Scaling Retrieval-Based Genomic Language Models to Long Contexts

arXiv:2610.11761v1 Announce Type: new Abstract: The genome holds the blueprint that governs the biological properties of the cell. Consequently, advancing our knowledge of genomic function is crucial

Reading the Room: Foundations, Design, and Challenges of Normative Competence in LLMs

arXiv:2610.10906v1 Announce Type: new Abstract: Human communities are governed by normative systems: shared standards that produce extit{norms} dictating acceptable behavior, enforced through communit

safetyarxiv-cs-ai

Residual Modeling Closes the Regression and Generative Policy Gap in Robot Learning

arXiv:2610.12231v1 Announce Type: new Abstract: Learning from demonstration has enabled impressive robot behaviors. A common choice for policy learning is to use diffusion or flow matching (Flow-Polic

safetyarxiv-cs-ro

Local Ai

Scalable AI Uncertainty Quantification via Generalized Laplace Active Subspaces

arXiv:2610.11738v1 Announce Type: new Abstract: Reliable uncertainty quantification (UQ) is essential for deploying neural networks in scientific and high-stakes applications, but full Bayesian infere

local-aiarxiv-cs-ai

Smoothing the Top-k Exposure Boundary for Sparse Mixture-of-Experts

arXiv:2610.11575v1 Announce Type: new Abstract: Sparse Mixture-of-Experts models scale parameter capacity efficiently while maintaining a fixed compute budget per token. However, traditional training

Tell Robot What Not to Do: A Negation Understanding Perspective

model-releasesarxiv-cs-ro

arXiv:2610.11952v1 Announce Type: new Abstract: Instruction following enables robots to perform diverse tasks specified in natural language, making it a fundamental capability for human-robot interact

Are Parameter-Efficient Fine-tuning Methods Really Different?

model-releasesarxiv-cs-lg

arXiv:2610.09122v1 Announce Type: new Abstract: Parameter-efficient fine-tuning (PEFT) offers many parameterizations, yet their methodological and functional differences remain unclear. We compare six

Local Ai

{Delta}WAM: Distilling Action Tangent Fields into World Action Models

arXiv:2610.09734v1 Announce Type: new Abstract: World Action Models (WAM) improve robot policies by augmenting sparse action supervision with dense future prediction. However, much of the predictable

local-aiarxiv-cs-ro

Juno: Taming Predictive Latents for Vision-Language-Action Models

arXiv:2610.09940v1 Announce Type: cross Abstract: Joint-embedding predictive architectures (JEPAs) predict masked or future observations in representation space, offering a natural source of predictiv

safetyarxiv-cs-cv

Tutorials

Mechanics of Long-Context Hybrid Models Part 1.1: From Hybrid Attention to Hybrid Position

arXiv:2610.10114v1 Announce Type: new Abstract: The architectural design of Large Language Models (LLMs) is shifting from traditional full-attention-only models to hybrid models, which combine differe

tutorialsarxiv-cs-cl

MorphCL: Morphological Contrastive Learning for Inertial-based Human Activity Recognition

arXiv:2610.10245v1 Announce Type: new Abstract: Despite the ubiquity of sensors in wearable and mobile devices and the abundance of human movement data they generate, translating unlabeled recordings

Q-Learning with Scalar Adjoint Matching

arXiv:2610.10437v1 Announce Type: new Abstract: Flow policies capture rich and diverse action distributions, and fine-tuning them with off-policy RL to improve beyond the demonstrations has drawn grow

safetyarxiv-cs-lg

RDGSplat: Render-Dedicated Geometry for Novel View Synthesis

arXiv:2610.09173v1 Announce Type: new Abstract: 3D foundation models enable efficient novel view synthesis by carrying a Gaussian head on the representation they already use for reconstruction. Howeve

Right Number, Wrong State? Measuring Cross-Jurisdiction Substitution in LLM Recall of State Policy

arXiv:2610.09458v1 Announce Type: new Abstract: When an LLM answers a state-specific policy question wrongly, it may be hallucinating, or it may be returning a real value that holds in another state.

SAREO-FM: Decoupled Semantic Supervision for SAR-EO Foundation Models

arXiv:2610.09317v1 Announce Type: new Abstract: Synthetic aperture radar (SAR) and electro-optical (EO) imagery provide complementary observations: SAR enables day-and-night, weather-resilient sensing

Video Prediction Policy 2: Predict Better, Act Better

model-releasesarxiv-cs-cv

arXiv:2610.10270v1 Announce Type: new Abstract: World action models (WAMs) have emerged as an important class of generalist robot policies, aiming to transfer video prediction priors to action learnin

A doctrine-grounded visual question answering dataset for Tactical Combat Casualty Care

arXiv:2610.07339v1 Announce Type: cross Abstract: Tactical Combat Casualty Care (TC3) requires responders to connect visual observations of injuries and interventions with established clinical guidanc

researcharxiv-cs-ai

Beyond Training from Scratch: Foundation Models for Data-Efficient and Generalizable Cardiac MRI Reconstruction

model-releasesarxiv-cs-cv

arXiv:2610.08109v1 Announce Type: new Abstract: Cardiac magnetic resonance imaging reconstruction aims to recover high-quality images from undersampled acquisitions, enabling faster scans while preser

Tutorials

CETUS: How Far Do Representations Trained on Earth Transfer to Cassini SAR of Titan?

arXiv:2610.07576v1 Announce Type: new Abstract: Cassini synthetic aperture radar (SAR) images reveal the dunes, plains, and lake basins of Titan, providing an instance of representations learned from

tutorialsarxiv-cs-cv

Complementary Supervised and Self-Supervised Representations for Out-of-Distribution Graph Learning

arXiv:2610.07628v1 Announce Type: new Abstract: Out-of-distribution (OOD) generalization remains challenging for graph neural networks (GNNs), as graph distributions can vary substantially across time

DepthWorld: 3D World Model for Robot Manipulation

arXiv:2610.08780v1 Announce Type: cross Abstract: World models offer a data-driven alternative to traditional simulators for robotics, with applications spanning policy evaluation, improvement, and pl

safetyarxiv-cs-ai

Isotropic Yet Undecodable: The Sequential Content-Sufficiency Gap in Latent-Predictive Text Representations

arXiv:2610.07906v1 Announce Type: new Abstract: We study sequential content sufficiency by investigating whether a representation retains the ordered target information available in its input. An info

researcharxiv-cs-ai

Learn2Play Bench: How Well Do LLM Agents Learn from Experience in Unfamiliar Environments?

model-releasesarxiv-cs-ai

arXiv:2610.08215v1 Announce Type: new Abstract: Learning from experience is essential for LLM agents to adapt to unfamiliar and dynmaic environments. Evaluating this ability is therefore important for

Learning Grasp Targeting from Point Clouds for Log Pile Clearing on a Hydraulic Crane

arXiv:2610.07613v1 Announce Type: cross Abstract: In mill yards, log loaders clear dense piles by a sequence of bundle grasps: hundreds of logs rest in contact, and each removal changes the pile avail

safetyarxiv-cs-lg

MASKerade: Token-Routed Mask Experts for Dense-to-MoE Upcycling

model-releasesarxiv-cs-lg

arXiv:2610.07809v1 Announce Type: new Abstract: Sparsely activated Mixture-of-Experts (MoE) models increase model capacity without a proportional increase in per-token computation. Dense-to-MoE upcycl

No Transformer Beats Six Covariates: Long-Horizon Prediction of Depressive Symptoms from Childhood Essays

arXiv:2610.07764v1 Announce Type: cross Abstract: Natural language processing (NLP) models can detect depression-related language in text written near the time symptoms are measured, but whether pretr

researcharxiv-cs-ai