Search: “pretraining”

arXiv:2609.34301v1 Announce Type: new Abstract: Drug design couples property evaluation, conditional generation, structure-based design, and local optimization, yet machine learning systems typically

local-aiarxiv-cs-lg

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Optimizing H-Graph Hybridization for Diffusion-Guided RRT

DGX agent

arXiv:2609.32897v1 Announce Type: new Abstract: Sampling-based motion planners guided by diffusion models produce high-quality trajectories in a single run, yet the stochastic diversity available at i

model-releasesarxiv-cs-lg

29 Sept 2026

PACER: Progressive Availability-Conditioned Evidence Routing for Radiology Report Generation under Incomplete Clinical Context

arXiv:2609.34487v1 Announce Type: new Abstract: Radiology report generation (RRG) increasingly incorporates heterogeneous clinical evidence, such as multi-view radiographs and previous reports, whose

PF-RL: Progress Field Reinforcement Learning via Goal-Conditioned Value Geometry for Vision-Language-Action Models

arXiv:2609.32634v1 Announce Type: new Abstract: Reinforcement Fine-Tuning~(RFT) has emerged as a promising paradigm for improving Vision-Language-Action~(VLA) policies, yet sparse task-level outcomes

safetyarxiv-cs-ro

PReCache: Efficient KV Cache Sharing for Multi-LoRA Agents via Low-Rank Precomputation and Neutral Reconstruction

arXiv:2609.34054v1 Announce Type: new Abstract: Multi-LoRA agent systems enable efficient role specialization by sharing a common backbone model. However, each agent repeatedly processes the growing s

agentsarxiv-cs-lg

Predicting the Next State Is Not Enough: JEPA Representations for Lean Theorem Proving

arXiv:2609.32908v1 Announce Type: new Abstract: Neural theorem provers must both propose tactics and decide which valid successor states to explore. We study whether one-step Lean transitions provide

Principal Steering Subspaces for Online Adaptation of Frozen Generative Robot Policies

model-releasesarxiv-cs-ro

arXiv:2609.33765v1 Announce Type: new Abstract: Generative robot policies provide expressive behavior priors, but updating a large diffusion or flow-matching model through online interaction is costly

PSM: Dataset Distillation Based on Precise Statistical Matching by Difficulty

arXiv:2609.34299v1 Announce Type: new Abstract: Dataset distillation (DD) condenses a large original dataset into a small distilled dataset with high training utility. Decoupled statistical matching m

RCVLA: 4D Radar-Grounded Semantic Reasoning and Trajectory Arbitration for Autonomous Driving

arXiv:2609.32681v1 Announce Type: new Abstract: 4D radar provides geometric and motion cues that complement visual semantics, but integrating it into vision-language-action (VLA) models requires both

Local Ai

ReAL: Accelerating Flow Matching through Segment Advancement with Shared Lookahead

arXiv:2609.33202v1 Announce Type: new Abstract: Flow-matching models generate high-quality images and videos, but repeated neural network evaluations make sampling expensive. Skipping evaluations redu

local-aiarxiv-cs-cv

ReDrive: Shaping Representations with World Modeling for End-to-End Driving

arXiv:2609.33854v1 Announce Type: new Abstract: Driving policies require capabilities of scene understanding and future evolution prediction. To achieve this goal, current end-to-end models typically

ReFM: Semantic-Aware Refinement Flow Model for Motion Retargeting

arXiv:2609.32068v1 Announce Type: new Abstract: Motion retargeting transfers motion across characters with different skeletal structures while preserving semantic intent and physical plausibility. Des

Reliability-Gated Fusion of Consumer Head and Foot IMUs for Lower-Body 3D Pose

arXiv:2609.35764v1 Announce Type: new Abstract: Sparse inertial pose estimation promises camera-free motion capture from consumer devices, but consumer sensors are unreliable: firmware-fused orientati

RepFlow: Reciprocal Supervision Improves Generation and Representation in Flow Models

arXiv:2609.33217v1 Announce Type: new Abstract: Generative models learn visual structure through denoising, yet their internal states are entangled with both noise level and network depth, making it d

SAGE: Semantic Audio Generative Encoder

model-releasesarxiv-cs-lg

arXiv:2609.32755v1 Announce Type: cross Abstract: Audio autoencoders compress waveforms into compact latent representations that serve as the interface between raw audio and downstream models. Current

Scaffold Then Internalize: Representation Injection for Diffusion Transformers

arXiv:2609.35292v1 Announce Type: new Abstract: Recent representation alignment (REPA) methods accelerate diffusion transformer training by aligning projections of the transformer's hidden states with

Seeing and Solving Are Not Enough for Vision-Language Models

arXiv:2609.33694v1 Announce Type: new Abstract: Vision-language models (VLMs) answer visual questions by combining visual information extraction with downstream problem solving. We investigate a funda

SegBanana: Steering Unified Multimodal Models into Medical Segmenters

arXiv:2609.34235v1 Announce Type: new Abstract: Medical image segmentation remains challenging in practical deployment, as models often struggle to generalize beyond the distributions covered by their

agentsarxiv-cs-cv

Self-Reconstruction Dynamics for Autoencoder Reconstruction Refinement

arXiv:2609.32268v1 Announce Type: new Abstract: Standard autoencoder (AE) inference uses a single encoder-decoder pass, though the latent may not be optimal for each sample under a fixed decoder. We a

Applications

seq2cause: One Autoregressive Backbone, Four Causal Discovery Tasks in Event Sequences

arXiv:2609.31801v1 Announce Type: new Abstract: Complex systems such as vehicles, patients, or genomes emit discrete event sequences whose operative question is causal, not predictive: which events ca

applicationsarxiv-cs-lg

Slot-RAE: Streamlining Object-Centric Learning via Direct Representation Auto-Encoders

arXiv:2607.11196v2 Announce Type: replace Abstract: Deploying object-centric models for real-world scene understanding typically requires complex pipelines to achieve both robust scene decomposition a

Squeeze3D: Extreme Neural Compression with Latent Space Bridging

arXiv:2506.07932v2 Announce Type: replace-cross Abstract: We propose Squeeze3D, a novel framework that leverages implicit prior knowledge learnt by existing pre-trained encoders and decoders to compre

Local Ai

Steer2Grasp: Inference-Time Embodiment-Aware Steering for Diverse Physically Feasible Grasp Diffusion

arXiv:2609.33546v1 Announce Type: new Abstract: Current grasp diffusion models provide rich priors for generation, yet their object-centric approach can violate the kinematic and collision constraints

local-aiarxiv-cs-ro

Applications

TemporalGraphLLM: Temporal Graph Neural Networks with Large Language Models for Dynamic Text-Attributed Graphs

arXiv:2609.31881v1 Announce Type: new Abstract: Dynamic text-attributed graphs (DTAGs), where nodes, edges, and textual attributes evolve over time, are crucial in applications such as social networks

applicationsarxiv-cs-lg

Timestep Weighting: A Hidden Key to Effective ELBO-Based Flow-Matching RL

arXiv:2609.32665v1 Announce Type: cross Abstract: ELBO-based reinforcement learning offers a sampler-agnostic approach to fine-tuning flow matching models with reward feedback. Timestep weighting in E

Transfer Learning for Edge Classification on Dynamic Text-Attributed Graphs

arXiv:2609.32849v1 Announce Type: new Abstract: Learning transferable representations for dynamic text-attributed graphs (DyTAGs) requires models to capture underlying interaction dynamics that persis

TreeRef-BFN: Equivariance-Free De Novo Molecule Generation based on 2D Topology and Internal 3D Geometry

arXiv:2609.32502v1 Announce Type: cross Abstract: De novo 3D molecular generation jointly models molecular size, topology, and geometry. Most methods pre-sample molecular size and generate Cartesian c

Tutorials

VGGT-Diff: Visual Geometry Meets Diffusion for Sparse-View Novel View Synthesis

arXiv:2609.33253v1 Announce Type: new Abstract: We present VGGT-Diff, a geometry-routed multi-view diffusion model for sparse-view novel view synthesis. Existing novel view synthesis (NVS) methods fac

tutorialsarxiv-cs-cv

Video, Ergo Genero: Unifying Video Tasks via Spatiotemporal Analogy

arXiv:2609.33935v1 Announce Type: new Abstract: Adapting video models to new tasks typically requires dedicated data curation and fine-tuning. While visual analogy provides a training-free alternative

Vision-Language Agents for Active Perception in Optics Laboratories

arXiv:2609.32918v1 Announce Type: cross Abstract: Vision-language models (VLMs) are increasingly being used in scientific workflows, but their ability as agents to directly control laboratory experime

agentsarxiv-cs-cv

What Does the Rank Buy? A Spectral and Distributional Analysis of Low-Rank Adaptation

arXiv:2609.32002v1 Announce Type: cross Abstract: The rank r in LoRA is widely treated as a capacity control: a smaller rank is assumed to yield a simpler model that generalizes better. We show that,

What Visual Generators Need from Teachers: Rethinking Representation Alignment

arXiv:2609.34732v1 Announce Type: new Abstract: Representation alignment speeds up diffusion transformer training by pulling an intermediate block of the model (student) toward features of a frozen pr

Tutorials

When Can Attention Heads Be Statically Defined?

arXiv:2609.34650v1 Announce Type: new Abstract: Some attention heads learn similar patterns across inputs. Reusing these patterns could reduce training cost by avoiding repeated query-key score comput

tutorialsarxiv-cs-lg

When Can We Trust the Sparse Lens? A Certification Framework for SAE Faithfulness

model-releasesarxiv-cs-lg

arXiv:2606.18383v2 Announce Type: replace Abstract: Sparse autoencoders (SAEs) are increasingly used to study internal representations in language models (LMs), but it remains unclear when an SAE-base

When Known Physics Helps Neural PDE Models: Residual Constraints Out-Regularize Generic Priors for Nonlinear Dynamics

arXiv:2609.34012v1 Announce Type: new Abstract: Neural PDE surrogates increasingly incorporate structural priors, yet it is often unclear whether their gains arise from physics-specific information or

WM-VLM: Probing Internal World Models for Interleaved Visual-Textual Reasoning

arXiv:2609.34826v1 Announce Type: new Abstract: Humans often solve spatial problems by mentally simulating visual transformations. In contrast, conventional vision-language models (VLMs) reason primar

WorldGraph: Graph-Native World Modeling

arXiv:2609.34159v1 Announce Type: cross Abstract: World models infer latent states of an environment to capture its underlying dynamics and predict future evolution. Many real-world environments, howe

WorldGuide: Learning Success-Failure Boundaries in Latent World Models for Vision-Language-Action Policies

arXiv:2609.34206v1 Announce Type: new Abstract: Latent world models offer a promising way to improve Vision-Language-Action policies by capturing the consequences of actions. However, models trained p

X-MoD: Practical Scaling Laws for Sparse-Depth Routing Beyond Mixture-of-Depths

model-releasesarxiv-cs-lg

arXiv:2609.34212v1 Announce Type: new Abstract: Mixture-of-Depths (MoD) enables conditional computation across Transformer depth by routing only a subset of tokens through selected layers, but its ori

Aligning One-Step Generative Models with Reward-Weighted Transport Distillation

arXiv:2609.30840v1 Announce Type: cross Abstract: One-step generators enable high-quality visual generation with a single network evaluation, but their post-training is difficult: general implicit gen

Audio emotion recognition for atypical hearing

arXiv:2609.31168v1 Announce Type: new Abstract: My doctoral work aims to explore Audio Emotion Recognition (AER) in the context of atypical listening. This research focuses on auditory hypersensitivit

Auditing Latent-Space Monitors for Autonomous Driving

arXiv:2609.30557v1 Announce Type: cross Abstract: Runtime failure monitors can use a model's internal representations to anticipate failures. We audit this monitoring strategy across two autonomous-dr

agentsarxiv-cs-ai

Differentiable RNA Secondary Structure Extraction for Deep Learning

arXiv:2609.30752v1 Announce Type: new Abstract: Many deep learning approaches to RNA secondary structure prediction have recently been proposed. They typically output a weight matrix W where W_{ij} is

Evaluation Is All You Need for Multi-Modal Autonomous Driving

arXiv:2609.30818v1 Announce Type: cross Abstract: Multi-modal planning is promising for autonomous driving by representing multiple plausible behaviors in ambiguous and long-tail scenarios. Existing m

safetyarxiv-cs-ai

Frame the adversary: a structure-aware attack methodology

arXiv:2609.31128v1 Announce Type: new Abstract: Frequency-based adversarial attacks have recently grown popular by exploiting spectral sensitivities shared across neural architectures. Unlike spatial

FTB Graph: Determining and Validating First-token Broadcasters and Language-Identity Head Circuits in Multilingual Language Models

arXiv:2609.30954v1 Announce Type: new Abstract: Large language models operating in multilingual contexts must resolve target response languages early in generation, yet the causal circuitry governing

researcharxiv-cs-ai

Applications

Geometric-Photometric Event-based 3D Gaussian Ray Tracing

arXiv:2512.18640v3 Announce Type: replace-cross Abstract: Event cameras offer a high temporal resolution over traditional frame-based cameras, which makes them suitable for motion and structure estima

applicationsarxiv-cs-ai

Improving Visual Sensitivity of LLMs on Multimodal Machine Translation with Metric-based Loss Weighting

arXiv:2609.31169v1 Announce Type: cross Abstract: Multimodal Machine Translation aims to incorporate additional signal from non-textual modalities to improve translations by resolving ambiguities. Whi

researcharxiv-cs-ai