Search: “pretraining”

LoRA's Second Descent Extends Beyond Parameter Parity

arXiv:2610.04507v1 Announce Type: new Abstract: Double descent has sparked considerable interest, with recent work relating it to the data, the model and the learning configuration. Practical fine-tun

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

MAGEFormer: Learning Metric-Consistent Representations for Anisotropic CT Segmentation

DGX agent

arXiv:2610.04036v1 Announce Type: new Abstract: Vision Transformers (ViTs) have shown strong performance in volumetric segmentation, but their effectiveness on clinical CT is limited by an isotropic E

safetyarxiv-cs-cv

6 Oct 2026

MAGIC: Topology-Aware Analytic Graph Few-Shot Class-Incremental Learning

arXiv:2610.04963v1 Announce Type: new Abstract: Graph few-shot class-incremental learning (GFSCIL) requires a model to continually recognize emerging classes from only a few labeled nodes while preser

Mind the Execution Gap: Action-Semantic Mismatch in World-Model Control

arXiv:2610.06582v1 Announce Type: cross Abstract: World-model controllers rely on action-conditioned dynamics for prediction and planning, yet real control systems often execute commands asynchronousl

MTV: Revisiting Multi-Task Visual Representation Learning

arXiv:2601.13886v2 Announce Type: replace Abstract: Current visual representation learning remains bifurcated: vision-language models (e.g., CLIP) excel at global semantic alignment but lack spatial p

local-aiarxiv-cs-cv

Multitask Conditional Generative Adversarial Network Enables Automatic Whole Knee Cartilage and Menisci Segmentation and Reliable T1r{ho} and T2 Quantification Without High-Resolution Morphological Images

arXiv:2610.06602v1 Announce Type: new Abstract: Early osteoarthritis detection through quantitative MRI (qMRI) requires accurate cartilage and meniscus segmentation, traditionally necessitating time-c

P3: Persistent Particle Planning for Constrained Diffusion Control

arXiv:2610.06002v1 Announce Type: cross Abstract: Diffusion models provide expressive priors over trajectories, but adapting these priors to test-time constraints requires maintaining feasibility and

Tutorials

Prism: Dynamic Sparse Attention for Native 2K Joint Video-Audio Generation Model Training

arXiv:2610.05416v1 Announce Type: new Abstract: Natively training joint video-audio generation models at higher resolutions empowers them to learn richer visual details and sharper motion dynamics. Ho

tutorialsarxiv-cs-cv

Prompt and Refinement: Asymmetric Mutual Learning for Infrared Small Target Detection with Noisy Labels

arXiv:2610.05918v1 Announce Type: new Abstract: Existing data-driven infrared small target detection (ISTD) methods typically require large-scale datasets with accurate pixel-level annotations for mod

local-aiarxiv-cs-cv

Reinforcement Learning on the Discrete Composition Channel of a Crystal Generator: Validated Gains and Reward Hacking

arXiv:2610.03880v1 Announce Type: new Abstract: Inverse materials design is a long-standing goal of computational materials discovery. Generative models for crystalline materials are typically trained

Representation-Space MMD for Diffusion Language Models

arXiv:2610.06648v1 Announce Type: cross Abstract: We introduce a post-training method for diffusion language models (DLMs) that minimizes Maximum Mean Discrepancy (MMD) between generated and reference

safetyarxiv-cs-lg

Riemannian Shape Analysis of the Corpus Callosum in Kendall Space: Aging and Alzheimer's Disease

model-releasesarxiv-cs-cv

arXiv:2610.05326v1 Announce Type: new Abstract: The corpus callosum (CC) is a major white-matter structure and a well-established marker of brain aging, but most studies quantify it using scalar summa

Robotic Long-Horizon Manipulation with Bayesian Non-parametric Skill Priors

arXiv:2503.21975v2 Announce Type: replace Abstract: Long-horizon manipulation under sparse rewards remains challenging for reinforcement learning due to delayed feedback and inefficient exploration. E

researcharxiv-cs-ro

Robust Parameter-Efficient LLM Adaptation on Analog Hardware

arXiv:2610.05318v1 Announce Type: new Abstract: Analog in-memory computing is a promising platform for on-device execution of large language models because it performs matrix--vector multiplications (

Robust Surgical Robotic Instrument Tracking via Sequential Multi-Cue Fusion and Sim-to-Real Self-Training

model-releasesarxiv-cs-cv

arXiv:2610.05491v1 Announce Type: cross Abstract: Efficient and robust tracking of surgical robotic instruments is important for robot-assisted minimally invasive surgery, yet remains challenging due

S2PD: Serial-to-Parallel Diffusion for Physically and Logically Consistent Video Generation

arXiv:2610.06847v1 Announce Type: new Abstract: Bidirectional video diffusion models denoise entire videos in parallel, yet when trained on effectively unlimited in-distribution data from procedural g

Shared Geometry Is Not Shared Physics: A Layerwise Test of the Platonic Representation Hypothesis in Astronomy

arXiv:2610.04130v1 Announce Type: cross Abstract: In this paper we investigate whether geometrically aligned astronomical representations are also scientifically interchangeable. We analyze every laye

local-aiarxiv-cs-lg

Tutorials

SimAuthor: Harnessing Foundation Models for Persistent Scientific Simulator Authoring

arXiv:2610.06257v1 Announce Type: new Abstract: Foundation models can generate scientific code, but authoring a scientific simulator (an executable program encoding hypotheses about how mechanisms gen

tutorialsarxiv-cs-lg

SimForcing: Distilling Simulation Motion Priors into Real-Domain Robot World Models

arXiv:2610.06598v1 Announce Type: cross Abstract: Action-conditioned robot world models must respond precisely to robot trajectories while preserving realistic visual dynamics, yet learning both from

safetyarxiv-cs-cv

Spectral Analysis of Molecular Features: When Richer Features Do Not Guarantee Better Generalization

arXiv:2510.14217v3 Announce Type: replace Abstract: The spectral properties of feature embeddings offer critical insights into model generalization and representation quality. While deep learning mode

TIGER: Time-Series Classification with In-Context-Learning Gated Ensemble of Representations

arXiv:2610.06156v1 Announce Type: new Abstract: A representation family is a distinct way of extracting features from time series. Ensemble algorithms that combine several representation families rema

TRACE: Time-Adaptive Residual Attention Control with Content-Style Decomposition for Training-Free Diffusion Style Transfer

arXiv:2610.04922v1 Announce Type: new Abstract: Reference-guided style transfer aims to preserve the semantic structure of a content image while transferring the visual appearance of a style reference

UniBRep: Learning Unified Geometry and Topology for Image-conditioned B-Rep Generation

model-releasesarxiv-cs-cv

arXiv:2610.04092v1 Announce Type: new Abstract: Generating a boundary representation (B-rep) conditioned on a single image requires faithful reconstruction of geometry, valid topology, and support for

Vela: Scaling Vision-Language-Action Models with Adaptive Action Curve Parametrization

arXiv:2610.05230v1 Announce Type: new Abstract: Most vision-language-action models represent future motion as fixed-rate action chunks, tying temporal resolution and prediction horizon to a fixed outp

local-aiarxiv-cs-ro

Hardware

Vision Transformer Ensembles for Panoramic Street Segmentation

arXiv:2610.06063v1 Announce Type: new Abstract: Semantic segmentation of street panoramas can support detailed descriptions of urban environments, yet small datasets and unequal training costs make mo

hardwarearxiv-cs-cv

VisualErase: Dual-Branch Visual Trajectory Redirection for Robust Concept Erasure in Text-to-Image Diffusion Models

arXiv:2610.05000v1 Announce Type: new Abstract: Concept erasure is essential for the safe deployment of text-to-image diffusion models, as they may reproduce harmful, copyrighted, or privacy-sensitive

WasserMan: Benchmark for Underwater Manipulation Policy Learning

model-releasesarxiv-cs-ro

arXiv:2610.04536v1 Announce Type: new Abstract: Underwater manipulation couples visual decisions, contact forces and a thruster-controlled floating base. We introduce WasserMan, to our knowledge the f

Tutorials

When Does a Diffusion Model Decide What to Draw ?

arXiv:2610.05645v1 Announce Type: new Abstract: A diffusion model starts from pure noise and removes it step by step. Somewhere along the way it stops being able to become 'anything' and becomes commi

tutorialsarxiv-cs-lg

Xaurora: Generative Weather Forecasting with Denoising Stochastic Interpolants from a Foundation Model Prior

arXiv:2610.06509v1 Announce Type: new Abstract: Deep learning has revolutionised weather forecasting in recent years, especially through atmospheric foundation models, which offer competitive skill fo

A Generative Model of Complex Networks Using Graphons and Neural Inverse Operators

arXiv:2610.02439v1 Announce Type: new Abstract: Generative graph models are central to understanding and simulating complex networks. However, existing approaches have complementary strengths and limi

A Unified Framework for Bayesian Data Assimilation with Generative Models and Observation Interpolants

arXiv:2610.03396v1 Announce Type: new Abstract: Bayesian data assimilation combines model forecasts with noisy observations, but sampling high-dimensional, non-Gaussian posteriors remains challenging.

safetyarxiv-cs-lg

Are you Synthesizing or Recalling? Evaluating LLMs on Algorithmic Code Retrieval

model-releasesarxiv-cs-ai

arXiv:2610.02438v1 Announce Type: cross Abstract: Large language models (LLMs) have demonstrated strong performance in code generation, where success depends on both recalling relevant algorithmic kno

BaCP: Backbone Contrastive Pruning for Preserving Representations in Extremely Sparse Neural Networks

arXiv:2610.02524v1 Announce Type: new Abstract: Unstructured pruning at extreme sparsity often suffers from representational collapse, causing sharp drops in accuracy. To address this, we study Backbo

CalCErt: Bin-wise Certification of Confidence Calibration in Medical Image Classification

arXiv:2610.03142v1 Announce Type: new Abstract: Deep neural networks remain vulnerable to adversarial perturbations, which can distort not only predictions but also confidence scores, undermining unce

Characterizing the Performance Gap in Human Activity Recognition for Older Adults

arXiv:2610.02711v1 Announce Type: cross Abstract: Human activity recognition (HAR) from wrist-worn accelerometers is increasingly used for health and behavioral tracking. Yet, most wearable HAR models

CHASE-VLA: Post-Training Quantization Framework for Vision-Language-Action Models with Chunk-Aware Scale Estimation

arXiv:2610.02666v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models map visual observations and language instructions to continuous robot actions, but a diffusion-based action expert (

safetyarxiv-cs-cv

Hardware

Coco: An Agentic Copilot for the Hardware--Software Co-Design Lifecycle

arXiv:2610.02376v1 Announce Type: cross Abstract: Co-designing ML models and the accelerators that run them is an unusual reasoning task: architects must draw confident, high-stakes conclusions about

hardwarearxiv-cs-ai

CoLMbo-SV: A Grounded Language Model for Explainable Speaker Verification

arXiv:2609.33212v2 Announce Type: replace Abstract: Speaker verification systems achieve high accuracy but provide little account of the acoustic evidence behind their judgments. Making these systems

researcharxiv-cs-cl

Counterfactual Predictions in Scientific Emulators Without Controlled Experiments

arXiv:2610.02252v1 Announce Type: cross Abstract: Many scientific questions require reasoning about what was never observed: What if the conditions, interventions, or history had been different? Model

researcharxiv-cs-ai

Custom Forcing: Training-Free Subject Customization for Autoregressive Video Generation

arXiv:2610.02914v1 Announce Type: new Abstract: Autoregressive video models can generate minute-long videos in real time, but they produce generic subjects from text rather than specific subjects from

DAGS: Disentangled Appearance-and-Geometry Steering of a Frozen Image DiT for Temporally Stabilized Generative Rendering

arXiv:2610.02567v1 Announce Type: cross Abstract: Diffusion transformers (DiTs) generate high-fidelity images from text and image conditions, but their outputs carry large variance and their faithfuln

researcharxiv-cs-ai

Divergence controls entropy in distillation

arXiv:2610.03529v1 Announce Type: cross Abstract: Distillation has become a core primitive of large language model training, but its properties are not yet well understood. We take an entropic perspec

safetyarxiv-cs-cl

Do as the Romans Do: Learning Universal Behaviors from Heterogeneous Agents

arXiv:2606.18537v2 Announce Type: replace Abstract: Humans often acquire new skills by observing others, since observed behaviors implicitly reveal how to act reasonably in an environment. However, ob

safetyarxiv-cs-lg

Do ResNets Route? Sparse Interaction Experts in Residual Networks

arXiv:2610.02907v1 Announce Type: new Abstract: Residual networks execute every block for every input, yet their functional contributions need not be input independent. We formulate a trained ResNet a

Drive vs. Decay: On the Training Dynamics of Joint-Embedding Predictive Architectures

arXiv:2610.02344v1 Announce Type: new Abstract: Joint-Embedding Predictive Architectures (JEPAs) are prone to representation collapse, typically mitigated through empirical heuristics. We develop an e

Effects of interpulse-interval variation on deep-learning classification of bat vocalizations

arXiv:2610.02284v1 Announce Type: new Abstract: Temporal context may aid automated bat-species classification, but the contribution of specific features remains unclear. We investigated whether variat

Emergent Structure in the Marginal Attention Space of Language Models

arXiv:2610.03109v1 Announce Type: new Abstract: While representation similarity across independently trained language models is well-documented, how internal mechanics such as attention behave across

researcharxiv-cs-cl

FiberGeoText: A Vision-Language Model for Population- Level Organization of Superficial White Matter

arXiv:2610.02755v1 Announce Type: new Abstract: The superficial white matter (SWM), a critical brain region for cognition across the lifespan and brain disease, contains abundant short-range associati