Search: “pretraining”

Remembering What Matters for Long-Horizon Robotic World Models

arXiv:2610.14583v1 Announce Type: cross Abstract: Autoregressive robot video world models based on discrete visual tokens remain unreliable over long rollout horizons. Retaining the entire generated h

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Representation Drift in Continual Learning: LoRA versus N-gram Memory

DGX agent

arXiv:2610.14921v1 Announce Type: new Abstract: A language model that keeps learning online must not slowly erode its own base capabilities. We ask which part of a modern LLM should absorb continual u

model-releasesarxiv-cs-lg

14 Oct 2026

Scaling Vision Transformers Without Training: Prune-and-Merge Token Compression

arXiv:2610.18039v1 Announce Type: new Abstract: Vision Transformers achieve strong performance but incur high computational costs from quadratic token interactions. Training-free token reduction metho

ScenePlacer: Reformulating Scene-Level Object Pose Estimation as Visibility Field Learning

arXiv:2610.15734v1 Announce Type: new Abstract: We present ScenePlacer, a framework for scene-level pose estimation of objects generated by state-of-the-art native shape generation models, placing gen

safetyarxiv-cs-cv

Semantic Context Forests for Learning-Based Knee Cartilage Segmentation in 3D MR Images

arXiv:1307.2965v3 Announce Type: replace Abstract: The automatic segmentation of human knee cartilage from 3D MR images is a useful yet challenging task due to the thin sheet structure of the cartilag

SenseWeather: Multimodal Sensing for Robust Robotic Perception under Extreme Conditions

arXiv:2610.14082v1 Announce Type: cross Abstract: Robotic perception must remain reliable when extreme environmental conditions severely degrade the primary RGB observation. Although robotic platforms

Agents

SLDBench v2: Active Scaling Law Discovery

arXiv:2610.16297v1 Announce Type: new Abstract: Scaling laws predict large-model performance from small experiments, but finding a reliable law itself requires costly experiments. SLDBench tests wheth

agentsarxiv-cs-lg

Sparse All-Layer Connector for Domain Generalised Semantic Segmentation

arXiv:2610.15660v1 Announce Type: new Abstract: Domain generalised semantic segmentation (DGSS) has recently benefited from combining multiple foundation models, such as vision-language and vision fou

SSM-Attack: Learning Where to Perturb for Black-Box Face Privacy

arXiv:2610.17323v1 Announce Type: new Abstract: Face recognition systems are deployed widely enough that a photograph shared online can be matched without its subject's consent. Generator-based protec

Stereo-Planner: Learning Stereo-to-Trajectory Planning for Zero-Shot Sim-to-Real Quadrotor Navigation

model-releasesarxiv-cs-ro

arXiv:2610.15560v1 Announce Type: new Abstract: Existing navigation systems commonly rely on dedicated depth sensors or explicit depth reconstruction, while learning to generate trajectories directly

SyncReward: Human-Aligned Synchronization Reward for Audio-Visual Generation

arXiv:2610.16338v1 Announce Type: new Abstract: Recent years have witnessed rapid progress in joint audio--visual generation. However, audio--visual synchronization remains a challenge, as generated s

TartanMatch: Towards Universal Dense Correspondence Across Modalities

arXiv:2610.14513v1 Announce Type: new Abstract: Robotic platforms combine multi-modal sensors to operate across diverse conditions, but most dense correspondence methods are limited to RGB-RGB or a sm

applicationsarxiv-cs-cv

Text-Vision Co-Instructed Image Editing

arXiv:2606.16767v2 Announce Type: replace Abstract: Existing image editing methods can be generally categorized into textual instruction-based and visual prompt-based ones. Textual instructions are se

Local Ai

Texture Interpolation as Texton Matching

arXiv:2610.18655v1 Announce Type: new Abstract: Texture interpolation asks what should lie between two textures. Standard methods typically blend pixels or features at corresponding spatial locations,

local-aiarxiv-cs-cv

TraceSampler: Making Sampling Errors Predictable and Correctable for Accelerated Generative Sampling

arXiv:2610.14332v1 Announce Type: new Abstract: Accurate sampling from continuous-time generative models can require many model evaluations. Low-step sampling reduces cost, but coarse updates introduc

Understanding Gene Expression-to-Image Learning: Spatial Structure and Information Fidelity

arXiv:2610.17699v1 Announce Type: cross Abstract: Single-cell RNA sequencing (scRNA-seq) enables cell-level analysis of biological heterogeneity, but learning effective representations from high-dimen

researcharxiv-cs-lg

UniLAP: A Unified Latent Action Policy for Cross-Embodiment Manipulation

arXiv:2610.16969v1 Announce Type: cross Abstract: Latent Action Models (LAMs) can capture manipulation priors from action-free videos, but discrete latents usually impose a granularity bottleneck, lim

UniMetric: Universal Metric Scale Recovery for Visual Geometry Foundation Models

arXiv:2610.16945v1 Announce Type: new Abstract: Recent advances in multimodal foundation models, exemplified by GPT-6 Astra, raise the prospect of general-purpose embodied reasoning and planning. Usin

safetyarxiv-cs-cv

Video-Based Sexual Harassment Detection Using Fine-Tuned Video Transformers

arXiv:2610.15354v1 Announce Type: new Abstract: Sexual harassment represents a pervasive societal challenge, with a substantial proportion of incidents remaining unreported due to insufficient evidenc

applicationsarxiv-cs-cv

VideoJev: System One Model for Video Understanding and Interaction

arXiv:2610.18615v1 Announce Type: new Abstract: Visual agents must turn video observations into timely decisions to track progress and choose what to do next. Building on the emerging System One parad

ViewStruct: View-Grounded Articulation and Connectivity Inference

arXiv:2610.16793v1 Announce Type: new Abstract: Interacting with unfamiliar objects requires understanding how their parts connect and move. We introduce ViewStruct, a framework for jointly predicting

applicationsarxiv-cs-cv

What Limits Cross-Task Generalization in World Action Models?

arXiv:2610.16641v1 Announce Type: new Abstract: Cross-task generalization remains difficult for world action models (WAMs), even when their predicted futures depict plausible manipulation. This gap ca

researcharxiv-cs-ro

What Makes a Good Visual Representation for Spatial Understanding in MLLMs?

arXiv:2610.17844v1 Announce Type: new Abstract: Spatial understanding is a necessary step in moving multimodal large language models (MLLMs) toward reasoning about the 3D physical world. Their visual

When Repeated Measurements Hurt Tabular Foundation Models

arXiv:2610.16801v1 Announce Type: cross Abstract: Tabular foundation models (TFMs) achieve state-of-the-art performance on IID benchmarks, but how do they respond to repeated measurements at the same

researcharxiv-cs-lg

ZOIF: Zeroth-Order Influence Function Estimation for LLM Data Selection Using Only Forward Passes

arXiv:2610.15336v1 Announce Type: new Abstract: Influence functions enable principled data selection for large language models (e.g., identifying influential training samples for model editing, debugg

Beyond Semantic IDs: Finite-Beam Reachability and Continuous-Query Generation in Generative Recommendation

arXiv:2610.12977v1 Announce Type: new Abstract: Generative recommendation (GR) of social media platforms commonly retrieves items by autoregressively decoding discrete Semantic IDs (SIDs) with finite-

researcharxiv-cs-ai

Byzantine-Resilient Federated Large Language Model via Hypergraph Message Passing

arXiv:2610.12711v1 Announce Type: new Abstract: Federated Large Language Models (FedLLMs) are promising to deliver privacy-preserving, collaborative intelligence. The decentralized training process is

DeFM: Learning Foundation Representations from Depth for Robotics

arXiv:2601.18923v2 Announce Type: replace Abstract: Depth sensors are widely deployed across robotic platforms, and advances in fast, high-fidelity depth simulation have enabled robotic policies train

applicationsarxiv-cs-ro

Dream to Remember: Continual Steering of Generalist Robot Policies with World Models

arXiv:2610.13816v1 Announce Type: cross Abstract: Generalist robot policies are trained with imitation learning and are bounded by the quality and coverage of their demonstrations. Reinforcement learn

Evaluating LLM Creativity through Long-Tail Performance

model-releasesarxiv-cs-cl

arXiv:2610.12998v1 Announce Type: new Abstract: Creativity benchmarks for large language models (LLMs) vary widely in task and metric design. This raises the question of whether they capture a common

From 2.1M Hours of Raw Broadcast Audio to Finnish Speech SSL: Confidence Filtering and Architectural Analysis at Scale

model-releasesarxiv-cs-cl

arXiv:2610.13102v1 Announce Type: new Abstract: Broadcast archives offer scale and diversity for self-supervised learning (SSL) but contain substantial noisy, non-speech, and multilingual content. Pri

Hardware

How Much Computation Does Every Forecast Need? Structured Block Skipping in Two Time-Series Foundation Models

arXiv:2610.13208v1 Announce Type: new Abstract: Time-series foundation models use the same network depth for every input, although forecasting windows differ in structure and difficulty. We test wheth

hardwarearxiv-cs-lg

Humanize Olympiad Agents: A Multi-Session Workflow for Olympiad Problem Solving with Solve, Review, Wiki, Verify

model-releasesarxiv-cs-ai

arXiv:2610.13632v1 Announce Type: new Abstract: Large language model (LLM) agents are rapidly improving on long-horizon scientific and olympiad tasks. Recent systems have produced a Lean-formalized re

Kairos: Toward a Byte-Level Foundation Model for Every Modality

arXiv:2610.12495v1 Announce Type: cross Abstract: Small language models trained on a single local machine leave little room for architectural trial and error. Kairos combines bidirectional gated-Delta

researcharxiv-cs-ai

KITE: A Knowledge-Injected Temporal Encoder for Time-Series Event Forecasting

arXiv:2610.12738v1 Announce Type: cross Abstract: Forecasting rare, high-cost events in multivariate time-series systems is hard because their precursors are seldom observed, so a purely data-driven m

safetyarxiv-cs-ai

LAPT-Scale: Scaling Embodied Policies with Latent Action Pre-Training on Human Videos

arXiv:2610.13732v1 Announce Type: cross Abstract: Scaling generalist robotic policies is limited by the high cost of collecting embodied interaction data. Large-scale egocentric human videos offer a r

safetyarxiv-cs-ai

Market Impact Estimation via Causal Foundation Models

arXiv:2610.12537v1 Announce Type: new Abstract: When a trader executes a large order, the relevant question is not what will the price be? but what would the price have been had I not traded? Market i

Mesh-Native Tokenisation: Retrofitting Foundation Models to Unstructured Data

arXiv:2610.12618v1 Announce Type: cross Abstract: Physics foundation models are an increasingly popular approach for building versatile emulators for spatiotemporal systems. They require tokenisation

researcharxiv-cs-ai

MORAD: Reinforcement Learning with Multi-Objective Rewards for RNA Inverse Design

arXiv:2610.13305v1 Announce Type: new Abstract: We introduce MORAD, an online reinforcement learning framework for backbone-conditioned RNA diffusion models that trains a single shared policy across d

On the Encoding of Calendar Features in Covariate-Informed Time Series Foundation Models

arXiv:2610.13676v1 Announce Type: new Abstract: Time series foundation models (TSFMs) increasingly offer covariate support, with calendar information being the most common type of categorical covariat

researcharxiv-cs-lg

One Model to Loop Them All: Elastic Latent Recurrence for Language Models

arXiv:2610.12582v1 Announce Type: new Abstract: A latent recurrent language model applies a shared block of layers repeatedly, so one checkpoint can trade inference compute for accuracy by changing th

researcharxiv-cs-cl

Overcoming Data Imbalances with Expert Selection Biases

arXiv:2610.13370v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models have become the standard architecture for frontier LLMs. The multiple parallel experts in each transformer block theoret

researcharxiv-cs-cl

Local Ai

PartiGen: Part-Aware Representations for Language-Conditioned Humanoid Motion Generation

arXiv:2610.13373v1 Announce Type: new Abstract: Translating language into humanoid motion requires coordinating body parts, determining motion duration, and producing references suitable for robot exe

local-aiarxiv-cs-ro

Agents

Prediction-Informed Landing Window Planning for UAV Landing on USV in High Sea States

arXiv:2610.13190v1 Announce Type: cross Abstract: Autonomous landing of unmanned aerial vehicle (UAV) on unmanned surface vehicle (USV) is difficult in high sea states. Existing hierarchical landing m

agentsarxiv-cs-lg

RARA: Robust Policy Fine-Tuning through Retrieval-Anchored Representation Alignment for Robotic Manipulation

arXiv:2610.13578v1 Announce Type: cross Abstract: Pre-trained robot policies, such as Vision-Language-Action (VLA) models, provide a strong foundation for generalist robotic manipulation, but adapting

Reflect-VLA: Internalizing Reflective Guidance via Dual-Path On-Policy Self-Distillation for Autonomous Driving

arXiv:2610.13453v1 Announce Type: new Abstract: Reinforcement Learning (RL) substantially improves planning performance in autonomous-driving Vision-Language-Action (VLA) models. However, existing RL

safetyarxiv-cs-ro

Reinforcement Learning via Fixed-point Flow Matching

arXiv:2610.12848v1 Announce Type: new Abstract: In maximum entropy and behavior-constrained reinforcement learning (RL), the optimal policy is given by a Boltzmann distribution. Generating samples fro

SmolWAM: A Latent World-Action Model for Robotic Manipulation on Edge Devices

arXiv:2610.13740v1 Announce Type: cross Abstract: World-action models (WAMs) predict a robot's actions together with the observations those actions will produce. However, the strongest models rely on