Search: “pretraining”

Globally Localizing Lunar Rover in Pixels via Graph Alignment

arXiv:2606.10602v1 Announce Type: new Abstract: Precise rover localization is a prerequisite for autonomous lunar exploration, yet the absence of Global Navigation Satellite System (GNSS) signals and

safetyarxiv-cs-cv

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

If Claude Fable stops helping you, you'll never know

DGX agent

If Claude Fable stops helping you, you'll never know Jonathon Ready highlights one of the more eyebrow-raising details from the 319 page system card for Fable 5 and Mythos 5. Here's a longer excerpt,

model-releasessimon-willison

10 Jun 2026

LAFP: Preserving Latent Action Structure in Latent Policy Learning via Flow Matching

arXiv:2606.10517v1 Announce Type: new Abstract: Learning high-quality latent actions from large-scale unlabeled videos, coupled with limited real-world interaction data for training an action decoder,

safetyarxiv-cs-cv

Tutorials

Leveraging Metric Depth for Relative Depth Prediction

arXiv:2606.10628v1 Announce Type: new Abstract: We present our solution to the 2025 SoccerNet Monocular Depth Estimation Competition Challenge. Predicting the relative depth in football scenarios is c

tutorialsarxiv-cs-cv

Next Forcing: Causal World Modeling with Multi-Chunk Prediction

model-releasesarxiv-cs-cv

arXiv:2606.11187v1 Announce Type: new Abstract: Autoregressive video generation has emerged as a powerful paradigm for World Action Models (WAMs). However, existing approaches suffer from slow trainin

One Token per Multimodal Evidence: Latent Memory for Resource-Constrained QA

arXiv:2606.10572v1 Announce Type: new Abstract: External memory effectively grounds large language models (LLMs) and vision-language models (VLMs)-based question answering (QA) in relevant multimodal

researcharxiv-cs-ai

Parallel Causal Associative Fields: Gated Sparse Memory for Long-Context Language Modeling

model-releasesarxiv-cs-cl

arXiv:2606.10435v1 Announce Type: cross Abstract: Transformers achieve strong language modeling performance by providing direct token-to-token communication paths, but causal self-attention scales qua

Piper: A Programmable Distributed Training System

arXiv:2606.11169v1 Announce Type: cross Abstract: Large-scale model training increasingly relies on composing multiple parallelism strategies, such as data, pipeline, and expert parallelism, together

Hardware

Sampling Triangulations and Calabi-Yau Threefolds with Autoregressive GNNs

arXiv:2605.27770v2 Announce Type: cross Abstract: We introduce `dualGNN', an autoregressive message-passing GNN for sampling fine, regular triangulations (FRTs) of convex polytopes. dualGNN operates o

hardwarearxiv-cs-lg

Self-EmoQ: Plutchik-Guided Value-based Planning to Drive Streaming Emotional TTS

arXiv:2606.09837v1 Announce Type: cross Abstract: Emotional interaction is increasingly crucial for conversational AI, yet current systems lack a self-emotion determination mechanism to drive the stre

Speech Meets ELF: Audio Conditional Continuous-Target Diffusion for Speech Recognition and Translation

arXiv:2606.10368v1 Announce Type: cross Abstract: Speech-to-text (S2T) systems for recognition (ASR) and translation (S2TT) typically generate discrete text tokens. In contrast, continuous-target lang

researcharxiv-cs-ai

Task Robustness via Re-Labelling Vision-Action Robot Data

arXiv:2606.10918v1 Announce Type: cross Abstract: The recent trend in scaling models for robot learning has resulted in impressive policies that can perform various manipulation tasks and generalize t

Local Ai

Tractogram foundation model

arXiv:2606.09893v1 Announce Type: cross Abstract: Diffusion MRI (dMRI) tractography is the only noninvasive approach for mapping white-matter pathways in the living human brain. It represents each bra

local-aiarxiv-cs-ai

A generalizable 3D framework and model for self-supervised learning in medical imaging

arXiv:2501.11755v2 Announce Type: replace-cross Abstract: Current self-supervised learning methods for 3D medical imaging rely on simple pretext formulations and organ- or modality-specific datasets,

Tutorials

A Systematic Study of Behavioral Cloning for Scientific Data Annotation

arXiv:2606.07568v1 Announce Type: cross Abstract: Scientific data annotation, such as tracking animals in video or proofreading neural reconstructions, remains bottlenecked by the 'last mile' problem:

tutorialsarxiv-cs-ai

A Unifying View of Attention Sinks: Two Algorithms, Two Solutions

arXiv:2606.08105v1 Announce Type: new Abstract: When attention concentrates on a single token, a sink, what is the model actually computing? Attention sinks are ubiquitous in softmax transformers, yet

Tutorials

A Universal Dense Football Event Representation Based on TabTransformer

arXiv:2606.09327v1 Announce Type: cross Abstract: Football event data constitute a rich spatiotemporal source for quantitative analysis of player actions in team sports. These datasets contain heterog

tutorialsarxiv-cs-ai

AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing

arXiv:2606.09811v1 Announce Type: cross Abstract: World-action models have emerged as a promising paradigm for robot manipulation, jointly modeling visual scene dynamics and actions to inject physical

AMix-1: A Pathway to Test-Time Scalable Protein Foundation Model

arXiv:2507.08920v4 Announce Type: replace-cross Abstract: We introduce AMix-1, a powerful protein foundation model built on Bayesian Flow Networks and empowered by a systematic training methodology, e

Assessing Sample Quality in Conditional Generation under Compositional Shift

arXiv:2606.09601v1 Announce Type: new Abstract: Conditional generators provide a natural tool for controllable generation, including settings where the desired condition is a new composition of observ

AttentionCap: Transformer Based Capacitance Matrix Learning Toward Full-Chip Extraction

arXiv:2606.08161v1 Announce Type: new Abstract: As capacitance extraction accuracy of rule-based pattern matching becomes difficult to sustain at advanced nodes, a growing trend emerges to develop dee

Benchmarking Vision-Language-Action Models on SO-101: Failure and Recovery Analysis

arXiv:2606.08881v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have demonstrated strong generalization in robotic manipulation, yet existing evaluations are primarily conducted

BLUE: Toward Better Language Use in Efficient Vision-Language-Action Models for Autonomous Driving

model-releasesarxiv-cs-cv

arXiv:2606.08684v1 Announce Type: new Abstract: We present BLUE, a minimal method for better language use in vision-language-action (VLA) models for autonomous driving (AD). Through extensive analysis

Breaking the Bubble: Asynchronous Pipeline Parallel Training with Bounded Weight Inconsistency

model-releasesarxiv-cs-lg

arXiv:2606.07881v1 Announce Type: new Abstract: Pipeline parallelism is essential for training large neural networks, but existing schedules trade off throughput, memory, and optimization consistency.

Causal Semantic Alignment for LLM-based Time Series Forecasting

arXiv:2606.08262v1 Announce Type: new Abstract: Recent advances in Large Language Models (LLMs) have opened new possibilities for time series forecasting by enabling alignment between temporal pattern

CLASP: Language-Driven Robot Skill Selection and Composition using Task-Parameterized Learning

arXiv:2606.08169v1 Announce Type: cross Abstract: Enabling robots to understand and execute tasks from natural language commands while maintaining data efficiency remains challenging. Foundation model

Community-Specific Slang and Entity Detection via Semantic Shift in Fine-Tuned Language Models

arXiv:2606.07522v1 Announce Type: cross Abstract: We propose an unsupervised method of resolving slang, unique entities, and folklore from online communities by isolating words in the lexicon that hav

De novo molecular generation with optical property preconditioning at the token level

model-releasesarxiv-cs-lg

arXiv:2606.08221v1 Announce Type: new Abstract: Designing OLED molecules with targeted optical properties remains challenging due to the scarcity of high-quality data and the limited reliability of co

DifferSeg: Towards Diverse Multimodal Binary Segmentation via Differential Perception and Frequency Guidance

arXiv:2606.08906v1 Announce Type: new Abstract: In many binary segmentation tasks, most multimodal methods rely on fixed feature concatenation for cross-modal interaction and straightforward decoder d

Discovering Functionally Selective Brain Regions with a Deep Topographic Multimodal Model

arXiv:2606.09770v1 Announce Type: cross Abstract: Nearby neurons in cortex share similar response profiles, producing systematic spatial organization across sensory and cognitive systems. Recent topog

DOME: Learning Transferable Domain Variables from Sparse Supervision for Test-Time Adaptation

arXiv:2606.07646v1 Announce Type: cross Abstract: Test-time adaptation (TTA) aims to align a model to shifting test domains using only unlabeled streaming data. Most existing methods implicitly infer

applicationsarxiv-cs-ai

DynaOD: Dynamic Origin-Destination Flow Generation with Discrete-to-Continuous Temporal Semantic Modeling

arXiv:2606.09086v1 Announce Type: new Abstract: Dynamic origin-destination (OD) flow generation seeks to synthesize realistic mobility dynamics from temporal context alone, without relying on historic

applicationsarxiv-cs-ai

Few-step Cofolding with All-Atom Flow Maps

arXiv:2606.08375v1 Announce Type: new Abstract: All-atom generative modeling of 3D biomolecular complexes has emerged as the dominant paradigm for predicting the structure of proteins and protein-liga

From A to B to A: Palindromic Zero-Shot Voice Conversion with Non-Parallel Data

arXiv:2606.08843v1 Announce Type: cross Abstract: We present a voice conversion (VC) framework that utilizes K-Nearest Neighbors (KNN) retrieval over WavLM representations to align non-parallel source

G2G: Exploiting Intra-Group Geometry for Inter-Group Pose Estimation

arXiv:2606.08284v1 Announce Type: new Abstract: Recovering the relative 6-DoF pose between two image groups underlies cross-sequence relocalization and multi-camera rig odometry. Each group carries kn

applicationsarxiv-cs-cv

Generative Reasoning Re-ranker

arXiv:2602.07774v5 Announce Type: replace-cross Abstract: Recent studies increasingly explore Large Language Models (LLMs) as a new paradigm for recommendation systems due to their scalability and wor

In-Context Learning of Stochastic Differential Equations with Foundation Inference Models

arXiv:2502.19049v3 Announce Type: replace Abstract: Stochastic differential equations (SDEs) describe dynamical systems where deterministic flows, governed by a drift function, are superimposed with r

applicationsarxiv-cs-lg

Land cover and flood type govern the detection limits of satellite-based flood mapping across diverse global flood events

arXiv:2606.07780v1 Announce Type: new Abstract: Floods are among the most destructive natural hazards, and their increasing frequency under climate change makes satellite-based inundation mapping esse

applicationsarxiv-cs-ai

Language-based Trial and Error Falls Behind in the Era of Experience

arXiv:2601.21754v3 Announce Type: replace Abstract: While Large Language Models (LLMs) excel in language-based agentic tasks, their applicability to unseen, nonlinguistic environments (e.g., symbolic

Learning to Solve Generative ODEs Beyond the Linear Span

arXiv:2606.08672v1 Announce Type: new Abstract: Diffusion and flow generative models sample by integrating a learned ODE, but high quality still requires many sequential model evaluations. Solver lear

MemoryVLA++: Temporal Modeling via Memory and Imagination in Vision-Language-Action Models

arXiv:2606.09827v1 Announce Type: cross Abstract: Temporal modeling is essential for robotic manipulation, as effective control requires both memory of past interactions and imagination of future stat

Local Ai

Model Poisoning Against Federated Model Adaptation with Chain of Bit-Flips

arXiv:2606.09548v1 Announce Type: cross Abstract: Federated Learning (FL) allows a set of clients to collectively train a global model without sharing local training data. Giving the responsibility of

local-aiarxiv-cs-ai

MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understanding

arXiv:2410.21747v2 Announce Type: replace Abstract: Generating lifelike human motions from descriptive texts has experienced remarkable research focus in the recent years, propelled by the emerging re

MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulation

arXiv:2606.09215v1 Announce Type: new Abstract: World Action Models (WAMs) couple a video dynamics prior to the policy and have shown encouraging results on tabletop manipulation, but iterative denois

safetyarxiv-cs-ro

omega-EVA: Envision, Verify, and Act with Latent Interactive World Models

arXiv:2606.09457v1 Announce Type: new Abstract: Embodied policies typically map current observations directly to actions, leaving candidate-action consequences implicit. World models provide predictiv

safetyarxiv-cs-ro

PACT: Self-Evolving Physical Safety Alignment for Diffusion Policies in Embodied Manipulation

arXiv:2606.08414v1 Announce Type: cross Abstract: Diffusion policies have achieved remarkable success in robotic manipulation, yet they often fail to satisfy strict physical constraints required for s

Physics-Guided Sequence-Based Generative Framework for Acoustic Metamaterial Inverse Design

arXiv:2606.09266v1 Announce Type: cross Abstract: Acoustic metamaterial (AMM) inverse design is particularly challenging for broadband target responses due to acoustic dispersion: a structure that mat

researcharxiv-cs-ai

POET-X: Memory-efficient LLM Training by Scaling Orthogonal Transformation

arXiv:2603.05500v2 Announce Type: replace-cross Abstract: Efficient and stable training of large language models (LLMs) remains a core challenge in modern machine learning systems. To address this cha