Soft Teacher Forcing
arXiv:2610.17189v1 Announce Type: cross Abstract: Soft tokens have so far been used to replace discrete chain-of-thought in latent reasoning methods. These approaches typically require multi-stage tra
Knowledge catalogue
arXiv:2610.17189v1 Announce Type: cross Abstract: Soft tokens have so far been used to replace discrete chain-of-thought in latent reasoning methods. These approaches typically require multi-stage tra
arXiv:2610.15968v1 Announce Type: new Abstract: Spiking Transformers achieve energy efficiency by discarding softmax normalization in favor of thresholded, binary attention. However, this removal brea
arXiv:2610.18486v1 Announce Type: new Abstract: Membership Inference Attacks (MIAs) are currently the dominant approach to evaluating privacy in machine learning applications. Despite their significan
arXiv:2610.17226v1 Announce Type: cross Abstract: Most machine-learning interatomic potentials (MLIPs) are trained on gas-phase data, which limits their use for chemistry in solution. Here, we introdu
arXiv:2610.18735v1 Announce Type: new Abstract: Speculative Decoding (SD) has demonstrated its efficacy in accelerating large language model inference, but for Vision-Language Models (VLMs), the diver
arXiv:2610.14400v1 Announce Type: new Abstract: Successor-feature-based zero-shot reinforcement learning methods pre-train a task encoder and successor-feature predictor on offline, reward-free data,
arXiv:2610.15039v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models combine specialized experts through an input-dependent routing mechanism, and their sparse variants underpin many modern
arXiv:2610.16264v1 Announce Type: new Abstract: Electroencephalography (EEG) is a non-invasive, scalable source of quantitative biomarkers for the early diagnosis of brain disorders, and deep represen
arXiv:2610.16680v1 Announce Type: cross Abstract: Resampling is the standard remedy against weight degeneracy in particle filters, yet its effect on the spectrum of the particle second-moment matrix i
arXiv:2610.16533v1 Announce Type: cross Abstract: Reinforcement learning with verifiable rewards (RLVR) is reshaping how large language models (LLMs) acquire reasoning capabilities, yet the optimizers
arXiv:2302.00985v3 Announce Type: replace-cross Abstract: We consider online scheduling on unrelated (heterogeneous) machines in a speed-oblivious setting, where an algorithm is unaware of the exact j
arXiv:2610.17029v1 Announce Type: new Abstract: Neural operator splitting composes a library of neural operators, one per physical mechanism, into zero-shot simulators of new equations. Existing appro
arXiv:2610.13996v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards improves mathematical reasoning when a final answer can be checked, but a correct answer does not certify
arXiv:2610.15458v1 Announce Type: new Abstract: Existing analyses of interval length in split conformal prediction largely focus on clean data. However, how contamination at the training and calibrati
arXiv:2610.14405v1 Announce Type: cross Abstract: Reinforcement learning (RL) has driven substantial progress in coding agents by relying on verified successful trajectories as learning signals. Howev
arXiv:2610.17904v1 Announce Type: new Abstract: Continual learning (CL) adapts pretrained models to a sequence of tasks while retaining knowledge acquired from earlier tasks. When task data are sensit
arXiv:2610.16816v1 Announce Type: cross Abstract: Global reanalyses are too coarse to resolve the convective systems that produce most West African monsoon rainfall. In this work, we use U-Net based a
arXiv:2610.18811v1 Announce Type: new Abstract: In this work, we study grokking in a simple, analytically tractable setting whose rich phenomenology allows us to disentangle the effects of initializat
arXiv:2610.18495v1 Announce Type: cross Abstract: In order to execute quantum algorithms on bosonic quantum computers, it is necessary to encode their inputs into a desired target quantum state, with
arXiv:2610.17925v1 Announce Type: new Abstract: Decisions that weigh several reward signals against each other require the joint distribution of the return vector. Categorical critics scale exponentia
arXiv:2510.17503v2 Announce Type: replace Abstract: We study the online stochastic difference-of-convex (DC) program min_{x in R^n} F(x) = G(x) - H(x) + r_1(x) - r_2(x), which covers sparse learning w
arXiv:2610.14338v1 Announce Type: cross Abstract: TREGO, a trust-region Bayesian optimization (BO) method for expensive blackbox problems, has convergence guarantees, but only for exact function value
arXiv:2610.14567v1 Announce Type: cross Abstract: This paper develops strong Gaussian approximations (KMT type) for constant learning rate stochastic gradient descent (SGD). We work with heavy tailed
arXiv:2603.28916v2 Announce Type: replace Abstract: Football action-value approaches estimate scoring, possession, or other downstream outcome value; complementary descriptions can characterise how a
arXiv:2610.17483v1 Announce Type: new Abstract: Machine learning surrogates of partial differential equations (PDEs) are commonly trained on data generated by numerical solvers. Therefore, the trainin
arXiv:2610.16451v1 Announce Type: new Abstract: Fine-tuning large language models at scale is increasingly limited by the memory cost of backpropagation. Zeroth-Order (ZO) optimizers reduce this burde
arXiv:2503.07775v3 Announce Type: replace Abstract: Resource-efficiently computing representations of probability distributions and the distances between them while only having access to the samples i
arXiv:2610.15322v1 Announce Type: cross Abstract: Enabling the reuse and composition of knowledge and capabilities distributed across foundation models is an important step toward building scalable ar
arXiv:2610.15095v1 Announce Type: new Abstract: LLM multi-agent systems split work across agents that communicate through text. An agent summarizes its findings, another agent receives the text. This
arXiv:2610.16990v1 Announce Type: new Abstract: Tabular data generation aims to synthesize realistic samples from limited observations while faithfully capturing the underlying data distribution. Tabu
arXiv:2610.15699v1 Announce Type: new Abstract: Generative modeling for tabular data has advanced to the point where models can synthesize realistic records, recover missing values, and generate sampl
arXiv:2610.14626v1 Announce Type: new Abstract: Mixed-variable optimization in scientific discovery often requires exploring large combinatorial spaces under costly experimental evaluations, making sa
arXiv:2610.16429v1 Announce Type: cross Abstract: We consider inverse problems regularized by a trained neural network with convex activations and unrestricted weights. The resulting optimization prob
arXiv:2610.17588v1 Announce Type: new Abstract: Muon controls weight updates through the RMS movement of a linear layer's output. This implicitly treats the linear output as a proxy for the full modul
arXiv:2610.14440v1 Announce Type: new Abstract: Asynchronous reinforcement-learning post-training of large language models is computationally efficient but inherently off-policy: the learner updates o
arXiv:2610.18256v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) has emerged as a popular training paradigm for LLMs, providing dense, token-level supervision by aligning a model's o
arXiv:2610.18459v1 Announce Type: new Abstract: External tools can extend the capabilities of small language models (SLMs), enabling their deployment in resource constrained environments. However, the
arXiv:2403.01079v2 Announce Type: replace Abstract: We study the challenging problem for inference tasks on large-scale graph datasets of Graph Neural Networks: huge time and memory consumption, and t
arXiv:2210.01705v3 Announce Type: replace-cross Abstract: Density based representations of atomic environments that are invariant under Euclidean symmetries have become a widely used tool in the machi
arXiv:2610.14860v1 Announce Type: new Abstract: Advances in large language models (LLMs) have brought the vision of a general-purpose personal assistant closer to reality. Such assistants could provid
arXiv:2610.15659v1 Announce Type: new Abstract: Centrality measures rank nodes even when the observed differences can be explained by ordinary structural variation. We therefore study a preceding ques
arXiv:2610.17655v1 Announce Type: cross Abstract: Watermarking embeds an imperceptible signal in text from large language models that is statistically detectable with a secret key. The recent textGrai
arXiv:2610.17444v1 Announce Type: new Abstract: Language model (LM) agents can fail for different reasons, requiring different explanations and interventions. We study how state beliefs, action values
arXiv:2610.16828v1 Announce Type: new Abstract: When does a shared representation become insufficient for jointly supporting multiple tasks? This question lies at the heart of multi-task learning mode
arXiv:2610.18104v1 Announce Type: new Abstract: Hybrid attention is rapidly becoming the dominant architectural choice for frontier models. Despite their successes, such architectures complicate model
arXiv:2404.14855v2 Announce Type: replace Abstract: We characterize the geometry of the set of all weight vectors for which a fully-connected linear neural network computes the same linear transformat
arXiv:2610.15589v1 Announce Type: new Abstract: Many deployed distillation pipelines show the student a truncated view of the teacher: keep the top-k probabilities, renormalize, and minimize a diverge
arXiv:2610.16565v1 Announce Type: new Abstract: Human gaze is the primary high-bandwidth interface through which we parse the semantics of our environment. While often modeled as a sequence, the degre
arXiv:2610.15058v1 Announce Type: new Abstract: Larger sample budgets benefit from higher sampling temperatures in LLMs, but what temperature tuning optimizes and why it works remain poorly understood
arXiv:2610.15629v1 Announce Type: new Abstract: Choosing a mixed-precision configuration for large language model (LLM) serving trades speed against accuracy. Allocators that use average bit-width or
arXiv:2610.14279v1 Announce Type: new Abstract: Learning long-range dependencies with recurrent neural networks (RNNs) is difficult because of the vanishing gradient problem. Gated recurrent neural ne
arXiv:2610.14363v1 Announce Type: new Abstract: A predictor is multicalibrated with respect to a class of subpopulations (formally, of functions on the inputs, called auditors) if, for every subpopula
arXiv:2610.17283v1 Announce Type: new Abstract: The success of autoregressive language models trained with Chain-of-Thought~(CoT) supervision raises a fundamental question: How simple can a next-token
arXiv:2610.17636v1 Announce Type: new Abstract: The Safety-Aware Denoiser (SAD) is a recent, training-free, safety-guidance framework for text diffusion models. During inference, SAD steers text sampl
arXiv:2508.04451v2 Announce Type: replace Abstract: Red teaming is essential for securing Large Language Models, yet current automated methods remain limited by templates and single-turn attacks. To s
arXiv:2610.16165v1 Announce Type: cross Abstract: Large language models (LLMs) have demonstrated remarkable capabilities in solving complex tasks in coding, mathematical logic, and iterative reasoning
arXiv:2610.17249v1 Announce Type: cross Abstract: Differentially private (DP) pipelines often combine heterogeneous mechanisms, yet their guarantees are best analyzed using different notions of privac
arXiv:2610.17065v1 Announce Type: new Abstract: Real-world tables are often heterogeneous, combining numerical features with free-form string columns. Table foundation models (TFMs) excel on numerical
arXiv:2610.16921v1 Announce Type: cross Abstract: Online motor imagery-based brain-computer interfaces (MI-BCIs) typically decode continuous EEG using fixed-length sliding windows that may be misalign
arXiv:2610.18649v1 Announce Type: new Abstract: Message passing neural networks have shown remarkable performance in algorithmic and constraint reasoning, due to their ability to encode the structure