When do Random Forests work?
arXiv:2504.12860v2 Announce Type: replace-cross Abstract: We study the effectiveness of randomizing split-directions in random forests. Prior literature has shown that, randomization can reduce varian
Knowledge catalogue
arXiv:2504.12860v2 Announce Type: replace-cross Abstract: We study the effectiveness of randomizing split-directions in random forests. Prior literature has shown that, randomization can reduce varian
arXiv:2609.33169v1 Announce Type: new Abstract: Policies with memory can learn along two backward paths: through the physical states their actions produce and through the representations they store. T
arXiv:2609.32488v1 Announce Type: cross Abstract: Dense retrieval powers retrieval-augmented generation, semantic search, and question answering, yet the theoretical basis for choosing between shared
arXiv:2606.16694v2 Announce Type: replace Abstract: Transformers perform computations through many successive attention and feedforward blocks, allowing them to learn complex correlations between a la
arXiv:2609.31639v1 Announce Type: new Abstract: Diagnosing rolling-element bearing faults from vibration is a canonical physical-sensing task and a widely used benchmark for domain adaptation under op
arXiv:2609.34460v1 Announce Type: cross Abstract: Does structured mathematical knowledge help LLMs prove theorems in Lean 4? If so, for which models, and does the answer vary by problem? Formal librar
arXiv:2609.32301v1 Announce Type: new Abstract: Active feature acquisition (AFA) sequentially selects informative features under budget constraints. However, existing policies rarely distinguish wheth
arXiv:2609.34091v1 Announce Type: new Abstract: Sparse autoencoders (SAEs) decompose dense model activations into discrete latents, making individual features easy to interpret--and easy to misinterpr
arXiv:2609.31678v1 Announce Type: new Abstract: KV cache compression is widely used for long context LLM inference under memory constraints, while deployed systems typically score refusals after gener
arXiv:2609.34012v1 Announce Type: new Abstract: Neural PDE surrogates increasingly incorporate structural priors, yet it is often unclear whether their gains arise from physics-specific information or
arXiv:2609.32898v1 Announce Type: new Abstract: Pretrained tabular foundation models process every dataset at a fixed depth, with inference costs growing with dataset size. To address this, we present
arXiv:2609.34489v1 Announce Type: new Abstract: Data pruning reduces the training cost of knowledge distillation (KD). However, the preferred teacher capacity changes with the data budget: smaller tea
arXiv:2609.34602v1 Announce Type: new Abstract: Frozen Earth-observation embeddings are judged almost entirely by spatially blocked cross-validation inside one study region. We show that this number d
arXiv:2609.33312v1 Announce Type: cross Abstract: Moving ML-mediated decision making onto privacy-preserving clients decentralises the economic decision along with the inference. Shared budget constra
arXiv:2609.32083v1 Announce Type: new Abstract: Deploying AI systems requires deciding when to delegate tasks and when humans should intervene to monitor and mitigate risk induced by AI operations. Th
arXiv:2609.35314v1 Announce Type: new Abstract: Neural residuals can improve satellite evapotranspiration (ET) estimates, but selectors must predict when a correction helps and reject unsupported inpu
arXiv:2603.13688v2 Announce Type: replace-cross Abstract: AI systems increasingly assist decision making by producing cheap factor-level assessments of complex inputs, but these assessments can be bia
arXiv:2609.34849v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards provides a sparse post-training signal: a single binary outcome evaluates the entire rollout, and every t
arXiv:2609.32332v1 Announce Type: new Abstract: Rehearsal-free continual learning with parameter-efficient adapters can be cast as a sequence of task-vector write-in operations: for each new task, a l
arXiv:2606.18820v2 Announce Type: replace Abstract: Sequential decisions often become better informed as action opportunities expire. We introduce Maturing Markov Decision Processes (MMDPs), a structu
arXiv:2609.33334v1 Announce Type: new Abstract: Training-free KV-cache compression methods such as SnapKV, H2O, and PyramidKV evict tokens at the end of prefill, aiming to preserve the attention mass
arXiv:2609.33889v1 Announce Type: new Abstract: At each step, decoding one sequence with a large language model rereads the projection weights, whose traffic is fixed, and the key-value (KV) cache, wh
arXiv:2609.32230v1 Announce Type: new Abstract: Surrogate models are commonly evaluated by how often they agree with their teacher model over an evaluation set. Local variation in this agreement is we
arXiv:2609.33180v1 Announce Type: cross Abstract: As recursive self-improvement (RSI) rapidly advances, reliable evaluation becomes critical for guiding adaptive search. RSI typically relies on finite
arXiv:2609.35630v1 Announce Type: cross Abstract: Massive activation features (MAs) in Transformers are extreme-value residual-stream features that persist across layers despite the model's ability to
arXiv:2609.34065v1 Announce Type: cross Abstract: Names are personal identifiers, but they also carry social meaning and are widely used to evaluate how language models treat different people. Such ev
arXiv:2505.15064v5 Announce Type: replace Abstract: We ask when adding hidden layers improves generalization, in a model that keeps the layers fixed and varies only their number. A hidden layer is a s
arXiv:2509.23219v2 Announce Type: replace Abstract: Technical-domain benchmarks constructed from arXiv papers can overlap the same public text used in LLM pretraining. Auditing this risk at training-c
arXiv:2609.34138v1 Announce Type: cross Abstract: With the advent of word representations, word similarity tasks are becoming increasing popular as an evaluation metric for the quality of the represen
arXiv:2603.01375v2 Announce Type: replace-cross Abstract: Test-time policy adaptation for multi-turn interactions (T2PAM) is essential for aligning Large Language Models (LLMs) with dynamic user needs
arXiv:2609.32457v1 Announce Type: new Abstract: Transformers process information strictly forward through depth, preventing deeper computation from revisiting and refining earlier representations. To
arXiv:2609.34212v1 Announce Type: new Abstract: Mixture-of-Depths (MoD) enables conditional computation across Transformer depth by routing only a subset of tokens through selected layers, but its ori
arXiv:2609.35715v1 Announce Type: new Abstract: Reinforcement learning (RL) in simulation can train dexterous manipulation policies without robot demonstrations, but training a single generalist polic
arXiv:2609.34939v1 Announce Type: new Abstract: Future exogenous variables provide valuable information for forecasting endogenous time series. Existing covariate-aware methods primarily learn the dir
arXiv:2609.33609v1 Announce Type: new Abstract: In-context learning (ICL) is crucial for boosting the inference performance of large language models (LLMs). However, the effectiveness of ICL in LLMs i
arXiv:2609.33757v1 Announce Type: cross Abstract: Symbolic models make melody, harmony, rhythm, and form explicit but typically stop before a finished recording; audio models produce complete songs wh
arXiv:2609.33066v1 Announce Type: new Abstract: Contemporary neural inference architectures rely on dense floating-point weight matrices stored in high-bandwidth memory (VRAM), incurring severe memory
arXiv:2609.34265v1 Announce Type: new Abstract: Error-correcting codes (ECCs) are essential across diverse applications, from wireless communications and storage to quantum computing, yet each applica
arXiv:2609.33314v1 Announce Type: new Abstract: Zero-shot graph models (ZGMs), which learn transferable knowledge from source graphs and directly apply to unseen target graphs without any adaptation,
arXiv:2609.34457v1 Announce Type: new Abstract: Transformer-based models are widely used for reasoning, coding, and multimodal agentic tasks. To provide formal assurance of desirable behaviors, such a
arXiv:2609.30975v1 Announce Type: cross Abstract: Speech content representations are central to voice conversion, speech-to-speech translation, and multimodal language models, yet they are rarely comp
arXiv:2609.31101v1 Announce Type: cross Abstract: The flatness of the loss landscape at a minimizer is a widely used heuristic for reasoning about neural-network generalization, yet evidence for this
arXiv:2012.02655v4 Announce Type: cross Abstract: In this article, we define a new non-archimedean metric structure, called cophenetic metric, on persistent homology classes of all degrees. We then sh
arXiv:2604.01525v2 Announce Type: replace-cross Abstract: We give a short linear-algebraic proof of the inequality $ |x|_1,|x|_infty le frac{1+sqrt{n}}{2},|x|_2^2, valid for every xinR^n. This inequal
arXiv:2609.30859v1 Announce Type: cross Abstract: Contingency analysis using the AC power flow (AC-PF) model is a critical tool for accurate grid security assessment, but its computational burden incr
arXiv:2609.30822v1 Announce Type: new Abstract: Learned particle simulators based on graph neural networks achieve strong one-step accuracy, but errors compound over long horizons. An underexplored va
arXiv:2609.30405v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed in settings where responses must reflect multiple, potentially interacting social norms and human
arXiv:2609.30321v1 Announce Type: cross Abstract: Adaptive arm selection changes the distribution of the observations collected by a bandit algorithm, but it need not change their limiting empirical s
arXiv:2609.31402v1 Announce Type: cross Abstract: Auditory Attention Detection (AAD) utilizes electroencephalographic (EEG) signals to identify a target speaker in a multi-speaker environment. Despite
arXiv:2609.31197v1 Announce Type: new Abstract: Machine learning for scientific discovery is almost systematically data bound. Producing relevant high quality data, under budget constraints, is amongs
arXiv:2606.15871v2 Announce Type: replace-cross Abstract: Uncertainty in the solution of an inverse problem and in the tasks performed on it is quantified by posterior expectations, each an average of
arXiv:2609.30396v1 Announce Type: cross Abstract: This paper presents an end-to-end causal machine learning (ML) pipeline designed for real-world applications with continuous treatments. The proposed
arXiv:2609.30839v1 Announce Type: new Abstract: Simultaneous speech-to-text translation (Simul-S2TT) consists of generating partial translations while the incoming audio frames are processed by the sy
arXiv:2609.31168v1 Announce Type: new Abstract: My doctoral work aims to explore Audio Emotion Recognition (AER) in the context of atypical listening. This research focuses on auditory hypersensitivit
arXiv:2609.30454v1 Announce Type: new Abstract: Non-generative 'System-1' models return structured probabilistic decisions in a single forward pass, without autoregressive decoding, at a small fractio
arXiv:2609.31038v1 Announce Type: new Abstract: Time series foundation models (TSFMs) enable cross-domain forecasting, but their development as general-purpose forecasters remains constrained by under
arXiv:2609.30541v1 Announce Type: new Abstract: Optimizing embedding systems for production recommendation pipelines demands systematic exploration that consumes disproportionate engineering effort at
arXiv:2504.01875v3 Announce Type: replace Abstract: Stochastic Gradient Descent (SGD) and its variants, such as ADAM, are foundational to deep learning optimization, adjusting model parameters through
arXiv:2609.31157v1 Announce Type: new Abstract: Multi-dimensional time series, inherently tensorial, are common in practice. Despite great progress in time series anomaly detection, most existing meth
arXiv:2609.30445v1 Announce Type: cross Abstract: Optimizing fMRI scan duration and spatial resolution is critical for experimental design, yet traditional correlation-based approaches cannot quantify