Search: “arxiv-cs-lg”

arXiv:2610.00049v1 Announce Type: new Abstract: Graphics processing unit (GPU) generations scale matrix, special-function, and memory pipelines at different rates, so kernel bottlenecks move as hardwa

hardwarearxiv-cs-lg

Hardware

FastCI: Efficient GPU-Intensive CI for LLM Training Frameworks

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2610.01967v1 Announce Type: new Abstract: As large language models (LLMs) keep growing in size and complexity, their training frameworks evolve at a rapid pace as well. Therefore, continuous int

hardwarearxiv-cs-lg

2 Oct 2026

Faynt: Scaling and Optimizing Policies for Competitive Melee

arXiv:2610.02144v1 Announce Type: new Abstract: We introduce Faynt, a family of 10M- and 75M-parameter Transformer policies for Super Smash Bros. Melee, each controlling all 26 characters with a singl

FedFit: Federated Fine-Tuning of LLMs via Vector-Bank Parameterization and Quantization

arXiv:2610.01537v1 Announce Type: new Abstract: Federated Learning (FL) enables privacy-preserving fine-tuning of Large Language Models (LLMs), yet the massive communication overhead remains a critica

FedSAP: Federated Learning with Structured Adaptive Partitioning for Multi-Domain Heterogeneous Edge Devices

arXiv:2610.01638v1 Announce Type: new Abstract: Federated learning (FL) on heterogeneous edge devices must jointly accommodate unequal resource budgets and domain-shifted local data. Existing resource

Fixed-point neural samplers on discrete spaces

arXiv:2610.01739v1 Announce Type: new Abstract: Sampling from discrete, unnormalized distributions without access to data is a challenging problem. Neural samplers offer a promising approach by traini

Fixing a Model That Learned Worse Cancer Means Lower Risk: Monotonic Constraints in Bladder Cancer Recurrence Prediction

arXiv:2610.00858v1 Announce Type: new Abstract: Background and Objective: Clinicians expect recurrence risk to climb with cancer severity. In a UK multicentre trial, an unconstrained XGBoost model lea

Forking: Sudden Overfitting Under Replay

arXiv:2610.00394v1 Announce Type: new Abstract: This paper studies forking, a generalization failure discovered in NanoGPT autoresearch. Under data replay, models with an over-encoding n-gram memory b

Format-Aware Fusion for Fast FP4 Pretraining

arXiv:2610.00053v1 Announce Type: new Abstract: Four-bit floating-point (FP4) Tensor Cores accelerate matrix multiplication, but scale computation, operand packing, layout construction, and saved back

Applications

Foundations without Fundamentals: Zero-Shot Blind Spots in Time Series FMs

arXiv:2610.02058v1 Announce Type: new Abstract: Despite the success of Time Series Foundation Models (TSFMs) on broad benchmarks, their ability to internalize basic temporal logic, especially in setti

applicationsarxiv-cs-lg

FourierQK: Filter Shape, Admissibility and the Leakage-Coverage Law

arXiv:2610.00009v1 Announce Type: new Abstract: Frequency-collapse attention [Zeris, 2026e] achieves large gains over standard dot-product attention by replacing the Q/K dot product with a bandpass-fi

Fractional Laplace Neural Operators: Exact Architectures, an Expressivity Frontier at Criticality, and Certified Stability for Memory-Driven Network Dynamics

arXiv:2610.00515v1 Announce Type: cross Abstract: Neural operators learn maps between function spaces, while hereditary network dynamics are described by Volterra resolvents with non-rational Laplace

From Gradients to Capabilities: Understanding Multi-Teacher On-Policy Distillation

arXiv:2610.02179v1 Announce Type: new Abstract: Multi-teacher on-policy distillation (MOPD) aims to combine the strengths of RL-trained teachers in a single student, but how teacher signals affect par

From Redundancy to Minimality: Fixed-Point-Guided Hierarchical Reduction of Learned Piecewise-Linear Dynamics

arXiv:2610.01369v1 Announce Type: new Abstract: Understanding a nonlinear dynamical system from time series requires not only reproducing its trajectories, but also identifying a simple representation

From Task Mixtures to Specialized Experts

arXiv:2610.00580v1 Announce Type: new Abstract: In collaborative foundation model fine-tuning, client data is rarely homogeneous. Instead, clients typically possess unknown mixtures of distinct data d

Fully Online Decentralized Learning in Stochastic Games with Unknown Independent Chains

arXiv:2610.01181v1 Announce Type: new Abstract: We consider stochastic games with independent controlled chains and unknown transition kernels, where players observe only their local states and realiz

Function-Structured Reinforcement Learning with Executable Verifiers for Mathematical Reasoning

arXiv:2610.01729v1 Announce Type: new Abstract: Algorithmic mathematical reasoning requires reliable decomposition, computation, and aggregation. Final-answer rewards provide limited guidance on inter

Fusion techniques of time frequency-based images to predict the outcome of rTMS depression therapy

arXiv:2610.00380v1 Announce Type: new Abstract: Depression is a mental condition that can lead to suicide and self-harm. Predicting the outcome of depression treatment is one of the most difficult tas

Generalization in Neural Networks Through the Lens of Magnitude Potential

arXiv:2610.01633v1 Announce Type: new Abstract: Explaining generalization and training dynamics in neural networks remains a challenge, and various approaches have been developed to study different as

Generalized Biomedicine Discovery

arXiv:2610.00120v1 Announce Type: new Abstract: In real-world clinical practice, medical images face open-world shifts: (i) long-tailed rare diseases, (ii) subtle lesions dominated by normal anatomy,

Generalized Engression Models

arXiv:2610.01823v1 Announce Type: cross Abstract: We consider estimating the conditional distribution of a multivariate outcome given covariates when its coordinates may be continuous, binary, categor

Generative modeling of intrinsically disordered protein regions by reinforcing sparse autoencoder features

arXiv:2610.02189v1 Announce Type: new Abstract: Intrinsically disordered protein regions (IDRs) play central roles in cellular processes such as transcriptional regulation, signal transduction, and su

Generative Modeling of Stochastic Dynamics for Long-Time Evolution

arXiv:2610.00546v1 Announce Type: cross Abstract: Exact stochastic equations for non-equilibrium dynamics are rarely accessible. We show that the long-time evolution of stochastic dynamics can be pred

Geometry-Dependent Bounds for Online Non-Monotone DR-Submodular Maximization

arXiv:2610.00545v1 Announce Type: new Abstract: We study adversarial online maximization of nonnegative, non-monotone DR-submodular functions over compact convex down-closed sets. A learner commits ea

GLoC-EHR: Evidence-Cited Clinical Reasoning over Global Context and Local EHR Events

arXiv:2610.01076v1 Announce Type: new Abstract: Structured electronic health records (EHRs) contain a patient's clinical trajectory as a sequence of clinical codes. Answering clinical questions from s

Grand Canonical Generators

arXiv:2610.00683v1 Announce Type: new Abstract: We introduce Grand Canonical Generators (GCG), a generative framework that extends Boltzmann generators to the grand canonical ensemble. We present two

Graph Representation via Elements of Discrete Morse and Cobordism Theories

arXiv:2610.01937v1 Announce Type: new Abstract: Topology is, by its nature and design, suited to structure that is nonlinear, multiscale, and nonstationary - however, within machine learning, its use

Group-Invariant Statistics Determine Embedding Geometry: Harmonic Analysis of Representations from Bach to the Night Sky

arXiv:2610.00647v1 Announce Type: new Abstract: The representations that language models learn for concepts such as months, weekdays, and places display consistent geometric structure: circles and sad

HADRec: A Hierarchy-Aware Drug Recommendation Framework by Fusing Molecular Knowledge and Electronic Health Record

arXiv:2610.00984v1 Announce Type: new Abstract: Accurate medication recommendation is central to clinical decision-making, directly determining therapeutic efficacy and patient safety. However, existi

Heteroskedastic Canonical Polyadic Tensor Decomposition

arXiv:2610.00498v1 Announce Type: cross Abstract: When minimizing the squared-error loss, the popular CP decomposition can be interpreted as parameter inference in a Gaussian model with a low-rank mea

High-Value Synthetic Supervision for Parameter-Efficient Adaptation of a Compact Japanese Speech Model

arXiv:2610.00026v1 Announce Type: cross Abstract: Private domain speech is difficult to collect and redistribute, while compact models need task-specific supervision. We study an auditable synthetic p

Applications

Higher-Order Positional Encodings for Graph Representation Learning

arXiv:2610.01903v1 Announce Type: new Abstract: Many real-world systems exhibit higher-order interactions among groups of entities that cannot be captured by pairwise relationships alone. Graph Transf

applicationsarxiv-cs-lg

How Far is Adam from Natural Gradient Descent?

arXiv:2610.00004v1 Announce Type: new Abstract: Adam is the standard optimizer in deep learning, yet its geometric relationship to natural gradient descent (NGD) contains unresolved questions. We stud

How Many Categories Are Enough? Distribution-Free Certification Limits for Few-Shot Anomaly Thresholds

arXiv:2610.00236v1 Announce Type: new Abstract: Few-shot anomaly detectors are judged by ranking metrics, yet deployment requires an alarm threshold with a controlled false-alarm rate (FAR). We ask ho

How many labelers do you have? A closer look at gold-standard labels

arXiv:2206.12041v3 Announce Type: replace-cross Abstract: The construction of most supervised learning datasets revolves around collecting multiple labels for each instance, then aggregating the label

How Much Can Language Models Gain from Test-Time Computation?

arXiv:2610.01110v1 Announce Type: new Abstract: How much can test-time computation improve a language model, and at what cost? Test-time scaling is widely proposed as a substitute for larger models, b

Hardware

ibUMAP: Coherent and Scalable Field Evaluation for UMAP Optimization

arXiv:2610.01445v1 Announce Type: new Abstract: UMAP achieves scalable layout optimization through stochastic negative sampling. However, this stochasticity can lead to unstable embeddings across reru

hardwarearxiv-cs-lg

Improving scoring functions for protein-protein docking with LambdaLoss

arXiv:2610.00191v1 Announce Type: cross Abstract: Modeling protein-protein interactions requires accurate scoring functions that can rank potential poses (conformations) of a protein-protein complex t

In CEM, a World Model Is Also a Proposal Mechanism

arXiv:2610.00921v1 Announce Type: new Abstract: The cross-entropy method (CEM) uses world-model scores to select action sequences and fit the distribution sampled in its next iteration. A scoring erro

In-context Learning of Single-index Targets: Comparing Kernel and Feature Learners

arXiv:2610.01712v1 Announce Type: new Abstract: In-context learning (ICL) enables a pretrained model to infer a task from demonstrations without updating its parameters. While much of the existing the

INDEQS: Informed Neural controlled Differential EQuationS

arXiv:2606.19138v2 Announce Type: replace Abstract: Neural Controlled Differential Equations (NCDE) provide a powerful continuous-time framework for forecasting time series, but standard graph-based e

Inference for stochastic differential equations driven by weighted sub-fractional Brownian motion using neural networks and the Euler approximation

arXiv:2610.00793v1 Announce Type: cross Abstract: We consider the estimation of drift, diffusion, and noise covariance from discrete observations of stochastic differential equations driven by Gaussia

Inferring Multi-Timescale Neural Dynamics with Switching Linear Dynamical Systems

arXiv:2610.01786v1 Announce Type: new Abstract: Neural activity often exhibits multiple timescales that can vary with behavioral states and task conditions. Identifying these timescales from neural re

Information propagation dynamics in Deep Graph Networks

arXiv:2410.10464v3 Announce Type: replace Abstract: Graphs are a highly expressive abstraction for modeling entities and their relations, such as molecular structures, social networks, and traffic net

Initial condition recovery in nonlinear damped viscous photoacoustic tomography using a convolutional neural network-guided gradient-free optimization framework

arXiv:2610.01015v1 Announce Type: cross Abstract: Photoacoustic tomography (PAT) is a hybrid imaging modality that combines high optical contrast with high ultrasonic resolution for biomedical imaging

Safety

Integrating Fairness and Explainability in a Multiple Instance Reinforcement Learning System

arXiv:2610.00035v1 Announce Type: new Abstract: Predicting student performance from educational interaction data requires models that are both accurate and sufficiently transparent to support meaningf

safetyarxiv-cs-lg

Invent a Dataset: Measuring dataset generation abilities with zero seed

arXiv:2610.01674v1 Announce Type: new Abstract: Building datasets remains one of the most manual and brittle parts of AI development. In this technical report, we focus on the most extreme but also mo

IQS-BO: In-Context Query Selection for Bayesian Optimisation

arXiv:2610.01269v1 Announce Type: new Abstract: Bayesian Optimisation (BO) is a powerful framework for the optimisation of expensive black-box functions, but typically requires refitting a surrogate a