Mixture-of-Kittens: MoE Megakernel for NVL72s
arXiv:2609.36070v1 Announce Type: cross Abstract: AI accelerator systems are rapidly consolidating into scale-up architectures, where tens to thousands of GPUs communicate over high-bandwidth, single-
Knowledge catalogue
arXiv:2609.36070v1 Announce Type: cross Abstract: AI accelerator systems are rapidly consolidating into scale-up architectures, where tens to thousands of GPUs communicate over high-bandwidth, single-
arXiv:2609.37384v1 Announce Type: new Abstract: Molecular representation learning is central to computer-aided drug discovery. Molecular graphs, SMILES strings, and 3D conformations provide complement
arXiv:2609.36039v1 Announce Type: cross Abstract: Machine learning (ML) and deep learning (DL) have dominated Intrusion Detection System (IDS) research in recent years. Unfortunately, many existing st
arXiv:2410.14839v5 Announce Type: replace-cross Abstract: We study the dynamic pricing problem faced by a broker seeking to learn prices for a large number of credit market securities, such as corpora
arXiv:2609.37994v1 Announce Type: cross Abstract: The classical information bottleneck (IB) measures the relevance of a representation U of X to a target Y by I(U;Y), which does not directly character
arXiv:2609.37113v1 Announce Type: new Abstract: Generalized reaction-diffusion systems encompass diverse transport mechanisms and coupled reaction kinetics. A central question for neural PDE solvers i
arXiv:2609.36375v1 Announce Type: new Abstract: Continual learning is usually studied through mechanisms that preserve old knowledge. We develop Successional Learning Theory (SLT), a mesoscopic accoun
arXiv:2605.05511v2 Announce Type: replace Abstract: Active feature acquisition (AFA) considers prediction problems in which features are costly to obtain and the learner adaptively decides which featu
arXiv:2606.17531v2 Announce Type: replace Abstract: Non-negative matrix factorisation (NMF) learns additive representations from data, but non-negativity alone does not ensure interpretable basis func
arXiv:2609.37660v1 Announce Type: new Abstract: We study nonpreemptive contextual queueing bandits in a single-server system. Each job is represented by a d-dimensional context vector; in each round,
arXiv:2609.36659v1 Announce Type: new Abstract: The strong generalization performance of on-policy post-training paradigms has motivated studies of their parameter update behaviors. However, these stu
arXiv:2602.04852v3 Announce Type: replace Abstract: Linear attention offers a computationally efficient yet expressive alternative to softmax attention. However, recent empirical results indicate that
arXiv:2609.37575v1 Announce Type: cross Abstract: We argue that dividing codec design into Coding for Machines (CfM) and Coding for Humans (CfH) is a misleading distinction for deciding what informati
arXiv:2506.03911v2 Announce Type: replace Abstract: Points-based rewards programs are a prevalent way to incentivize customer loyalty. In theory, the effective design of these programs is shaped by tw
arXiv:2609.36486v1 Announce Type: new Abstract: We study an unknown-transition finite-horizon Markov decision process (MDP) with a finite collection of known reward functions {r^1, r^2, ldots, r^M}. T
arXiv:2609.38073v1 Announce Type: cross Abstract: We study exact learning with membership queries for concept classes mathcal Csubseteq{0,1}^N, focusing on the relationships among their deterministic,
arXiv:2606.19302v2 Announce Type: replace-cross Abstract: As deep learning for physical systems continues to grow in popularity, efforts to improve generalizability have primarily focused on designing
arXiv:2405.07944v1 Announce Type: cross Abstract: Among the well-known methods to approximate derivatives of expectancies computed by Monte-Carlo simulations, averages of pathwise derivatives are ofte
arXiv:2609.37745v1 Announce Type: new Abstract: Neural scaling, in which loss falls as a power law with training, is central to large language models, and one recent proposal is that a 1/3 exponent em
arXiv:2609.37579v1 Announce Type: cross Abstract: Bresar and Mijatovic ite{bresar2025} show that Ornstein--Uhlenbeck diffusion is hard to beat in forward convergence under assumptions that exclude sup
arXiv:2609.37323v1 Announce Type: new Abstract: Discrete diffusion models have emerged as a powerful paradigm for solving combinatorial optimization (CO) problems on graphs by learning to sample high-
arXiv:2609.37921v1 Announce Type: new Abstract: What are the inductive biases of a Transformer architecture? Existing theory on how the forward pass shapes representations either considers whether Tra
arXiv:2609.36521v2 Announce Type: new Abstract: Physical-field reconstruction and forecasting depend on both measurement density and spatial layout, yet evaluation under a single observation pattern d
arXiv:2601.01207v2 Announce Type: replace Abstract: In stochastic message passing, an edge's sampled role changes the node states used to compute adaptive weights at later layers. Weight averaging the
arXiv:2609.37609v1 Announce Type: new Abstract: Magnetohydrodynamics (MHD) is central to plasma modeling in astrophysics, space science, fusion, and engineering, but resolving multiscale MHD dynamics
arXiv:2609.36193v1 Announce Type: new Abstract: Learning from scientific measurements often requires aligning modalities with different spatial support and resolution. Subsurface characterization is a
arXiv:2609.37525v1 Announce Type: new Abstract: Physical neural networks and analog in-memory computing could reduce the energy cost of neural network training. Realizing this potential, however, requ
arXiv:2609.36633v1 Announce Type: new Abstract: This paper proposes a physics-guided gradient-ascent-based machine unlearning method that couples the forgetting signal with the physical residual of th
arXiv:2511.22435v2 Announce Type: replace Abstract: Invariant learning on graphs aims to build predictors that rely on causal substructures rather than on environment-specific shortcuts. Current metho
arXiv:2609.37209v1 Announce Type: new Abstract: Pairwise losses are increasingly used for reward learning even when pointwise rewards are observed, with mixed empirical results. When and why do pairwi
arXiv:2609.37935v1 Announce Type: cross Abstract: Deep Support Vector Data Description (Deep SVDD) has become a prominent framework for unsupervised anomaly detection by learning latent representation
arXiv:2609.36642v1 Announce Type: new Abstract: Language-model agents are usually trained by reinforcement learning from one reward per episode, and privileged self-distillation enriches it by letting
arXiv:2609.36216v1 Announce Type: new Abstract: Neural operators are typically trained in a supervised fashion, which requires a dataset to be generated with a classical solver. Training them physics-
arXiv:2609.36030v1 Announce Type: new Abstract: The lack of rigorous safety and performance certificates remains a key bottleneck to the deployment of modern learning-based methods. Sample compression
arXiv:2609.36153v1 Announce Type: cross Abstract: B2B advertising targets a viewer's professional attributes (employer size and industry, function, seniority) and has obtained them by matching identit
arXiv:2609.37202v1 Announce Type: cross Abstract: Droplet collision governs droplet population dynamics in many chemical engineering processes, such as spray drying, spray cooling, agricultural sprayi
arXiv:2609.37470v1 Announce Type: new Abstract: A probability used for a decision should refer to the same event across equivalent requests. We introduce probability contracts, a benchmark connecting
arXiv:2609.38095v1 Announce Type: new Abstract: Backpropagation (BP) dominates deep learning but imposes a massive memory tax. For example, training OPT-30B with Adam requires approx 600GB of GPU memo
arXiv:2609.38018v1 Announce Type: new Abstract: Group relative policy optimization (GRPO) learns only from prompts whose sampled responses disagree: a group that is entirely correct or entirely incorr
arXiv:2507.21135v2 Announce Type: replace Abstract: We demonstrate how Quantum Cognition Machine Learning (QCML) encodes data as quantum geometry. In QCML, features of the data are represented by lear
arXiv:2609.37650v1 Announce Type: new Abstract: Counterfactual explanations of graph neural networks identify edge deletions that flip a prediction. On heterogeneous graphs, however, existing methods
arXiv:2609.36794v1 Announce Type: new Abstract: Signal features derived from photoplethysmography (PPG) require different signal durations to characterize. Existing PPG foundation models treat duratio
arXiv:2609.36391v1 Announce Type: cross Abstract: An ongoing challenge in sensory neuroscience is to characterize the feature dimensions encoded by cortical populations. Recent approaches probe featur
arXiv:2609.38112v1 Announce Type: cross Abstract: Many applications of black-box predictive models require controlling task-relevant error rates, such as missed lesion pixels in segmentation or missed
arXiv:2609.36329v1 Announce Type: new Abstract: Parameter-efficient fine-tuning (PEFT) determines not only how many parameters are trained, but also which local directions a model can move in, so simi
arXiv:2603.11210v2 Announce Type: replace Abstract: Machine unlearning aims to remove the influence of specific training data from a model while preserving its general utility. In vision, many approxi
arXiv:2609.35867v1 Announce Type: new Abstract: We propose ReLOBGen, a method for generating limit order book (LOB) messages that are replayable by construction. Replayability is required for closed-l
arXiv:2609.35917v1 Announce Type: new Abstract: Graph neural networks are increasingly applied to road-level crash prediction, but the stability of their reported gains has received little scrutiny. W
arXiv:2609.36288v1 Announce Type: new Abstract: EEG foundation models (EEG-FMs) are intended to generalize across different datasets by learning representations that, ideally, are invariant to dataset
arXiv:2609.36813v1 Announce Type: new Abstract: Large language models (LLMs) exhibit strong general capabilities that mechanistic interpretability has attributed to sparse computational circuits. Howe
arXiv:2609.37391v1 Announce Type: new Abstract: Diffusion language models (DLMs) enable parallel generation by predicting and committing multiple tokens at each denoising step, yet they can generate i
arXiv:2609.37500v1 Announce Type: new Abstract: On-policy distillation (OPD) trains language models using dense token-level teacher supervision on student-generated trajectories. However, its reliance
arXiv:2609.37065v1 Announce Type: new Abstract: Decision-making under uncertainty often relies on predicted parameters, yet accurate prediction does not necessarily lead to good operational decisions.
arXiv:2609.36885v1 Announce Type: cross Abstract: RNA design aims to identify sequences that fold into specified secondary structures. Existing methods formulate the task as target-specific search or
arXiv:2609.36843v1 Announce Type: new Abstract: Interpretability methods such as probes, activation patches and learned editors are designed to reveal or modify a model's current computation. World mo
arXiv:2609.36724v1 Announce Type: new Abstract: Sparse expert models can distribute traffic evenly while still grouping incompatible training signals within the same experts. We study routing as a gra
arXiv:2609.37294v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used for software engineering tasks, yet their stochastic behavior challenges the validity, reproducibil
arXiv:2609.36421v1 Announce Type: cross Abstract: Reinforcement learning (RL) is a powerful framework for robotic control, yet its practical application is often hindered by high sample complexity. Th
arXiv:2609.37509v1 Announce Type: new Abstract: The boundary element method (BEM) provides an efficient numerical framework for solving multiple scattering problems in unbounded homogeneous domains. B
arXiv:2609.36950v1 Announce Type: new Abstract: Simulation-based inference is challenging when many heterogeneous observations must be composed, hierarchical latent structure must be preserved, and th