research

A bunch of nerds making progress.

Nous Research shared an update on X regarding progress made by their team on research or development initiatives. Without access to the specific post content, this likely documents advances in AI rese

researchnous-research--x

A Diffusive Classification Loss for Learning Energy-based Generative Models

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

arXiv:2601.21025v3 Announce Type: replace-cross Abstract: Score-based generative models have recently achieved remarkable success. While they are usually parameterized by the score, an alternative way

researcharxiv-cs-lg

23 May 2026

A Martingale Kernel Independence Test

arXiv:2605.22549v1 Announce Type: cross Abstract: The Hilbert-Schmidt Independence Criterion (HSIC) and its joint-independence extension dHSIC are degenerate V-statistics whose data-dependent weighted

A Short and Unified Convergence Analysis of the SAG, SAGA, and IAG Algorithms

arXiv:2602.05304v2 Announce Type: replace Abstract: Stochastic variance-reduced algorithms such as Stochastic Average Gradient (SAG) and SAGA, and their deterministic counterparts like the Incremental

Aerodynamic force reconstruction using physics-informed Gaussian processes

arXiv:2605.22111v1 Announce Type: new Abstract: Accurate modeling of aerodynamic loads is essential for understanding and predicting the responses of complex structural systems. However, these models

AgForce Enables Antigen-conditioned Generative Antibody Design

arXiv:2605.21610v1 Announce Type: new Abstract: Antibody design methods condition on antigen structure to generate complementarity-determining regions (CDR), yet a systematic evaluation of baseline me

Algorithm Design and Stronger Guarantees for the Improving Multi-Armed Bandits Problem

arXiv:2511.10619v2 Announce Type: replace Abstract: The improving multi-armed bandits problem is a formal model for allocating effort under uncertainty, motivated by scenarios such as investing resear

AMUSE: Anytime Muon with Stable Gradient Evaluation

arXiv:2605.22432v1 Announce Type: new Abstract: Modern deep learning commonly relies on AdamW with prescribed learning rate schedules, but recent works challenge both components: Schedule-Free optimiz

And just like that, it’s completely VANISHED from the media. A sitting congressman, Ted Lieu, said on the record the Epstein files are being…

And just like that, it’s completely VANISHED from the media. A sitting congressman, Ted Lieu, said on the record the Epstein files are being blocked because they show Trump raped and threatened to kil

ASAP: Attention Sink Anchored Pruning

arXiv:2605.22372v1 Announce Type: new Abstract: Vision Transformers (ViTs) face severe computational bottlenecks due to the quadratic complexity of self-attention at high resolutions. Existing token r

Asymmetric Virtual Memory Paging for Hybrid Mamba-Transformer Inference

arXiv:2605.22416v1 Announce Type: new Abstract: Hybrid language models like Jamba mix attention layers with State Space Models (SSMs), creating two memory cache types with opposite profiles: Key-Value

Atom-anchored LLMs speak Chemistry: A Retrosynthesis Demonstration

arXiv:2510.16590v2 Announce Type: replace Abstract: Applications of machine learning in chemistry are often limited by the scarcity and expense of labeled data, restricting traditional supervised meth

Bandit Convex Optimization with Gradient Prediction Adaptivity

arXiv:2605.22191v1 Announce Type: new Abstract: Bandit convex optimization (BCO) is a fundamental online learning framework with partial feedback, where the learner observes only the loss incurred at

Bringing Stability to Diffusion: Decomposing and Reducing Variance of Training Masked Diffusion Models

arXiv:2511.18159v2 Announce Type: replace Abstract: Masked diffusion models (MDMs) are a promising alternative to autoregressive models (ARMs), but they suffer from inherently much higher training var

Calibration, Uncertainty Communication, and Deployment Readiness in CKD Risk Prediction: A Framework Evaluation Study

arXiv:2605.21566v1 Announce Type: new Abstract: Machine learning models for chronic kidney disease (CKD) risk prediction often post strong discrimination scores on internal test sets. Calibration and

Can Breath Biomarkers Causally Influence Blood Glucose? Investigating VOC-Mediated Modulation in Diabetes

arXiv:2605.22075v1 Announce Type: new Abstract: Diabetes is a global health burden, and early detection is critical for timely intervention. This study explores a non-invasive, data-driven framework t

CASE-NET: Deep Spatio-Temporal Representation Learning via Causal Attention and Channel Recalibration for Multivariate Time Series Classification

arXiv:2605.22043v1 Announce Type: new Abstract: Multivariate time series (MTS) classification is foundational to pervasive computing and financial analysis, yet existing multi-scale paradigms are ofte

CausalGuard: Conformal Inference under Graph Uncertainty

arXiv:2605.21928v1 Announce Type: new Abstract: Estimating treatment effects from observational data requires choosing an adjustment set, but valid adjustment depends on an unknown causal graph. Graph

CellFluxRL: Biologically-Constrained Virtual Cell Modeling via Reinforcement Learning

arXiv:2603.21743v4 Announce Type: replace Abstract: Building virtual cells with generative models to simulate cellular behavior in silico is emerging as a promising paradigm for accelerating drug disc

Cluster-Adaptive Feature Extraction and its Theoretical Foundation with Minkowski Weighted k-Means

arXiv:2603.25958v2 Announce Type: replace Abstract: The Minkowski weighted k-means (mwk-means) algorithm extends classical k-means by incorporating feature weights and a Minkowski distance. We first s

CoFEH: LLM-driven Feature Engineering Empowered by Collaborative Bayesian Hyperparameter Optimization

arXiv:2602.09851v2 Announce Type: replace Abstract: Feature Engineering (FE) is pivotal in automated machine learning (AutoML) but remains a bottleneck for traditional methods, which operate within ri

CogAdapt: Transferring Clinical ECG Foundation Models to Wearable Cognitive Load Assessment via Lead Adaptation

arXiv:2605.22774v1 Announce Type: new Abstract: Real-time cognitive load assessment is essential for adaptive human-computer interaction but remains challenging due to limited labeled data and poor cr

Community-Aware Vertex Ordering for Reference-Based Graph Compression: A Cross-Encoder Empirical Study

arXiv:2605.21510v1 Announce Type: cross Abstract: Reference-based graph compression encodes each vertex's neighbor list relative to a recent vertex, exploiting locality to compress large directed grap

Compact Lifted Relaxations for Low-Rank Optimization

arXiv:2603.20228v2 Announce Type: replace-cross Abstract: We develop tractable convex relaxations for rank-constrained quadratic optimization problems over n imes m matrices, a setting for which tract

Conditional Neural Field based Reduced Order Model for Dynamic Ditching Load Prediction

arXiv:2605.21499v1 Announce Type: cross Abstract: Grid-based neural networks such as convolutional autoencoders are widely used in dimension reduction-based surrogate models for computational fluid dy

Correcting Class Imbalance in Prior-Data Fitted Networks for Tabular Classification

arXiv:2605.21742v1 Announce Type: new Abstract: Prior-data fitted networks (PFNs) have achieved exceptional performance on tabular classification tasks. However, like other classifiers, their performa

Cyber-Physical Anomaly Detection in IoT-Enabled Smart Grids Using Machine Learning and Metaheuristic Feature Optimization

arXiv:2605.22749v1 Announce Type: new Abstract: Modern smart grids rely on dense measurement infrastructures, communication links, and intelligent field devices. Although this improves supervision and

Decision-Aware Quadratic ReLU Replacement for HE-Friendly Inference

arXiv:2605.22237v1 Announce Type: cross Abstract: Fully homomorphic encryption (FHE) supports only additions and multiplications, so FHE-only neural-network inference typically replaces ReLU with poly

Decision Potential Surface: A Theoretical and Practical Approximation of Large Language Model Decision Boundary

arXiv:2510.03271v2 Announce Type: replace Abstract: Decision boundary, the subspace of inputs where a machine learning model assigns equal classification probabilities to two classes, is pivotal in re

Decomposing Ensemble Spread in Lorenz '96 With Learned Stochastic Parameterizations

arXiv:2605.22242v1 Announce Type: new Abstract: Weather and climate forecasts are inherently uncertain due to chaotic dynamics, imperfect initial conditions, and incomplete representation of the under

Departure from Regularity: Degree Heterogeneity and Eigengap as the Structural Drivers of ASE-LSE Latent Subspace Disagreement

arXiv:2605.22346v1 Announce Type: cross Abstract: Two of the most widely used methods for analysing graph data, Adjacency Spectral Embedding and Laplacian Spectral Embedding, often produce different r

Doing a massive Hermes deployment today. Full team, isolated VMs, @honchodotdev shared memory for the team. This stuff is so fun. @NousResea…

Nous Research conducted a large-scale deployment of Hermes today using isolated virtual machines and shared memory infrastructure via honchodotdev for team coordination. The post highlights enthusiasm

researchnous-research--x

Double descent for least-squares interpolation on contaminated data: A simulation study

arXiv:2605.21494v1 Announce Type: new Abstract: Overparametrized models can exhibit an excellent generalization performance, although they should be prone to overfitting according to classical statist

Dynamic Mixture of Latent Memories for Self-Evolving Agents

arXiv:2605.21951v1 Announce Type: new Abstract: Achieving self-evolution in intelligent agents requires the continual accumulation of new knowledge across changing task sequences without forgetting pr

Efficient Higher-order Subgraph Attribution via Message Passing

arXiv:2605.22385v1 Announce Type: new Abstract: Explaining graph neural networks (GNNs) has become more and more important recently. Higher-order interpretation schemes, such as GNN-LRP (layer-wise re

End-to-End Semantic ID Generation for Generative Advertisement Recommendation

arXiv:2602.10445v3 Announce Type: replace-cross Abstract: Generative Recommendation (GR) has excelled by framing recommendation as next-token prediction. This paradigm relies on Semantic IDs (SIDs) to

Equilibrium Propagation and Hamiltonian Inference in the Diffusive Fitzhugh-Nagumo Model

arXiv:2605.21568v1 Announce Type: new Abstract: In this work, we extend the Equilibrium Propagation framework to skew-gradient systems and show an equivalence between deep Energy-Based Models and Hami

Evolutionary Multi-Task Optimization for LLM-Guided Program Discovery

arXiv:2605.22613v1 Announce Type: new Abstract: Recent LLM-guided evolutionary search methods have shown that iterative program mutation can discover strong algorithms, but they typically optimize eac

Ex-GraphRAG: Interpretable Evidence Routing for Graph-Augmented LLMs

arXiv:2605.21994v1 Announce Type: new Abstract: GraphRAG conditions language models on subgraphs retrieved from knowledge graphs, encoded via message-passing GNNs. Because these encoders entangle node

Explainable AI for Data-Driven Design of High-Dimensional Predictive Studies

arXiv:2605.22243v1 Announce Type: new Abstract: Predictive modelling is important for health data analysis and data-driven clinical decision-making. However, predictive studies are challenging to desi

Finite-Particle Convergence Rates for Conservative and Non-Conservative Drifting Models

arXiv:2605.22795v1 Announce Type: cross Abstract: We propose and analyze a conservative drifting method for one-step generative modeling. The method replaces the original displacement-based drifting v

Flashlight: PyTorch Compiler Extensions to Accelerate Attention Variants

arXiv:2511.02043v4 Announce Type: replace Abstract: Attention is a fundamental building block of large language models (LLMs), so there have been many efforts to implement it efficiently. For example,

Francis Fukuyama on the U.S. as a declining power: American decline is a direct product of Trump's rise since 2016. It is as if Trump had de…

Francis Fukuyama on the U.S. as a declining power: American decline is a direct product of Trump's rise since 2016. It is as if Trump had decided to do everything in his power to weaken the United Sta

From Betting to Empirical Bernstein LIL

arXiv:2605.22124v1 Announce Type: cross Abstract: This is a verbatim copy of a technical report I wrote in 2017-2018 to obtain the law of the iterated logarithm using the guarantee on the wealth of an

Gradient Descent as a Perceptron Algorithm: Understanding Dynamics and Implicit Acceleration

arXiv:2512.11587v2 Announce Type: replace Abstract: Even for the gradient descent (GD) method applied to neural network training, understanding its optimization dynamics, including convergence rate, i

Graph neural network explanations reveal a topological signature of disease-associated hubs in biological networks

arXiv:2605.21502v1 Announce Type: cross Abstract: Graph neural networks (GNNs) are increasingly used to model biological systems, yet the reliability of post-hoc explanation methods for recovering mea

He has directly betrayed all his followers who trusted him, all of the rest of us who never trusted him, and his country.

This post contains criticism of an unspecified individual, likely a political or public figure, accusing them of betrayal toward their supporters, skeptics, and the nation. The statement appears to be

Historically, the US has been the greatest magnet for talent on earth. Whether that continues to be the case is not inevitable.

Historically, the US has been the greatest magnet for talent on earth. Whether that continues to be the case is not inevitable. Nearly half of the founders of billion-dollar tech startups are immigran