research

Sliding Window Informative Canonical Correlation Analysis

arXiv:2507.17921v2 Announce Type: replace-cross Abstract: Canonical correlation analysis (CCA) is a technique for finding correlated sets of features between two datasets. In this paper, we propose a

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

SlimQwen: Exploring the Pruning and Distillation in Large MoE Model Pre-training

DGX agent

arXiv:2605.08738v1 Announce Type: cross Abstract: Structured pruning and knowledge distillation (KD) are typical techniques for compressing large language models, but it remains unclear how they shoul

researcharxiv-cs-ai

12 May 2026

SlimSpec: Low-Rank Draft LM-Head for Accelerated Speculative Decoding

arXiv:2605.10453v1 Announce Type: cross Abstract: Speculative decoding speeds up autoregressive generation in Large Language Models (LLMs) through a two-step procedure, where a lightweight draft model

Slum Detection and Density Mapping with AlphaEarth Foundations: A Representation Learning Evaluation Across 12 Global Cities

arXiv:2605.10029v1 Announce Type: new Abstract: Pixel-level slum mapping has long been constrained by limited cross-city generalisation, the absence of continuous density estimation, and weak global c

SMOG: Scalable Meta-Learning for Multi-Objective Bayesian Optimization

arXiv:2601.22131v2 Announce Type: replace Abstract: Multi-objective optimization aims to solve problems with competing objectives. Evaluating such problems is often slow or expensive, limiting the bud

Smoothing Out the Edges: Continuous-Time Estimation with Gaussian Process Motion Priors on Factor Graphs

arXiv:2605.09073v1 Announce Type: new Abstract: Continuous-time state estimation is gaining in popularity due to its abilities to provide smooth solutions, handle asynchronous sensors, and interpolate

researcharxiv-cs-ro

Social Determinants of Health and Fentanyl Overdose Mortality Across US Counties: An XGBoost and SHAP Analysis Identifying Silent Risk Counties and Treatment Deserts

arXiv:2605.08230v1 Announce Type: new Abstract: Background: Fentanyl overdose deaths are still increasing across the U.S. We do not fully understand which county-level social and structural conditions

SpaceMind++: Toward Allocentric Cognitive Maps for Spatially Grounded Video MLLMs

arXiv:2605.09449v1 Announce Type: new Abstract: Recent multimodal large language models (MLLMs) have made remarkable progress in visual understanding and language-based reasoning, yet they lack a pers

Sparse Layers are Critical to Scaling Looped Language Models

arXiv:2605.09165v1 Announce Type: cross Abstract: Looped language models repeat a set of transformer layers through depth, reducing memory costs and providing natural early-exit points at loop boundar

Spatial-Frequency Gated Swin Transformer for Remote Sensing Single-Image Super-Resolution

arXiv:2605.09687v1 Announce Type: new Abstract: Remote Sensing (RS) single-image super-resolution aims to reconstruct high-resolution imagery from low-resolution observations while preserving fine spa

Spatial Priming Outperforms Semantic Prompting: A Grid-Based Approach to Improving LLM Accuracy on Chart Data Extraction

arXiv:2605.08220v1 Announce Type: new Abstract: The automated extraction of data from scientific charts is a critical task for large-scale literature analysis. While multimodal Large Language Models (

Spectral Condition for muP under Width-Depth Scaling

arXiv:2603.00541v2 Announce Type: replace Abstract: Generative foundation models are increasingly scaled in both width and depth, posing significant challenges for stable feature learning and reliable

Spectrally-Guided Diffusion Noise Schedules

arXiv:2603.19222v2 Announce Type: replace Abstract: Denoising diffusion models are widely used for high-quality image and video generation. Their performance depends on noise schedules, which define t

Speech-based Psychological Crisis Assessment using LLMs

arXiv:2605.10027v1 Announce Type: cross Abstract: Psychological support hotlines provide critical support for individuals experiencing mental health emergencies, yet current assessments largely rely o

Spherical Flows for Sampling Categorical Data

arXiv:2605.05629v2 Announce Type: replace-cross Abstract: We study the problem of learning generative models for discrete sequences in a continuous embedding space. Whereas prior approaches typically

Split CNN Inference on Networked Microcontrollers

arXiv:2605.09357v1 Announce Type: cross Abstract: Running deep neural networks on microcontroller units (MCUs) is severely constrained by limited memory resources. While TinyML techniques reduce model

SSA: Improving Performance With a Better Scoring Function

arXiv:2508.14685v4 Announce Type: replace Abstract: While transformer models exhibit strong in-context learning (ICL) abilities, they often fail to generalize under simple distribution shifts. We anal

Stability of the Monge Map in Semi-Dual Optimal Transport

arXiv:2605.05569v2 Announce Type: replace-cross Abstract: This paper shows that the semi-dual formulation of the optimal transport problem has a degenerate saddle-point structure, and that its numeric

Statistical Inference and Quality Measures of KV Cache Quantisations Inspired by TurboQuant

arXiv:2605.08114v1 Announce Type: new Abstract: We analyse three KV cache quantization schemes under a fair bit budget: extbf{KV} (scalar MSE baseline), extbf{KQV} (WHT + MSE on K; WHT + MSE + QJL on

Stealthy Patch-Wise Backdoor Attack in 3D Point Cloud via Curvature Awareness

arXiv:2503.09336v4 Announce Type: replace Abstract: Backdoor attacks pose a severe threat to deep neural networks (DNNs) by implanting hidden backdoors that can be activated with predefined triggers t

Stellar Age Compression Reshapes Interpretations of the Milky Way Thick-Disk Formation History

arXiv:2605.10220v1 Announce Type: cross Abstract: The formation timescale of the Milky Way thick disk is one of the central debates in Galactic archaeology. The age-metallicity relation (AMR), formati

Step 3.5 Flash from @StepFun_ai is now free again in Nous Portal for the next 15 days!

Nous Research announced that Step 3.5 Flash, an AI model from StepFun, is temporarily available for free on the Nous Portal for a 15-day period. This offer provides users access to the model without c

researchnous-research--x

Streaming Sliced Optimal Transport

arXiv:2505.06835v4 Announce Type: replace Abstract: Sliced optimal transport (SOT), or sliced Wasserstein (SW) distance, is widely recognized for its statistical and computational scalability. In this

Structure-Centric Graph Foundation Model via Geometric Bases

arXiv:2605.08689v1 Announce Type: cross Abstract: Graph foundation models (GFMs) seek transferable representations across graph domains but are limited by structural heterogeneity and incompatible nod

Structured Recurrent Mixers for Massively Parallelized Sequence Generation

arXiv:2605.08696v1 Announce Type: new Abstract: Over the last two decades, language modeling has experienced a shift from predominantly recurrent architectures that process tokens sequentially during

Sufficient conditions for a Heuristic Rating Estimation Method application

arXiv:2605.08991v1 Announce Type: new Abstract: A series of papers has introduced the Heuristic Rating Estimation method, which evaluates a set of alternatives based on pairwise comparisons and the we

Supersampling Stable Diffusion and More: An Approach for Interpolating Neural Networks Using Common Interpolation Methods

arXiv:2605.08698v1 Announce Type: new Abstract: Stable Diffusion (SD) has evolved DDPM (Denoising Diffusion Probabilistic Model) based image generation significantly by denoising in latent space inste

Supervised Dimensionality Reduction Revisited: Why LDA on Frozen CNN Features Deserves a Second Look

arXiv:2604.03928v2 Announce Type: replace-cross Abstract: Frozen pretrained image representations are widely used for transfer learning: a backbone is kept fixed, feature vectors are extracted, and a

Supervised Guidance Training for Infinite-Dimensional Diffusion Models

arXiv:2601.20756v2 Announce Type: replace Abstract: Score-based diffusion models have recently been extended to infinite-dimensional function spaces, with uses such as inverse problems arising from pa

Survey on Disaster Management Datasets for Remote Sensing Based Emergency Applications

arXiv:2605.08196v1 Announce Type: new Abstract: Recent natural disasters have highlighted the urgent need for efficient data-driven approaches to disaster management. Machine learning (ML) and deep le

Symbolic learning is not a replacement for coding agents, it's a replacement for gradient descent & NNs: a low-level, completely general, ex…

researchfrancois-chollet--x

Francois Chollet argues that symbolic learning represents a fundamental alternative to gradient descent and neural networks rather than a replacement for coding agents, offering a low-level, general-p

SynerDiff: Synergetic Continuous Batching for Fast and Parallel Diffusion Model Inference

arXiv:2605.08835v1 Announce Type: new Abstract: The expansion of Artificial Intelligence-generated content service requires diffusion model serving to simultaneously achieve high throughput and low ta

TAD: Temporal-Aware Trajectory Self-Distillation for Fast and Accurate Diffusion LLM

arXiv:2605.09536v1 Announce Type: cross Abstract: Diffusion large language models (dLLMs) offer a promising paradigm for parallel text generation, but in practice they face an accuracy-parallelism tra

TAH-QUANT: Effective Activation Quantization in Pipeline Parallelism over Slow Network

arXiv:2506.01352v2 Announce Type: replace Abstract: Decentralized training of large language models offers the opportunity to pool computational resources across geographically distributed participant

TARO: Temporal Adversarial Rectification Optimization Using Diffusion Models as Purifiers

arXiv:2605.08440v1 Announce Type: cross Abstract: Adversarial purification with diffusion models seeks to project adversarial examples back toward the data manifold, but balancing semantic preservatio

Task-Agnostic Noisy Label Detection via Standardized Loss Aggregation

arXiv:2605.10165v1 Announce Type: cross Abstract: Noisy labels are common in large-scale medical imaging datasets due to inter-observer variability and ambiguous cases. We propose a statistically grou

Task-Aware Calibration: Provably Optimal Decoding in LLMs

arXiv:2605.10202v1 Announce Type: cross Abstract: LLM decoding often relies on the model's predictive distribution to generate an output. Consequently, misalignment with respect to the true generating

Task complexity shapes internal representations and robustness in neural networks

arXiv:2508.05463v2 Announce Type: replace-cross Abstract: Neural networks excel across a wide range of tasks, yet remain black boxes. In particular, how their internal representations are shaped by th

TELL-TALE: Task Efficient LLMs with Task Aware Layer Elimination

arXiv:2510.22767v3 Announce Type: replace-cross Abstract: Large Language Models (LLMs) typically come with a fixed architecture, despite growing evidence that not all layers contribute equally to ever

Temporal-Decay Shapley: A Time-Aware Data Valuation Framework for Time-Series Data

arXiv:2605.08153v1 Announce Type: new Abstract: With the rapid development of machine learning applications on time-series data, accurately assessing the value of training samples has become essential

Tensor Product Representation Probes Reveal Shared Structure Across Linear Directions

arXiv:2605.09967v1 Announce Type: new Abstract: While researchers are finding concepts represented as linear directions in language models, a bag of linear directions fails to capture relational struc

Test-Time Training for Visual Foresight Vision-Language-Action Models

arXiv:2605.08215v1 Announce Type: new Abstract: Visual Foresight VLA (VF-VLA) has become a prominent architectural choice in the recent VLA due to its impressive performance. Nevertheless, the inheren

The Association of Transformer-based Sentiment Analysis with Symptom Distress and Deterioration in Routine Psychotherapy Care

arXiv:2605.09838v1 Announce Type: new Abstract: Sentiment analysis has been of long-standing interest in psychotherapy research. Recently, the Transformer deep learning architecture has produced text-

The Astonishing Ability of Large Language Models to Parse Jabberwockified Language

arXiv:2602.23928v2 Announce Type: replace Abstract: We show that large language models (LLMs) have an astonishing ability to recover meaning from severely degraded English texts. Texts in which conten

The Benefits of Temporal Correlations: SGD Learns k-Juntas from Random Walks Efficiently

arXiv:2605.10237v1 Announce Type: new Abstract: We study how temporal correlations in the data can make certain sparse learning problems efficiently learnable by gradient-based methods. Our focus is o

The Cancellation Hypothesis in Critic-Free RL: From Outcome Rewards to Token Credits

arXiv:2605.08666v1 Announce Type: new Abstract: A commonly accepted explanation of critic-free RL for LLMs, based on sequence-level rewards, is that it reinforces successful rollouts with a positive a

The Cartesian Shortcut: Re-evaluate Vision Reasoning in Polar Coordinate Space

arXiv:2605.09883v1 Announce Type: cross Abstract: As current Multimodal Large Language Models rapidly saturate canonical visual reasoning benchmarks, a key question emerges: do these strong scores gen

The Direct Integration Theorem: A Rigorous Framework for Consistent Discrete Solutions of the Inverse Radon Problem

arXiv:2605.09020v1 Announce Type: new Abstract: This paper presents a novel Direct Integration Theorem (DIT), derived as a non-trivial corollary of the classical Central Slice Theorem (CST). The DIT p