research

Strong Teacher Not Needed? On Distillation in LLM Pretraining

arXiv:2605.23857v1 Announce Type: cross Abstract: Knowledge distillation generally assumes a strong-to-weak relationship where stronger teachers yield better students. In this work, we examine this as

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Suicide Risk Assessment from AI-powered Video Surveillance: An Interpretable Framework for Prevention in Metro Stations

DGX agent

arXiv:2605.22904v1 Announce Type: cross Abstract: Understanding and monitoring human behavior in metro stations play an important role in supporting suicide prevention efforts, where early identificat

researcharxiv-cs-ai

25 May 2026

SyMerge: From Non-Interference to Synergistic Merging via Single-Layer Adaptation

arXiv:2412.19098v4 Announce Type: replace Abstract: Model merging combines independently trained models into a single multi-task model. However, most existing approaches focus primarily on avoiding ta

TCAP: Tri-Component Attention Profiling for Unsupervised Backdoor Detection in MLLM Fine-Tuning

arXiv:2601.21692v2 Announce Type: replace Abstract: Fine-Tuning-as-a-Service (FTaaS) facilitates the customization of Multimodal Large Language Models (MLLMs) but introduces critical backdoor risks vi

Tensor Cache: Eviction-conditioned Associative Memory for Transformers

arXiv:2605.22884v1 Announce Type: cross Abstract: Autoregressive Transformer KV caches grow linearly with context length; sliding-window caching bounds memory but discards evicted tokens entirely, so

The Efficiency Frontier: A Unified Framework for Cost-Performance Optimization in LLM Context Management

arXiv:2605.23071v1 Announce Type: new Abstract: Large language models (LLMs) increasingly rely on long-context processing, but expanding context windows introduces substantial computational and financ

The ramp up of cancer immunotherapy is remarkable. Now we're seeing vaccines achieve some cures or remissions in the most refractory cancers…

The ramp up of cancer immunotherapy is remarkable. Now we're seeing vaccines achieve some cures or remissions in the most refractory cancers: pancreatic, melanoma, glioblastoma, renal, triple-negative

researchyann-lecun--x

Thinking of AI as a productivity booster for prior workflows is the wrong framing. Like all of the previous waves of computerization/softwar…

researchfrancois-chollet--x

Thinking of AI as a productivity booster for prior workflows is the wrong framing. Like all of the previous waves of computerization/softwarization, AI is a tool that lets you do new things in new way

Training-Free Looped Transformers

arXiv:2605.23872v1 Announce Type: new Abstract: We introduce training-free looped transformers, in which a lightweight inference-time wrapper loops a contiguous mid-stack block of layers of a frozen c

Training-Free Rate-Distortion-Perception Traversal With Diffusion

arXiv:2603.04005v2 Announce Type: replace-cross Abstract: The rate-distortion-perception (RDP) tradeoff characterizes the fundamental limits of lossy compression by jointly considering bitrate, recons

TurkicNLP: An NLP Toolkit for Turkic Languages

arXiv:2602.19174v5 Announce Type: replace Abstract: Natural language processing for the Turkic language family, spoken by over 200 million people across Eurasia, remains fragmented, with most language

U-CESE: Unified Clip-based Event Search Engine for AI Challenge HCMC 2025

arXiv:2605.23274v1 Announce Type: new Abstract: Retrieving events from large-scale video datasets is challenging due to complex temporal, spatial, and multimodal information. This paper presents U-CES

researcharxiv-cs-cv

Understanding Task Aggregation for Generalizable Ultrasound Foundation Models

arXiv:2603.18123v3 Announce Type: replace-cross Abstract: Foundation models promise to unify multiple clinical tasks within a single framework, but recent ultrasound studies report that unified models

Universal Matrix Multiplication on Quantum Computer

arXiv:2408.03085v3 Announce Type: replace-cross Abstract: As the most central and computationally intensive component of deep neural networks, the execution efficiency of matrix multiplication directl

USIM and U0: A Vision-Language-Action Dataset and Model for General Underwater Robots

arXiv:2510.07869v4 Announce Type: replace Abstract: Underwater environments pose unique challenges for robotic navigation and manipulation. While existing research has primarily focused on task-specif

researcharxiv-cs-ro

Valid and Expressive Copulas for Irregular Multivariate Time Series

arXiv:2605.23632v1 Announce Type: new Abstract: We introduce CopFITi, a copula model for probabilistic forecasting of irregular multivariate time series (IMTS). Our model combines the expressivity of

Verified Task-Space Motion Planning Under Joint-Space Constraints

arXiv:2605.22991v1 Announce Type: new Abstract: Reactive task-space planners such as Bug2 operate with fixed Cartesian step sizes and are unaware of the manipulator's joint-angle limits. When the Jaco

researcharxiv-cs-ro

VGAS: Value-Guided Action-Chunk Selection for Few-Shot Vision-Language-Action Adaptation

arXiv:2602.07399v2 Announce Type: replace Abstract: Vision--Language--Action (VLA) models bridge multimodal reasoning with physical control, but adapting them to new tasks with scarce demonstrations r

WeCon: An Efficient Weight-Conditioned Neural Solver for Multi-Objective Combinatorial Optimization Problems

arXiv:2605.22876v1 Announce Type: new Abstract: Existing neural solvers for Multi-Objective Combinatorial Optimization Problems (MOCOPs) commonly adopt decomposition-based strategies that scalarize an

Weierstrass Positional Encoding for Vision Transformers

arXiv:2605.23719v1 Announce Type: cross Abstract: Vision Transformers have achieved remarkable success in computer vision, but their common use of learnable one-dimensional positional encodings weaken

Weisfeiler-Leman Is Incomplete on Simple Spectrum Graphs, so Canonicalize Them

arXiv:2605.23446v1 Announce Type: new Abstract: Graphs with a simple spectrum admit cubic-time isomorphism testing, yet we prove that for every natural number k, the k-Weisfeiler-Leman (k-WL) test can

What Does the Server See? Understanding Privacy Leakage from Large Language Models in Split Inference

arXiv:2605.23158v1 Announce Type: cross Abstract: The deployment of large language models (LLMs) on resource-constrained devices remains challenging, spurring interest in split inference, where models

When Do LLMs Reason? A Dynamical Systems View via Entropy Phase Transitions

arXiv:2605.22873v1 Announce Type: cross Abstract: Chain-of-thought (CoT) reasoning has become the default strategy for enhancing LLM capabilities, yet its application raises a fundamental question: wh

When One Point Is Not Enough: Addressing Ambiguous Instances in Dimensionality Reduction by Splitting

arXiv:2605.23540v1 Announce Type: new Abstract: Dimensionality Reduction (DR) methods are widely used to visualize high-dimensional data. One key task in DR-based analysis is discovering neighborhoods

WMAttack: Automated Attack Search for Adversarial Evaluation of World-Model Agents

arXiv:2605.23220v1 Announce Type: new Abstract: Despite the growing use of world models as decision-making agents, their adversarial robustness remains underexplored due to the lack of dedicated autom

World Machine: Towards Generative World Modeling for Time-Series

arXiv:2605.23025v1 Announce Type: new Abstract: World models represent a paradigm shift in generative AI, pursuing predictive understanding and controllable simulation of environments in a structured

Worse than Random: The Importance of a Baseline for Unsupervised Feature Selection

arXiv:2605.22973v1 Announce Type: cross Abstract: Many novel unsupervised feature selection methods are proposed each year, yet their empirical evaluation is limited to supervised and unsupervised eva

MergeNB: An intuitive merge conflict resolver built for Jupyter notebooks in VS Code [P]

researchr-machinelearning

MergeNB is a VSCode extension to resolve Jupyter Notebook git merge conflicts . It applies three-way merge logic on matched notebook entities (source, metadata, outputs, execution_count) to automatica

People keep asking if AI will replace software engineers. I believe the exact opposite. Thanks to the Jevons paradox, AI tools are making gr…

People keep asking if AI will replace software engineers. I believe the exact opposite. Thanks to the Jevons paradox, AI tools are making great engineers 10x more productive, allowing us to tackle muc

researchdavid-ha--x

Sooo many people dont know this but Hermes creator @NousResearch has its own sub program... the FREE account is HUGE because it gives you ac…

Sooo many people dont know this but Hermes creator @NousResearch has its own sub program... the FREE account is HUGE because it gives you access to all of their FREE models there are paid subs and if

researchnous-research--x

Thinking Machines is impressive. In a couple hours I just fine tuned my own Qwen3.5-397B model this afternoon. Fast usable multimodal is als…

researchsoumith-chintala--x

Thinking Machines is impressive. In a couple hours I just fine tuned my own Qwen3.5-397B model this afternoon. Fast usable multimodal is also going to enable very mind-blowing personal AI. People talk

A bunch of nerds making progress.

Nous Research shared an update on X regarding progress made by their team on research or development initiatives. Without access to the specific post content, this likely documents advances in AI rese

researchnous-research--x

A Diffusive Classification Loss for Learning Energy-based Generative Models

arXiv:2601.21025v3 Announce Type: replace-cross Abstract: Score-based generative models have recently achieved remarkable success. While they are usually parameterized by the score, an alternative way

A Martingale Kernel Independence Test

arXiv:2605.22549v1 Announce Type: cross Abstract: The Hilbert-Schmidt Independence Criterion (HSIC) and its joint-independence extension dHSIC are degenerate V-statistics whose data-dependent weighted

A Short and Unified Convergence Analysis of the SAG, SAGA, and IAG Algorithms

arXiv:2602.05304v2 Announce Type: replace Abstract: Stochastic variance-reduced algorithms such as Stochastic Average Gradient (SAG) and SAGA, and their deterministic counterparts like the Incremental

Aerodynamic force reconstruction using physics-informed Gaussian processes

arXiv:2605.22111v1 Announce Type: new Abstract: Accurate modeling of aerodynamic loads is essential for understanding and predicting the responses of complex structural systems. However, these models

AgForce Enables Antigen-conditioned Generative Antibody Design

arXiv:2605.21610v1 Announce Type: new Abstract: Antibody design methods condition on antigen structure to generate complementarity-determining regions (CDR), yet a systematic evaluation of baseline me

Algorithm Design and Stronger Guarantees for the Improving Multi-Armed Bandits Problem

arXiv:2511.10619v2 Announce Type: replace Abstract: The improving multi-armed bandits problem is a formal model for allocating effort under uncertainty, motivated by scenarios such as investing resear

AMUSE: Anytime Muon with Stable Gradient Evaluation

arXiv:2605.22432v1 Announce Type: new Abstract: Modern deep learning commonly relies on AdamW with prescribed learning rate schedules, but recent works challenge both components: Schedule-Free optimiz

And just like that, it’s completely VANISHED from the media. A sitting congressman, Ted Lieu, said on the record the Epstein files are being…

And just like that, it’s completely VANISHED from the media. A sitting congressman, Ted Lieu, said on the record the Epstein files are being blocked because they show Trump raped and threatened to kil

researchyann-lecun--x

ASAP: Attention Sink Anchored Pruning

arXiv:2605.22372v1 Announce Type: new Abstract: Vision Transformers (ViTs) face severe computational bottlenecks due to the quadratic complexity of self-attention at high resolutions. Existing token r

Asymmetric Virtual Memory Paging for Hybrid Mamba-Transformer Inference

arXiv:2605.22416v1 Announce Type: new Abstract: Hybrid language models like Jamba mix attention layers with State Space Models (SSMs), creating two memory cache types with opposite profiles: Key-Value

Atom-anchored LLMs speak Chemistry: A Retrosynthesis Demonstration

arXiv:2510.16590v2 Announce Type: replace Abstract: Applications of machine learning in chemistry are often limited by the scarcity and expense of labeled data, restricting traditional supervised meth

Bandit Convex Optimization with Gradient Prediction Adaptivity

arXiv:2605.22191v1 Announce Type: new Abstract: Bandit convex optimization (BCO) is a fundamental online learning framework with partial feedback, where the learner observes only the loss incurred at

Bringing Stability to Diffusion: Decomposing and Reducing Variance of Training Masked Diffusion Models

arXiv:2511.18159v2 Announce Type: replace Abstract: Masked diffusion models (MDMs) are a promising alternative to autoregressive models (ARMs), but they suffer from inherently much higher training var

Calibration, Uncertainty Communication, and Deployment Readiness in CKD Risk Prediction: A Framework Evaluation Study

arXiv:2605.21566v1 Announce Type: new Abstract: Machine learning models for chronic kidney disease (CKD) risk prediction often post strong discrimination scores on internal test sets. Calibration and

Can Breath Biomarkers Causally Influence Blood Glucose? Investigating VOC-Mediated Modulation in Diabetes

arXiv:2605.22075v1 Announce Type: new Abstract: Diabetes is a global health burden, and early detection is critical for timely intervention. This study explores a non-invasive, data-driven framework t

CASE-NET: Deep Spatio-Temporal Representation Learning via Causal Attention and Channel Recalibration for Multivariate Time Series Classification

arXiv:2605.22043v1 Announce Type: new Abstract: Multivariate time series (MTS) classification is foundational to pervasive computing and financial analysis, yet existing multi-scale paradigms are ofte