Search: “research”

Exploiting Low-Rank Structure in Max-K-Cut Problems

arXiv:2602.20376v2 Announce Type: replace-cross Abstract: We approach the Max-3-Cut problem through the lens of maximizing complex-valued quadratic forms and demonstrate that low-rank structure in the

Fast, close, non-singular and property-preserving approximations of entropic measures

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2505.14234v2 Announce Type: replace-cross Abstract: Entropic measures like Shannon entropy (SE), its quantum mechanical analogue von Neumann entropy, and Kullback-Leibler divergence (KL) are key

researcharxiv-cs-ai

27 Apr 2026

Federated Nonlinear System Identification

arXiv:2508.15025v5 Announce Type: replace Abstract: We consider federated learning of linearly-parameterized nonlinear systems. We establish theoretical guarantees on the effectiveness of federated no

FedSPDnet: Geometry-Aware Federated Deep Learning with SPDnet

arXiv:2604.22494v1 Announce Type: cross Abstract: We introduce two federated learning frameworks for the classical SPDnet model operating on symmetric positive definite (SPD) matrices with Stiefel-con

FeudalNav: A Simple Framework for Visual Navigation

arXiv:2602.06974v2 Announce Type: replace-cross Abstract: Visual navigation for robotics is inspired by the human ability to navigate environments using visual cues and memory, eliminating the need fo

FixV2W: Correcting Invalid CVE-CWE Mappings with Knowledge Graph Embeddings

arXiv:2604.22176v1 Announce Type: cross Abstract: Accurate mapping between Common Vulnerabilities and Exposures (CVE) and Common Weakness Enumeration (CWE) entries is critical for effective vulnerabil

Focus Session: Hardware and Software Techniques for Accelerating Multimodal Foundation Models

arXiv:2604.21952v1 Announce Type: cross Abstract: This work presents a multi-layered methodology for efficiently accelerating multimodal foundation models (MFMs). It combines hardware and software co-

Forecasting Solar Energy Using a Single Image

arXiv:2604.21982v1 Announce Type: new Abstract: Solar panels are increasingly deployed in cities on rooftops, walls, and urban infrastructure. Although the panel costs have fallen in recent years, the

Foundation models for discovering robust biomarkers of neurological disorders from dynamic functional connectivity

arXiv:2604.22018v1 Announce Type: cross Abstract: Several brain foundation models (FM) have recently been proposed to predict brain disorders by modelling dynamic functional connectivity (FC). While t

From graphemic dependence to lexical structure: a Markovian perspective on Dante's Commedia

arXiv:2604.22626v1 Announce Type: new Abstract: This study investigates the structural organisation of Dante's Divina Commedia through a symbolic representation based on vowel-consonant (V/C) encoding

From Words to Amino Acids: Does the Curse of Depth Persist?

arXiv:2602.21750v2 Announce Type: replace Abstract: Protein language models (PLMs) have become widely adopted as general-purpose models, demonstrating strong performance in protein engineering and de

Safety

@GaryMarcus

Gary Marcus is a prominent AI researcher, cognitive scientist, and entrepreneur who frequently discusses artificial intelligence, machine learning, and cognitive science on X (formerly Twitter). His p

safetygary-marcus--x

Generative Modeling of Neurodegenerative Brain Anatomy with 4D Longitudinal Diffusion Model

arXiv:2604.22700v1 Announce Type: new Abstract: Understanding and predicting the progression of neurodegenerative diseases remains a major challenge in medical AI, with significant implications for ea

H-Sets: Hessian-Guided Discovery of Set-Level Feature Interactions in Image Classifiers

arXiv:2604.22045v1 Announce Type: cross Abstract: Feature attribution methods explain the predictions of deep neural networks by assigning importance scores to individual input features. However, most

HFS-TriNet: A Three-Branch Collaborative Feature Learning Network for Prostate Cancer Classification from TRUS Videos

arXiv:2604.22388v1 Announce Type: new Abstract: Transrectal ultrasound (TRUS) imaging is a cost-effective and non-invasive modality widely used in the diagnosis of prostate cancer. The computer-aided

Hidden Failure Modes of Gradient Modification under Adam in Continual Learning, and Adaptive Decoupled Moment Routing as a Repair

arXiv:2604.22407v1 Announce Type: cross Abstract: Many continual-learning methods modify gradients upstream (e.g., projection, penalty rescaling, replay mixing) while treating Adam as a neutral backen

How attention simplifies mental representations for planning

arXiv:2506.09520v2 Announce Type: replace-cross Abstract: Human planning is efficient--it frugally deploys limited cognitive resources to accomplish difficult tasks--and flexible--adapting to novel pr

How Hard is it to Decide if a Fact is Relevant to a Query?

arXiv:2604.22422v1 Announce Type: cross Abstract: We consider the following fundamental problem: given a database D, Boolean conjunctive query (CQ) q, and fact f in D, decide whether f is relevant to

Identifying the Periodicity of Information in Natural Language

arXiv:2510.27241v2 Announce Type: replace Abstract: Recent theoretical advancement of information density in natural language has brought the following question on desk: To what degree does natural la

Initial results of the Digital Consciousness Model

arXiv:2601.17060v2 Announce Type: replace-cross Abstract: Artificially intelligent systems have become remarkably sophisticated. They hold conversations, write essays, and seem to understand context i

Interpretable Deep Learning for Stock Returns: A Consensus-Bottleneck Asset Pricing Model

arXiv:2512.16251v5 Announce Type: replace-cross Abstract: We introduce the Consensus-Bottleneck Asset Pricing Model (CB-APM), which embeds aggregate analyst consensus as a structural bottleneck, treat

Introducing Background Temperature to Characterise Hidden Randomness in Large Language Models

arXiv:2604.22411v1 Announce Type: new Abstract: Even when decoding with temperature T=0, large language models (LLMs) can produce divergent outputs for identical inputs. Recent work by Thinking Machin

Iterative Model-Learning Scheme via Gaussian Processes for Nonlinear Model Predictive Control of (Semi-)Batch Processes

arXiv:2604.22672v1 Announce Type: new Abstract: Batch processes are inherently transient and typically nonlinear, motivating nonlinear model predictive control (NMPC). However, adopting NMPC is hinder

Joint Embedding Variational Bayes

arXiv:2602.05639v4 Announce Type: replace Abstract: We introduce Variational Joint Embedding (VJE), a reconstruction-free latent-variable framework for non-contrastive self-supervised learning in repr

Large Language Models Decide Early and Explain Later

arXiv:2604.22266v1 Announce Type: new Abstract: Large Language Models often achieve strong performance by generating long intermediate chain-of-thought reasoning. However, it remains unclear when a mo

LATMiX: Learnable Affine Transformations for Microscaling Quantization of LLMs

arXiv:2602.17681v2 Announce Type: replace-cross Abstract: Post-training quantization (PTQ) is a widely used approach for reducing the memory and compute costs of large language models (LLMs). Recent s

LayerBoost: Layer-Aware Attention Reduction for Efficient LLMs

arXiv:2604.22050v1 Announce Type: cross Abstract: Transformers are mostly relying on softmax attention, which introduces quadratic complexity with respect to sequence length and remains a major bottle

Lifting Unlabeled Internet-level Data for 3D Scene Understanding

arXiv:2604.01907v2 Announce Type: replace-cross Abstract: Annotated 3D scene data is scarce and expensive to acquire, while abundant unlabeled videos are readily available on the internet. In this pap

Measuring and Mitigating Persona Distortions from AI Writing Assistance

arXiv:2604.22503v1 Announce Type: new Abstract: Hundreds of millions of people use artificial intelligence (AI) for writing assistance. Here, we evaluated how AI writing assistance distorts writer per

Mechanistic Interpretability of Antibody Language Models Using SAEs

arXiv:2512.05794v2 Announce Type: replace-cross Abstract: Sparse autoencoders (SAEs) are a mechanistic interpretability technique that have been used to provide insight into learned concepts within la

Mixed Membership sub-Gaussian Models

arXiv:2604.22633v1 Announce Type: cross Abstract: The Gaussian mixture model is widely used in unsupervised learning, owing to its simplicity and interpretability. However, a fundamental limitation of

Model Predictive Control of Hybrid Dynamical Systems

arXiv:2604.21989v1 Announce Type: cross Abstract: The problem of controlling hybrid dynamical systems using model predictive control (MPC) is formulated and sufficient conditions for asymptotic stabil

Multi-Token Prediction via Self-Distillation

arXiv:2602.06019v2 Announce Type: replace Abstract: Existing techniques for accelerating language model inference, such as speculative decoding, require training auxiliary speculator models and buildi

MultiTok: Variable-Length Tokenization for Efficient LLMs Adapted from LZW Compression

arXiv:2410.21548v3 Announce Type: replace Abstract: Large language models have drastically changed the prospects of AI by introducing technologies for more complex natural language processing. However

Neural Recovery of Historical Lexical Structure in Bantu Languages from Modern Data

arXiv:2604.22730v1 Announce Type: cross Abstract: We investigate whether neural models trained exclusively on modern morphological data can recover cross-lingual lexical structure consistent with hist

NeuronMLP: Efficient LLM Inference via Singular Value Decomposition Compression and Tiling on AWS Trainium

arXiv:2510.25977v4 Announce Type: replace Abstract: Emerging AI accelerators have started to gain attention and offer new opportunities for efficient inference of large language models (LLMs). Trainiu

New work with @AlecRad and @DavidDuvenaud: Have you ever dreamed of talking to someone from the past? Introducing talkie, a 13B model traine…

New work with @AlecRad and @DavidDuvenaud: Have you ever dreamed of talking to someone from the past? Introducing talkie, a 13B model trained only on pre-1931 text. Vintage models should help us to un

researchkarpathy--x

NiuTrans.LMT: Toward Inclusive and Scalable Multilingual Machine Translation with LLMs

arXiv:2511.07003v2 Announce Type: replace Abstract: Large language models have significantly advanced Multilingual Machine Translation (MMT), yet scaling to many languages while keeping quality robust

Non-Minimal Sampling and Consensus for Prohibitively Large Datasets

arXiv:2604.22518v1 Announce Type: new Abstract: We introduce NONSAC (Non-Minimal Sampling and Consensus), a general framework for robust and scalable model estimation from arbitrarily large datasets c

NRGS: Neural Regularization for Robust 3D Semantic Gaussian Splatting

arXiv:2604.22439v1 Announce Type: new Abstract: We propose a neural regularization method that refines the noisy 3D semantic field produced by lifting multi-view inconsistent 2D features, in order to

Null-Space Flow Matching for MIMO Channel Estimation in Latency-Constrained Systems

arXiv:2604.22005v1 Announce Type: cross Abstract: Accurate yet low-latency channel state information (CSI) acquisition is essential for multiple-input multiple-output (MIMO) communication systems. Whi

OmniOVCD: Streamlining Open-Vocabulary Change Detection with SAM 3

arXiv:2601.13895v2 Announce Type: replace-cross Abstract: Change Detection (CD) is a fundamental task in remote sensing. It monitors the evolution of land cover over time. Based on this, Open-Vocabula

On Pareto Optimality for Parametric Choice Bandits

arXiv:2501.19277v4 Announce Type: replace-cross Abstract: We study online assortment optimization under stochastic choice when a decision maker simultaneously values cumulative revenue performance and

Operational Feature Fingerprints of Graph Datasets via a White-Box Signal-Subspace Probe

arXiv:2604.22676v1 Announce Type: new Abstract: Graph neural networks achieve strong node-classification accuracy, but their learned message passing entangles ego attributes, neighborhood smoothing, h

Optimal Lower Bounds for Online Multicalibration

arXiv:2601.05245v2 Announce Type: replace Abstract: We prove tight lower bounds for online multicalibration, establishing an information-theoretic separation from marginal calibration. In the general

OREN: Octree Residual Network for Real-Time Euclidean Signed Distance Mapping

arXiv:2510.18999v2 Announce Type: replace-cross Abstract: Reconstructing signed distance functions (SDFs) from point cloud data benefits many robot autonomy capabilities, including localization, mappi

Outcome Rewards Do Not Guarantee Verifiable or Causally Important Reasoning

arXiv:2604.22074v1 Announce Type: new Abstract: Reinforcement Learning from Verifiable Rewards (RLVR) on chain-of-thought reasoning has become a standard part of language model post-training recipes.

Pack only the essentials: Adaptive dictionary learning for kernel ridge regression

arXiv:2604.22386v1 Announce Type: cross Abstract: One of the major limits of kernel ridge regression (KRR) is that storing and manipulating the kernel matrix K_n for n samples requires O(n^2) space, w