research

Hybrid Architectures for Language Models: Systematic Analysis and Design Insights

arXiv:2510.04800v3 Announce Type: replace Abstract: Recent progress in large language models demonstrates that hybrid architectures--combining self-attention mechanisms with structured state space mod

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

I am looking for a Principal Platform Engineer to join us in Tokyo and build the core data infrastructure for Japan’s most critical systems.…

DGX agent

I am looking for a Principal Platform Engineer to join us in Tokyo and build the core data infrastructure for Japan’s most critical systems. Read the full mission and apply here: https://sakana.ai/car

researchdavid-ha--x

22 Apr 2026

Idle is the New Sleep: Configuration-Aware Alternative to Powering Off FPGA-Based DL Accelerators During Inactivity

arXiv:2407.12027v2 Announce Type: replace-cross Abstract: In the rapidly evolving Internet of Things (IoT) domain, we concentrate on enhancing energy efficiency in Deep Learning accelerators on FPGA-b

Imagine every pixel on your screen, streamed live directly from a model. No HTML, no layout engine, no code. Just exactly what you want to s…

Imagine every pixel on your screen, streamed live directly from a model. No HTML, no layout engine, no code. Just exactly what you want to see. @eddiejiao_obj, @drewocarr and I built a prototype to se

researchkarpathy--x

Impact of large language models on peer review opinions from a fine-grained perspective: Evidence from top conference proceedings in AI

arXiv:2604.19578v1 Announce Type: cross Abstract: With the rapid advancement of Large Language Models (LLMs), the academic community has faced unprecedented disruptions, particularly in the realm of a

Improved Anomaly Detection in Medical Images via Mean Shift Density Enhancement

arXiv:2604.19191v1 Announce Type: cross Abstract: Anomaly detection in medical imaging is essential for identifying rare pathological conditions, particularly when annotated abnormal samples are limit

Improvements to the post-processing of weather forecasts using machine learning and feature selection

arXiv:2604.19340v1 Announce Type: cross Abstract: This study aims to develop and improve machine learning-based post-processing models for precipitation, temperature, and wind speed predictions using

“In the end the Party would announce that two and two made five, and you would have to believe it.” -George Orwell, 1984.

“In the end the Party would announce that two and two made five, and you would have to believe it.” -George Orwell, 1984. RFK Jr: 'President Trump has a different way of calculating percentages. If yo

researchyann-lecun--x

INT3 compression+fused metal kernels [R]

researchr-machinelearning

INT3 compression with fused Metal kernels enables large language models to compute attention operations directly on compressed (INT3/INT4) key-value cache representations using custom GPU kernels that

Investigating the structure of emotions by analyzing similarity and association of emotion words

arXiv:2602.06430v2 Announce Type: replace-cross Abstract: In the field of natural language processing, some studies have attempted sentiment analysis on text by handling emotions as explanatory or res

IonMorphNet: Generalizable Learning of Ion Image Morphologies for Peak Picking in Mass Spectrometry Imaging

arXiv:2604.19369v1 Announce Type: new Abstract: Peak picking is a fundamental preprocessing step in Mass Spectrometry Imaging (MSI), where each sample is represented by hundreds to thousands of ion im

KG-ViP: Bridging Knowledge Grounding and Visual Perception in Multi-modal LLMs for Visual Question Answering

arXiv:2601.11632v2 Announce Type: replace Abstract: Multi-modal Large Language Models (MLLMs) for Visual Question Answering (VQA) often suffer from dual limitations: knowledge hallucination and insuff

Learning Evolution via Optimization Knowledge Adaptation

arXiv:2501.02200v2 Announce Type: replace-cross Abstract: The iterative search process of evolutionary algorithms (EAs) encapsulates optimization knowledge within historical populations and fitness ev

Los Angeles is finally going underground

Los Angeles deserves its reputation as the quintessential car city—the rhythms of its 2,200 square miles are dictated by wide boulevards and concrete arcs of freeways. But it once had a world-class ra

researchmit-tech-review

Lost in the Prompt Order: Revealing the Limitations of Causal Attention in Language Models

arXiv:2601.14152v2 Announce Type: replace-cross Abstract: Large language models exhibit surprising sensitivity to the structure of the prompt, but the mechanisms underlying this sensitivity remain poo

Match-Any-Events: Zero-Shot Motion-Robust Feature Matching Across Wide Baselines for Event Cameras

arXiv:2604.18744v1 Announce Type: new Abstract: Event cameras have recently shown promising capabilities in instantaneous motion estimation due to their robustness to low light and fast motions. Howev

MedFlowSeg: Flow Matching for Medical Image Segmentation with Frequency-Aware Attention

arXiv:2604.19675v1 Announce Type: new Abstract: Flow matching has recently emerged as a principled framework for learning continuous-time transport maps, enabling efficient deterministic generation wi

Memory Assignment for Finite-Memory Strategies in Adversarial Patrolling Games

arXiv:2505.14137v2 Announce Type: replace Abstract: Adversarial Patrolling games form a subclass of Security games where a Defender moves between locations, guarding vulnerable targets. The main algor

Mind the Unseen Mass: Unmasking LLM Hallucinations via Soft-Hybrid Alphabet Estimation

arXiv:2604.19162v1 Announce Type: new Abstract: This paper studies uncertainty quantification for large language models (LLMs) under black-box access, where only a small number of responses can be sam

MiTA Attention: Efficient Fast-Weight Scaling via a Mixture of Top-k Activations

arXiv:2602.01219v4 Announce Type: replace-cross Abstract: The attention operator in Transformers can be viewed as a two-layer fast-weight MLP, whose weights are dynamically instantiated from input tok

Model-Agnostic Meta Learning for Class Imbalance Adaptation

arXiv:2604.18759v1 Announce Type: new Abstract: Class imbalance is a widespread challenge in NLP tasks, significantly hindering robust performance across diverse domains and applications. We introduce

MoonSeg3R: Monocular Online Zero-Shot Segment Anything in 3D with Reconstructive Foundation Priors

arXiv:2512.15577v2 Announce Type: replace Abstract: In this paper, we focus on online zero-shot monocular 3D instance segmentation, a novel practical setting where existing approaches fail to perform

NeuroAI and Beyond: Bridging Between Advances in Neuroscience and ArtificialIntelligence

arXiv:2604.18637v1 Announce Type: cross Abstract: Neuroscience and Artificial Intelligence (AI) have made impressive progress in recent years but remain only loosely interconnected. Based on a worksho

New `hermes --tui` `/agents` slash command to monitor delegated subagents in real time @Teknium @karan4d @NousResearch

Nous Research announced a new `hermes --tui` feature that introduces a `/agents` slash command for real-time monitoring of delegated subagents through a terminal user interface (TUI). This enhancement

researchnous-research--x

Nexusformer: Nonlinear Attention Expansion for Stable and Inheritable Transformer Scaling

arXiv:2604.19147v1 Announce Type: cross Abstract: Scaling Transformers typically necessitates training larger models from scratch, as standard architectures struggle to expand without discarding learn

Nonmonotone subgradient methods based on a local descent lemma

arXiv:2510.19341v2 Announce Type: replace-cross Abstract: In this paper we present a nonmonotone line search subgradient algorithm tailored to upper-C^2 functions. This is a family of nonsmooth and no

OmniParser V2: Structured-Points-of-Thought for Unified Visual Text Parsing and Its Generality to Multimodal Large Language Models

arXiv:2502.16161v2 Announce Type: replace-cross Abstract: Visually-situated text parsing (VsTP) has recently seen notable advancements, driven by the growing demand for automated document understandin

OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Models

arXiv:2604.00688v3 Announce Type: replace Abstract: We present OmniVoice, a massively multilingual zero-shot text-to-speech (TTS) model that scales to over 600 languages. At its core is a novel diffus

On Accelerating Grounded Code Development for Research

arXiv:2604.19022v1 Announce Type: new Abstract: A major challenge for niche scientific and technical domains in leveraging coding agents is the lack of access to up-to-date, domain- specific knowledge

On Solving the Multiple Variable Gapped Longest Common Subsequence Problem

arXiv:2604.18645v1 Announce Type: new Abstract: This paper addresses the Variable Gapped Longest Common Subsequence (VGLCS) problem, a generalization of the classical LCS problem involving flexible ga

On the Conditioning Consistency Gap in Conditional Neural Processes

arXiv:2604.19312v1 Announce Type: new Abstract: Neural processes are meta-learning models that map context sets to predictive distributions. While inspired by stochastic processes, NPs do not generall

On the Derivation of Tightly-Coupled LiDAR-Inertial Odometry with VoxelMap

arXiv:2603.15471v2 Announce Type: replace Abstract: This note presents a concise mathematical formulation of tightly-coupled LiDAR-Inertial Odometry within an iterated error-state Kalman filter framew

researcharxiv-cs-ro

On two ways to use determinantal point processes for Monte Carlo integration

arXiv:2604.19698v1 Announce Type: new Abstract: The standard Monte Carlo estimator widehat{I}_N^{MC} of int fdomega relies on independent samples from omega and has variance of order 1/N. Replacing th

One town’s scheme to get rid of its geese

“Pull over!” I order my brother one sunny February afternoon. Our target is in sight: a gaggle of Canada geese, pecking at grass near the dog park. As I approach, tiptoeing over their grayish-white po

researchmit-tech-review

Opinion de-polarization in social networks with GNNs

arXiv:2412.09404v3 Announce Type: replace-cross Abstract: Nowadays, social media is the ground for political debate and exchange of opinions. There is a significant amount of research that suggests th

Pause or Fabricate? Training Language Models for Grounded Reasoning

arXiv:2604.19656v1 Announce Type: new Abstract: Large language models have achieved remarkable progress on complex reasoning tasks. However, they often implicitly fabricate information when inputs are

Phase Transitions in the Fluctuations of Functionals of Random Neural Networks

arXiv:2604.19738v1 Announce Type: cross Abstract: We establish central and non-central limit theorems for sequences of functionals of the Gaussian output of an infinitely-wide random neural network on

Planning in entropy-regularized Markov decision processes and games

arXiv:2604.19695v1 Announce Type: new Abstract: We propose SmoothCruiser, a new planning algorithm for estimating the value function in entropy-regularized Markov decision processes and two-player gam

Plausible Reasoning and First-Order Plausible Logic

arXiv:2604.19036v1 Announce Type: new Abstract: Defeasible statements are statements that are likely, or probable, or usually true, but may occasionally be false. Plausible reasoning makes conclusions

Preparation and Motion Study of Magnetically Driven Micro Soft Robot Mimicking the Cownose Ray

arXiv:2601.15349v2 Announce Type: replace Abstract: In narrow, unstructured underwater environments such as environmental monitoring and minimally invasive medical procedures, micro soft robots exhibi

researcharxiv-cs-ro

QSLM: A Performance- and Memory-aware Quantization Framework with Tiered Search Strategy for Spike-driven Language Models

arXiv:2601.00679v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have been emerging as prominent AI models for solving many natural language tasks due to their high performance (

Quantum AI for Cancer Diagnostic Biomarker Discovery

arXiv:2604.18621v1 Announce Type: cross Abstract: Quantum machine learning offers a promising new paradigm for computational biology by leveraging quantum mechanical principles to enhance cancer class

Quantum inspired qubit qutrit neural networks for real time financial forecasting

arXiv:2604.18838v1 Announce Type: new Abstract: This research investigates the performance and efficacy of machine learning models in stock prediction, comparing Artificial Neural Networks (ANNs), Qua

Quantum spatial best-arm identification via quantum walks

arXiv:2509.05890v3 Announce Type: replace-cross Abstract: Quantum reinforcement learning has emerged as a framework combining quantum computation with sequential decision-making, and applications to t

Real-Time Streamable Generative Speech Restoration with Flow Matching

arXiv:2512.19442v3 Announce Type: replace-cross Abstract: Diffusion-based generative models have greatly impacted the speech processing field in recent years, exhibiting high speech naturalness and sp

Reducing the Offline-Streaming Gap for Unified ASR Transducer with Consistency Regularization

arXiv:2604.19079v1 Announce Type: cross Abstract: Unification of automatic speech recognition (ASR) systems reduces development and maintenance costs, but training a single model to perform well in bo

ReImagine: Rethinking Controllable High-Quality Human Video Generation via Image-First Synthesis

arXiv:2604.19720v1 Announce Type: new Abstract: Human video generation remains challenging due to the difficulty of jointly modeling human appearance, motion, and camera viewpoint under limited multi-

Reinforcement Learning Enabled Adaptive Multi-Task Control for Bipedal Soccer Robots

arXiv:2604.19104v1 Announce Type: cross Abstract: Developing bipedal football robots in dynamiccombat environments presents challenges related to motionstability and deep coupling of multiple tasks, a