Search: “model-releases”

Ordinary Least Squares as an Attention Mechanism

arXiv:2504.09663v3 Announce Type: replace Abstract: I show that ordinary least squares (OLS) predictions can be rewritten as the output of a restricted attention module, akin to those forming the back

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

OVAL: Output-Aware Local Page Bases for KV Cache Retrieval

DGX agent

arXiv:2610.06686v1 Announce Type: new Abstract: Long context inference with large language models becomes increasingly expensive as attention must operate over an ever growing KV cache. Page sparse at

model-releasesarxiv-cs-lg

6 Oct 2026

PACMI: Provenance-Aware Cascading Memory Invalidation for Long-Term LLM Agents

arXiv:2610.05732v1 Announce Type: new Abstract: LLM agents rely on long-term memory to retain and reuse information when performing tasks over long horizons. Existing methods provide limited support f

Paradee: Distilling Kokoro-82M into an 8M-Parameter Single-Voice Text-to-Speech Model

arXiv:2610.06817v1 Announce Type: cross Abstract: We distill Kokoro-82M, a widely used open text-to-speech model with 54 voices, into Paradee, an 8.07M-parameter model that speaks one of them. Paradee

Parameter Estimation in Machining Dynamics with Regenerative Delay and Nonsmooth Friction using Physics-Informed Neural Networks

arXiv:2610.06230v1 Announce Type: new Abstract: A multi-domain eXtended Physics-Informed Neural Network (XPINN) framework is developed for nonsmooth Delay Differential Equations (DDEs). This is the fi

Path Laplacian Encodings for Directed Graphs

arXiv:2610.04657v1 Announce Type: new Abstract: Directed graphs naturally model many real-world systems in which interactions are asymmetric, such as citation networks, web graphs, and information-flo

Periscope: Extending Frozen Language Models Beyond Their Context Window

arXiv:2610.04047v1 Announce Type: cross Abstract: A language model reads long text in one quadratic forward pass, stops at the context window, and loses accuracy with length before reaching it. We ask

Physics-Augmented Graph Transformers for Patch-Antenna Forward and Inverse Design

arXiv:2610.05004v1 Announce Type: new Abstract: Full-wave electromagnetic (EM) simulation enables accurate patch-antenna analysis but is computationally expensive for large-scale forward prediction an

PixReenact: Pixel-Conditioned Causal Video Diffusion for Streaming Head-Avatar Reenactment

arXiv:2610.05233v1 Announce Type: new Abstract: Streaming head-avatar reenactment aims to animate a reference image according to a live driving video, requiring robust motion transfer, long-term ident

PlotGround: Grounding Plot Digitization in Real Scientific Figures and Their Source Data

arXiv:2610.06825v1 Announce Type: cross Abstract: Scientific figures often encode quantitative results that are not readily available in machine-readable form, making accurate plot digitization import

PortraitAes: Intent-Conditioned Structured Portrait Aesthetics Assessment

arXiv:2610.05010v1 Announce Type: new Abstract: Portrait aesthetic assessment assigns comparable scores according to how effectively human-centered images fulfill their photographic intent. These scor

Priced Guidance: Can Language Models Generate Future Research Ideas?

arXiv:2610.04976v1 Announce Type: new Abstract: We evaluate language models' capability to generate novel research ideas through the lens of compression. We aim to lower-bound the potentially tiny pro

Probabilistic Pedestrian Forecasts from a Handheld Phone: World-Frame Heat Maps, Visual-Inertial Height Drift, and Evaluation without Ground Truth

arXiv:2610.04736v1 Announce Type: new Abstract: A pedestrian with a phone could be shown where nearby people will be in the next few seconds, if the forecast stays on the ground while the phone moves,

ProbeFlow: Training-Free Adaptive Flow Matching for Vision-Language-Action Models

arXiv:2603.17850v2 Announce Type: replace Abstract: Recent Vision-Language-Action (VLA) models equipped with Flow Matching (FM) action heads achieve state-of-the-art performance in complex robot manip

Propagating Elevation-Map Uncertainty Through the Contact Maximum in Closed Form

arXiv:2610.06103v1 Announce Type: new Abstract: Risk-aware planners score paths on uncertain elevation maps using the path cost's mean and standard deviation. Modeling rigid contact, however, requires

Quantum Information Ordering and Differential Privacy

arXiv:2511.01467v4 Announce Type: replace-cross Abstract: We study quantum differential privacy (QDP) by defining a notion of the order of informativeness between two pairs of quantum states. In parti

RAC: Rectified Flow Auto Coder

arXiv:2603.05925v2 Announce Type: replace Abstract: In this paper, we propose a Rectified Flow Auto Coder (RAC) inspired by Rectified Flow to replace the traditional VAE: 1. It achieves multi-step dec

Radar2Plan: Benchmarking 4D Radar for End-to-End Open-Loop Ego-Trajectory Planning

arXiv:2610.06121v1 Announce Type: new Abstract: Adverse weather and poor illumination remain major challenges for robust ego-trajectory planning in mobile autonomy. 4D radar offers reliable sensing un

Ranking Bandits for Carousel Interfaces with Observable Browsing Depth

arXiv:2610.05220v1 Announce Type: new Abstract: Carousel interfaces allow a recommender system to directly observe how far a user has browsed. This signal distinguishes displayed but unclicked items f

REBASE: Reference-Background Subspace Elimination for Training-Free In-Context Segmentation

arXiv:2607.09082v2 Announce Type: replace Abstract: Training-free in-context segmentation enables new object categories to be introduced at inference time from a single annotated reference image, elim

RefAtomNet++: Advancing Referring Atomic Video Action Recognition using Multi-Trajectory Semantic Retrieval

arXiv:2510.16444v2 Announce Type: replace Abstract: Who is being described, where are they, and what are they doing? Referring Atomic Video Action Recognition (RAVAR) answers these questions jointly b

Reflection-Robust 6DoF Object Tracking with Light Fields

arXiv:2610.04883v1 Announce Type: new Abstract: Tracking the 6DoF pose of a moving rigid object is fundamental to robotics and autonomous driving, but existing trackers assume that object appearance i

Reinforcement Learning-Based Optimization of Workload-Aware Power Delivery Networks

arXiv:2610.06148v1 Announce Type: cross Abstract: Power Delivery Networks (PDNs) are critical components of modern VLSI chips, providing stable voltage levels while satisfying electromigration (EM) an

Reinforcement Learning on the Discrete Composition Channel of a Crystal Generator: Validated Gains and Reward Hacking

arXiv:2610.03880v1 Announce Type: new Abstract: Inverse materials design is a long-standing goal of computational materials discovery. Generative models for crystalline materials are typically trained

ReMAP: Restoring the Perceptual Cycle with Reasoning-Time Latent Visual Memory

arXiv:2610.05097v1 Announce Type: new Abstract: As multimodal large language models (MLLMs) reason for longer, attention to the initial visual input diminishes, weakening visual grounding. Visual memo

RepICL: Reusable In-Context Prediction Across Heterogeneous Representation Spaces

arXiv:2610.05852v1 Announce Type: new Abstract: Frozen representations are widely reused for downstream classification, yet each new task typically requires fitting a new predictor. We ask whether the

Representation--Behavior Alignment for Explainable Weakly-Supervised Video Anomaly Detection

arXiv:2610.05129v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) provide a natural way to make video anomaly detection more explainable. However, their final decisions do not a

Revisiting Label-Free Speaker Embedding Enhancement with vMF Profile Likelihood

arXiv:2610.06691v1 Announce Type: cross Abstract: Embedding enhancement improves speaker verification under acoustic mismatch without modifying a frozen backbone. Recent work has established a practic

Riemannian Shape Analysis of the Corpus Callosum in Kendall Space: Aging and Alzheimer's Disease

arXiv:2610.05326v1 Announce Type: new Abstract: The corpus callosum (CC) is a major white-matter structure and a well-established marker of brain aging, but most studies quantify it using scalar summa

RMMBench: A Comprehensive Benchmark for Robotic Mobile Manipulation

arXiv:2610.05414v1 Announce Type: new Abstract: Although the advancement of vision-language models (VLMs) has endowed robots with enhanced environmental understanding and task reasoning, a comprehensi

Robust Parameter-Efficient LLM Adaptation on Analog Hardware

arXiv:2610.05318v1 Announce Type: new Abstract: Analog in-memory computing is a promising platform for on-device execution of large language models because it performs matrix--vector multiplications (

Robust Surgical Robotic Instrument Tracking via Sequential Multi-Cue Fusion and Sim-to-Real Self-Training

arXiv:2610.05491v1 Announce Type: cross Abstract: Efficient and robust tracking of surgical robotic instruments is important for robot-assisted minimally invasive surgery, yet remains challenging due

RoSA: Rotational Sparse Adaptation for Memory-Efficient Fine-Tuning

arXiv:2610.06243v1 Announce Type: new Abstract: Parameter-efficient fine-tuning (PEFT) reduces the cost of adapting foundation models by focusing training on a small parameter subset. Complementary to

Rotated, but How Far? Diagnosing and Improving Object-Rotation Reasoning in VLMs

arXiv:2610.05715v1 Announce Type: new Abstract: Vision-language models (VLMs) can detect that an object has rotated across views, but cannot reliably tell by how much. We introduce OR-Bench, a fine-gr

Round-Trip KNN Clustering: multiscale hierarchical cluster detection on directed nearest-neighbour graphs

arXiv:2610.06795v1 Announce Type: new Abstract: We introduce Round-Trip KNN Clustering (RTKNNC), a graph-based method for finding cluster structure at several neighbourhood scales without requiring th

Routing-Aware Safety Alignment for Mixture-of-Experts Models

arXiv:2602.04448v3 Announce Type: replace Abstract: Mixture-of-Experts (MoE) language models introduce unique challenges for safety alignment due to their sparse routing mechanisms, which can enable d

RSure-Agent: Reliable Use of Tool Observations for Remote Sensing Agents

arXiv:2610.04836v1 Announce Type: new Abstract: Remote sensing agents rely on perception, measurement, and raster analysis tools to solve Earth observation tasks. We refer to their judgments and quant

Safe Image Generation via Reinforcement Learning

arXiv:2610.05908v1 Announce Type: new Abstract: Recent Text-to-Image (T2I) models achieve remarkable visual image generation performance, but they can still generate NSFW (Not-Safe-For-Work) contents,

SALUS: Automated Auditing of NL-to-SQL Benchmarks through Weak Supervision of Multi-Agent Output

arXiv:2610.05540v1 Announce Type: cross Abstract: Natural language to SQL (NL-to-SQL) benchmarks are foundational to progress in data analysis research, yet recent work has shown that widely-used benc

Same Output, Different Gold: Measuring How Reference Choice Moves a Multilingual Benchmark Score

arXiv:2610.03825v1 Announce Type: cross Abstract: A benchmark score compares a system output against a reference, and methodological attention falls almost entirely on the first term. We measure the s

Same Pieces, Different Servers: A Tetris Benchmark for AI Agents as Served

arXiv:2603.02348v2 Announce Type: replace Abstract: An agent meets a model as served: through an endpoint with a price card, a shared cache and other tenants, or on whatever hardware a self-hosted mod

Sampling Allocation of LinUCB: Optimal Design Limits in the Small-Gap Regime

arXiv:2610.06213v1 Announce Type: new Abstract: We study the sampling allocation of LinUCB in the small-gap regime, where the reward gaps are of order at most n^{-1/2} over the decision horizon n. Thi

Saying, Not Knowing: Aggressively GGUF-Quantized Small Language Models Still Write Rare Words They Can No Longer Define

arXiv:2610.04403v1 Announce Type: cross Abstract: Post-training quantization to the GGUF format's mixed-precision K-quants is commonly how open-weight language models reach consumer hardware, yet its

Scaling Down the Scaling Laws: Parameter Efficiency and Compute-Optimal Training in Resource-Constrained Large Language Models

arXiv:2610.06387v1 Announce Type: new Abstract: Large language models (LLMs) have achieved substantial performance gains through increases in model size, training data, and computational resources. Ho

Selective Backpropagation for Efficient Few-Shot Class-Incremental Learning

arXiv:2610.04003v1 Announce Type: cross Abstract: Few-Shot Class-Incremental Learning (FSCIL) requires models to continuously learn new classes from limited samples while retaining prior knowledge, un

Self-Reflection Fine-Tuning: Enhancing Agent Security against Prompt Injection Attacks from Failure Experience

arXiv:2610.04269v1 Announce Type: new Abstract: Large language model (LLM) agents are increasingly deployed in tool-augmented environments, but their reliance on external inputs makes them highly vuln

SemCam: Semantic Camera Motion Control for Video Generation

arXiv:2610.05141v1 Announce Type: new Abstract: Controlling the camera relative to a moving subject in an existing video is challenging: behaviors such as maintaining a frontal view require the camera

Separators Make Carry Propagation Learnable:The Geometry of Latent Carry in a Multiplication Transformer

arXiv:2610.06605v1 Announce Type: new Abstract: Transformers asked to multiply multi-digit numbers in a single forward pass often fail, and interpretability studies of pretrained language models find