All entries

What Can a Leaderboard Certify? Compositional Controllability for Fair Evaluation and Training of Biomedical Literature-Review Agents

arXiv:2609.32318v1 Announce Type: new Abstract: Leaderboards rank long-horizon agents by their final outputs. Yet a higher score alone does not establish whether two systems are comparable or which st

Content type

All Blog X Post Paper YouTube Reddit GitHub

Local Ai

What Do Latent Predictive Vehicle Representations Retain? Measuring State, Geometry, and Local Response

DGX agent

arXiv:2609.32512v1 Announce Type: new Abstract: Models of vehicle dynamics learned from logged states and commands complement physics-based models, and latent world models, which predict in a learned

local-aiarxiv-cs-lg

29 Sept 2026

What Does a ProcGen Generalization Gap Measure? Action Rules, Convergence, and the Missing Random Floor

arXiv:2609.32532v1 Announce Type: new Abstract: A generalization gap in reinforcement learning (return on training levels minus return on held-out levels) is usually reported without a reference point

What Does a Stream Model Buy You in Flow Matching?

arXiv:2609.34123v1 Announce Type: new Abstract: Stream-level flow matching replaces the linear interpolant of conditional flow matching (CFM) by a Gaussian-process (GP) stream connecting each source--

What does FFN compression change downstream? Same-state causal restoration in diffusion language models

arXiv:2609.31685v1 Announce Type: new Abstract: Diffusion language models (DLMs) enable flexible, parallel generation, but their iterative denoising remains computationally expensive, motivating incre

What Does Model Growth Really Add? Functional Capacity Beyond Parameter Count

arXiv:2607.14571v2 Announce Type: replace Abstract: Model growth adds parameters to a trained checkpoint and continues training, aiming to increase capacity while reusing the existing model instead of

What Does the Rank Buy? A Spectral and Distributional Analysis of Low-Rank Adaptation

arXiv:2609.32002v1 Announce Type: cross Abstract: The rank r in LoRA is widely treated as a capacity control: a smaller rank is assumed to yield a simpler model that generalizes better. We show that,

Agents

What everyone was talking about at WeAreDevelopers World Congress North America

After 237 talks across eight stages, code review emerged as the bottleneck for AI-generated code. Here are the production eval, sandbox, context, and agent experience themes that kept showing up. The

agentsarize-ai

What is a way to test human-level generality in artificial intelligence? 'The meta-benchmark of being able to pass ARC-AGI-(n+1) immediately…

model-releasesfrancois-chollet--x

What is a way to test human-level generality in artificial intelligence? 'The meta-benchmark of being able to pass ARC-AGI-(n+1) immediately upon release' @Jabaluck @DAcemogluMIT The meta-benchmark of

Applications

What Makes World Action Models Generalize? An Empirical Study of Test-Time Future Modeling

arXiv:2609.34981v1 Announce Type: new Abstract: World action models (WAMs) predict the future alongside actions during training. Due to the heavy computation cost of video denoising, whether the futur

applicationsarxiv-cs-cv

What masking geometry works best for EEG foundation models?

arXiv:2609.33487v1 Announce Type: new Abstract: EEG foundation models hold promise for scalable brain-signal decoding across clinical and cognitive neuroscience applications, yet their pre-training pi

What Must a World Model Distinguish for Planning?

arXiv:2609.33030v1 Announce Type: new Abstract: World models simulate the consequences of action candidates, but good planning need not preserve every physical distinction required for accurate predic

What Next-Event Accuracy Cannot See: Closed-Loop Evaluation of Emergency Department Trajectory Simulators

arXiv:2609.31635v1 Announce Type: new Abstract: Clinical trajectory models are usually evaluated by next-event accuracy on observed histories. Simulation is different: models must condition on their o

What Paired Evaluations Reveal under Visual Perturbations

arXiv:2609.35583v1 Announce Type: new Abstract: Robustness evaluation must examine diverse visual perturbations, while benchmarks cover only some real-world conditions and physical testing is costly.

Tutorials

What Should a Streaming Video Model Remember?

arXiv:2606.16353v2 Announce Type: replace Abstract: Streaming video understanding models must answer queries at any moment during an ongoing stream, using only what they have observed so far and under

tutorialsarxiv-cs-cv

What Should Data Teach? Moving Bottlenecks Across Circuit, Store, and Use

arXiv:2609.32991v1 Announce Type: new Abstract: What should data teach a language model at a particular point in training? A circuit view reveals three distinct bottlenecks: forming a computation, mak

What Should Federated LoRA Share? FedSAIL via Input-aware Subspace Alignment

arXiv:2609.32485v1 Announce Type: new Abstract: Federated low-rank adaptation (LoRA) requires identifying an update structure that is shared across heterogeneous clients. Prior work reports strong sim

What Should the Reflector See? An Empirical Study of Evidence in Reflective Prompt Optimization

arXiv:2609.32452v1 Announce Type: cross Abstract: Reflective prompt optimization revises instructions using examples of a model's behavior, but which evidence the reflector should receive remains uncl

What Should We Freeze? Guarded Freezing: Connectivity Shapes the Fine-Tuning of Pretrained Models

arXiv:2609.32124v1 Announce Type: new Abstract: When adapting pre-trained models through fine-tuning, freezing weights alone might not preserve performance, as updates elsewhere can change the inputs

Agents

What Stops Recursive Self-Improvement in Robotics? Lessons from 123 Rounds of Agentic Skill Discovery

arXiv:2609.31760v1 Announce Type: cross Abstract: Can a robot improve itself the way coding agents now improve software? We built an agentic system to find out. It watches a robot fail, works out whic

agentsarxiv-cs-lg

What Survives the Codec Shift: Pooled No-Vocals Residuals for Speech Deepfake Detection

arXiv:2609.33375v1 Announce Type: cross Abstract: The transition from vocoder-based to neural-codec speech synthesis makes generalization more difficult for speech deepfake detectors, particularly tho

What Visual Generators Need from Teachers: Rethinking Representation Alignment

arXiv:2609.34732v1 Announce Type: new Abstract: Representation alignment speeds up diffusion transformer training by pulling an intermediate block of the model (student) toward features of a frozen pr

What Would Falsify It? A Variable Specific Evidence Standard for Mechanistic Claims About Self Explanation

arXiv:2609.32670v1 Announce Type: cross Abstract: When a language model explains an answer it has already given, does it reuse the computation that produced the answer or reconstruct a story from the

When an Evaluation Rule Writes Training Labels: Measuring Human-Reference Forgiveness in NAVSIM

model-releasesarxiv-cs-cv

arXiv:2609.33189v1 Announce Type: cross Abstract: When the human reference scores zero on a metric, the released GTRS-Dense label generator for NAVSIM marks every candidate trajectory in the scene as

When Better Gets Worse: Improvement Fidelity for Self-Improving Agents in Adaptive Worlds

arXiv:2609.32677v1 Announce Type: cross Abstract: Self-improving agents increasingly rely on proxy verifiers to choose policy updates, yet deployment can change the world in which those updates are ev

Tutorials

When Can Attention Heads Be Statically Defined?

arXiv:2609.34650v1 Announce Type: new Abstract: Some attention heads learn similar patterns across inputs. Reusing these patterns could reduce training cost by avoiding repeated query-key score comput

tutorialsarxiv-cs-lg

When Can Old Evaluations Certify a New Model? Label-Efficient Release Decisions under Evaluator Drift

arXiv:2609.32267v1 Announce Type: new Abstract: Releasing a model update requires certifying that its current-population risk stays below a threshold. Trusted labels are expensive, while a cheap evalu

When Can We Trust the Sparse Lens? A Certification Framework for SAE Faithfulness

arXiv:2606.18383v2 Announce Type: replace Abstract: Sparse autoencoders (SAEs) are increasingly used to study internal representations in language models (LMs), but it remains unclear when an SAE-base

When Do Model Internals Help? Exploring the Role of Representation Engineering in LLM Safety

arXiv:2609.34771v1 Announce Type: cross Abstract: Reliable AI safeguards require both control mechanisms that reduce unsafe behavior and monitoring mechanisms that detect safety risks during model int

When Do Models Admit They Are Wrong? Failure Disclosure Is Unstable Under Reinforcement Learning

arXiv:2609.33220v1 Announce Type: new Abstract: Outcome-based reinforcement learning can produce models with similar task performance but very different ways of communicating about their mistakes. We

When do Random Forests work?

arXiv:2504.12860v2 Announce Type: replace-cross Abstract: We study the effectiveness of randomizing split-directions in random forests. Prior literature has shown that, randomization can reduce varian

When Does an Image Determine the Answer? Benchmarking Visual Answerability across Charts and Scenes

model-releasesarxiv-cs-cv

arXiv:2609.34480v1 Announce Type: new Abstract: Reliable visual question answering requires correct answers when evidence is sufficient and abstention when it is not. We introduce a benchmark that con

When Does Backpropagating Through Policy Memory Matter? Physical Credit, Optimizer Updates, and Observability

arXiv:2609.33169v1 Announce Type: new Abstract: Policies with memory can learn along two backward paths: through the physical states their actions produce and through the representations they store. T

When Does Dense Retrieval Need Asymmetric Geometry? A Bias-Variance Theory of Shared and Dual Projections

arXiv:2609.32488v1 Announce Type: cross Abstract: Dense retrieval powers retrieval-augmented generation, semantic search, and question answering, yet the theoretical basis for choosing between shared

Tutorials

When Does Depth Matter For In-Context Learning? Adaptive Inference in Deep Transformers

arXiv:2606.16694v2 Announce Type: replace Abstract: Transformers perform computations through many successive attention and feedforward blocks, allowing them to learn complex correlations between a la

tutorialsarxiv-cs-lg

When Does Domain Adaptation Help on Physical Vibration Sensors? A Held-Out-Bearing Study of Neural-Operator and Convolutional Models

arXiv:2609.31639v1 Announce Type: new Abstract: Diagnosing rolling-element bearing faults from vibration is a canonical physical-sensing task and a widely used benchmark for domain adaptation under op

When Does Geometric View Synthesis Help Wine Label Retrieval? A Public One-Shot Benchmark Across Self-Supervised and Vision-Language Backbones

model-releasesarxiv-cs-cv

arXiv:2609.33359v1 Announce Type: new Abstract: Geometric view synthesis can expand a single wine-label photograph into a training set, but its value with pretrained image encoders is unclear. We stud

When Does Structured Knowledge Help Neural Theorem Proving?

arXiv:2609.34460v1 Announce Type: cross Abstract: Does structured mathematical knowledge help LLMs prove theorems in Lean 4? If so, for which models, and does the answer vary by problem? Formal librar

When Does Synergy Help Active Feature Acquisition? A PID-Based Study

arXiv:2609.32301v1 Announce Type: new Abstract: Active feature acquisition (AFA) sequentially selects informative features under budget constraints. However, existing policies rarely distinguish wheth

When Helpful Text Hurts: Option-Redirecting Bias in Vision-Language Models

arXiv:2609.32489v1 Announce Type: cross Abstract: In tri-modal visual question answering (VQA), auxiliary text is commonly used to complement visual and textual inputs, yet its reliability is often un

When Is an SAE Feature Interpretable? A Validation Ladder for EEG Foundation Models

arXiv:2609.34091v1 Announce Type: new Abstract: Sparse autoencoders (SAEs) decompose dense model activations into discrete latents, making individual features easy to interpret--and easy to misinterpr

When Keywords Drop but Classifiers Hold: Soft Refusals under KV Cache Compression

arXiv:2609.31678v1 Announce Type: new Abstract: KV cache compression is widely used for long context LLM inference under memory constraints, while deployed systems typically score refusals after gener

When Known Physics Helps Neural PDE Models: Residual Constraints Out-Regularize Generic Priors for Nonlinear Dynamics

arXiv:2609.34012v1 Announce Type: new Abstract: Neural PDE surrogates increasingly incorporate structural priors, yet it is often unclear whether their gains arise from physics-specific information or

Applications

When Less Compute Is More: Adaptive Early Exit Improves Pretrained Outlier Detection

arXiv:2609.32898v1 Announce Type: new Abstract: Pretrained tabular foundation models process every dataset at a fixed depth, with inference costs growing with dataset size. To address this, we present

applicationsarxiv-cs-lg

When Less Data Favors Smaller Teachers: Rethinking Teacher Capacity and Data Selection for Knowledge Distillation

arXiv:2609.34489v1 Announce Type: new Abstract: Data pruning reduces the training cost of knowledge distillation (KD). However, the preferred teacher capacity changes with the data budget: smaller tea

When local gains fail to transfer: Frozen Earth-observation embeddings across wildfires

arXiv:2609.34602v1 Announce Type: new Abstract: Frozen Earth-observation embeddings are judged almost entirely by spatially blocked cross-validation inside one study region. We show that this number d

When Noise Meets Long-Tail: Feature-Threshold Dual Calibration for Robust Pseudo-Labeling

arXiv:2609.33668v1 Announce Type: new Abstract: Pseudo-labeling has become a cornerstone of learning from unlabeled data in semantic segmentation. Yet its effectiveness drops sharply in real-world sce

When Privacy Moves ML-Mediated Decisions On Device: Information and Incentive Misalignment in Auctions

arXiv:2609.33312v1 Announce Type: cross Abstract: Moving ML-mediated decision making onto privacy-preserving clients decentralises the economic decision along with the inference. Shared budget constra