Search: “benchmark”

Beyond Marginal Monitoring: Distributed Joint-Distribution Testing for Data Concept Drift in Large Scale E-Commerce Operations

arXiv:2610.08132v1 Announce Type: cross Abstract: Concept drift threatens production machine learning, yet the empirical behavior of multivariate two-sample drift detectors at scale remains under-char

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

CheckerBench: Can Long-Horizon Agents Synthesize Static-Analysis Checkers?

DGX agent

arXiv:2610.07557v1 Announce Type: cross Abstract: Static-analysis checker synthesis requires agents to interpret a defect specification, inspect a repository, implement analyzer-specific logic, and re

model-releasesarxiv-cs-ai

7 Oct 2026

Research

COMPASS: Finding Where Reasoning Lives in Language Models

arXiv:2610.07469v1 Announce Type: new Abstract: Explicitly eliciting reasoning substantially improves LLM performance. Existing approaches require a predefined characterization of reasoning, whether t

researcharxiv-cs-ai

Defense-in-Depth for LLMs: Evaluating Memory Gates Against Activation-Induced and Memory-Induced Sycophancy

arXiv:2610.07403v1 Announce Type: new Abstract: Long-term memory allows Large Language Models (LLMs) to maintain personalized context across interactions, but retrieved user history can induce memory-

Early Memory Selection for Balanced Adam

arXiv:2610.08624v1 Announce Type: cross Abstract: We propose a method for choosing the shared memory parameter eta_1=eta_2=eta in Adam from a short pilot training. The selected eta remains fixed durin

Evaluating Inference Compute for Generative AI: A Framework for Enterprise Workloads

arXiv:2610.07094v1 Announce Type: cross Abstract: LLM deployment is shifting from single-turn completion to agentic trajectories in which a model plans, calls tools, reads results and reasons at test

Forensic Reserve: Eliciting Latent Knowledge for Image Forgery Detection

arXiv:2610.08639v1 Announce Type: new Abstract: As generated images become increasingly realistic, reliable forgery detection is essential for maintaining trust in visual information. However, existin

GIVE-KWS: Gated Injection of Visual Evidence for Noise-Robust Query-by-Example Keyword Spotting

model-releasesarxiv-cs-cl

arXiv:2610.07046v1 Announce Type: cross Abstract: Visual speech promises noise-robust keyword spotting, yet a visual stream is not necessarily used. On a tri-modal query-by-example keyword spotting (Q

Safety

Graph-Based Recognition of Simulated Train-Driver States From Facial and Upper-Body Keypoints

arXiv:2610.07083v1 Announce Type: cross Abstract: Driver fatigue poses a significant challenge to railway safety, with traditional systems like the dead-man switch offering limited and basic alertness

safetyarxiv-cs-ai

Large Pretraining Datasets Don't Guarantee Robustness after Fine-Tuning in Image Classification

arXiv:2410.21582v4 Announce Type: replace-cross Abstract: Large-scale pretrained models are widely leveraged as foundations for learning new specialized tasks via fine-tuning, with the goal of maintai

Safety

Latent space bias directions in LLMs capture confidence, not fairness

arXiv:2610.08559v1 Announce Type: cross Abstract: Activation steering has gained popularity as a lightweight inference-time debiasing technique for large language models. However, prior work reports t

safetyarxiv-cs-ai

Learn2Play Bench: How Well Do LLM Agents Learn from Experience in Unfamiliar Environments?

arXiv:2610.08215v1 Announce Type: new Abstract: Learning from experience is essential for LLM agents to adapt to unfamiliar and dynmaic environments. Evaluating this ability is therefore important for

Learning When to Refine: Long-Horizon Reinforcement Learning for Budgeted Neural-Operator PDE Solvers

arXiv:2610.06883v1 Announce Type: cross Abstract: Neural operators provide fast surrogates for time-dependent PDEs, but autoregressive deployment creates a refinement-allocation problem: prediction er

Local Qwen 3.8 27B vs DeepSeek Flash API: Is local good enough?

model-releasesr-localllama

Running a model on your own machine used to be a privacy story with a quality tax. On this generation that trade has narrowed to where we can state it plainly: for daily work, the local model is good

MASC: A Multi-Agent Self-Calibration Framework with Latent Construct Alignment for Consistent Client Role-Playing in Psychological Counseling

arXiv:2610.08250v1 Announce Type: new Abstract: Large language models are increasingly used to simulate clients for counselor training and psychological counseling research, but reliable simulation re

MedHorizon: Towards Long-context Medical Video Understanding in the Wild

arXiv:2605.06537v2 Announce Type: replace Abstract: Medical multimodal large language models (MLLMs) have advanced image understanding and short-video analysis, but real clinical review often requires

MINDSET: Energy-based Schema Evolution for Long Conversational Agent Memory

arXiv:2610.08586v1 Announce Type: new Abstract: Long conversational agents have become essential in our daily lives. They must remember what was said long back in order to help us efficiently complete

Navigation with RF Cues: Embodied Perception Action under Multipath Uncertainty

model-releasesarxiv-cs-ro

arXiv:2610.08105v1 Announce Type: new Abstract: Smart factory inspection requires robots to reach connected equipment without a prior map or known target coordinates. Radio frequency (RF) signals from

OMIT the Action: Measuring Framing-Invariant Omission Bias under Philosophical Disagreement

model-releasesarxiv-cs-cl

arXiv:2610.07847v1 Announce Type: new Abstract: As LLMs increasingly assist in moral reasoning, omission bias, the tendency to prefer inaction even when equivalent framings reverse substantive outcome

On Open-Ended Information Seeking for Information Elicitation Agents

arXiv:2610.07509v1 Announce Type: new Abstract: Information elicitation is an open-ended information-seeking problem in which an interaction can unfold in many potentially valuable directions, requiri

OOPMAS: Object-Oriented Multi-Agent Systems for Query-Level Workflow Generation

arXiv:2610.07787v1 Announce Type: new Abstract: Multi-agent systems (MAS) powered by large language models have shown strong performance across code generation, mathematical reasoning, and question an

Qwen 3.6 35B and indentation

Seems like a bit of a long shot, but since it’s so mystifying I figured I might as well ask: I have been trying to get Qwen 3.6 35B to function as a local implementation agent in my subagent driven de

model-releasesr-ollama

Rethinking Visual Provenance: Detection and Watermarking Across Direct Visual Generation and LLM-Driven Code Rendering

arXiv:2610.08137v1 Announce Type: cross Abstract: AI systems create images and videos with image/video generation models or by writing code and graphics descriptions that are then rendered. These rout

SAE++: Cascaded Sparse Autoencoders Learn Multi-Level Visual Concepts in Multimodal LLMs

arXiv:2606.16193v2 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) have demonstrated strong performance on vision-language tasks, yet their internal visual representati

Same Feedback, Different Answer: Measuring Run-to-Run Instability in Frontier-Model Customer Feedback Analysis

arXiv:2610.08036v1 Announce Type: new Abstract: AI agents are increasingly being programmed to automate knowledge work over large collections of unstructured data. Such automation requires repeatabili

SCOPE: Certified Theorem Proving with a Language Model as the Policy Planner

arXiv:2610.08319v1 Announce Type: new Abstract: In proof assistants such as Lean, a generated proof must pass machine compilation checks, so evaluation needs no human scoring. Direct generation fails

SpeedrunBench: Challenging LLM Agents with Video Game Speedrunning

arXiv:2610.08076v1 Announce Type: new Abstract: Frontier LLM agents have been shown to be capable of solving increasingly complex tasks for which humans have measurable solutions. This begs the pertin

SquidAgent: Parallelize Wisely, Coordinate Efficiently

arXiv:2610.08647v1 Announce Type: new Abstract: LLM-based agents solve complex multi-step tasks, but sequential execution incurs substantial latency. In principle, parallelizing work across multiple a

Safety

Structure-Aware Graph Abstention for Reliable Selective Forecasting

arXiv:2610.08322v1 Announce Type: new Abstract: Selective forecasting abstains on high-risk test windows under a retained-coverage budget. Existing gates such as TEM (Brusokas et al., 2025) score each

safetyarxiv-cs-lg

Tested in Coding: Strata

model-releasesr-localllama

This will be a potentially unpopular post - but it's the truth and grounded - so let's get to it. Hopefully you are familiar with my previous Tested in Coding series: https://www.reddit.com/r/LocalLLa

Thin Evidence, Thick Priors: How Language Models Substitute Identity for Missing Financial Facts

arXiv:2610.07798v1 Announce Type: new Abstract: People increasingly ask large language models what to do with their money, yet seldom describe their finances in full. This paper asks what a model does

Today I’m excited to introduce OpenDocRouter - a unified API for document parsing with the latest frontier and open-weight models. There are…

model-releasesjerry-liu--x

Today I’m excited to introduce OpenDocRouter - a unified API for document parsing with the latest frontier and open-weight models. There are a lot of VLMs and OCR models that can be used for document

Agents

Token-Efficient Multi-Agent Collaboration via System One-Guided Computational Division of Labor

arXiv:2610.08155v1 Announce Type: cross Abstract: Large language model (LLM)-based multi-agent systems (MAS) have become a promising paradigm for complex information-seeking and reasoning tasks by ena

agentsarxiv-cs-ai

UniCounting: Instance-Aware Proposal Consolidation for Image-Query-Free Multi-Category Counting

arXiv:2610.08379v1 Announce Type: new Abstract: Visual counting is commonly formulated as counting a single specified target, with a model receiving an image-specific exemplar, text query, or target c

Universe of Thoughts: A Computational Framework for Creative Reasoning in Large Language Models

arXiv:2511.20471v3 Announce Type: replace Abstract: Recent advances in Large Language Model (LLM) reasoning have improved conventional problem solving, but creative reasoning remains comparatively und

Visual Abstention in Unified Multimodal Models

arXiv:2610.07887v1 Announce Type: cross Abstract: Unified multimodal models (UMMs) integrate understanding and generation, yet their generative behavior is rarely governed by what they understand abou

WareFly-VLA: A Vision-Language-Action Framework for UAV Navigation and Human Tracking in Smart Warehouses

arXiv:2610.08526v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have achieved impressive results in robotic manipulation and ground-mobile navigation, yet language-conditioned co

World Properties without World Models: Distributional Associations and the Interpretation of Decoding Results from Language Models

arXiv:2603.04317v2 Announce Type: replace-cross Abstract: A growing literature shows that variables can be linearly decoded from the activations of large language models (LLMs). These range from prope

Adaptive-Shot Hybrid Quantum Anomaly Detection for Tactile Internet Security: Reliability-Aware Measurement Allocation Under Resource Constraints

arXiv:2610.05835v1 Announce Type: cross Abstract: Tactile Internet (TI) security analytics must balance reliable thresholded decisions with constrained computational and measurement resources. We stud

AIProver: Agentic Auto-Formalization of Mathematical Research via Certificate-Driven Evolving Harness

arXiv:2610.05367v1 Announce Type: cross Abstract: Proof auto-formalization translates natural-language (NL) theorems and proofs into a formal language (FL) such as Lean, enabling mechanical verificati

ALoDLM: Adaptively Looped Diffusion Language Models

arXiv:2610.04198v1 Announce Type: cross Abstract: Diffusion language models (DLMs) enable fast generation by predicting multiple tokens in parallel, but their practical adoption remains limited by a p

Aplomb 1: open-weights 5.3B decision model, 1M context, text/image/video/audio in one request, #1 among 4B models on the Decision Index

model-releasesr-localllama

We released Aplomb 1 today, a 5.3B decision model with open weights. It reads up to 1M tokens of text, JSON, images, video and audio in a single request, and on our API it makes a decision on a 1M-tok

Asymptotically Optimal Best Arm Identification with Fixed-Budget under Differential Privacy

arXiv:2610.04600v1 Announce Type: new Abstract: Best arm identification under differential privacy is a pure-exploration problem in which both statistical efficiency and privacy protection must be ach

Bayesian Optimization in Sequence-to-Architecture Latent Space for Zero-Shot NAS

arXiv:2610.06167v1 Announce Type: new Abstract: Zero-shot Neural Architecture Search removes the prohibitive cost of traditional NAS, but its search process is typically based on the evolutionary algo

ColdDDI: Evaluating Knowledge Utilization in Cold-Start Drug-Drug Interaction Prediction

arXiv:2610.05590v1 Announce Type: new Abstract: Cold-start drug-drug interaction (DDI) prediction tests whether models can identify clinically significant interactions for drugs without training-time

Component-Level Evaluation of Adaptive PINN Training for CFD-Oriented Crystal Growth Simulation

arXiv:2610.05127v1 Announce Type: new Abstract: Physics-informed neural network (PINN) training minimizes a weighted combination of partial differential equation (PDE), boundary-condition, and initial

Constrained Goal-directed Planar Graph Generation with Grammar-based Reinforcement Learning

arXiv:2610.06244v1 Announce Type: new Abstract: Planar graphs are central to applications across science and engineering, yet existing generators provide limited support for goal-directed generation u

Continual Action Quality Assessment via Adaptive Manifold-Aligned Graph Regularization

arXiv:2510.06842v2 Announce Type: replace Abstract: Action Quality Assessment (AQA) quantifies human actions in videos, supporting applications in sports scoring, rehabilitation, and skill evaluation.