Search: “benchmark”

Discrete Annotation, Continuous Preference: Rethinking Supervision for Accurate and Generalizable Aesthetic Image Cropping

arXiv:2610.00582v1 Announce Type: new Abstract: Aesthetic image cropping aims to identify the optimal crop of an image in terms of aesthetics and composition. While supervision based on annotated data

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Do Better Scores Mean Better Physics? Physics-Grounded Explanations for Sim2Real Neural Operators

DGX agent

arXiv:2610.00415v1 Announce Type: new Abstract: Machine-learning surrogates accelerate physical simulation, but lower prediction error need not coincide with lower error in physically relevant flow st

model-releasesarxiv-cs-lg

2 Oct 2026

DuoMind: Enabling Distributed Multi-Robot Coordination with Semantic Communication

arXiv:2610.02161v1 Announce Type: cross Abstract: Vision-language models (VLMs) and vision-language-action models (VLAs) have recently driven rapid progress in general-purpose robots, yet most progres

Evidence-Gated Research: Statistically Controlled Model Adoption in Adaptive Search

arXiv:2610.01751v1 Announce Type: new Abstract: Adaptive model search is path dependent: once a challenger is adopted, it becomes the reference from which later candidates are generated. A statistical

Faynt: Scaling and Optimizing Policies for Competitive Melee

arXiv:2610.02144v1 Announce Type: new Abstract: We introduce Faynt, a family of 10M- and 75M-parameter Transformer policies for Super Smash Bros. Melee, each controlling all 26 characters with a singl

FedCKA: Representation-Guided Layer Personalization for Federated 3D Perception Across Driving Domains

arXiv:2610.01510v1 Announce Type: new Abstract: Robust perception in intelligent vehicles demands 3D object detectors that remain dependable under domain shifts, such as changes in time of day, locati

Finding the Right Fit: Model-Harness Interactions across Agent Tasks

arXiv:2610.00917v1 Announce Type: new Abstract: Choosing an agent system means choosing both a language model and the harness through which it acts. We ask whether a strong model, harness, or pairing

FlashDexRetarget: Accelerating Dexterous Manipulation Data Generation through Multi-Motion Retargeting

model-releasesarxiv-cs-ro

arXiv:2610.01849v1 Announce Type: new Abstract: Human hand-object demonstrations offer a reusable source of dexterous robot manipulation data, but transferring them across embodiments requires physica

Generalization Is Stability, Not Accuracy: Multi-Axis Evaluation of LLMs

arXiv:2610.01428v1 Announce Type: cross Abstract: Generalization in large language models (LLMs) is the ability to produce consistent and semantically stable outputs when the same input is expressed i

HiPhy: Hierarchical Alignment for Physically-Plausible Multi-Principle Video Generation

arXiv:2610.02197v1 Announce Type: new Abstract: Video generation models have achieved remarkable visual fidelity and have strong potential to become general-purpose world simulators. Despite this prog

How to implement long-term AI agent memory in AlloyDB and Memorystore for Valkey

model-releasesgoogle-cloud-ai

Enterprise AI agents need persistent memory to execute complex, multi-day workflows and long-horizon tasks. In this blog, we examine how a 2-tier memory architecture using Memorystore for Valkey for s

I spent 3 weeks testing local Qwen3.8 on the new low-latency SGLang/vLLM recipes: DFlash2 2.8x. Builds: RadixArk + Inferact 27B NVFP4, 27B BF16, orcarouter 27B Uncensored, Flash-Next NVFP4

Hey guys, Last time I tested Qwen3.8-Flash-Next on its own. This time I put three Qwen3.8 checkpoints through the same 10 tests on the same RTX PRO 6000: RadixArk/Qwen3.8-27B-NVFP4 (dense) orcarouter/

Interpreting Reasoning of Large Language Models via Partial Information Decomposition

arXiv:2610.00571v1 Announce Type: cross Abstract: Large reasoning models (LRMs) have achieved substantial improvements in solving complex mathematical problems, but often produce lengthy, repetitive,

JoinGR: Learning to Traverse Join Graphs for Table Retrieval

arXiv:2610.01064v1 Announce Type: cross Abstract: Retrieving the right tables is a prerequisite for Text-to-SQL over realistic databases. Dense table retrievers rank schema elements independently, but

Learning to Sell: Reinforcement Learning for Strategic Large Language Model Agents in Multi-Product Markets

arXiv:2609.33289v2 Announce Type: replace Abstract: Autonomous large language model (LLM) agents operating in multi-product markets must make sequential decisions under information asymmetry and resou

Legal Research Bench: Measuring End-to-End Reliability in Long-Horizon Legal Research Agents

arXiv:2610.00609v1 Announce Type: new Abstract: Legal research is a core and time-consuming legal workflow. Lawyers must identify controlling authority, verify that it remains valid, reconcile statute

Research

Let the Heads Talk: Beyond Diagonal Graph Attention

arXiv:2610.01494v1 Announce Type: new Abstract: Sheaf Neural Networks generalize scalar-weighted message passing by replacing scalar edge weights with linear transport maps between local feature space

researcharxiv-cs-lg

Match the Distribution, Not the Compute: Post-Training Multi-Token Prediction Heads

arXiv:2610.00888v1 Announce Type: cross Abstract: Multi-token prediction (MTP) improves the throughput of autoregressive generation by enabling the language model to draft multiple next tokens per for

MCRI: A Four-Dimensional Framework for Analyzing and Evaluating Agent Skills

arXiv:2610.01506v1 Announce Type: new Abstract: As agents evolve from single-tool systems into modular, composite architectures, skills are becoming an important mechanism for capability development a

Mem++: Non-Destructive Memory for Long-Term Organizational LLM Agents

arXiv:2610.02002v1 Announce Type: cross Abstract: Large Language Model (LLM) agents now take part in organizational work, where many authors record decisions across documents over months. Because a re

Memorizon: Training World Models Beyond Their Context Window

arXiv:2610.00544v1 Announce Type: new Abstract: Streaming world models should render a place consistently across repeated visits. Directly supervising such revisits requires training samples that capt

Mingbird: A Local-First Agent Harness Enabling Small Open Models to Complete Real Tasks

arXiv:2610.02001v1 Announce Type: new Abstract: Small open-weight models (2-9B) run on ordinary laptops, but under cloud-scale agent harnesses they rarely complete real tasks: tool prefill overflows t

MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoning

arXiv:2610.01352v1 Announce Type: new Abstract: Open multimodal reasoning models have benefited from large-scale reasoning supervision, yet reliable post-training remains challenging due to uneven dat

MosaiChunk: Compositing Spatio-Temporal Memory for Autoregressive Video Generation

arXiv:2610.02153v1 Announce Type: new Abstract: Long-horizon autoregressive video generation is limited by a finite context window. When an object or scene falls out of context, its fine-grained visua

Not Too Hard, Not Too Easy: Learning from Intermediate States for LLM Structured Reasoning

arXiv:2609.33149v2 Announce Type: replace Abstract: A common principle of effective learning is to practice material that is neither already mastered nor too difficult to permit progress. We ask how t

Research

OmniMed-Jev: Calibrating LVLM Confidence for Trustworthy Medical Multimodal Decisions via System One

arXiv:2610.00381v1 Announce Type: new Abstract: Medical models are judged not only on correctness, but on whether reported confidence matches actual accuracy. Generalist multimodal medical models have

researcharxiv-cs-lg

On the Divergence of Accuracy and Mechanism Consistency in Time Series World Models

arXiv:2610.01842v1 Announce Type: new Abstract: A time series world model (TSWM) predicts a controlled system's state from its observed history and planned actions and exogenous inputs. Current approa

One-Step Generative Modeling via Training Dynamics Action

arXiv:2610.00518v1 Announce Type: new Abstract: One-step generative models construct a static generator through iterative training-time transport. Existing transport objectives primarily assess distri

PhysicsLENS: Diagnosing Physical Property Blindness in Video Generation Models

arXiv:2610.01162v1 Announce Type: new Abstract: Reliable video world models could provide scalable predictive environments for robot learning, planning, and evaluation. However, generated robot videos

Quantifying Diversity of Thought: A Predictive Law of Weighted LLM Ensemble Lift

arXiv:2607.17384v3 Announce Type: replace Abstract: This paper provides an experimentally verified formal law for calculating the uplift that diversity of thought provides in Large Language Model (LLM

Qwen3.8-27B-Humanlike-Chat 2.0: texts like a human, now with tool calls and better instruction following

Last month I posted a Qwen3.8-27B LoRA that makes it talk like a person instead of an assistant. It got a lot more attention than I expected: 700+ upvotes, 248 comments and 44k downloads since. I read

Reachability-Informed Reinforcement Learning for Multi-Impulse Interplanetary Transfers

arXiv:2610.01344v1 Announce Type: cross Abstract: Reinforcement learning offers the prospect of a reusable sequential decision-making mechanism for spacecraft trajectory design, motivating policy inte

Self-hosting AI does not save money, and I do it anyway

Hi folks, I'm a long-time lurker and big fan of this subreddit and a massive self-hosting fan (also outside of AI). I doubt many people will disagree with me here because I see the same arguments bein

Should we plead opensource labs to still produce great non thinking (instruct) models?

The results are in, no thinking / instruct mode for new models degrade performance more than on old models such as 3.6 vs 3.8, where 3.6 takes the lead on several coding benches in instruct mode. I wo

Research

Structure-agnostic Causal Representation Learning

arXiv:2610.00968v1 Announce Type: cross Abstract: Causal representation learning aims to discover robust features by exploiting the causal structure underlying data generation. Existing methods requir

researcharxiv-cs-ai

SyntheticHLS: Building Diverse Synthetic High-Level Synthesis Datasets using LLMs

arXiv:2610.00106v1 Announce Type: cross Abstract: Deep learning and large language models (LLMs) are rapidly gaining adoption in semiconductor design, driving demand for training datasets. Most effort

The Delegation Danger Band: Why Mid-Capability Sub-Agents Over-Trust Inherited Stale State

arXiv:2610.00041v1 Announce Type: cross Abstract: Agent frameworks increasingly delegate work by forking sub-agents; a common default makes the child inherit the parent's full working context. We meas

The Missing Primitive: Diagnosing and Repairing Mathematical Reasoning in Large Language Models

arXiv:2610.02191v1 Announce Type: new Abstract: While Large Language Models (LLMs) have demonstrated striking capabilities on frontier mathematical problems, it remains unclear whether they possess th

UnifiedAttack: Evaluating the Safety of Large Multimodal Models in Synergistic Harmful Image-Text Generation

arXiv:2610.00341v1 Announce Type: cross Abstract: As Large Multimodal Models (LMMs) transition toward natively unified architectures, evaluating their safety in synergistic harmful image-text generati

VIEScore2: Unified Image Evaluation with Spatially Grounded Explanations

arXiv:2610.00994v1 Announce Type: new Abstract: Existing synthetic image evaluators typically provide only a scalar quality score and do not identify the image regions that support it. We introduce VI

Weather-Aware Domain Adaptation for Street-View Weather Recognition

arXiv:2610.02000v1 Announce Type: new Abstract: Adverse conditions such as rain, snow, fog, and dust remain challenging for camera-based perception in autonomous driving. We study multi-class weather

When the Judge Acts: Auditing VLM-Guided Image Selection on Culturally Situated Prompts

arXiv:2610.01243v1 Announce Type: cross Abstract: Vision-language models (VLMs) increasingly act as judges that pick the best of several generated images, so their choices decide what users see. Such

Safety

Where-OPD: Spatially Guided On-Policy Self-Distillation of MLLMs with Synthetic Scenes

arXiv:2610.02117v1 Announce Type: cross Abstract: On-policy self-distillation has recently emerged as an effective approach for improving language-model reasoning by supervising students with a frozen

safetyarxiv-cs-ai

A2Z GameSpec-Bench: How Faithfully Can Coding Agents Generate Games from Game Design Specifications?

arXiv:2609.39564v1 Announce Type: new Abstract: Delegating complete application development to coding agents requires preserving the intended design rather than simply producing plausible outputs thro

Attention Function as an Intrinsic Inductive Bias: How Models' Behavior Diverges in Novel Contexts

arXiv:2609.39188v1 Announce Type: new Abstract: Developmental psychology holds that certain priors are given to infants prior to experience rather than induced from data, and that the influence of suc

Audio Token Attention Is Predictable Before the Language Model Runs

arXiv:2609.38878v1 Announce Type: cross Abstract: A large audio language model (LALM) turns a minute of speech into 750-1,500 tokens and prefills every one. Image-token pruning often cuts after the la

Auditing Agent Actions through Query-Conditioned Attribution

arXiv:2609.33676v2 Announce Type: replace Abstract: LLM agents increasingly take consequential actions through interactions with users, policies, and external tools. Auditing these agents requires aut

Applications

BayesNDE: Bayesian Generative Modeling for Neural Density Estimation

arXiv:2609.39843v1 Announce Type: cross Abstract: Density estimation is a fundamental problem in statistics and machine learning. In this work, we introduce BayesNDE, a neural density estimator based

applicationsarxiv-cs-ai