Search: “evaluation”

Ajar: Measuring Open Privilege in Agent Defenses

arXiv:2609.26900v1 Announce Type: cross Abstract: A language model agent acts through the tools it is given. The data it reads while working on a task can redirect what it does with those tools. A gro

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Alignment Inertia: Auditing the Durability of Training Data Influence Through Policy Override Resistance

DGX agent

arXiv:2609.27333v1 Announce Type: new Abstract: Platform operators increasingly rely on system prompts and fine-tuning to govern model behavior, yet it remains unclear how reliably these interventions

model-releasesarxiv-cs-ai

24 Sept 2026

An open benchmark for machine learning-based polymer property prediction

arXiv:2609.27036v1 Announce Type: cross Abstract: Polymer property prediction lacks open, standardized benchmarks that enable rigorous comparison of machine-learning methods, with existing resources c

Anatomy-Aware Synthesis of Post-Contrast Breast MRI from Pre-Contrast Images

arXiv:2609.27015v1 Announce Type: new Abstract: We developed an anatomy-aware deep learning framework to synthesize post-contrast breast MRI from pre-contrast images, emphasizing tumor and background

Ask Which, Not How Good: Sizing Benchmarks Scored by an LLM

arXiv:2609.27787v1 Announce Type: new Abstract: Benchmarks scored by an LLM judge routinely adjudicate differences of a tenth of a point, but the resolution of those benchmarks has never been measured

Backdoors Leave Structural Traces: FedMAST for Backdoor Detection and Containment in Federated Learning

arXiv:2609.27760v1 Announce Type: cross Abstract: Federated learning enables distributed training of a shared model without requiring clients to share their raw data. However, its reliance on the inte

Benchmarking Active Spot Selection for Cost-Efficient Spatial Transcriptomics

arXiv:2609.27208v1 Announce Type: new Abstract: Spatial transcriptomics (ST) measures gene expression in tissue context, but dense capture grids can be costly and may repeatedly sample morphologically

Bend the Clock: Predicting Ahead to Beat Latency in Event-Based Object Detection

arXiv:2609.26919v1 Announce Type: cross Abstract: Event cameras promise low-latency perception for high-speed robotic systems, where even short delays can render detections stale by the time they info

agentsarxiv-cs-cv

Beyond Balanced Accuracy: A Resolution and Parity-Controlled Benchmark for Vision-Language and Vision-Only Defect Assessment in UAV Power-Line Inspection

arXiv:2609.27457v1 Announce Type: new Abstract: Vision-language models (VLMs) are often reported to outperform task-specific vision backbones for unmanned aerial vehicle (UAV) power-line defect assess

CART: Closed-Loop Adaptive Red Teaming for Large Language Models

arXiv:2609.27336v1 Announce Type: new Abstract: Automated red teaming often replays a fixed set of prompts, which measures known risks but cannot learn from failures found during testing. We present C

CereVLA: Cerebellum-Inspired Consequence-Aware Residual Governance for Efficient Vision-Language-Action Execution

arXiv:2609.27468v1 Announce Type: new Abstract: Action-chunked vision-language-action (VLA) policies improve inference efficiency, but limited feedback within committed action chunks can lead to accum

CRISP: Compositional Relations as Invariant Structural Priors for Domain Generalization

arXiv:2605.06043v2 Announce Type: replace Abstract: Domain generalization requires identifying stable representations that support reliable classification across domains. Domains may differ in low-lev

safetyarxiv-cs-cv

Cross-Scale Transfer Learning for Depression Severity Prediction: From PHQ-8 to HAMD-17 Across Languages and Clinical Paradigms

arXiv:2609.28430v1 Announce Type: new Abstract: This work addresses continuous depression-severity score prediction from clinical interview transcripts under data scarcity. We propose a sequential low

researcharxiv-cs-cl

Diverse by Design: Architectural Constraints for Prototype-Based Interpretability

arXiv:2609.27194v1 Announce Type: new Abstract: Prototype-based neural networks provide inherent interpretability through case-based reasoning, yet suffer from critical limitations: prototypes converg

Do Center Biases Propagate? Robustness of Pathology Foundation Models in Whole-Slide Image Classification

arXiv:2609.28231v1 Announce Type: cross Abstract: Pathology foundation models (PFMs) have transformed computational pathology through powerful representation learning from histopathological images. PF

EidosDoc: Implicit Structure Encoding for Cost-Effective Semi-Structured Document QA

arXiv:2609.27784v1 Announce Type: cross Abstract: Semi-structured documents are ubiquitous in scientific reports, financial statements, and technical manuals. Question answering over such documents re

EmbodiedMemory-Bench: Benchmarking Embodied Memory for Long-Horizon Embodied Tasks

arXiv:2609.28236v1 Announce Type: new Abstract: Long-horizon embodied interaction requires agents to retain and continually update information about the environment as they observe, act, and encounter

safetyarxiv-cs-cv

Emergi-PersonaOS: A Persona Agent Operating System for Situational Adaptation and Controllable Evolution

arXiv:2609.27417v1 Announce Type: new Abstract: Symbiosis between humans and digital beings offers a vision for the future of human--machine interaction. In enduring human--machine relationships, pers

Fed-ReMasker: Federated Tabular Imputation under Feature-Level Missingness

arXiv:2609.28105v1 Announce Type: cross Abstract: Multi-center clinical studies and biomedical research collaborations increasingly seek to utilize data across centers to build models that generalize

From ECG Signals to Representative-Morphology Heatmaps for Biometric Recognition

arXiv:2609.28183v1 Announce Type: new Abstract: Electrocardiography (ECG) contains subject-specific morphology that supports biometric recognition, yet image-based performance depends on how the wavef

From Reasoning Strings to Partial Orders: Verifier-Certified Rule Transport through Quotient Policy Optimization

arXiv:2609.27833v1 Announce Type: new Abstract: Many computations admit several valid execution orders because independent subgoals or disjoint state updates can commute. Reinforcement learning with v

safetyarxiv-cs-lg

Harness as a Language: A Minimalist Agent Framework With Maximal Expressivity

arXiv:2609.26891v1 Announce Type: new Abstract: Modern language-model agents are built around the extit{agent loop}, where the LLM is placed in an environment exposing a set of tools, and the LLM has

Invisible in Space, Visible in Time: Motion Vision CAPTCHA against GUI Agents

arXiv:2609.27461v1 Announce Type: new Abstract: Most existing visual CAPTCHAs remain spatially solvable: the required information is exposed by static appearance, local structure, and interface state.

JEV almost dead: CLM vs JEV

model-releasesr-localllama

Original post: https://www.reddit.com/r/LocalLLaMA/comments/1woscea/contrastive_language_models/ (sorry I felt it wasn't giving CLM the highlight it deserves) What it is: a new projection head for Qwe

Learning a Speed-adaptive Hip Exoskeleton Control Policy Via Sim-to-real Reinforcement Learning

arXiv:2609.28027v1 Announce Type: new Abstract: Providing personalized exoskeleton assistance across varying walking speeds remains challenging. Existing online optimization methods are sample-ineffic

safetyarxiv-cs-ro

Learning Expressive Humanoid Locomotion from Monocular Runway Videos for Robot Fashion Shows

arXiv:2609.27003v1 Announce Type: new Abstract: Runway walking requires coordinated control of posture, stride, foot placement, and whole-body motion to effectively present clothing and convey a disti

safetyarxiv-cs-ro

LightMIS: Ultra-Lightweight Medical Image Segmentation Without a Stage-Wise Decoder

arXiv:2609.28327v1 Announce Type: new Abstract: We present LightMIS, a scalable family of ultra-lightweight convolutional networks for 2D binary medical image segmentation without a learned stage-wise

Listening and Mirroring: The Effects of Verbal Attunement and Behavioral Mimicry on Social and Empathic Perceptions of Embodied AI Agents in VR

arXiv:2609.27246v1 Announce Type: cross Abstract: As embodied agents take on increasingly social and relational roles in VR, visual realism and embodiment alone may be insufficient; users must also pe

LOCKR: A Hidden-State Trajectory-Guided Planner for Detecting and Repairing Stable-but-Wrong Lock-In in Diffusion Language Models

arXiv:2609.27220v1 Announce Type: new Abstract: Diffusion language models generate text through iterative denoising, exposing intermediate trajectories before final answers are produced. We identify a

researcharxiv-cs-cl

Loss Choice or Model Choice? The Role of Forecast Level in Cryptocurrency Volatility Forecasting

arXiv:2609.27024v1 Announce Type: cross Abstract: Volatility forecasts play a central role in financial risk management because their overall level and day-to-day movements affect downstream decisions

safetyarxiv-cs-ai

LWiAI Podcast #257 - GPT 6 Astra, AI Extinction, Security Incidents

LWiAI Podcast #257 (recorded 19 Sep 2026) reviewed OpenAI’s latest model, GPT‑6 Astra, noting its agentic coding focus and purported loop‑transformer reasoning as a significant capability jump. The ep

safetylast-week-in-ai

Optimization without Future Compromises? Decentralized Coordination via Collective and Reinforcement Learning

model-releasesarxiv-cs-lg

arXiv:2509.18088v2 Announce Type: replace-cross Abstract: Efficient resource allocation in multi-agent systems requires autonomous agents to coordinate their decisions while balancing system-wide obje

Policy-as-Skill: Governed LLM Decision Support with Evidence, Deterministic Control, and Audit

arXiv:2609.27087v1 Announce Type: new Abstract: Organizations increasingly use LLMs for policy, compliance, risk, and operational decision support, requiring evidence validation, review routing, versi

safetyarxiv-cs-ai

Proactive Defense: Hardening Code Pipelines and CI/CD Infrastructure

model-releasesgoogle-cloud-ai

Introduction The landscape of software supply chain security has undergone a significant shift. Recent campaigns demonstrate that sophisticated threat actors are systematically targeting the engineeri

Realize What Matters: Principled Context Representation for Large-Scale Reasoning

model-releasesarxiv-cs-cl

arXiv:2609.27173v1 Announce Type: new Abstract: Solving complex tasks in domains such as science, medicine, law, and finance often requires assembling interdependent information scattered across vast,

Safety Nudges: User-Facing Interventions for Real-Time AI Risk Awareness

arXiv:2609.26865v1 Announce Type: cross Abstract: Conversational AI systems can pose safety risks to their users such as hallucination, sycophancy, overconfidence, and anthropomorphism, but these risk

safetyarxiv-cs-ai

SoLiD26: A First Principles Solid-Liquid Interface Dataset for Machine-learned Interatomic Potentials

arXiv:2609.28013v1 Announce Type: cross Abstract: Machine-learned interatomic potentials (MLIPs) for solid-liquid interfaces in advanced materials applications, e.g., electrochemistry, catalysis and c

researcharxiv-cs-lg

Sparse-Observation Atmospheric Thermal Forecasting with Physics-Informed Neural Networks for Climate-Aware Digital Twins

arXiv:2609.27290v1 Announce Type: new Abstract: Short-horizon forecasts of atmospheric temperature are needed to support climate-aware digital-twin systems, but such forecasts must be produced where t

Spatial and Semantic Reasoning for LLM-Driven Robot Navigation via MCP

arXiv:2609.27340v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as natural-language interfaces for robotic systems, yet their integration with Robot Operating System

agentsarxiv-cs-ro

Stable Neural Decoding Across Sessions via Task-Conditioned Latent Alignment for Brain-Machine Interfaces

arXiv:2609.27441v1 Announce Type: new Abstract: Achieving stable long-term neural decoding in invasive brain-machine interfaces (BMIs) remains challenging due to variations in recorded neural populati

safetyarxiv-cs-lg

StudentBench: AI and human tutoring yield equivalent GRE learning gains

arXiv:2609.28470v1 Announce Type: new Abstract: Artificial intelligence offers an unprecedented opportunity to augment human capabilities, yet progress at the frontier has focused primarily on advanci

The Past Frames the Future: Memory for Autoregressive Video Generation

arXiv:2609.28466v1 Announce Type: new Abstract: Advances in generative models have improved video fidelity, enabling long-horizon generation, interactive world modeling, and evolving visual environmen

The Tasteful Agent: Measuring and Improving Taste in Long-Horizon Tasks

arXiv:2609.25804v2 Announce Type: replace Abstract: LLM agents increasingly work on long-horizon tasks, and the decisions they make along the way, such as which hypothesis to test or which implementat

ThinkingCap 3.8-27B vs. Swift 3.8-27B vs. Qwen 3.8-27B Benchmarks

model-releasesr-localllama

With the release of ThinkingCap-Qwen3.8-27B, I thought it would be worthwhile to do a comparison between the original Qwen3.8-27B, the new ThinkingCap, and Swift-Qwen3.8-27B. Both Swift which I alread

tidyHEBO: Robust General-Purpose Bayesian Optimization with Model-Consistent Warping and Pareto Search

model-releasesarxiv-cs-lg

arXiv:2607.10669v2 Announce Type: replace Abstract: Bayesian optimization (BO) is widely used for expensive black-box problems, yet practical performance depends not only on high-level algorithmic cho

Two Global Crops Suffice: Locating Semantic Emergence in DINO-Style Self-Supervised Learning

arXiv:2609.28187v1 Announce Type: new Abstract: Self-supervised vision transformers trained with DINO-style objectives exhibit striking emergent semantic representation quality across visual tasks, ye

safetyarxiv-cs-cv

Verifiable Hidden Dynamics Play: Generating Agentic RL Environments from Solved Mechanisms

arXiv:2609.27321v1 Announce Type: new Abstract: Language-model agents increasingly face long-horizon tasks with evolving state, interdependent decisions, and delayed outcomes. Scaling their training r

WAInjectBench: Benchmarking Prompt Injection Detections for Web Agents

arXiv:2510.01354v2 Announce Type: replace-cross Abstract: Multiple prompt injection attacks have been proposed against web agents. At the same time, various methods have been developed to detect gener