Search: “evaluation”

Assessing Alignment and Stability of Feature Importance Explanations via Weight of Evidence

arXiv:2609.00090v1 Announce Type: cross Abstract: Feature importance Methods (FIMs) are widely used in Explainable AI to interpret model predictions, yet attribution scores alone often provide limited

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

Assessing Suicide Risk in Arabic Crisis Helpline Calls: A Comparison of Arabic and English Large Language Models

DGX agent

arXiv:2609.00191v1 Announce Type: cross Abstract: Crisis helplines assess suicide risk through structured interviews, a process that is slow and dependent on operator training and workload. Natural la

local-aiarxiv-cs-ai

2 Sept 2026

Athena: Vulnerability-Affected Library Identification via Knowledge Graph Completion

arXiv:2609.01187v1 Announce Type: cross Abstract: A single vulnerability in a widely used library can cascade through millions of dependent applications, yet more than half of vulnerability database e

researcharxiv-cs-ai

Auditing Frozen-Encoder Anomaly Detection Across Mechanical Systems: Representation Provenance, Calibration, and Protocol Effects

model-releasesarxiv-cs-lg

arXiv:2601.11415v2 Announce Type: replace-cross Abstract: This version reports a reproducibility audit of the frozen-encoder experiments presented in version 1. The numerical discrimination results ar

Auditing Harness Tampering in Self-Improving Agents

arXiv:2609.00069v1 Announce Type: cross Abstract: Self-improving agents iteratively modify their own harness to push the frontier of their performance. However, such modifications can produce illusory

Applications

Autoresearch for Marketplace Catalogs: From Legacy Forms to AI-Native Matching

arXiv:2609.00274v1 Announce Type: new Abstract: Two-sided service marketplaces are moving from deterministic request-form intake to AI-native probabilistic matching, enabled by large language models (

applicationsarxiv-cs-ai

Behaviorally Grounded User Profiles from the Wild for Personalized Alignment and Multi-Perspective Reasoning

arXiv:2609.00014v1 Announce Type: cross Abstract: Persona-driven techniques increasingly adapt large language models (LLMs) to diverse contexts. However, existing methods predominantly rely on rigid,

Beneath the Diff: Diagnosing and Mitigating Algorithmic Mode Collapse in Code-Level Autonomous Research Loops

arXiv:2609.00077v1 Announce Type: new Abstract: Code-level autonomous research loops (ARLs) have recently emerged as a concrete object of study in automated machine learning research. In such loops, a

agentsarxiv-cs-cl

Beyond Object Selection:Markerless Gaze-based Robot Placement at Arbitrary Position

model-releasesarxiv-cs-ro

arXiv:2609.00478v1 Announce Type: new Abstract: Gaze-based assistive manipulation typically supports object selection, while arbitrary-position placement requires accurate spatial alignment between th

Bridging Lexical Divergence: LLM-Assisted, Cost-Efficient, Zero-shot Scientific Entity Linking

model-releasesarxiv-cs-cl

arXiv:2609.00228v1 Announce Type: new Abstract: Scientific domain entity linking (EL) differs from general domain EL because mentions and entity names often lack lexical overlap. Another challenge is

CameraEditor: Camera-Controlled Image Editing via Video-Prior Sequential Modeling

arXiv:2609.01479v1 Announce Type: new Abstract: Beyond semantic content, camera parameters play a pivotal role in dictating the geometric perspective and appearance of any given image. While recent im

Can LLMs Use Relational Transformer Embeddings?

arXiv:2609.00457v1 Announce Type: new Abstract: Injecting frozen relational-encoder embeddings as soft tokens into a large language model (LLM) is a conceptually appealing fusion strategy: the encoder

safetyarxiv-cs-lg

Candidate-Expanding Routing with Permutation-Stabilized Experts for Mixed-Format Medical VQA

arXiv:2609.00959v1 Announce Type: new Abstract: Mixed-format medical visual question answering (VQA) requires stable option selection and machine-readable free-text output. The two formats fail differ

researcharxiv-cs-cv

Causal Evidentiary Governance for High-Risk Machine Learning Systems

arXiv:2609.01040v1 Announce Type: cross Abstract: Machine learning systems deployed for credit, hiring, and resource distribution are increasingly subject to regulatory oversight from policies such as

CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Prediction

arXiv:2609.00242v1 Announce Type: cross Abstract: Long-tail autonomous driving failures are often framed as rare-object recognition errors. We argue that this view is incomplete: the decision-critical

Conditional Flow Matching for Cross-Field MRI Harmonisation

arXiv:2609.00960v1 Announce Type: new Abstract: Magnetic resonance images of the same subject look markedly different across field strengths, which complicates the comparison and pooling of data acros

Connectivity-Aware Graph Extension for Decentralized Multi-Robot Exploration

arXiv:2609.00804v1 Announce Type: new Abstract: Exploring unknown environments with multiple UAVs requires coordination under intermittent communication, making decentralized operation a baseline assu

researcharxiv-cs-ro

Consistency Without Alignment: Item-Sensitive Language Models Indistinguishable From Random

arXiv:2609.00576v1 Announce Type: new Abstract: Item-sensitivity, defined as whether a model's choice depends on the specific input rather than on its own output prior, is widely reported as evidence

Contact-Consistent Interaction Dynamics Normalization for Predictive Physical Human--Robot Interaction

arXiv:2606.14617v3 Announce Type: replace Abstract: Safe physical human--robot interaction on floating-base robots requires interaction regulation under changing contact constraints. We develop a cont

researcharxiv-cs-ro

ContextPipe: Database-Inspired Context Assembly for Long-Horizon Agents

arXiv:2609.00749v1 Announce Type: new Abstract: Long-horizon large language model (LLM) agents require context assembly: the runtime must decide what to include in each prompt, in what order, and when

ConvDeck: Conversational Paper-to-Slide Generation via Stage-Specific User Feedback

arXiv:2609.00226v1 Announce Type: new Abstract: Automatic academic paper-to-slide generation is inherently iterative, because creating an effective presentation requires repeated cycles of generation,

Counterfactual Closing-Acceleration Risk: An Anticipatory Surrogate Safety Measure for the Blind Region of Car-Following

model-releasesarxiv-cs-ro

arXiv:2609.00370v1 Announce Type: cross Abstract: Surrogate safety measures allow road-safety assessment from trajectory data in which crashes are absent, yet the dominant proximity measures - time-to

Hardware

CUDA-Harness: Harnessing Agentic CUDA Kernel Generation and Optimization from Natural Language

arXiv:2609.00058v1 Announce Type: cross Abstract: Developing high-performance CUDA kernels demands specialized knowledge in algorithm implementation, correctness validation, and hardware-aware paralle

hardwarearxiv-cs-ai

CWoMP: Morpheme Representation Learning for Interlinear Glossing

arXiv:2603.18184v2 Announce Type: replace Abstract: Interlinear glossed text (IGT) is a standard notation for language documentation which is linguistically rich but laborious to produce manually. Rec

researcharxiv-cs-cl

DAGGER: Distractor-Aware Graph Generation for Executable Reasoning in Math Problems

model-releasesarxiv-cs-cl

arXiv:2601.06853v3 Announce Type: replace Abstract: Chain-of-Thought (CoT) prompting is widely adopted for mathematical problem solving, including in low-resource languages, yet its behavior under irr

Design and Implementation of a Kalman Filter-Infused Algorithm for Tilt Estimation

arXiv:2609.00730v1 Announce Type: new Abstract: Accurate tilt angle estimation is important in many engineering applications, such as robotics, motion tracking, and embedded control systems. However,

researcharxiv-cs-cv

DeSyR: A Decoupled Symbolic Recovery Framework with PINN-Guided Structure Search and Physics-Informed Coefficient Refinement

model-releasesarxiv-cs-lg

arXiv:2609.00530v1 Announce Type: new Abstract: Recovering compact explicit solutions from neural approximations is challenging when imperfect teacher data guide symbolic topology search and coefficie

Detecting Hidden Behaviors in LLMs via Activation-matched Finetuning

arXiv:2609.00351v1 Announce Type: cross Abstract: Large language models can hide hidden behaviors that activate only under narrow conditions, such as backdoor triggers, sleeper-agent deployment cues,

Detoxifying Toxic Communication: A Design Science Approach to Responsible AI

arXiv:2609.00361v1 Announce Type: cross Abstract: Toxic language in digital workplaces such as pejoratives, sarcasm, condescension, and subtle incivility can erode trust, morale, and collaboration. Ex

safetyarxiv-cs-cl

Discrete-Time MDP Modeling for Multi-Item Capacitated Lot Sizing with Stochastic Demand Timing

arXiv:2609.00004v1 Announce Type: new Abstract: This paper studies a finite-horizon multi-item capacitated lot-sizing problem in which demand quantities are deterministic, while demand-arrival periods

DISTAL: Distillation and Self-Supervised Pretraining for Structure-Agnostic Materials Property Prediction

arXiv:2609.00059v1 Announce Type: cross Abstract: Materials property prediction remains difficult in low-data settings, where many target properties are supported by only a limited number of labeled s

Distributed Implicit Harm: A Compositional Safety Blind Spot in MLLM-Based Video Moderation

arXiv:2609.00206v1 Announce Type: cross Abstract: Despite their growing use in video moderation, multimodal large language models (MLLMs) exhibit a compositional safety blind spot: videos composed of

Do LLMs Know Your Neighborhood? Auditing LLM Priors for Neighborhood-Level Mobility Prediction and Structural Alignment

arXiv:2609.00345v1 Announce Type: new Abstract: Human mobility is central to urban planning, transportation, public health, and emergency response, yet fine-grained trajectory data are often proprieta

safetyarxiv-cs-lg

Local Ai

Does Fault Localization Beat a Fresh Attempt? A Placebo-Controlled Study of Test-Guided Code Repair

arXiv:2609.00854v1 Announce Type: cross Abstract: Fault localization can focus a code model's repair on the statements a failing test implicates, but a targeted edit may succeed merely because it is s

local-aiarxiv-cs-ai

Does Reasoning Mitigate Backdoor Attacks? A Neuro-Symbolic Perspective

arXiv:2609.00464v1 Announce Type: cross Abstract: Neuro-Symbolic (NeSy) AI has recently emerged as a novel paradigm to enable trustworthy AI, aiming at integrating sub-symbolic neural perception with

researcharxiv-cs-ai

Don't Let the Model Write the YAML: Deterministic, Minimal-Diff GitOps Remediation from LLM-Proposed Field Changes

arXiv:2609.00227v1 Announce Type: cross Abstract: LLM agents increasingly diagnose incidents and propose remediations. In a GitOps workflow, applying a fix means editing a version-controlled config fi

Dr. Claw: An AI Scientist Workspace for Vibe Research

arXiv:2609.00365v1 Announce Type: new Abstract: Command-line coding agents (e.g., Claude Code, Gemini CLI) can already read and write files and sustain long sessions, yet end-to-end research still fra

DSG: Dynamic 3D Scene Graph Construction for Embodied Agents in Changing Indoor Environments

model-releasesarxiv-cs-ro

arXiv:2609.00619v1 Announce Type: new Abstract: In indoor environments, object positions frequently change due to human activities or embodied-agent interactions, causing previously constructed scene

Dual Process Motion Planning

arXiv:2609.01260v1 Announce Type: new Abstract: Robotic systems are deeply embedded in both industry and everyday life, where they are expected to act with speed, precision, and reliability. Classical

Dyn-3D: Unveiling and Resolving Ego-Motion Ambiguity in Vision-Language Models

arXiv:2609.01059v1 Announce Type: new Abstract: As Vision-Language Models (VLMs) tackle dynamic 3D spatial reasoning, ego-motion perception becomes essential to resolve monocular scale ambiguity. Howe

EDGE: Error Dependency Graph-Guided Multi-Error Attribution in Multi-Agent LLM Systems

arXiv:2609.01360v1 Announce Type: new Abstract: Large language model (LLM) agent failures often contain multiple related errors rather than a single mistake. Existing attribution methods usually ident

Applications

Efficiently Estimating Optimal Hyperparameter Scaling Laws through Power-Law Entropy Search

arXiv:2609.01431v1 Announce Type: cross Abstract: Optimal hyperparameter scaling laws describe how the best hyperparameters for large language model (LLM) training change with model and data scale, en

applicationsarxiv-cs-ai

Embedded Conditional Independence Tests for Large Language Model Generated Text with an Application to German Parliament Speeches

arXiv:2609.00946v1 Announce Type: cross Abstract: Conditional independence tests (CITs) test for conditional dependence between two random objects X and Y given a third random object Z. Existing CITs

researcharxiv-cs-ai

Emotional Labor Strategy Preferences in LLM Personas

arXiv:2609.00310v1 Announce Type: new Abstract: Emotional labor is the effortful management of emotional displays to meet social or professional expectations. Personality traits have been correlated w

researcharxiv-cs-cl

EULER: Exploring Underused Links with Evidence-Checked Return for Multi-Agent Mathematical Discovery

arXiv:2609.00032v1 Announce Type: new Abstract: Mathematical communities work with different objects, invariants, and tools, so transferring a problem across them is expensive and often skipped. We pr

ExpArt-KG: Artwork Image Description Generation through Iterative Exploration of Knowledge Graphs

arXiv:2609.00629v1 Announce Type: new Abstract: Large Vision-Language Models (LVLMs) achieve strong performance on image-grounded text generation and visual question answering. However, it remains dif

researcharxiv-cs-cl

Expert-like Bone Ultrasound Segmentation through Expert-in-the-loop Mask-conditioned Progressive Learning

arXiv:2609.00473v1 Announce Type: cross Abstract: Manual annotation remains a major bottleneck in ultrasound (US) bone segmentation, where experts typically iteratively refine rough brush masks rather

Local Ai

Federated Trust for Embodied Robot Capability Marketplaces

arXiv:2609.00404v1 Announce Type: cross Abstract: Robot capability marketplaces, the 'app store for robot skills,' are emerging as the deployment vector for LLM-driven robot fleets. The default cloud-

local-aiarxiv-cs-ro