Search: “evaluation”

applicationsr-machinelearning

Links: Preprint: https://doi.org/10.5281/zenodo.22028087 Entropic Scree Function v1.0.0 / GitHub: https://github.com/tjleestjohn/Entropic-Scree TL;DR: Standard PCA fundamentally fractures non-linear d

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Monroe: A Molecular Foundation Model for In-Context Probabilistic Inference

arXiv:2608.18982v1 Announce Type: new Abstract: Bioassay activity prediction is often data-limited because drug-discovery datasets rely on time-consuming and expensive wet-lab experiments for data gen

researcharxiv-cs-lg

Multi-Class Electrical and Mechanical Fault Classification Using Random Convolutional Kernels

arXiv:2608.18716v1 Announce Type: new Abstract: Diagnosing faults in rotating machinery is essential for ensuring the reliability of industrial processes. Random convolutional kernel-based Time Series

NE-BERT: A Multilingual Language Model for Nine Northeast Indian Languages

arXiv:2608.18094v1 Announce Type: cross Abstract: Large pretrained language models have demonstrated remarkable capabilities across diverse languages, yet critically underrepresented low-resource lang

Operationalizing Narrative Entropy (Sn): A Two-Scene Registered Pilot Report and Pre-Validation Protocol

arXiv:2608.18109v1 Announce Type: new Abstract: Narrative Entropy (S_n) is a proposed quantitative descriptor within the Bulut Doctrine, intended to capture the rate at which a narrative text imposes

researcharxiv-cs-cl

Pairwise Ranking Outperforms Single-Action RL for Offline Explanation Selection: A Practical Lesson

arXiv:2608.18531v1 Announce Type: new Abstract: Industrial explainable-recommendation systems built on LLMs incur a substantial serving cost: each request triggers an LLM generation, with latency in t

Local Ai

PartialBiGrasp: Inferring Hidden Local Geometry for Bimanual Grasping from Partial Views

arXiv:2608.19188v1 Announce Type: new Abstract: Dual-arm robotic grasping is essential for manipulating large, heavy, and geometrically complex objects that cannot be reliably handled using a single m

local-aiarxiv-cs-ro

Position: Profiling Game Worlds by Transition Complexity

arXiv:2608.18079v1 Announce Type: new Abstract: Game world modeling (GWM) and reinforcement learning (RL) are often confounded because research papers rarely quantify how difficult the underlying tran

Applications

Repeatability is not recovery: Quantifying algorithmic stability and topic recovery in Latent Dirichlet Allocation

arXiv:2511.12850v2 Announce Type: replace Abstract: Topic models are often judged by the consistency of their outputs across repeated runs, implicitly assuming that repeatable topic output is a succes

applicationsarxiv-cs-cl

Reproducible Multimodal Affordance Prediction

arXiv:2608.18317v1 Announce Type: new Abstract: Affordance prediction is the identification of potential actions an agent can perform on a target object from multimodal inputs. Affordance prediction m

safetyarxiv-cs-cv

Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspective

arXiv:2608.18104v1 Announce Type: new Abstract: Large language model (LLM)-based agents are increasingly becoming self-evolving systems that persist across interactions, maintain memories, use tools,

agentsarxiv-cs-ai

SkillForge: Self-Distilling Agents for Project-Specific Issue Resolution

arXiv:2608.18933v1 Announce Type: cross Abstract: Large language model (LLM) based agents have demonstrated remarkable proficiency in automated software issue resolution, yet they often struggle to re

The Deontic Gap: Large Language Models and the Modal Language of Obligation

arXiv:2608.18144v1 Announce Type: cross Abstract: Modal auxiliaries such as must, should, and have to mark necessity and obligation within the contexts of speaker authority and interpersonal stance. W

UMER: Unifying Embedding and Ranking via Pair-Aware Discriminative Reasoning for Universal Multimodal Retrieval

arXiv:2608.18504v1 Announce Type: new Abstract: Universal multimodal retrieval aims to support diverse instruction-aware retrieval tasks, demanding both efficient corpus-scale matching and fine-graine

Understanding Multilingual Medical ASR Adaptation Through Layer-Wise Analysis

arXiv:2608.18825v1 Announce Type: cross Abstract: Medical automatic speech recognition (MedASR) requires adaptation to specialised terminology, limited annotated clinical data, and multilingual use ca

When Safety Overrides Vision: Exploring Dynamics between Vision Influence and Safety Alignment in Vision-Language Models

arXiv:2608.18628v1 Announce Type: cross Abstract: Aligned vision-language models (VLMs) are designed to balance grounded visual reasoning with safe generation behavior. However, we observe a striking

safetyarxiv-cs-cl

When Two Tracers Disagree: An Investigation of Multimodal Fusion for Clinical PET/CT Segmentation

arXiv:2608.19063v1 Announce Type: new Abstract: PSMA and FDG PET/CT visualise complementary biological information in prostate cancer. Combining both tracers could capture heterogeneous tumour phenoty

researcharxiv-cs-cv

Local Ai

AISA: AI Safety Assistant Framework for Continuous Improvement of Highway Construction

arXiv:2608.17184v1 Announce Type: new Abstract: Job Safety Analysis (JSA) and pre-task planning can benefit from prior incident records, yet historical accident data is often stored as unstructured na

local-aiarxiv-cs-cl

Auditing Self-Evolution in Financial Agents: Capability Gains, Security Drift, and Execution-Interface Mismatch

arXiv:2608.17684v1 Announce Type: new Abstract: Self-evolving agents turn experience into reusable skills, workflows, or memories, but post-evolution accuracy alone does not show whether learned behav

CABLE: Extending the Reach of Memory Retrieval via Complementary Antecedent-Based Linking and Expansion

model-releasesarxiv-cs-cl

arXiv:2608.17911v1 Announce Type: new Abstract: As LLM agents operate across structured workflows and sessions, preserving long-term history does not ensure that later contexts can recover relevant ev

CARA: Cognitive Adaptive Recommendation Agent

arXiv:2608.16919v1 Announce Type: cross Abstract: Recent advances in large language models and agent-based recommendation frameworks have introduced new opportunities for more flexible and context-awa

agentsarxiv-cs-ai

CAS-FD: Contact-Aware Temporal Sampling for Single-View Foul vs Dive Recognition

arXiv:2608.17060v1 Announce Type: new Abstract: Distinguishing a genuine foul from a simulated dive in football remains one of the sport's most contested fine-grained recognition problems, especially

researcharxiv-cs-cv

COMIC: Reference-Aware Safety Gating for Multimodal Large Language Models

arXiv:2608.17234v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) are increasingly used to interact with screenshots, scanned documents, diagrams, and other visually grounded

safetyarxiv-cs-ai

CORAM: Coherent Orthogonal Rotation for Model Merging

arXiv:2608.17366v1 Announce Type: new Abstract: Merging finetuned models combines specialized capabilities without joint training or access to the original data. Most methods operate by linear arithme

researcharxiv-cs-lg

DataSTORM: Deep Research on Large-Scale Databases using Exploratory Data Analysis and Data Storytelling

arXiv:2604.06474v2 Announce Type: replace Abstract: Deep research with Large Language Model (LLM) agents is emerging as a powerful paradigm for multi-step information discovery, synthesis, and analysi

agentsarxiv-cs-cl

Deep Academic Survey: Stateful Agentic Closed-Loop Paradigm for Academic Survey Automation

model-releasesarxiv-cs-cv

arXiv:2608.18034v1 Announce Type: new Abstract: Academic surveys play a central role in organizing rapidly expanding scholarly literature, yet their construction requires extensive paper analysis, coh

Domain-Adapted Molecular Language Models for Efficient Search of Make-on-Demand Libraries

arXiv:2608.17567v1 Announce Type: cross Abstract: Pretrained molecular language models are increasingly used as molecular encoders for learning structure-property relationships. However, their practic

Efficient Dynamic Shielding for Parametric Safety Specifications

arXiv:2505.22104v2 Announce Type: replace Abstract: Shielding has emerged as a promising approach for ensuring safety of AI-controlled autonomous systems. The algorithmic goal is to compute a shield,

Exact Reformulation and Optimization for Direct Metric Optimization in Binary Imbalanced Classification

arXiv:2507.15240v2 Announce Type: replace Abstract: For classification with imbalanced class frequencies, i.e., imbalanced classification (IC), standard accuracy is known to be misleading as a perform

Explicit State Elicitation Is Not Enough: A Controlled Audit of Memory-Policy Classification

arXiv:2608.17247v1 Announce Type: new Abstract: Personalized agents must decide whether retrieved user memory should be used, ignored, updated, or queried before it affects a current task. We use this

From Abductive Explanations to Global Logical Rules for Node Classification in SGCs

arXiv:2608.17103v1 Announce Type: cross Abstract: Graph Neural Networks (GNNs) have achieved remarkable performance in node classification tasks, motivating growing interest in methods capable of expl

From Adoption to Deployment: A Qualitative Study on AI Integration in Software Development Practice

arXiv:2607.16660v2 Announce Type: replace-cross Abstract: The increasing adoption of Large Language Models (LLMs) as AI components in modern software systems introduces distinct security risks to the

safetyarxiv-cs-ai

GSToken: Geometry-Structured Gaussian Tokens for Compact 3D Medical Image Representation

model-releasesarxiv-cs-cv

arXiv:2608.17425v1 Announce Type: new Abstract: Effective segmentation of multi-modal MRI is central to improving neural network accuracy in brain tumor recognition. Existing methods typically compres

Hardware

Hermes now leverages NVIDIA's SkillEvaluator on skill installs, checking for PII, leaked secrets, Unicode smuggling, licensing and security …

Hermes now leverages NVIDIA's SkillEvaluator on skill installs, checking for PII, leaked secrets, Unicode smuggling, licensing and security issues before you confirm. We pointed it at our own bundled

hardwarenous-research--x

Hidden Prompts in Manuscripts Exploit AI-Assisted Peer Review

arXiv:2507.06185v2 Announce Type: replace-cross Abstract: In July 2025, 18 academic manuscripts on arXiv contained hidden instructions that manipulated AI-assisted peer review (indirect prompt injecti

Initialization-Free Bundle Adjustment Revisited: A Controlled Experimental Study

model-releasesarxiv-cs-cv

arXiv:2608.18028v1 Announce Type: new Abstract: Initialization-free bundle adjustment (InitFree BA) aims to recover camera poses and scene structure directly from image observations, avoiding the geom

LEGO-RL: Harness-Native Reinforcement Learning for Coding Agents

arXiv:2608.17393v1 Announce Type: new Abstract: Reinforcement learning for coding agents increasingly relies on long-running agent harnesses to manage tool integration, repository contexts, and execut

LLM Enhancement with Domain Expert Mental Model to Reduce LLM Hallucination with Causal Prompt Engineering

arXiv:2509.10818v2 Announce Type: replace Abstract: When consequential decisions depend on knowledge that exists nowhere in writing, LLMs hallucinate not from retrieval failure but from model absence.

Tutorials

Looking Beyond the Scale: Do Surgical Skill Models Learn Transferable Representations Across Assessment Rubrics?

arXiv:2608.17519v1 Announce Type: new Abstract: Vision-based surgical skill assessment has shown strong in-domain results, yet a fundamental question remains unasked: do these models learn transferabl

tutorialsarxiv-cs-cv

Monitoring Pasture Restoration from Satellite Image Time Series: Caveats and Opportunities

arXiv:2608.17704v1 Announce Type: new Abstract: Monitoring nature restoration at scale is an important but difficult ecological problem. Deep learning methods to analyze satellite image time series (S

safetyarxiv-cs-cv

MPC for underactuated spacecraft control with a Lyapunov supervised physics-informed neural network correction layer

arXiv:2606.13113v2 Announce Type: replace-cross Abstract: Underactuated spacecraft faces controllability limitations and heightened sensitivity to environmental disturbances, complicating attitude man

safetyarxiv-cs-ro

Applications

Multi-Observer Vehicle Localization Case Study with Roadside Radar and Connected Vehicle Sensing

arXiv:2608.16966v1 Announce Type: new Abstract: In modern intelligent transportation systems, it is essential to accurately estimate vehicle positions, especially in mixed traffic conditions where bot

applicationsarxiv-cs-cv

One Pipeline, Many Transformers: Pattern-Specific Imputation Specialists for Tabular Missing Data

arXiv:2510.02625v5 Announce Type: replace Abstract: Missing data in tabular datasets forces practitioners into a hard choice: deploy a general-purpose imputer that may perform poorly for the problem a

PACE: Policy-Attested Contract Execution for Safe AI Agents in Decentralized Finance

arXiv:2608.17220v1 Announce Type: cross Abstract: Autonomous AI agents are emerging as interfaces for decentralized finance (DeFi) actions such as swaps, lending operations, and yield management. Beca

PDDL-ART: Autonomous Symbolic Abstraction From Demonstration For Long-Horizon Robotic Manipulation Using Vision-Language Models

arXiv:2608.17146v1 Announce Type: new Abstract: Symbolic planning with PDDL offers a principled framework for long-horizon robot manipulation, but constructing accurate PDDL domain and problem descrip

agentsarxiv-cs-ro

Picture the Epsilon: Pursuing Identity-Level Privacy Guarantees for Images

arXiv:2608.17147v1 Announce Type: cross Abstract: Image-to-image face generators are widely used, and visual dissimilarity between their outputs and source images is sometimes treated as evidence of p

Local Ai

SGHA: Evidence-Grounded Research Problem Discovery with Local Language Models

arXiv:2608.17501v1 Announce Type: new Abstract: Recent efforts toward fully automated AI scientists have demonstrated that language-model agents can generate hypotheses, execute experiments, and draft

local-aiarxiv-cs-ai

StartupBench: Benchmarking General-Purpose Agents on Market-Validated End-to-End Workflows

arXiv:2608.17800v1 Announce Type: new Abstract: Recent advances in Large Language Models(LLMs) and agents have substantially improved the ability of AI systems to execute complex tasks. Yet existing b