Search: “evaluation”

I built a visual multi-agent workflow editor that exports runnable CrewAI code — here’s a 5-agent workflow running locally with Ollama

I've been building AgentGraph Studio, a visual editor for designing multi-agent workflows and exporting them as runnable Python code. One thing I wanted to verify was whether the generated code actual

model-releasesr-ollama

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Applications

Image-Guided Pavement Defect Recognition in GPR Data with novel 3D Deep Learning Architecture

DGX agent

arXiv:2608.19177v1 Announce Type: new Abstract: Ground Penetrating Radar (GPR) is a widely adopted non-destructive sensing technology for subsurface inspection in civil and transportation engineering.

applicationsarxiv-cs-cv

20 Aug 2026

Intercepting the Kangaroo: Experimental Astrolinguistics with Constructed Lexicons, Active Probing, and Large Language Models as Informants and Hypothesis Proposers

arXiv:2608.19124v1 Announce Type: cross Abstract: Astrolinguistics -- communication with minds that categorize reality differently from ours -- has been purely speculative since Freudenthal's Lincos (

Introducing the Privacy-HSD Trade-off: Hate Speech Detection, but not at the Cost of Privacy

model-releasesarxiv-cs-cl

arXiv:2608.19006v1 Announce Type: new Abstract: Hate speech is a real and timely threat that affects a large portion of online users, especially youth and minority groups. While building reliable and

Language Models for Portuguese: A Systematic Mapping Study

arXiv:2608.18138v1 Announce Type: cross Abstract: In recent years, the rapid development of language models has transformed the field of Natural Language Processing through a wide range of application

Leaf Values as Coordinates: Exact Contrastive Explanation for Gradient-Boosted Ensembles

arXiv:2608.19127v1 Announce Type: cross Abstract: A gradient-boosted ensemble predicts by summing one leaf value per tree. Read those values as coordinates rather than as intermediate results, and eve

Applications

Mapping intrinsic rank and informational gravity in complex tabular data: I developed a non-parametric, model-agnostic, information-theoretic diagnostic to bypass the limits of linear, rank, and Euclidean baselines. [R]

applicationsr-machinelearning

Links: Preprint: https://doi.org/10.5281/zenodo.22028087 Entropic Scree Function v1.0.0 / GitHub: https://github.com/tjleestjohn/Entropic-Scree TL;DR: Standard PCA fundamentally fractures non-linear d

Monroe: A Molecular Foundation Model for In-Context Probabilistic Inference

arXiv:2608.18982v1 Announce Type: new Abstract: Bioassay activity prediction is often data-limited because drug-discovery datasets rely on time-consuming and expensive wet-lab experiments for data gen

researcharxiv-cs-lg

Multi-Class Electrical and Mechanical Fault Classification Using Random Convolutional Kernels

model-releasesarxiv-cs-lg

arXiv:2608.18716v1 Announce Type: new Abstract: Diagnosing faults in rotating machinery is essential for ensuring the reliability of industrial processes. Random convolutional kernel-based Time Series

NE-BERT: A Multilingual Language Model for Nine Northeast Indian Languages

arXiv:2608.18094v1 Announce Type: cross Abstract: Large pretrained language models have demonstrated remarkable capabilities across diverse languages, yet critically underrepresented low-resource lang

Operationalizing Narrative Entropy (Sn): A Two-Scene Registered Pilot Report and Pre-Validation Protocol

arXiv:2608.18109v1 Announce Type: new Abstract: Narrative Entropy (S_n) is a proposed quantitative descriptor within the Bulut Doctrine, intended to capture the rate at which a narrative text imposes

researcharxiv-cs-cl

Pairwise Ranking Outperforms Single-Action RL for Offline Explanation Selection: A Practical Lesson

arXiv:2608.18531v1 Announce Type: new Abstract: Industrial explainable-recommendation systems built on LLMs incur a substantial serving cost: each request triggers an LLM generation, with latency in t

Local Ai

PartialBiGrasp: Inferring Hidden Local Geometry for Bimanual Grasping from Partial Views

arXiv:2608.19188v1 Announce Type: new Abstract: Dual-arm robotic grasping is essential for manipulating large, heavy, and geometrically complex objects that cannot be reliably handled using a single m

local-aiarxiv-cs-ro

Position: Profiling Game Worlds by Transition Complexity

arXiv:2608.18079v1 Announce Type: new Abstract: Game world modeling (GWM) and reinforcement learning (RL) are often confounded because research papers rarely quantify how difficult the underlying tran

Applications

Repeatability is not recovery: Quantifying algorithmic stability and topic recovery in Latent Dirichlet Allocation

arXiv:2511.12850v2 Announce Type: replace Abstract: Topic models are often judged by the consistency of their outputs across repeated runs, implicitly assuming that repeatable topic output is a succes

applicationsarxiv-cs-cl

Reproducible Multimodal Affordance Prediction

arXiv:2608.18317v1 Announce Type: new Abstract: Affordance prediction is the identification of potential actions an agent can perform on a target object from multimodal inputs. Affordance prediction m

safetyarxiv-cs-cv

Agents

Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspective

arXiv:2608.18104v1 Announce Type: new Abstract: Large language model (LLM)-based agents are increasingly becoming self-evolving systems that persist across interactions, maintain memories, use tools,

agentsarxiv-cs-ai

SkillForge: Self-Distilling Agents for Project-Specific Issue Resolution

arXiv:2608.18933v1 Announce Type: cross Abstract: Large language model (LLM) based agents have demonstrated remarkable proficiency in automated software issue resolution, yet they often struggle to re

The Deontic Gap: Large Language Models and the Modal Language of Obligation

arXiv:2608.18144v1 Announce Type: cross Abstract: Modal auxiliaries such as must, should, and have to mark necessity and obligation within the contexts of speaker authority and interpersonal stance. W

UMER: Unifying Embedding and Ranking via Pair-Aware Discriminative Reasoning for Universal Multimodal Retrieval

arXiv:2608.18504v1 Announce Type: new Abstract: Universal multimodal retrieval aims to support diverse instruction-aware retrieval tasks, demanding both efficient corpus-scale matching and fine-graine

Understanding Multilingual Medical ASR Adaptation Through Layer-Wise Analysis

arXiv:2608.18825v1 Announce Type: cross Abstract: Medical automatic speech recognition (MedASR) requires adaptation to specialised terminology, limited annotated clinical data, and multilingual use ca

When Safety Overrides Vision: Exploring Dynamics between Vision Influence and Safety Alignment in Vision-Language Models

arXiv:2608.18628v1 Announce Type: cross Abstract: Aligned vision-language models (VLMs) are designed to balance grounded visual reasoning with safe generation behavior. However, we observe a striking

safetyarxiv-cs-cl

When Two Tracers Disagree: An Investigation of Multimodal Fusion for Clinical PET/CT Segmentation

arXiv:2608.19063v1 Announce Type: new Abstract: PSMA and FDG PET/CT visualise complementary biological information in prostate cancer. Combining both tracers could capture heterogeneous tumour phenoty

researcharxiv-cs-cv

Local Ai

AISA: AI Safety Assistant Framework for Continuous Improvement of Highway Construction

arXiv:2608.17184v1 Announce Type: new Abstract: Job Safety Analysis (JSA) and pre-task planning can benefit from prior incident records, yet historical accident data is often stored as unstructured na

local-aiarxiv-cs-cl

Auditing Self-Evolution in Financial Agents: Capability Gains, Security Drift, and Execution-Interface Mismatch

arXiv:2608.17684v1 Announce Type: new Abstract: Self-evolving agents turn experience into reusable skills, workflows, or memories, but post-evolution accuracy alone does not show whether learned behav

CABLE: Extending the Reach of Memory Retrieval via Complementary Antecedent-Based Linking and Expansion

model-releasesarxiv-cs-cl

arXiv:2608.17911v1 Announce Type: new Abstract: As LLM agents operate across structured workflows and sessions, preserving long-term history does not ensure that later contexts can recover relevant ev

Agents

CARA: Cognitive Adaptive Recommendation Agent

arXiv:2608.16919v1 Announce Type: cross Abstract: Recent advances in large language models and agent-based recommendation frameworks have introduced new opportunities for more flexible and context-awa

agentsarxiv-cs-ai

CAS-FD: Contact-Aware Temporal Sampling for Single-View Foul vs Dive Recognition

arXiv:2608.17060v1 Announce Type: new Abstract: Distinguishing a genuine foul from a simulated dive in football remains one of the sport's most contested fine-grained recognition problems, especially

researcharxiv-cs-cv

COMIC: Reference-Aware Safety Gating for Multimodal Large Language Models

arXiv:2608.17234v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) are increasingly used to interact with screenshots, scanned documents, diagrams, and other visually grounded

safetyarxiv-cs-ai

CORAM: Coherent Orthogonal Rotation for Model Merging

arXiv:2608.17366v1 Announce Type: new Abstract: Merging finetuned models combines specialized capabilities without joint training or access to the original data. Most methods operate by linear arithme

researcharxiv-cs-lg

Agents

DataSTORM: Deep Research on Large-Scale Databases using Exploratory Data Analysis and Data Storytelling

arXiv:2604.06474v2 Announce Type: replace Abstract: Deep research with Large Language Model (LLM) agents is emerging as a powerful paradigm for multi-step information discovery, synthesis, and analysi

agentsarxiv-cs-cl

Deep Academic Survey: Stateful Agentic Closed-Loop Paradigm for Academic Survey Automation

model-releasesarxiv-cs-cv

arXiv:2608.18034v1 Announce Type: new Abstract: Academic surveys play a central role in organizing rapidly expanding scholarly literature, yet their construction requires extensive paper analysis, coh

Domain-Adapted Molecular Language Models for Efficient Search of Make-on-Demand Libraries

arXiv:2608.17567v1 Announce Type: cross Abstract: Pretrained molecular language models are increasingly used as molecular encoders for learning structure-property relationships. However, their practic

Efficient Dynamic Shielding for Parametric Safety Specifications

arXiv:2505.22104v2 Announce Type: replace Abstract: Shielding has emerged as a promising approach for ensuring safety of AI-controlled autonomous systems. The algorithmic goal is to compute a shield,

Exact Reformulation and Optimization for Direct Metric Optimization in Binary Imbalanced Classification

model-releasesarxiv-cs-lg

arXiv:2507.15240v2 Announce Type: replace Abstract: For classification with imbalanced class frequencies, i.e., imbalanced classification (IC), standard accuracy is known to be misleading as a perform

Explicit State Elicitation Is Not Enough: A Controlled Audit of Memory-Policy Classification

arXiv:2608.17247v1 Announce Type: new Abstract: Personalized agents must decide whether retrieved user memory should be used, ignored, updated, or queried before it affects a current task. We use this

From Abductive Explanations to Global Logical Rules for Node Classification in SGCs

arXiv:2608.17103v1 Announce Type: cross Abstract: Graph Neural Networks (GNNs) have achieved remarkable performance in node classification tasks, motivating growing interest in methods capable of expl

From Adoption to Deployment: A Qualitative Study on AI Integration in Software Development Practice

arXiv:2607.16660v2 Announce Type: replace-cross Abstract: The increasing adoption of Large Language Models (LLMs) as AI components in modern software systems introduces distinct security risks to the

safetyarxiv-cs-ai

GSToken: Geometry-Structured Gaussian Tokens for Compact 3D Medical Image Representation

model-releasesarxiv-cs-cv

arXiv:2608.17425v1 Announce Type: new Abstract: Effective segmentation of multi-modal MRI is central to improving neural network accuracy in brain tumor recognition. Existing methods typically compres

Hardware

Hermes now leverages NVIDIA's SkillEvaluator on skill installs, checking for PII, leaked secrets, Unicode smuggling, licensing and security …

Hermes now leverages NVIDIA's SkillEvaluator on skill installs, checking for PII, leaked secrets, Unicode smuggling, licensing and security issues before you confirm. We pointed it at our own bundled

hardwarenous-research--x

Hidden Prompts in Manuscripts Exploit AI-Assisted Peer Review

arXiv:2507.06185v2 Announce Type: replace-cross Abstract: In July 2025, 18 academic manuscripts on arXiv contained hidden instructions that manipulated AI-assisted peer review (indirect prompt injecti

Initialization-Free Bundle Adjustment Revisited: A Controlled Experimental Study

model-releasesarxiv-cs-cv

arXiv:2608.18028v1 Announce Type: new Abstract: Initialization-free bundle adjustment (InitFree BA) aims to recover camera poses and scene structure directly from image observations, avoiding the geom

LEGO-RL: Harness-Native Reinforcement Learning for Coding Agents

arXiv:2608.17393v1 Announce Type: new Abstract: Reinforcement learning for coding agents increasingly relies on long-running agent harnesses to manage tool integration, repository contexts, and execut

LLM Enhancement with Domain Expert Mental Model to Reduce LLM Hallucination with Causal Prompt Engineering

arXiv:2509.10818v2 Announce Type: replace Abstract: When consequential decisions depend on knowledge that exists nowhere in writing, LLMs hallucinate not from retrieval failure but from model absence.

Tutorials

Looking Beyond the Scale: Do Surgical Skill Models Learn Transferable Representations Across Assessment Rubrics?

arXiv:2608.17519v1 Announce Type: new Abstract: Vision-based surgical skill assessment has shown strong in-domain results, yet a fundamental question remains unasked: do these models learn transferabl

tutorialsarxiv-cs-cv

Monitoring Pasture Restoration from Satellite Image Time Series: Caveats and Opportunities

arXiv:2608.17704v1 Announce Type: new Abstract: Monitoring nature restoration at scale is an important but difficult ecological problem. Deep learning methods to analyze satellite image time series (S

safetyarxiv-cs-cv

MPC for underactuated spacecraft control with a Lyapunov supervised physics-informed neural network correction layer

arXiv:2606.13113v2 Announce Type: replace-cross Abstract: Underactuated spacecraft faces controllability limitations and heightened sensitivity to environmental disturbances, complicating attitude man

safetyarxiv-cs-ro

Applications

Multi-Observer Vehicle Localization Case Study with Roadside Radar and Connected Vehicle Sensing

arXiv:2608.16966v1 Announce Type: new Abstract: In modern intelligent transportation systems, it is essential to accurately estimate vehicle positions, especially in mixed traffic conditions where bot

applicationsarxiv-cs-cv