Search: “evaluation”

The Human Utility Factor: A Computable Welfare Metric That Reframes AI Governance as a Constrained Optimisation Problem

arXiv:2607.26068v1 Announce Type: cross Abstract: Existing AI governance frameworks, including the EU AI Act and NIST AI RMF, address safety, transparency, and accountability but do not operationalize

safetyarxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

THGFM: Dual-Branch Temporal Heterogeneous Graph Fusion Model

DGX agent

arXiv:2607.27303v1 Announce Type: cross Abstract: Temporal heterogeneous graphs offer a natural abstraction for dynamic relational systems in which diverse node and relation types co-exist and evolve

model-releasesarxiv-cs-cl

31 Jul 2026

Toward Multi-Modal Deep Learning for Pulmonary Disease Classification: A Texture-Based Machine Learning Pilot Study on Public Chest X-Ray Data

arXiv:2607.27286v1 Announce Type: cross Abstract: Automated classification of pulmonary disease from chest radiographs is a widely studied application of machine learning in medical imaging. This pape

researcharxiv-cs-cv

Towards Stability of Parameter-Free Optimization

arXiv:2405.04376v4 Announce Type: replace Abstract: Hyperparameter tuning, particularly the selection of an appropriate learning rate in adaptive gradient training methods, remains a challenge. To add

VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine System

arXiv:2607.27380v1 Announce Type: new Abstract: Text-to-video models have achieved remarkable visual quality, yet they still struggle to generate physically consistent dynamics because the temporal ev

agentsarxiv-cs-cv

ViP-Rig: Visual-Prompted Controllable Rigging

arXiv:2607.27982v1 Announce Type: new Abstract: Rigging is inherently task-dependent because the same mesh may require different skeletons and deformation behaviors across animation tasks. In practice

researcharxiv-cs-cv

Where and When to Commit: Candidate-Aware Decoding for Diffusion Language Models

arXiv:2607.28166v1 Announce Type: new Abstract: Diffusion language models (DLMs) expose a provisional prediction at every denoising step, creating an opportunity for generation-time early exit that st

Why Are GUI Agents Correct but Late? Decode on the Decision-Time Critical Path, Tested with Pre-Compiled Policy Trees

arXiv:2607.28399v1 Announce Type: new Abstract: Computer-use agents often fail on transient GUI events because they produce the correct action only after the relevant window has already closed. We ide

A Closer Look at Dynamic Scene Graph Generation In the Era of Multimodal Large Language Models

arXiv:2503.15846v2 Announce Type: replace Abstract: Dynamic Scene Graph Generation (DSGG) aims to capture objects and their evolving relations in videos. Despite recent progress, the practicality and

researcharxiv-cs-cv

An Attention-Based Framework for Alzheimers Disease Classification Using Resting-State fMRI

arXiv:2607.26746v1 Announce Type: cross Abstract: Accurate identification of Alzheimers disease (AD) using resting-state functional magnetic resonance imaging (rs-fMRI) remains challenging due to the

APEX-Accounting

arXiv:2607.27189v1 Announce Type: new Abstract: We introduce APEX-Accounting, a benchmark built by Mercor in partnership with Ramp, to assess whether frontier models can do the real work of accountant

BioVLN: A Simulation Platform for Visual Language Navigation in Biomedical Laboratories

arXiv:2607.26914v1 Announce Type: new Abstract: Biomedical laboratory robots must navigate to instruments before performing experimental procedures. Existing embodied navigation platforms are designed

safetyarxiv-cs-ro

Characterizing Human-Likeness in AI Generated Poetry: A Zero-shot Classification Study

arXiv:2607.26221v1 Announce Type: new Abstract: With the advancement of AI technologies, Generative AI (GenAI) and human written text have become nearly indistinguishable. Additionally, the global sta

CMT-RAG: Complementary Memory Traces for Multi-turn Multi-hop RAG

arXiv:2607.26470v1 Announce Type: new Abstract: Multi-turn information-seeking conversations require both multi-hop reasoning and long-range dependency tracking across turns. However, existing RAG sys

Diagnosing Fine-Grained Inconsistency Classification in Financial Disclosure Text

arXiv:2607.26368v1 Announce Type: new Abstract: Financial disclosures contain numerical claims, temporal statements, entity references, policy commitments, and risk descriptions that may conflict in q

DialectLLM: A Dialect-Aware Dialog[ue] Generation Framework Beyond Standard American English

arXiv:2601.22888v4 Announce Type: replace Abstract: More than 80% of the 1.6B English speakers do not use Standard American English (SAE), yet LLMs often fail to correctly identify non-SAE dialects an

DREvo: Distilling Recalibrated Historical Experience for Harness Self-Evolution

arXiv:2607.26722v1 Announce Type: cross Abstract: Harness plays a critical role in large language model agent performance, and building a high-performing harness requires substantial expert effort. Th

agentsarxiv-cs-lg

Examining the Efficacy of Graph Neural Network Message-Passing in Regression Contexts

arXiv:2607.26404v1 Announce Type: new Abstract: Graph Neural Networks (GNN) facilitate effective prediction on graph data such as molecules, media networks and neural network blueprints. GNNs facilita

From Conceptual Hydrologic Models to Conceptually Interpretable Neural Networks: A Snow-Water Mass-Conserving-Perceptron Framework for Discovering Catchment-Scale Precipitation-Storage-Runoff Representations

arXiv:2607.26492v1 Announce Type: new Abstract: The Mass-Conserving Perceptron (MCP) establishes a modeling paradigm in which conceptual hydrologic models can be reformulated as physically constrained

agentsarxiv-cs-lg

From Representations to Behaviors: Exploring the Person-Situation-Behavior Triad in LLMs

arXiv:2607.26853v1 Announce Type: new Abstract: Human personality theories characterize traits not as isolated attributes captured by a single score, but as stable individual tendencies expressed thro

Harnessing Large Language Models for Intelligent Resource Allocation in the Internet of Everything

arXiv:2607.26602v1 Announce Type: cross Abstract: The rapid development of the Internet of Everything (IoE) is accelerating the adoption of intelligent applications. However, the massive number of con

Applications

HealthSLM-Bench: Benchmarking Small Language Models for Mobile and Wearable Healthcare Monitoring

arXiv:2509.07260v5 Announce Type: replace-cross Abstract: Mobile and wearable healthcare monitoring play a vital role in facilitating timely interventions, managing chronic health conditions, and ulti

applicationsarxiv-cs-lg

Identifying Implicit Bias in LLM-based Chat AI Toward People with Intellectual Disabilities

arXiv:2607.26062v1 Announce Type: cross Abstract: Background: This work investigates the presence of implicit bias in Large Language Model (LLM)-based chat AI models directed toward people with intell

Large Emotional World Model

arXiv:2512.24149v2 Announce Type: replace Abstract: The world is governed by both physical laws and affective dynamics. Physical laws govern state transitions, while affective dynamics shape human act

Applications

Learning Dynamic User Personas from Implicit Interaction Streams via Iterative Refinement

arXiv:2607.26473v1 Announce Type: cross Abstract: Personalizing large language models (LLMs) to individual users is essential for improving user experience, yet existing approaches typically rely on e

applicationsarxiv-cs-cl

Lilith: Backdoor Generalization under Training-Inference Trigger Shift

arXiv:2607.26099v1 Announce Type: cross Abstract: Machine-learning services increasingly rely on public data, third-party providers, and outsourced training, creating opportunities for data-poisoning

safetyarxiv-cs-lg

Low-cost Embedded Breathing Rate Determination Using 802.15.4z IR-UWB Hardware for Remote Healthcare

arXiv:2504.03772v3 Announce Type: replace-cross Abstract: Respiratory diseases account for a significant portion of global mortality. Affordable and early detection is an effective way of addressing t

Metis: Memory Foundation Model

arXiv:2607.26760v1 Announce Type: new Abstract: Recent advances in AI agents have increasingly internalized native capabilities into their underlying foundation models, giving rise to multimodal found

agentsarxiv-cs-cl

OptimismBench: Forecasting Bias and the Alignment Effect in Language Model Judgment

arXiv:2607.26981v1 Announce Type: new Abstract: Large language models are increasingly used as decision aids whose probability judgments shape downstream choices. Whether those judgments carry a syste

safetyarxiv-cs-cl

Retrospective Orthogonal Design: Response-Surface Reconstruction from Observational Data

arXiv:2607.26219v1 Announce Type: cross Abstract: Regression estimates from observational data can depend on specification under multicollinearity, while sequential sums of squares (SS) depend on term

safetyarxiv-cs-lg

Scientific Knowledge Discovery in the Age of Large Language Models

arXiv:2607.26670v1 Announce Type: cross Abstract: The rapid growth of scholarly literature has made identifying relevant publications increasingly difficult, and conventional search systems still depe

Local Ai

ScratchSim: A Procedural Synthetic Data Pipeline for Surface Scratch Detection

arXiv:2607.27065v1 Announce Type: new Abstract: While automated defect detection such as the detection of surface scratched is an important aspect in industrial quality control, the scarcity of annota

local-aiarxiv-cs-cv

Sim2Win: A Team-Agnostic, Event-Based Pre-Match Outcome Prediction and Tactical Profiling System for Football

arXiv:2607.26061v1 Announce Type: new Abstract: Pre-match tactical decision-making in professional football relies heavily on subjective expert analysis and identity-based scouting systems that cannot

SymmGrid: Super-Scaling On-Robot Learning with Parallelized Symmetries and Egocentric-Exocentric Visual Perception

arXiv:2607.26985v1 Announce Type: cross Abstract: Deep reinforcement policy learning directly in physical robots (on-robot learning) remains bottlenecked by slow wall-clock training times. We present

safetyarxiv-cs-lg

TiPToP: A Modular Open-Vocabulary Robot Manipulation System That Plans

model-releasesarxiv-cs-ro

arXiv:2603.09971v2 Announce Type: replace Abstract: We present TiPToP, a modular manipulation system that integrates pretrained foundation models with a GPU-accelerated Task and Motion Planner to solv

Towards Trustworthy Embodied Intelligence: A Systems Framework and Graded Trustworthiness Levels

model-releasesarxiv-cs-ro

arXiv:2607.26121v1 Announce Type: new Abstract: Embodied intelligence integrates learned perception and decision making with real-time computation, control, and physical interaction. Because failures

ToxScreen: Detecting Whether an LLM Has Been Poisoned

arXiv:2607.26849v1 Announce Type: cross Abstract: As large language models (LLMs) are deployed in high-stakes domains, adversaries may poison training data to implant backdoors: hidden triggers that c

Understanding Knowledge Transfer Mechanism in Heterogeneous MLLM Fusion: A Simple Linear Approach

model-releasesarxiv-cs-cv

arXiv:2607.26608v1 Announce Type: new Abstract: Training-free fusion of heterogeneous multimodal large language models (MLLMs) provides a direct route for cross-scale capability transfer, yet improvem

VEGA: Learning Navigation VLAs from In-the-Wild Egocentric Video with Geometric Trajectory Supervision

model-releasesarxiv-cs-ro

arXiv:2606.18426v2 Announce Type: replace Abstract: We introduce VEGA, an approach for training navigation VisionLanguage-Action (VLA) models from unlabeled egocentric navigation videos. Internet-scal

VideoNorms: Benchmarking Cultural Awareness of Video Language Models

arXiv:2510.08543v2 Announce Type: replace-cross Abstract: As Video Large Language Models (VideoLLMs) are deployed globally, it is important to assess their ability to reason across cultural contexts.

When Synthetic Users Fail: A Cross-Domain Benchmark of LLM-Simulated Human Survey Responses

arXiv:2607.26348v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as synthetic users, stand-ins for human respondents whose simulated answers feed product, policy, and

AnnoBench: A Benchmark for Visualization Annotation Generation

model-releasesarxiv-cs-ai

arXiv:2607.25911v1 Announce Type: cross Abstract: Annotation is among the most demanding visualization tasks to automate, as it simultaneously requires correctly navigating visual, semantic, and styli

Authoring Agent Skills: A Software-Engineering Approach

model-releasesarxiv-cs-ai

arXiv:2607.25032v1 Announce Type: cross Abstract: Agent Skills are an emerging way to extend large language model agents with reusable procedural knowledge that the agent loads on demand. Anthropic in

Automated Modernization of Machine Learning Engineering Notebooks for Reproducibility

arXiv:2602.07195v2 Announce Type: replace-cross Abstract: Interactive computational notebooks (e.g., Jupyter notebooks) are widely used in machine learning engineering (MLE) to program and share end-t

Balancing multiscale similarity and cartographic constraints: A similarity-driven optimization framework for line generalization

model-releasesarxiv-cs-ai

arXiv:2607.25474v1 Announce Type: new Abstract: Cartographic generalization is essential for generating multiscale map representations by balancing information preservation and cartographic readabilit

Local Ai

Beyond Counts: A Distributional Robustness Margin For Pathology Foundation Models

arXiv:2607.25497v1 Announce Type: cross Abstract: Pathology foundation models are approaching clinical deployment, yet remain vulnerable to systematic non-biological variation across centres. Differen

local-aiarxiv-cs-ai

Beyond Epistemia: Epistemic Schizologia and Large Language Models as Techno-Semiotic Machines

arXiv:2607.25620v1 Announce Type: new Abstract: Quattrociocchi and colleagues warn that the fluent outputs of large language models may allow linguistic plausibility to substitute for epistemic evalua

agentsarxiv-cs-ai

Beyond Self-Knowledge: Propagating Uncertainty Across Reasoning and Retrieval in LLMs

arXiv:2607.25600v1 Announce Type: cross Abstract: Retrieval-augmented generation improves knowledge-intensive question answering, but indiscriminate retrieval can introduce irrelevant evidence and unn

safetyarxiv-cs-ai