Search: “evaluation”

CiteGuard-RAG: A Validation-Centered AI System for Evidence-Grounded Question Answering

arXiv:2609.15830v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) can improve access to complex information; however, retrieving evidence alone does not ensure that answers are gr

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Applications

CRITICS - Critical Science Without Borders: Language Models to Promote Critical Thinking in Science Education

DGX agent

arXiv:2609.13942v1 Announce Type: cross Abstract: The CRITICS project addresses science accessibility and literacy by converging advanced Machine Translation (MT) based on Large Language Models (LLMs)

applicationsarxiv-cs-ai

15 Sept 2026

Local Ai

DeepDiscovery: A Location-Inference Framework for Task-Level Repository Understanding

arXiv:2606.22906v2 Announce Type: replace-cross Abstract: Large language models have shown strong performance on software engineering (SE) tasks, yet understanding large industrial repositories remain

local-aiarxiv-cs-ai

Applications

DeepFeature: LLM-Empowered Context-aware Feature Generation for Wearable Biosignals

arXiv:2512.08379v3 Announce Type: replace Abstract: Biosignals collected from wearable devices are widely utilized in healthcare applications. Machine learning models used in these applications often

applicationsarxiv-cs-ai

Empathy Is Steerable but Multi-Axial: Mechanism Geometry and Persona Effects in LLMs

arXiv:2609.15654v1 Announce Type: new Abstract: Activation steering has been used to control traits such as honesty, refusal, and sycophancy, yet supportive empathy is evaluated along multiple dimensi

researcharxiv-cs-cl

Generalized Agent Iteration: One Formal Framework for Iterative Policy Improvement and Recursive Self-Improvement

arXiv:2609.13406v1 Announce Type: new Abstract: When we speak of recursive self-improvement (RSI), are we speaking of a phenomenon, a mechanism, or a prospect? Towards autonomous and evolving intellig

How Lossless Is Lossless Speculative Decoding? The Role of Numerical Precision in Orthrus

arXiv:2609.15504v1 Announce Type: cross Abstract: Orthrus is a hybrid autoregressive-diffusion architecture that accelerates autoregressive language-model inference by generating multiple tokens in pa

Is my model perplexed for the right reason? Contrasting LLMs' Benchmark Behavior with Token-Level Perplexity

arXiv:2603.29396v2 Announce Type: replace Abstract: Standard evaluations of Large language models (LLMs) focus on task performance, offering limited insight into whether correct behavior reflects appr

JaxAHT: A JAX-Based Library for Ad Hoc Teamwork

arXiv:2609.13716v1 Announce Type: new Abstract: Ad Hoc Teamwork (AHT) addresses the challenge of designing agents capable of coordinating with novel partners without prior coordination. However, progr

K-Bench: A Benchmark for LLM Unlearning in Agentic Deployments

arXiv:2609.12808v2 Announce Type: replace Abstract: Unlearning benchmarks such as TOFU and MUSE certify forgetting by reading the model's final answer, where a model that refuses to answer already cou

Leakage-Safe and Scheduler-Aware Machine Learning for Grid Job Runtime Prediction

arXiv:2609.13701v1 Announce Type: cross Abstract: Accurate job runtime prediction can improve scheduling-aware resource management in grid and distributed computing environments, but prediction models

LLM-Microscope: Uncovering the Hidden Role of Punctuation in Context Memory of Transformers

arXiv:2502.15007v2 Announce Type: replace-cross Abstract: We introduce methods to quantify how Large Language Models (LLMs) encode and store contextual information, revealing that tokens often seen as

LPA-CWM: A Learned Physical Adjudicator for Motion Reasoning with Counterfactual World Models

arXiv:2609.14073v1 Announce Type: cross Abstract: Counterfactual world models (CWM) extract motion from pretrained video predictors by comparing factual and intervened predictions. However, responses

MarKey: Marginal Utility Guided Greedy Keyframe Selection for Long Video Understanding

arXiv:2609.15408v1 Announce Type: cross Abstract: Long-video understanding remains challenging for multimodal large language models (MLLMs) because densely encoding long frame sequences is computation

researcharxiv-cs-cl

Applications

Medical Knowledge Simplification for Patients in the Era of LLMs: A Case Study on Diabetes

arXiv:2609.15129v1 Announce Type: new Abstract: Complex medical information is often difficult for patients to understand, making effective medical knowledge simplification essential for improving pat

applicationsarxiv-cs-ai

ModiGen: A Large Language Model-Based Workflow for Multi-Task Modelica Code Generation

arXiv:2503.18460v2 Announce Type: replace-cross Abstract: Modelica is a widely adopted language for simulating complex physical systems, yet effective model creation and optimization require substanti

Agents

Moral Rebel Agents: Decision-Making Under Conflicting Obligations

arXiv:2609.14716v1 Announce Type: new Abstract: Autonomous agents are typically obliged to follow user-assigned tasks. However, strict obedience may conflict with moral obligations that arise during e

agentsarxiv-cs-ai

MoveBench: A Benchmark for Global-Scale Wildlife Movement Forecasting

model-releasesarxiv-cs-lg

arXiv:2609.15780v1 Announce Type: new Abstract: Understanding and predicting wildlife movement is critical for ecology and conservation. While trajectory forecasting has advanced for human and vehicle

Local Ai

Multi-Objective Hyperparameter Search via Damped Gauss--Newton Optimization

arXiv:2401.03580v2 Announce Type: replace-cross Abstract: We study hyperparameter optimization (HPO) from a numerical-optimization perspective and propose a multi-objective, damped Gauss--Newton searc

local-aiarxiv-cs-lg

Multimodal deep learning from spectra for small-molecule structure identification: enhancing robustness with mixed-condition training

arXiv:2609.14360v1 Announce Type: new Abstract: In practical molecular characterization, small-molecule structure identification benefits from complementary spectroscopic evidence, but missing, degrad

researcharxiv-cs-lg

Occlusal Geometry in Closed Form for Orthodontic Report Generation

arXiv:2609.13237v1 Announce Type: cross Abstract: Orthodontic report generation from intraoral data is normally cast as multimodal captioning, yet the released Bite2Text scan pairs are supplied alread

Agents

OpenAl4S: Code as Action, Science as Sessions

arXiv:2609.15096v1 Announce Type: new Abstract: AI co-scientists could accelerate computational research, but over a long-running study the workflow also has to stay inspectable, resumable and reprodu

agentsarxiv-cs-ai

Operational Range Bounding in Spectroscopy: A Safety Cage Framework for Machine Learning Models

arXiv:2609.13514v1 Announce Type: new Abstract: Ensuring the reliability of black-box machine learning models in safety-critical space missions remains a significant challenge, particularly when groun

safetyarxiv-cs-lg

Parameter-Efficient Fine-Tuning of Foundation Models for Liver Tumor Segmentation in CT

arXiv:2609.14106v1 Announce Type: new Abstract: We evaluated parameter-efficient fine-tuning (PEFT) of the Segment Anything Model (SAM) for liver tumor segmentation in abdominal CT of colorectal liver

Partition Scores Are Not System Scores: Deployment-Fidelity Gaps in Decomposed Algorithm Selection

arXiv:2609.13785v1 Announce Type: new Abstract: Oracle-style quantities, including virtual best solvers, selected-portfolio VBS, virtual-best encodings, and best-in-family summaries, are widely report

Applications

Personalized and Explainable Blood Pressure Estimation from PPG via Hybrid CNN--Morphological Features

arXiv:2609.13190v1 Announce Type: new Abstract: Continuous cuffless blood pressure (BP) monitoring using photoplethysmography (PPG) offers a promising solution for personalized healthcare. However, ex

applicationsarxiv-cs-cv

PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems

arXiv:2609.13152v1 Announce Type: new Abstract: Large language models (LLMs) perform strongly on static science benchmarks, yet their ability to reason about the physical world through active experime

Predictive Likelihood Ratios for Language Model Watermark Detection

arXiv:2609.15657v1 Announce Type: cross Abstract: Keyed watermark detection tests dependence between observed tokens and pseudorandom variables reconstructed from a secret key. Building on the pivotal

QSTAR: Quantum Selective Transfer with Adaptive Routing

model-releasesarxiv-cs-lg

arXiv:2607.21411v1 Announce Type: cross Abstract: Quantum transfer learning (QTL) is often evaluated by replacing a classical classifier with a fixed variational quantum head, but this hides a key que

Query-Conditioned Spherical Centroid Aggregation for Multimodal Retrieval

arXiv:2609.15335v1 Announce Type: new Abstract: Multimodal retrieval integrates video, audio, subtitles, and text; however, recent geometric aggregators, such as Gramian volumes, hyperbolic volumes, a

Realistic Continual Learning Approach using Pre-trained Models

arXiv:2404.07729v2 Announce Type: replace-cross Abstract: Continual learning (CL) evaluates adaptability in learning solutions to retain knowledge. Our research addresses the challenge of catastrophic

researcharxiv-cs-cv

Rethinking Correctness for Uncertainty Estimation in Clinical Prediction with Vision-Language Models

arXiv:2609.15180v1 Announce Type: new Abstract: Vision-language models are increasingly explored for clinical prediction from electronic health records and medical images, where identifying unreliable

researcharxiv-cs-lg

Reverse Spatio-Temporal Disease Progression Modelling

arXiv:2609.14590v1 Announce Type: new Abstract: Deep learning-based spatio-temporal disease progression models commonly overlook the incubation period of progressive diseases, limiting the use of thos

Same Patient, Different Order: Action-Level Reliability of Clinical LLM Agents Under Repeated Runs

arXiv:2609.13582v1 Announce Type: cross Abstract: A clinical agent benchmark can report the same verdict on identical inputs while the agent files a materially different order on each run. Such agents

SDUs DAISY: A Benchmark for Danish Culture

arXiv:2601.19930v2 Announce Type: replace-cross Abstract: We introduce Daisy, a factual knowledge benchmark for Danish cultural heritage, based on curated topics from the Danish Culture Canon 2006. Fo

Sharing standardized image-derived data in computational pathology using DICOM

arXiv:2609.14530v1 Announce Type: cross Abstract: Development and evaluation of computational pathology methods require access to large and diverse datasets. Over the past decade, various initiatives

Sweet Talkers: How Query Formulation Shapes Sycophancy in Romantic Relationship Advice

arXiv:2609.13841v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for emotional support and relationship advice, where a model's tendency to preserve a user's face can

Task-Based CT Protocol Optimization Using Reinforcement Learning and Virtual Imaging Trials

arXiv:2609.13309v1 Announce Type: cross Abstract: Protocol optimization in computed tomography (CT) aims to improve diagnostic image quality while reducing radiation dose, but the interdependence of a

The University of Melbourne WMT 2026 CreoleMT Submission: A Domain-Balanced Approach to Low-Resource Pacific Creole Machine Translation

arXiv:2609.13615v1 Announce Type: new Abstract: For our submission to the WMT26 Creole Language Translation Shared Task, we focus on machine translation (MT) models for Pacific creoles: Tok Pisin, Bis

Thinking beyond the anthropomorphic paradigm benefits LLM research

arXiv:2502.09192v3 Announce Type: replace Abstract: Anthropomorphism, or the attribution of human traits to technology, is an automatic and unconscious response that occurs even in those with advanced

researcharxiv-cs-cl

To do(x) or not to do(x): Medical Image Counterfactuals for Dataset Augmentation

arXiv:2609.14124v1 Announce Type: cross Abstract: Medical image analysis is often hindered by biased datasets, which can lead to biased models and limited clinical applicability. A promising strategy

Agents

Toward Self-Adaptive Physical AI: Can LLM Agents Manage Long-Horizon Physical Tasks?

arXiv:2609.13436v1 Announce Type: new Abstract: Large Language Model (LLM) agents offer a promising path toward autonomously managing long-term physical tasks without human intervention. However, phys

agentsarxiv-cs-ai

TRACTA: Benchmarking Temporal Reasoning over Semantic Trajectories

arXiv:2607.22365v2 Announce Type: replace Abstract: High-complexity operational environments require methods that characterize temporally distributed patterns rather than classify isolated events. Thi

TwinICL: Diagnosing Multimodal In-Context Learning through Paired Counterfactuals

arXiv:2609.15028v1 Announce Type: new Abstract: In-context learning (ICL) enables models to infer tasks from demonstrations, but existing benchmarks generally lack matched text and image versions need

VGFM: Expressive Robot Policies via Dense Value Guidance in Flow Matching

arXiv:2609.14261v1 Announce Type: cross Abstract: Recent robot learning paradigms increasingly rely on large offline datasets of robotic interactions to train control policies. Expressive generative m

safetyarxiv-cs-lg

Vision-Language Models for Criterion-Level Grading of Handwritten Examinations in Outcome-Based Education

arXiv:2609.14284v1 Announce Type: new Abstract: Criterion-level grading connects examination performance to learning outcomes, but manual marking introduces workload and variation between markers. Thi

What Does the Encoder Actually Decide? A Controlled Comparison of Vision Backbones on Joint Tree Segmentation and Stereo Depth

arXiv:2609.13232v1 Announce Type: new Abstract: A robot pruning trees needs two facts per pixel: whether it belongs to a tree, and its distance. Both are usually obtained via task heads attached to a

When Do Learned Priors Help Visual Inertial Estimation? A Controlled Study of Prior Integration, Calibration, Initialization, and Backend Consistency

arXiv:2609.13777v1 Announce Type: cross Abstract: Learned components are increasingly integrated into geometric visual--inertial estimators to provide motion, depth, bias, uncertainty, or confidence c

safetyarxiv-cs-cv