Search: “evaluation”

Safe Error Correction for Language Models: Frozen-Base Adjustment with Capability Preservation

arXiv:2609.16145v1 Announce Type: new Abstract: We study a practical question: can a small correction module fix errors in a frozen language model's outputs without degrading its base capabilities? We

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Shielded Analysis: Certification and Characterization of Defensibility in Systems under Adversarial Interaction

DGX agent

arXiv:2606.13621v2 Announce Type: replace Abstract: Formal safety analysis determines whether a system admits a safe defense; adaptive evaluation characterizes the operating quality sustained under ad

safetyarxiv-cs-ai

16 Sept 2026

ViD: Vision-Dominant Gender Bias Mitigation for Large Vision-Language Models

arXiv:2609.16647v1 Announce Type: new Abstract: Gender bias in large vision-language models (LVLMs) undermines their fairness and reliability, compromising output trustworthiness. Current mitigation m

VideoMM: Adaptive Macro-Micro Inference for Efficient Video MLLMs

arXiv:2609.16722v1 Announce Type: new Abstract: Scaling Multimodal Large Language Models (MLLMs) to long-form video understanding is bottlenecked by the explosion of visual tokens, which saturates con

When Should LLMs Abstain? Chain-of-Self-Questioning for Selective Risk Control

arXiv:2609.17516v1 Announce Type: cross Abstract: Large language models can produce fluent answers when their factual support is weak. This paper introduces Chain-of-Self-Questioning (CoSQ), a prompt-

World Models for Embodied Intelligence: From Plausible to Controllable to Actionable

arXiv:2609.16697v1 Announce Type: cross Abstract: World models connect perception and decision-making in embodied intelligence by maintaining hidden state, anticipating consequences, comparing interve

Accurate and Scalable Multimodal Pathology Retrieval via Attentive Vision-Language Alignment

arXiv:2510.23224v2 Announce Type: replace Abstract: The rapid digitization of histopathology slides has opened new opportunities for computational tools in clinical and research workflows. Content-bas

safetyarxiv-cs-cv

ActGuard: Pre-execution Action Auditing against Indirect Prompt Injection in LLM Agents

arXiv:2609.14987v1 Announce Type: cross Abstract: Large language model (LLM) agents interact with external environments through tool invocation, but tool outputs can also expose them to indirect promp

Tutorials

Aerial Wildfire Suppression Planning with a Hybrid CNN-Cellular Automata Fire Model

arXiv:2606.13633v2 Announce Type: replace-cross Abstract: Aerial wildfire suppression requires decisions about when, where, and how to deploy limited aircraft. We present an intervention-design framew

tutorialsarxiv-cs-lg

Algorithm Validation as a Policy Audit: Evidence from Race-blind Charging

arXiv:2609.13174v1 Announce Type: cross Abstract: California recently required all prosecutors in the state to conduct a 'race-blind charging' decision by reviewing case documents in which selected ra

safetyarxiv-cs-cl

ANASSA: An Agentic AI Orchestration Framework for Spatial Intelligence

arXiv:2609.14824v1 Announce Type: new Abstract: The emergence of large language models (LLMs) and large multimodal models (LMMs) has enabled a new class of agentic systems capable of integrating natur

Assessing nnU-Net Generalization across Brain Tumor Populations in BraTS-GoAT 2026

arXiv:2609.15524v1 Announce Type: new Abstract: BraTS-GoAT evaluates tumor segmentation across heterogeneous populations. We trained a conventional 3D nnU-Net on 1,351 labeled cases using five-fold cr

researcharxiv-cs-cv

Before You Poll with LLMs: A Deliberative Diagnostic Framework

arXiv:2609.15849v1 Announce Type: cross Abstract: Can LLMs reason through new information like humans, or do they merely retrieve cached opinions? This is critical for silicon sampling, where LLM pers

Beyond Natural Images: Rethinking AI-Generated Image Detection in Documents

arXiv:2609.14352v1 Announce Type: new Abstract: AI-generated image detection has attracted increasing attention, but existing evaluations mainly focus on natural images, leaving AI-generated document

Beyond Scene Description: Multi-Agent Orchestration for Non-visual Access to Virtual Worlds

arXiv:2609.14512v1 Announce Type: new Abstract: Virtual worlds now host classrooms, meetings, conferences, shops, and social venues, and nearly every interaction they expose assumes a user who can sca

safetyarxiv-cs-ai

Bridging the Modality Gap in Long-Form Clinical Audio: A Comparative Study of Lightweight and Heavyweight End-to-End SOAP Generation

arXiv:2609.14467v1 Announce Type: cross Abstract: Automating clinical documentation from long-form doctor-patient conversations remains challenging for modern audio-language models. While cascaded ASR

Can We Stop Malicious AI? KILLBENCH: A Benchmark for External AI Kill Switch Feasibility

arXiv:2511.13725v5 Announce Type: replace-cross Abstract: Malicious AI causing harm to humans is not just a Hollywood fantasy. Indeed, as highly capable models such as Claude Mythos emerge and agent s

Chance-Constrained Belief-Space Maneuver Planning for Autonomous Collision Avoidance Under Uncertainty

arXiv:2609.13428v1 Announce Type: cross Abstract: Increasing conjunction frequency in low Earth orbit places growing pressure on spacecraft operators to determine not only whether an encounter require

CiteGuard-RAG: A Validation-Centered AI System for Evidence-Grounded Question Answering

arXiv:2609.15830v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) can improve access to complex information; however, retrieving evidence alone does not ensure that answers are gr

safetyarxiv-cs-ai

CRITICS - Critical Science Without Borders: Language Models to Promote Critical Thinking in Science Education

arXiv:2609.13942v1 Announce Type: cross Abstract: The CRITICS project addresses science accessibility and literacy by converging advanced Machine Translation (MT) based on Large Language Models (LLMs)

applicationsarxiv-cs-ai

Local Ai

DeepDiscovery: A Location-Inference Framework for Task-Level Repository Understanding

arXiv:2606.22906v2 Announce Type: replace-cross Abstract: Large language models have shown strong performance on software engineering (SE) tasks, yet understanding large industrial repositories remain

local-aiarxiv-cs-ai

DeepFeature: LLM-Empowered Context-aware Feature Generation for Wearable Biosignals

arXiv:2512.08379v3 Announce Type: replace Abstract: Biosignals collected from wearable devices are widely utilized in healthcare applications. Machine learning models used in these applications often

applicationsarxiv-cs-ai

Empathy Is Steerable but Multi-Axial: Mechanism Geometry and Persona Effects in LLMs

arXiv:2609.15654v1 Announce Type: new Abstract: Activation steering has been used to control traits such as honesty, refusal, and sycophancy, yet supportive empathy is evaluated along multiple dimensi

researcharxiv-cs-cl

Generalized Agent Iteration: One Formal Framework for Iterative Policy Improvement and Recursive Self-Improvement

arXiv:2609.13406v1 Announce Type: new Abstract: When we speak of recursive self-improvement (RSI), are we speaking of a phenomenon, a mechanism, or a prospect? Towards autonomous and evolving intellig

safetyarxiv-cs-ai

How Lossless Is Lossless Speculative Decoding? The Role of Numerical Precision in Orthrus

arXiv:2609.15504v1 Announce Type: cross Abstract: Orthrus is a hybrid autoregressive-diffusion architecture that accelerates autoregressive language-model inference by generating multiple tokens in pa

Is my model perplexed for the right reason? Contrasting LLMs' Benchmark Behavior with Token-Level Perplexity

model-releasesarxiv-cs-cl

arXiv:2603.29396v2 Announce Type: replace Abstract: Standard evaluations of Large language models (LLMs) focus on task performance, offering limited insight into whether correct behavior reflects appr

JaxAHT: A JAX-Based Library for Ad Hoc Teamwork

arXiv:2609.13716v1 Announce Type: new Abstract: Ad Hoc Teamwork (AHT) addresses the challenge of designing agents capable of coordinating with novel partners without prior coordination. However, progr

K-Bench: A Benchmark for LLM Unlearning in Agentic Deployments

arXiv:2609.12808v2 Announce Type: replace Abstract: Unlearning benchmarks such as TOFU and MUSE certify forgetting by reading the model's final answer, where a model that refuses to answer already cou

Leakage-Safe and Scheduler-Aware Machine Learning for Grid Job Runtime Prediction

arXiv:2609.13701v1 Announce Type: cross Abstract: Accurate job runtime prediction can improve scheduling-aware resource management in grid and distributed computing environments, but prediction models

LLM-Microscope: Uncovering the Hidden Role of Punctuation in Context Memory of Transformers

arXiv:2502.15007v2 Announce Type: replace-cross Abstract: We introduce methods to quantify how Large Language Models (LLMs) encode and store contextual information, revealing that tokens often seen as

LPA-CWM: A Learned Physical Adjudicator for Motion Reasoning with Counterfactual World Models

arXiv:2609.14073v1 Announce Type: cross Abstract: Counterfactual world models (CWM) extract motion from pretrained video predictors by comparing factual and intervened predictions. However, responses

MarKey: Marginal Utility Guided Greedy Keyframe Selection for Long Video Understanding

arXiv:2609.15408v1 Announce Type: cross Abstract: Long-video understanding remains challenging for multimodal large language models (MLLMs) because densely encoding long frame sequences is computation

researcharxiv-cs-cl

Medical Knowledge Simplification for Patients in the Era of LLMs: A Case Study on Diabetes

arXiv:2609.15129v1 Announce Type: new Abstract: Complex medical information is often difficult for patients to understand, making effective medical knowledge simplification essential for improving pat

applicationsarxiv-cs-ai

ModiGen: A Large Language Model-Based Workflow for Multi-Task Modelica Code Generation

arXiv:2503.18460v2 Announce Type: replace-cross Abstract: Modelica is a widely adopted language for simulating complex physical systems, yet effective model creation and optimization require substanti

Moral Rebel Agents: Decision-Making Under Conflicting Obligations

arXiv:2609.14716v1 Announce Type: new Abstract: Autonomous agents are typically obliged to follow user-assigned tasks. However, strict obedience may conflict with moral obligations that arise during e

MoveBench: A Benchmark for Global-Scale Wildlife Movement Forecasting

model-releasesarxiv-cs-lg

arXiv:2609.15780v1 Announce Type: new Abstract: Understanding and predicting wildlife movement is critical for ecology and conservation. While trajectory forecasting has advanced for human and vehicle

Local Ai

Multi-Objective Hyperparameter Search via Damped Gauss--Newton Optimization

arXiv:2401.03580v2 Announce Type: replace-cross Abstract: We study hyperparameter optimization (HPO) from a numerical-optimization perspective and propose a multi-objective, damped Gauss--Newton searc

local-aiarxiv-cs-lg

Multimodal deep learning from spectra for small-molecule structure identification: enhancing robustness with mixed-condition training

arXiv:2609.14360v1 Announce Type: new Abstract: In practical molecular characterization, small-molecule structure identification benefits from complementary spectroscopic evidence, but missing, degrad

researcharxiv-cs-lg

Occlusal Geometry in Closed Form for Orthodontic Report Generation

model-releasesarxiv-cs-cl

arXiv:2609.13237v1 Announce Type: cross Abstract: Orthodontic report generation from intraoral data is normally cast as multimodal captioning, yet the released Bite2Text scan pairs are supplied alread

OpenAl4S: Code as Action, Science as Sessions

arXiv:2609.15096v1 Announce Type: new Abstract: AI co-scientists could accelerate computational research, but over a long-running study the workflow also has to stay inspectable, resumable and reprodu

Operational Range Bounding in Spectroscopy: A Safety Cage Framework for Machine Learning Models

arXiv:2609.13514v1 Announce Type: new Abstract: Ensuring the reliability of black-box machine learning models in safety-critical space missions remains a significant challenge, particularly when groun

safetyarxiv-cs-lg

Parameter-Efficient Fine-Tuning of Foundation Models for Liver Tumor Segmentation in CT

arXiv:2609.14106v1 Announce Type: new Abstract: We evaluated parameter-efficient fine-tuning (PEFT) of the Segment Anything Model (SAM) for liver tumor segmentation in abdominal CT of colorectal liver

Partition Scores Are Not System Scores: Deployment-Fidelity Gaps in Decomposed Algorithm Selection

arXiv:2609.13785v1 Announce Type: new Abstract: Oracle-style quantities, including virtual best solvers, selected-portfolio VBS, virtual-best encodings, and best-in-family summaries, are widely report

Personalized and Explainable Blood Pressure Estimation from PPG via Hybrid CNN--Morphological Features

arXiv:2609.13190v1 Announce Type: new Abstract: Continuous cuffless blood pressure (BP) monitoring using photoplethysmography (PPG) offers a promising solution for personalized healthcare. However, ex

applicationsarxiv-cs-cv

PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems

model-releasesarxiv-cs-cl

arXiv:2609.13152v1 Announce Type: new Abstract: Large language models (LLMs) perform strongly on static science benchmarks, yet their ability to reason about the physical world through active experime

Predictive Likelihood Ratios for Language Model Watermark Detection

arXiv:2609.15657v1 Announce Type: cross Abstract: Keyed watermark detection tests dependence between observed tokens and pseudorandom variables reconstructed from a secret key. Building on the pivotal

QSTAR: Quantum Selective Transfer with Adaptive Routing

model-releasesarxiv-cs-lg

arXiv:2607.21411v1 Announce Type: cross Abstract: Quantum transfer learning (QTL) is often evaluated by replacing a classical classifier with a fixed variational quantum head, but this hides a key que

Query-Conditioned Spherical Centroid Aggregation for Multimodal Retrieval

arXiv:2609.15335v1 Announce Type: new Abstract: Multimodal retrieval integrates video, audio, subtitles, and text; however, recent geometric aggregators, such as Gramian volumes, hyperbolic volumes, a