Search: “evaluation”

Learning-Guided Planning in Large Dynamic Action Spaces: Budgeted Tree Search for One-to-Many Mobile Charging

arXiv:2609.17429v1 Announce Type: cross Abstract: Many learned sequential decision systems map the current state directly to an action. That shortcut becomes brittle when candidate actions are numerou

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

little m: An AI Agent for Industrial Process Optimization

DGX agent

arXiv:2609.16680v1 Announce Type: new Abstract: Manufacturing consumes one third of global energy and still has significant room for improvement in terms of energy efficiency. Optimal process control

model-releasesarxiv-cs-ai

16 Sept 2026

MLPerf Inference v6.1: pioneering agent, VLM benchmarks

MLPerf Inference v6.1 introduced the first agentic workload run on datacenter hardware and evaluated a model with more than one trillion parameters (Kimi K2), setting a new benchmark for scale. The te

agentslambda-labs

OPD-Aha: From Linguistic Momentum to Visual Reflection in Multimodal On-Policy Distillation

arXiv:2609.16459v1 Announce Type: cross Abstract: Privileged on-policy distillation improves multimodal reasoning by allowing a teacher to evaluate student trajectories using rich, training-only visua

Optimizing agent system prompts with Amazon Bedrock AgentCore

model-releasesaws-ml-blog

AgentCore optimization turns production traces into proposed configuration changes, then validates them before promotion. This technical companion to the launch post explains how the system prompt opt

PARSA-Bench: A Comprehensive Persian Audio-Language Model Benchmark

model-releasesarxiv-cs-cl

arXiv:2603.14456v2 Announce Type: replace Abstract: Persian poses unique audio understanding challenges through its classical poetry, traditional music, and pervasive code-switching, none of which is

Safe Error Correction for Language Models: Frozen-Base Adjustment with Capability Preservation

arXiv:2609.16145v1 Announce Type: new Abstract: We study a practical question: can a small correction module fix errors in a frozen language model's outputs without degrading its base capabilities? We

Shielded Analysis: Certification and Characterization of Defensibility in Systems under Adversarial Interaction

arXiv:2606.13621v2 Announce Type: replace Abstract: Formal safety analysis determines whether a system admits a safe defense; adaptive evaluation characterizes the operating quality sustained under ad

ViD: Vision-Dominant Gender Bias Mitigation for Large Vision-Language Models

model-releasesarxiv-cs-cv

arXiv:2609.16647v1 Announce Type: new Abstract: Gender bias in large vision-language models (LVLMs) undermines their fairness and reliability, compromising output trustworthiness. Current mitigation m

VideoMM: Adaptive Macro-Micro Inference for Efficient Video MLLMs

arXiv:2609.16722v1 Announce Type: new Abstract: Scaling Multimodal Large Language Models (MLLMs) to long-form video understanding is bottlenecked by the explosion of visual tokens, which saturates con

When Should LLMs Abstain? Chain-of-Self-Questioning for Selective Risk Control

arXiv:2609.17516v1 Announce Type: cross Abstract: Large language models can produce fluent answers when their factual support is weak. This paper introduces Chain-of-Self-Questioning (CoSQ), a prompt-

World Models for Embodied Intelligence: From Plausible to Controllable to Actionable

arXiv:2609.16697v1 Announce Type: cross Abstract: World models connect perception and decision-making in embodied intelligence by maintaining hidden state, anticipating consequences, comparing interve

Accurate and Scalable Multimodal Pathology Retrieval via Attentive Vision-Language Alignment

arXiv:2510.23224v2 Announce Type: replace Abstract: The rapid digitization of histopathology slides has opened new opportunities for computational tools in clinical and research workflows. Content-bas

safetyarxiv-cs-cv

ActGuard: Pre-execution Action Auditing against Indirect Prompt Injection in LLM Agents

arXiv:2609.14987v1 Announce Type: cross Abstract: Large language model (LLM) agents interact with external environments through tool invocation, but tool outputs can also expose them to indirect promp

Tutorials

Aerial Wildfire Suppression Planning with a Hybrid CNN-Cellular Automata Fire Model

arXiv:2606.13633v2 Announce Type: replace-cross Abstract: Aerial wildfire suppression requires decisions about when, where, and how to deploy limited aircraft. We present an intervention-design framew

tutorialsarxiv-cs-lg

Algorithm Validation as a Policy Audit: Evidence from Race-blind Charging

arXiv:2609.13174v1 Announce Type: cross Abstract: California recently required all prosecutors in the state to conduct a 'race-blind charging' decision by reviewing case documents in which selected ra

safetyarxiv-cs-cl

ANASSA: An Agentic AI Orchestration Framework for Spatial Intelligence

arXiv:2609.14824v1 Announce Type: new Abstract: The emergence of large language models (LLMs) and large multimodal models (LMMs) has enabled a new class of agentic systems capable of integrating natur

Assessing nnU-Net Generalization across Brain Tumor Populations in BraTS-GoAT 2026

arXiv:2609.15524v1 Announce Type: new Abstract: BraTS-GoAT evaluates tumor segmentation across heterogeneous populations. We trained a conventional 3D nnU-Net on 1,351 labeled cases using five-fold cr

researcharxiv-cs-cv

Before You Poll with LLMs: A Deliberative Diagnostic Framework

arXiv:2609.15849v1 Announce Type: cross Abstract: Can LLMs reason through new information like humans, or do they merely retrieve cached opinions? This is critical for silicon sampling, where LLM pers

Beyond Natural Images: Rethinking AI-Generated Image Detection in Documents

model-releasesarxiv-cs-cv

arXiv:2609.14352v1 Announce Type: new Abstract: AI-generated image detection has attracted increasing attention, but existing evaluations mainly focus on natural images, leaving AI-generated document

Beyond Scene Description: Multi-Agent Orchestration for Non-visual Access to Virtual Worlds

arXiv:2609.14512v1 Announce Type: new Abstract: Virtual worlds now host classrooms, meetings, conferences, shops, and social venues, and nearly every interaction they expose assumes a user who can sca

Bridging the Modality Gap in Long-Form Clinical Audio: A Comparative Study of Lightweight and Heavyweight End-to-End SOAP Generation

arXiv:2609.14467v1 Announce Type: cross Abstract: Automating clinical documentation from long-form doctor-patient conversations remains challenging for modern audio-language models. While cascaded ASR

Can We Stop Malicious AI? KILLBENCH: A Benchmark for External AI Kill Switch Feasibility

arXiv:2511.13725v5 Announce Type: replace-cross Abstract: Malicious AI causing harm to humans is not just a Hollywood fantasy. Indeed, as highly capable models such as Claude Mythos emerge and agent s

Chance-Constrained Belief-Space Maneuver Planning for Autonomous Collision Avoidance Under Uncertainty

arXiv:2609.13428v1 Announce Type: cross Abstract: Increasing conjunction frequency in low Earth orbit places growing pressure on spacecraft operators to determine not only whether an encounter require

CiteGuard-RAG: A Validation-Centered AI System for Evidence-Grounded Question Answering

arXiv:2609.15830v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) can improve access to complex information; however, retrieving evidence alone does not ensure that answers are gr

Applications

CRITICS - Critical Science Without Borders: Language Models to Promote Critical Thinking in Science Education

arXiv:2609.13942v1 Announce Type: cross Abstract: The CRITICS project addresses science accessibility and literacy by converging advanced Machine Translation (MT) based on Large Language Models (LLMs)

applicationsarxiv-cs-ai

Local Ai

DeepDiscovery: A Location-Inference Framework for Task-Level Repository Understanding

arXiv:2606.22906v2 Announce Type: replace-cross Abstract: Large language models have shown strong performance on software engineering (SE) tasks, yet understanding large industrial repositories remain

local-aiarxiv-cs-ai

Applications

DeepFeature: LLM-Empowered Context-aware Feature Generation for Wearable Biosignals

arXiv:2512.08379v3 Announce Type: replace Abstract: Biosignals collected from wearable devices are widely utilized in healthcare applications. Machine learning models used in these applications often

applicationsarxiv-cs-ai

Empathy Is Steerable but Multi-Axial: Mechanism Geometry and Persona Effects in LLMs

arXiv:2609.15654v1 Announce Type: new Abstract: Activation steering has been used to control traits such as honesty, refusal, and sycophancy, yet supportive empathy is evaluated along multiple dimensi

researcharxiv-cs-cl

Generalized Agent Iteration: One Formal Framework for Iterative Policy Improvement and Recursive Self-Improvement

arXiv:2609.13406v1 Announce Type: new Abstract: When we speak of recursive self-improvement (RSI), are we speaking of a phenomenon, a mechanism, or a prospect? Towards autonomous and evolving intellig

How Lossless Is Lossless Speculative Decoding? The Role of Numerical Precision in Orthrus

arXiv:2609.15504v1 Announce Type: cross Abstract: Orthrus is a hybrid autoregressive-diffusion architecture that accelerates autoregressive language-model inference by generating multiple tokens in pa

Is my model perplexed for the right reason? Contrasting LLMs' Benchmark Behavior with Token-Level Perplexity

model-releasesarxiv-cs-cl

arXiv:2603.29396v2 Announce Type: replace Abstract: Standard evaluations of Large language models (LLMs) focus on task performance, offering limited insight into whether correct behavior reflects appr

JaxAHT: A JAX-Based Library for Ad Hoc Teamwork

arXiv:2609.13716v1 Announce Type: new Abstract: Ad Hoc Teamwork (AHT) addresses the challenge of designing agents capable of coordinating with novel partners without prior coordination. However, progr

K-Bench: A Benchmark for LLM Unlearning in Agentic Deployments

arXiv:2609.12808v2 Announce Type: replace Abstract: Unlearning benchmarks such as TOFU and MUSE certify forgetting by reading the model's final answer, where a model that refuses to answer already cou

Leakage-Safe and Scheduler-Aware Machine Learning for Grid Job Runtime Prediction

arXiv:2609.13701v1 Announce Type: cross Abstract: Accurate job runtime prediction can improve scheduling-aware resource management in grid and distributed computing environments, but prediction models

LLM-Microscope: Uncovering the Hidden Role of Punctuation in Context Memory of Transformers

arXiv:2502.15007v2 Announce Type: replace-cross Abstract: We introduce methods to quantify how Large Language Models (LLMs) encode and store contextual information, revealing that tokens often seen as

LPA-CWM: A Learned Physical Adjudicator for Motion Reasoning with Counterfactual World Models

arXiv:2609.14073v1 Announce Type: cross Abstract: Counterfactual world models (CWM) extract motion from pretrained video predictors by comparing factual and intervened predictions. However, responses

MarKey: Marginal Utility Guided Greedy Keyframe Selection for Long Video Understanding

arXiv:2609.15408v1 Announce Type: cross Abstract: Long-video understanding remains challenging for multimodal large language models (MLLMs) because densely encoding long frame sequences is computation

researcharxiv-cs-cl

Applications

Medical Knowledge Simplification for Patients in the Era of LLMs: A Case Study on Diabetes

arXiv:2609.15129v1 Announce Type: new Abstract: Complex medical information is often difficult for patients to understand, making effective medical knowledge simplification essential for improving pat

applicationsarxiv-cs-ai

ModiGen: A Large Language Model-Based Workflow for Multi-Task Modelica Code Generation

arXiv:2503.18460v2 Announce Type: replace-cross Abstract: Modelica is a widely adopted language for simulating complex physical systems, yet effective model creation and optimization require substanti

Moral Rebel Agents: Decision-Making Under Conflicting Obligations

arXiv:2609.14716v1 Announce Type: new Abstract: Autonomous agents are typically obliged to follow user-assigned tasks. However, strict obedience may conflict with moral obligations that arise during e

MoveBench: A Benchmark for Global-Scale Wildlife Movement Forecasting

model-releasesarxiv-cs-lg

arXiv:2609.15780v1 Announce Type: new Abstract: Understanding and predicting wildlife movement is critical for ecology and conservation. While trajectory forecasting has advanced for human and vehicle

Local Ai

Multi-Objective Hyperparameter Search via Damped Gauss--Newton Optimization

arXiv:2401.03580v2 Announce Type: replace-cross Abstract: We study hyperparameter optimization (HPO) from a numerical-optimization perspective and propose a multi-objective, damped Gauss--Newton searc

local-aiarxiv-cs-lg

Multimodal deep learning from spectra for small-molecule structure identification: enhancing robustness with mixed-condition training

arXiv:2609.14360v1 Announce Type: new Abstract: In practical molecular characterization, small-molecule structure identification benefits from complementary spectroscopic evidence, but missing, degrad

researcharxiv-cs-lg

Occlusal Geometry in Closed Form for Orthodontic Report Generation

model-releasesarxiv-cs-cl

arXiv:2609.13237v1 Announce Type: cross Abstract: Orthodontic report generation from intraoral data is normally cast as multimodal captioning, yet the released Bite2Text scan pairs are supplied alread

OpenAl4S: Code as Action, Science as Sessions

arXiv:2609.15096v1 Announce Type: new Abstract: AI co-scientists could accelerate computational research, but over a long-running study the workflow also has to stay inspectable, resumable and reprodu

Operational Range Bounding in Spectroscopy: A Safety Cage Framework for Machine Learning Models

arXiv:2609.13514v1 Announce Type: new Abstract: Ensuring the reliability of black-box machine learning models in safety-critical space missions remains a significant challenge, particularly when groun

safetyarxiv-cs-lg

Parameter-Efficient Fine-Tuning of Foundation Models for Liver Tumor Segmentation in CT

model-releasesarxiv-cs-cv

arXiv:2609.14106v1 Announce Type: new Abstract: We evaluated parameter-efficient fine-tuning (PEFT) of the Segment Anything Model (SAM) for liver tumor segmentation in abdominal CT of colorectal liver