Search: “evaluation”

Linguistic Triggers of Gender and Racial Bias in Open-Weight LLMs Applied to Recruitment

arXiv:2609.18106v1 Announce Type: cross Abstract: Open-weight large language models are rapidly entering hiring pipelines, yet their discriminatory failure modes -- and the regulatory exposure these c

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

LM Fight Arena: Benchmarking Large Multimodal Models via Game Competition

DGX agent

arXiv:2510.08928v2 Announce Type: replace Abstract: Existing benchmarks for large multimodal models (LMMs) often fail to capture their performance in real-time, adversarial environments. We introduce

model-releasesarxiv-cs-ai

17 Sept 2026

Local Ai

LocQE: Principled Domain Adaptation for Localisation Quality Estimation by Leveraging Post-Edits

arXiv:2609.18720v1 Announce Type: new Abstract: Learned quality estimation (QE) models such as COMETKiwi are widespread and work well for general machine translation evaluation. However, they are know

local-aiarxiv-cs-cl

Playing log(N)-Questions over Wikipedia Abstracts: Communication Efficiency Between Paired Frontier Models

arXiv:2609.19113v1 Announce Type: new Abstract: We evaluate six frontier language models on the two-agent log(N)-Questions game. A questioner sees N Wikipedia lead paragraphs and must identify a secre

QEMScore: How Much Does the Measurement Add to Learned Quantum Error Mitigation?

model-releasesarxiv-cs-lg

arXiv:2609.17896v1 Announce Type: cross Abstract: How much does the noisy measurement add to learned quantum error mitigation? An accuracy table cannot say, because a model handed circuit structure ca

ReFigBench: Benchmarking Scientific Figure Reconstruction as Editable PowerPoint Artifacts

arXiv:2609.18844v1 Announce Type: new Abstract: Multimodal coding agents are expected to turn visual inputs into usable artifacts, and they act through a harness, the layer of tools, context managemen

Reflections on Trusting Trust, Revisited: Contaminating Self-Modifying AI Coding Agents with Poisoned Benchmarks

arXiv:2609.17817v1 Announce Type: cross Abstract: Thompson's 'Reflections on Trusting Trust' showed that a compiler can be poisoned to reinsert its own backdoor, so that even recompiling clean source

SNOMED CT Concept Recommendation from Masked Clinical Context

arXiv:2609.17855v1 Announce Type: new Abstract: Standardizing clinical language to SNOMED CT supports interoperability, analytics, and reusable phenotyping, but concept recommendation remains difficul

Social Laws for Multi-agent Coordination in Stochastic Environments

arXiv:2609.18929v1 Announce Type: cross Abstract: In multi-agent environments, coordinating agents to prevent interference and ensure robust individual performance is a critical challenge. Previous re

Which LLM is Best for Translating Natural Language Goals to PDDL

arXiv:2609.18731v1 Announce Type: new Abstract: Bridging the gap between human intent and machine execution remains a challenge in automated planning, where expressing goals in formal languages like P

Zero-Shot Cross-Lingual Recognition of Sign Language Handshapes

arXiv:2609.18772v1 Announce Type: new Abstract: Sign language processing advances rapidly for high-resource languages such as American Sign Language (ASL), yet most of the world's sign languages lack

A panoramic aerodynamic performance prediction method for turbomachinery cascades using transformer-enhanced neural operator

arXiv:2609.16066v1 Announce Type: new Abstract: To enable flexible and rapid aerodynamic performance evaluation in turbomachinery design, this paper proposes a panoramic performance prediction framewo

researcharxiv-cs-lg

AI for Games in the Foundation Model Era

arXiv:2609.16679v1 Announce Type: new Abstract: Foundation models, alongside advances in learned game-world models, are reshaping AI across the game lifecycle. Beyond playing games, recent systems mod

Autoformalizing Argumentative Material Inferences

arXiv:2609.16991v1 Announce Type: new Abstract: Natural language arguments are compelling before they are formally explicit. A premise supports a claim through defeasible warrants, background commitme

researcharxiv-cs-cl

Benchmarking Factual Robustness of LLMs via Multi-conversation Persuasion

arXiv:2609.16777v1 Announce Type: new Abstract: As Large Language Models (LLMs) increasingly serve as primary knowledge retrieval interfaces, their robustness against extit{persuasion attacks}---attem

safetyarxiv-cs-cl

Bio-Inspired Palette Evolution in Indirectly Encoded Substrates: Timescale Compatibility Shapes Activation Function Discovery

arXiv:2609.17067v1 Announce Type: cross Abstract: Indirectly encoded neural networks can assign different activation functions to individual nodes, but the right functions are rarely known in advance.

researcharxiv-cs-lg

Bridging the Perceptual Gap: Residual-Enhanced Downscaling and Manifold-Aware Perception Alignment Adaptation for NR-IQA

arXiv:2609.16664v1 Announce Type: new Abstract: Leveraging Large Vision-Language Models like CLIP has recently set new benchmarks for No-Reference Image Quality Assessment (NR-IQA). However, the contr

Competence-Preserving Resume Perturbations Expose Presentation Sensitivity in LLM Screening

arXiv:2609.16517v1 Announce Type: cross Abstract: Resume screeners must infer job-relevant competence from resumes whose presentation can vary substantially in wording, structure, stylistic polish, an

Local Ai

CorrRisk-WM: Corridor-Conditioned Risk World Modeling for Safety-Critical Trajectory Planning

arXiv:2609.16724v1 Announce Type: new Abstract: Safe local planning requires forecasting surrounding-agent motion and evaluating candidate-specific risks, since identical agent motion can pose differe

local-aiarxiv-cs-ro

Applications

Cross-Anatomy Transfer Versus Sparse Interpolation in Digital-Twin-Oriented Aortic Fluid-Structure Interaction Surrogates

arXiv:2609.16322v1 Announce Type: new Abstract: Surrogate credibility for fluid-structure interac- tion (FSI) requires distinguishing transfer across independent anatomies from interpolation within an

applicationsarxiv-cs-ai

Cross-Domain Inference for Human Localization: Applying Wi-Fi RSSI Data to CSI-Trained Models

arXiv:2609.17204v1 Announce Type: cross Abstract: Wi-Fi signal data can be used to compromise the privacy of individuals. While many existing approaches rely on Channel State Information (CSI), collec

researcharxiv-cs-lg

Few-Shot Degradation Is Not What It Seems: Behavioral Evidence, Representation Analysis, and a Random-Text Control Across 12 Models, 2 Tasks, and 2 Architectures

arXiv:2609.15990v1 Announce Type: new Abstract: Few-shot prompting sometimes degrades language models instead of helping them, but why this happens is unknown. We evaluate 12 open-weight models on two

FluxVLA Engine: A One-Stop VLA Engineering Platform for Embodied Intelligence

arXiv:2609.17210v1 Announce Type: cross Abstract: Vision-language-action (VLA) models, world-action models (WAMs), and offline reinforcement learning methods are rapidly expanding the design space of

GeoCrossBench: Cross-Band Generalization for Remote Sensing

model-releasesarxiv-cs-lg

arXiv:2511.02831v2 Announce Type: replace Abstract: The data for remote sensing is constantly acquired, and new data comes from a growing number and diversity of satellites, while the vast majority of

GRADE: Benchmarking Discipline-Informed Reasoning in Image Editing

arXiv:2603.12264v2 Announce Type: replace Abstract: Unified multimodal models target joint understanding, reasoning, and generation, but current image editing benchmarks are largely confined to natura

Latent Undertow: How Ordinary Typos Break Probes

arXiv:2609.15994v1 Announce Type: new Abstract: LLMs handle ordinary typing variation fluently: a typo or missing punctuation leaves both user intent and the model's response substantively unchanged.

Learning-Guided Planning in Large Dynamic Action Spaces: Budgeted Tree Search for One-to-Many Mobile Charging

arXiv:2609.17429v1 Announce Type: cross Abstract: Many learned sequential decision systems map the current state directly to an action. That shortcut becomes brittle when candidate actions are numerou

little m: An AI Agent for Industrial Process Optimization

arXiv:2609.16680v1 Announce Type: new Abstract: Manufacturing consumes one third of global energy and still has significant room for improvement in terms of energy efficiency. Optimal process control

OPD-Aha: From Linguistic Momentum to Visual Reflection in Multimodal On-Policy Distillation

arXiv:2609.16459v1 Announce Type: cross Abstract: Privileged on-policy distillation improves multimodal reasoning by allowing a teacher to evaluate student trajectories using rich, training-only visua

PARSA-Bench: A Comprehensive Persian Audio-Language Model Benchmark

arXiv:2603.14456v2 Announce Type: replace Abstract: Persian poses unique audio understanding challenges through its classical poetry, traditional music, and pervasive code-switching, none of which is

Safe Error Correction for Language Models: Frozen-Base Adjustment with Capability Preservation

arXiv:2609.16145v1 Announce Type: new Abstract: We study a practical question: can a small correction module fix errors in a frozen language model's outputs without degrading its base capabilities? We

Shielded Analysis: Certification and Characterization of Defensibility in Systems under Adversarial Interaction

arXiv:2606.13621v2 Announce Type: replace Abstract: Formal safety analysis determines whether a system admits a safe defense; adaptive evaluation characterizes the operating quality sustained under ad

ViD: Vision-Dominant Gender Bias Mitigation for Large Vision-Language Models

arXiv:2609.16647v1 Announce Type: new Abstract: Gender bias in large vision-language models (LVLMs) undermines their fairness and reliability, compromising output trustworthiness. Current mitigation m

VideoMM: Adaptive Macro-Micro Inference for Efficient Video MLLMs

arXiv:2609.16722v1 Announce Type: new Abstract: Scaling Multimodal Large Language Models (MLLMs) to long-form video understanding is bottlenecked by the explosion of visual tokens, which saturates con

When Should LLMs Abstain? Chain-of-Self-Questioning for Selective Risk Control

arXiv:2609.17516v1 Announce Type: cross Abstract: Large language models can produce fluent answers when their factual support is weak. This paper introduces Chain-of-Self-Questioning (CoSQ), a prompt-

Agents

World Models for Embodied Intelligence: From Plausible to Controllable to Actionable

arXiv:2609.16697v1 Announce Type: cross Abstract: World models connect perception and decision-making in embodied intelligence by maintaining hidden state, anticipating consequences, comparing interve

agentsarxiv-cs-ai

Accurate and Scalable Multimodal Pathology Retrieval via Attentive Vision-Language Alignment

arXiv:2510.23224v2 Announce Type: replace Abstract: The rapid digitization of histopathology slides has opened new opportunities for computational tools in clinical and research workflows. Content-bas

safetyarxiv-cs-cv

ActGuard: Pre-execution Action Auditing against Indirect Prompt Injection in LLM Agents

arXiv:2609.14987v1 Announce Type: cross Abstract: Large language model (LLM) agents interact with external environments through tool invocation, but tool outputs can also expose them to indirect promp

Tutorials

Aerial Wildfire Suppression Planning with a Hybrid CNN-Cellular Automata Fire Model

arXiv:2606.13633v2 Announce Type: replace-cross Abstract: Aerial wildfire suppression requires decisions about when, where, and how to deploy limited aircraft. We present an intervention-design framew

tutorialsarxiv-cs-lg

Algorithm Validation as a Policy Audit: Evidence from Race-blind Charging

arXiv:2609.13174v1 Announce Type: cross Abstract: California recently required all prosecutors in the state to conduct a 'race-blind charging' decision by reviewing case documents in which selected ra

safetyarxiv-cs-cl

Agents

ANASSA: An Agentic AI Orchestration Framework for Spatial Intelligence

arXiv:2609.14824v1 Announce Type: new Abstract: The emergence of large language models (LLMs) and large multimodal models (LMMs) has enabled a new class of agentic systems capable of integrating natur

agentsarxiv-cs-ai

Assessing nnU-Net Generalization across Brain Tumor Populations in BraTS-GoAT 2026

arXiv:2609.15524v1 Announce Type: new Abstract: BraTS-GoAT evaluates tumor segmentation across heterogeneous populations. We trained a conventional 3D nnU-Net on 1,351 labeled cases using five-fold cr

researcharxiv-cs-cv

Before You Poll with LLMs: A Deliberative Diagnostic Framework

arXiv:2609.15849v1 Announce Type: cross Abstract: Can LLMs reason through new information like humans, or do they merely retrieve cached opinions? This is critical for silicon sampling, where LLM pers

Beyond Natural Images: Rethinking AI-Generated Image Detection in Documents

arXiv:2609.14352v1 Announce Type: new Abstract: AI-generated image detection has attracted increasing attention, but existing evaluations mainly focus on natural images, leaving AI-generated document

Beyond Scene Description: Multi-Agent Orchestration for Non-visual Access to Virtual Worlds

arXiv:2609.14512v1 Announce Type: new Abstract: Virtual worlds now host classrooms, meetings, conferences, shops, and social venues, and nearly every interaction they expose assumes a user who can sca

Bridging the Modality Gap in Long-Form Clinical Audio: A Comparative Study of Lightweight and Heavyweight End-to-End SOAP Generation

arXiv:2609.14467v1 Announce Type: cross Abstract: Automating clinical documentation from long-form doctor-patient conversations remains challenging for modern audio-language models. While cascaded ASR

Can We Stop Malicious AI? KILLBENCH: A Benchmark for External AI Kill Switch Feasibility

arXiv:2511.13725v5 Announce Type: replace-cross Abstract: Malicious AI causing harm to humans is not just a Hollywood fantasy. Indeed, as highly capable models such as Claude Mythos emerge and agent s

Agents

Chance-Constrained Belief-Space Maneuver Planning for Autonomous Collision Avoidance Under Uncertainty

arXiv:2609.13428v1 Announce Type: cross Abstract: Increasing conjunction frequency in low Earth orbit places growing pressure on spacecraft operators to determine not only whether an encounter require

agentsarxiv-cs-ai