Search: “evaluation”

Benchmarking Large Language Models on Floating-Point Error Classification

arXiv:2606.31308v1 Announce Type: new Abstract: This paper investigates the capability of Large Language Models (LLMs) to detect and classify floating-point errors statically in software code. We intr

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Beyond Static Prompts: Building Scale-Proof, Polymorphic Multi-Agent Systems with Google's ADK

DGX agent

As enterprise generative AI transitions from simple, conversational chatbots to autonomous multi-agent workflows, developers face a critical bottleneck: scale. In a production environment, an enterpri

model-releasesgoogle-cloud-ai

1 Jul 2026

Can Physician Expertise Improve Machine Learning Identification of Delirium?

arXiv:2606.30651v1 Announce Type: cross Abstract: Delirium is common in hospitalized patients and is often missed in routine care. We present a user-centered interactive machine learning (UC-iML) fram

CLOUDADV: Decision-Aligned Instance Sizing with Zero-Shot Foundation Models under Drift

arXiv:2606.31470v1 Announce Type: new Abstract: Cloud virtual machines are often overprovisioned, creating avoidable cost and operational inefficiency. We present CLOUDADV, an interactive engineer-fac

Coarsening Bias from Variable Discretization in Causal Functionals

model-releasesarxiv-cs-lg

arXiv:2602.22083v2 Announce Type: replace-cross Abstract: Causal identification functionals often require integration over conditional densities of continuous variables, such as those arising in nonpa

Local Ai

ComplianceGate: Classifier-Gated Multi-Tier LLM Routing for Inference in Regulated Industries

arXiv:2606.31163v1 Announce Type: cross Abstract: Large language models deployed in regulated industries operate under two constraints: compliance enforcement and cost efficiency. Personally identifia

local-aiarxiv-cs-ai

CSTrader: A Testbed for Language-Grounded Trading in a Community-Driven Virtual Asset Market

arXiv:2606.31461v1 Announce Type: new Abstract: Niche asset markets, such as Counter-Strike 2 (CS2) weapon skins, are small, volatile, and heavily driven by community discussions and platform rules. T

DeXposure-Claw: An Agentic System for DeFi Risk Supervision

arXiv:2606.19501v2 Announce Type: replace Abstract: Decentralized finance exposes supervisors to fast-moving, networked credit risks. General-purpose LLM agents fit this setting poorly: they over-read

agentsarxiv-cs-ai

Diffusing Blame: Task-Dependent Credit Assignment in Biologically Plausible Dual-Stream Networks

model-releasesarxiv-cs-lg

arXiv:2606.31700v1 Announce Type: new Abstract: Biological neural circuits obey Dale's principle: each neuron's synapses are uniformly excitatory or inhibitory. Artificial networks that respect this c

DSIP: A Dynamic Coordination Planner for Signal-Free Intersections using Diffusion-Model-Based Multi-Agent Motion Planning

arXiv:2606.30694v1 Announce Type: cross Abstract: Traffic signal control at urban intersections inherently introduces stop-and-go behavior, resulting in increased delays and reduced traffic efficiency

agentsarxiv-cs-ai

Explainable Artificial Intelligence For The Detection and Characterisation of Stage B Heart Failure

arXiv:2606.30665v1 Announce Type: cross Abstract: Stage B heart failure is characterized by asymptomatic structural or functional cardiac abnormalities. Identifying individuals at this stage is clinic

safetyarxiv-cs-lg

FinPersona-Bench: A Benchmark for Longitudinal Psychometric Stability of Autonomous Financial Agents

arXiv:2606.31522v1 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly deployed as autonomous financial agents initialized with explicit behavioral mandates such as 'preserve

From Propositional to Perceptual Asymmetry: Extending Frictive Policy Optimization to Asymmetric Partial Information Dialogue

arXiv:2606.30973v1 Announce Type: new Abstract: Frictive Policy Optimization (FPO; Pustejovsky et al., 2025) treats friction in collaborative dialogue -- misalignment, misunderstanding, repair -- as a

safetyarxiv-cs-cl

Google named a Leader in 2026 Gartner® Magic Quadrant™ for Analytics and Business Intelligence Platforms for third year in a row

model-releasesgoogle-cloud-ai

For the third consecutive year, Google has been recognized as a Leader in the 2026 Gartner® Magic Quadrant™ for Analytics and Business Intelligence Platforms. This recognition comes on the heels of Go

HistoriQA-ThirdRepublic: Multi-Hop Question Answering Corpus for Historical Research, Parliamentary Debates from the French Third Republic (1870-1940)

arXiv:2606.31325v1 Announce Type: new Abstract: We present HistoriQA-ThirdRepublic: a French-language dataset of multi-hop historical questions derived from parliamentary debates and newspapers of the

Hybrid Unet-Transformer Model for Generating Stress and Strain Fields from Composite Geometrics

arXiv:2606.31068v1 Announce Type: new Abstract: Accurate prediction of stress and strain fields in hierarchical composite microstructures is critical for physics-informed material design, yet conventi

researcharxiv-cs-cv

Labimus: A Simulation and Benchmark for Humanoid Dexterous Manipulation in Chemical Laboratory

model-releasesarxiv-cs-ro

arXiv:2606.31037v1 Announce Type: new Abstract: Laboratory automation has made remarkable progress through robotic platforms and AI-driven scientific reasoning. However, many laboratory operations (e.

LaMP: Learning Vision-Language-Action Policy with 3D Scene Flow as Latent Motion Prior

arXiv:2603.25399v2 Announce Type: replace Abstract: We introduce extbf{LaMP}, a dual-expert Vision-Language-Action framework that embeds dense 3D scene flow as a latent motion prior for robotic manipu

safetyarxiv-cs-cv

Learning to Deny: Action Denial in Multimodal Large Language Models

model-releasesarxiv-cs-cv

arXiv:2606.31187v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have rapidly advanced video understanding, achieving strong zero-shot and few-shot recognition across standard

Long-term Traffic Simulation via Structured Autoregressive Modeling

arXiv:2606.31209v1 Announce Type: new Abstract: Interactive traffic simulation is a vital world model for autonomous driving. A central challenge in long-horizon simulation is modeling sustained multi

LuxEmo: Expressive Text-to-Speech Corpus for Luxembourgish

model-releasesarxiv-cs-cl

arXiv:2606.31947v1 Announce Type: new Abstract: State-of-the-art speech datasets predominantly focus on widely spoken languages, often overlooking low-resource languages such as Luxembourgish, which r

Measuring & Mitigating Over-Alignment for LLMs in Multilingual Criminal Law Courts

arXiv:2606.23375v2 Announce Type: replace-cross Abstract: While the wider applicability of LLMs in the legal field is currently debated due to their reliability and the gravity of any errors, narrow u

Modality-Driven Search with Holistic Trace Judging for ARC-AGI-2

arXiv:2606.31543v1 Announce Type: new Abstract: Large language models can produce fluent, internally coherent reasoning traces for abstract reasoning tasks while still being confidently wrong - making

OopsieVerse: A Safety Benchmark with Damage-Aware Simulation for Robot Manipulation

model-releasesarxiv-cs-ro

arXiv:2606.31993v1 Announce Type: new Abstract: While robotic manipulation capabilities have advanced rapidly, physical safety remains a major barrier to deploying household robots: task success is in

RCT: A Robot-Collected Touch-Vision-Language Dataset for Tactile Generalization

arXiv:2606.31694v1 Announce Type: cross Abstract: For robots manipulating open-world objects, tactile representations must generalize to unseen materials. We introduce RCT (Robotic Contact Tactile), a

RESOLVE: A Multi-Resolution and Multi-Modal Dataset for Roadside Cooperative Perception

model-releasesarxiv-cs-cv

arXiv:2606.31895v1 Announce Type: new Abstract: LiDAR has increasingly been integrated into traffic cameras to expand coverage and mitigate occlusion in roadside cooperative perception. However, how u

Revisiting Audio-language Pretraining for Learning General-purpose Audio Representation

arXiv:2511.16757v2 Announce Type: replace-cross Abstract: Audio-language pretraining (ALP) holds promise for learning general-purpose audio representation, yet remains underexplored. Crucially, there

Revisiting Parameter Redundancy in Vision-Language-Action Models: Insights from VLM-to-VLA Adaptation

model-releasesarxiv-cs-ro

arXiv:2606.31382v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have made significant strides in embodied intelligence by integrating the powerful representations of pre-trained Vi

Simple Supervision Is Hard to Beat: A Bitter Lesson from Sparse Target Labels in Domain-Adaptive Object Detection

arXiv:2606.30795v1 Announce Type: new Abstract: Source-free domain adaptive object detection adapts a source-trained detector to an unlabeled target domain, typically through teacher-student self-trai

researcharxiv-cs-cv

SOCRadar powers rapid threat detection with AlloyDB and Gemini Enterprise

model-releasesgoogle-cloud-ai

Editor’s note: SOCRadar is a leading cybersecurity company that provides threat intelligence to businesses worldwide. As the volume of cyber threats continued to grow, SOCRadar needed to modernize its

Teaching LLMs String Matching, Backtracking, and Error Recovery to Deduce Bases and Truth Tables for the Combinatorially Exploding Bit Manipulation Puzzles

arXiv:2606.23672v2 Announce Type: replace Abstract: This paper presents our algorithmic innovations for the NVIDIA Nemotron Model Reasoning Challenge, focusing on Bit Manipulation Puzzles. In this tas

Thinking Before Retrieving: Robust Zero-Shot Composed Image Retrieval via Strategic Planning and Self-Criticism

arXiv:2606.31222v1 Announce Type: new Abstract: Composed image retrieval requires identifying a target image from a gallery by integrating a reference image with a textual modification instruction. In

TSHA: A Benchmark for Visual Language Models in Trustworthy Safety Hazard Assessment Scenarios

arXiv:2603.29759v2 Announce Type: replace-cross Abstract: Recent advances in vision-language models (VLMs) have accelerated their application to indoor safety hazards assessment. However, existing ben

VIGOR: VIdeo Geometry-Oriented Reward for Temporal Generative Alignment

arXiv:2603.16271v3 Announce Type: replace Abstract: Video diffusion models lack explicit geometric supervision during training, leading to inconsistency artifacts such as object deformation, spatial d

safetyarxiv-cs-cv

Local Ai

When transformers learn 'impossible' languages, what do they learn?

arXiv:2606.30815v1 Announce Type: cross Abstract: Recent work suggests that transformer language models show a bias towards human languages over unnatural ('impossible') languages argued to be unacqui

local-aiarxiv-cs-ai

Local Ai

Which Tokens Matter? Adaptive Token Selection for RLVR with the Relative Surprisal Index

arXiv:2606.31575v1 Announce Type: new Abstract: Reinforcement learning (RL) has become a powerful tool for propelling Large Language Models (LLMs) beyond imitation-based training towards more robust r

local-aiarxiv-cs-ai

A causal modeling perspective on decision theory

arXiv:2606.29911v1 Announce Type: new Abstract: Decision theory provides a formal framework for how agents should make choices under uncertainty, drawing on ideas from philosophy, probability, and cau

A Comparative Study on Affective Cues in Text Embeddings Across Psychological Emotion Theories

arXiv:2606.29068v1 Announce Type: cross Abstract: Text encoders are known for their utility in natural language processing, as they are able to efficiently compress inputs into dense vectors while pre

A French OSCE Dialogue Dataset and Controllable Virtual Patient System for Clinical Training

arXiv:2606.28526v1 Announce Type: new Abstract: The clinical and communication skills of medical students are commonly assessed through Objective Structured Clinical Examinations (OSCEs), which consis

researcharxiv-cs-cl

A Multi-task Mixture of Experts Framework for Malware Classification, Packing Detection, and Family Attribution

arXiv:2606.30572v1 Announce Type: cross Abstract: Malware classification remains a challenging problem due to its inherent heterogeneity, the presence of packed binaries, and the diverse distribution

AerialMetric: Benchmarking and Adapting UAV Monocular Metric Depth Estimation in the Real World

model-releasesarxiv-cs-cv

arXiv:2606.29716v1 Announce Type: new Abstract: This paper addresses the problem of monocular metric depth estimation in aerial UAV imagery. Although recent data-driven methods have achieved remarkabl

Agentic Abstention: Do Agents Know When to Stop Instead of Act?

arXiv:2606.28733v1 Announce Type: new Abstract: LLM agents are expected to act over multiple turns, using search, browsing interfaces, and terminal tools to complete user goals. Yet not every goal is

AI Training Manager: Bounded Closed-Loop Control of Adaptive Training Recipes

arXiv:2606.29871v1 Announce Type: new Abstract: We present the AI Training Manager, a bounded LLM-based supervisory controller for adaptive machine learning training. Standard training pipelines often

agentsarxiv-cs-ai

Always-OnAgents:A Survey of Persistent Memory, State, and Governance in LLMAgents

arXiv:2606.30306v1 Announce Type: cross Abstract: Always-on agents are systems whose future behavior depends on durable state accumulated across earlier interactions. We treat them as persistent-state

An Integrated Machine Learning and Hierarchical Variance Decomposition Pipeline for Student Performance Prediction and Metacognitive Calibration on Multi-Signal Telemetry

arXiv:2606.28881v1 Announce Type: cross Abstract: Predicting student performance and characterizing metacognitive calibration are essential for personalization in intelligent tutoring systems. Prior r

Analyzing Defensive Misdirection Against Model-Guided Automated Attacks on Agentic AI Systems

arXiv:2606.20470v2 Announce Type: replace-cross Abstract: Agentic AI systems increasingly rely on language-model components to interpret instructions, process external data, invoke tools, and coordina

Analyzing Uncertainty in the Spatial Representation of the Kinematic Bicycle Model

arXiv:2606.29566v1 Announce Type: new Abstract: Locating a vehicle and determining its orientation in an uncertain environment is a critical challenge in autonomous vehicle navigation and path plannin

agentsarxiv-cs-ro

Anatomy-Grounded Synthetic Coronary Angiography for Geometry-Informed Multi-View Matching

arXiv:2606.28474v1 Announce Type: cross Abstract: Accurate correspondence matching across multiple angiographic views is the prerequisite for 3D coronary reconstruction and interventional guidance. Ho

researcharxiv-cs-cv