Search: “evaluation”

applicationsharrison-chase--x

Cost controls are one of the main benefits of langsmith LLM gateway We’re seeing in a bunch of use cases adoption is getting to a point where cost really starts to matter Your agents can burn through

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Cross-scale Aligned Supervision for Training GANs

DGX agent

arXiv:2605.26449v1 Announce Type: cross Abstract: Modern GANs often introduce adversarial supervision on intermediate generator outputs and interpret the resulting multi-stage synthesis as coarse-to-f

researcharxiv-cs-ai

27 May 2026

CSV-ViT: A Vision Transformer with the Variable-sized Cortical Supervertices for Detection of Alzheimer's Disease Pathologies

arXiv:2605.26514v1 Announce Type: cross Abstract: Confirming Alzheimer's disease (AD) typically relies on positron emission tomography (PET), which remains costly and invasive, motivating the use of s

researcharxiv-cs-ai

Cultural Value Alignment Via Latent Activation Steering in Large Language Models

arXiv:2605.26365v1 Announce Type: new Abstract: Large Language Models (LLMs) often exhibit homogenized cultural perspectives. While the World Values Survey (WVS) provides a gold standard for mapping h

CyberEvolver: Structured Self-Evolution for Cybersecurity Agents On the Fly

arXiv:2605.26195v1 Announce Type: cross Abstract: LLM-based agents are increasingly used for cybersecurity tasks, but most existing systems rely on fixed, human-designed scaffolds that struggle to ada

Datasets for Lane Detection in Autonomous Driving: A Comprehensive Review

arXiv:2504.08540v2 Announce Type: replace Abstract: Accurate lane detection is essential for automated driving, enabling safe and reliable vehicle navigation across a variety of road scenarios. Numero

agentsarxiv-cs-cv

Decoupled Delay Compensation: Enhancing Pre-trained MARL Policies via Learned Dynamics Filtering

arXiv:2605.26286v1 Announce Type: cross Abstract: Real-world multi-agent reinforcement learning (MARL) systems must often operate under stale observations, stochastic communication delays, and intermi

DEI: Diversity in Evolutionary Inference for Quality-Diversity Search

arXiv:2605.27130v1 Announce Type: cross Abstract: We present DEI: Diversity in Evolutionary Inference, a distributed Quality-Diversity (QD) search framework that assigns heterogeneous large language m

Developing a Totally Unimodular Linear Program for Optimal Conformance Checking: When and Why It Complements A*

arXiv:2605.26938v1 Announce Type: new Abstract: Alignment-based conformance checking is the state-of-the-art approach for comparing observed process executions with normative process models. The stand

Device Context Protocol: A Compact, Safety-First Architecture for LLM-Driven Control of Constrained Devices

model-releasesarxiv-cs-lg

arXiv:2605.26159v1 Announce Type: cross Abstract: Large language models are increasingly used as orchestrators of external tools via the Model Context Protocol (MCP), but MCP is built for software ser

DuoGesture: Neuro-Inspired and Biomechanically Informed Dual-Stream Co-Speech Gesture Generation

arXiv:2605.26236v1 Announce Type: new Abstract: Co-speech gesture generation requires both semantic expressivity and biomechanically plausible rhythmic motion. Existing holistic gesture models mix lex

safetyarxiv-cs-cv

ECHO-2: A Large-Scale Distributed Rollout Framework for Cost-Efficient Reinforcement Learning

model-releasesarxiv-cs-lg

arXiv:2602.02192v5 Announce Type: replace Abstract: Reinforcement learning (RL) is a critical stage in post-training large language models (LLMs), involving repeated interaction between rollout genera

Local Ai

Efficient All-Pairs Correlation Volume Sampling for Optical Flow Estimation

arXiv:2505.16942v2 Announce Type: replace Abstract: Recent optical flow estimation methods often employ local cost sampling from a dense all-pairs correlation volume. This results in quadratic computa

local-aiarxiv-cs-cv

EHRSummarizer: A Privacy-Aware, FHIR-Native Reference Architecture for Source-Grounded EHR Summarization

arXiv:2601.01668v2 Announce Type: replace-cross Abstract: Clinicians routinely navigate fragmented electronic health record (EHR) interfaces to assemble a coherent picture of a patient's problems, med

Enabling Extensible Embodied Capabilities with Tools

arXiv:2605.26637v1 Announce Type: new Abstract: Most existing embodied intelligence methods formulate perception, reasoning, planning, and control within a unified parameterized policy. Yet these capa

safetyarxiv-cs-ro

ENPMR-Bench: Benchmarking Proactive Memory Retrieval for Emotional Support Agents

arXiv:2605.27240v1 Announce Type: new Abstract: Memory-augmented language agents are increasingly deployed in affective applications such as emotional support, where understanding and responding to us

Entropy Sentinel: Continuous LLM Accuracy Monitoring from Decoding Entropy Traces in STEM

arXiv:2601.09001v4 Announce Type: replace Abstract: Deploying LLMs raises two coupled challenges: (1) monitoring--estimating where a model underperforms as traffic and domains drift--and (2) improveme

EpiQAL: Benchmarking Large Language Models in Epidemiological Question Answering and Reasoning

arXiv:2601.03471v3 Announce Type: replace-cross Abstract: Reliable epidemiological reasoning requires synthesizing study evidence to infer disease burden, transmission dynamics, and intervention effec

ESMFold2 is a state of the art folding model. It's crazy good. The -Fast model does better on antibody-antigen complexes than AF3 with MSAs.

ESMFold2 is described as a high-performance protein structure prediction model that demonstrates particular strength in predicting antibody-antigen complex structures, reportedly outperforming AlphaFo

researchyann-lecun--x

Evi-Steer: Learning to Steer Biomedical Vision-Language Models through Efficient and Generalizable Evidential Tuning

arXiv:2605.26292v1 Announce Type: cross Abstract: Parameter-efficient adaptation of vision-language foundation models is crucial for precise multimodal understanding of biomedical images, yet existing

Evidence Absence Is Not Evidence Insufficiency: Diagnosing NEI Construction Artifacts in Fact Verification

arXiv:2605.26663v1 Announce Type: new Abstract: Evidence absence is not evidence insufficiency, but fact verification benchmarks can make them observationally similar. The Not Enough Information (NEI)

researcharxiv-cs-cl

EvoEmo: Towards Evolved Emotional Policies for Adversarial LLM Agents in Multi-Turn Price Negotiation

arXiv:2509.04310v4 Announce Type: replace Abstract: Recent research on Chain-of-Thought (CoT) reasoning in Large Language Models (LLMs) has demonstrated that agents can engage in extit{complex}, extit

Explainable Comparison of Feature-Based and Deep Learning Models for TROPOMI Methane Plume Screening

arXiv:2605.27236v1 Announce Type: new Abstract: Continuous and global detection of large methane emissions is a crucial step for global warming mitigation. Satellite observations, such as from S5P/TRO

researcharxiv-cs-lg

Exploring the robustness of TractOracle methods in RL-based tractography

arXiv:2507.11486v2 Announce Type: replace Abstract: Tractography algorithms leverage diffusion MRI to reconstruct the fibrous architecture of the brain's white matter. Among machine learning approache

researcharxiv-cs-lg

FalAR: A Large-scale Speaker-Annotated European Portuguese Speech Corpus of Parliamentary Sessions

arXiv:2605.27062v1 Announce Type: new Abstract: State-of-the-art performance for Automatic Speech Recognition (ASR) largely depends on the availability of large-scale labeled corpora. This creates a d

FinHarness: An Inline Lifecycle Safety Harness for Finance LLM Agents

arXiv:2605.27333v1 Announce Type: new Abstract: Finance LLM agents must simultaneously block prompt-induced unauthorized actions and approve legitimate multi-step business workflows. However, boundary

Flow Matching Policy Optimization with Mirror Descent and Entropy Constraints

arXiv:2603.17685v3 Announce Type: replace Abstract: Balancing policy expressiveness with the exploration-exploitation trade-off is a core challenge in online Reinforcement Learning (RL). While Stochas

safetyarxiv-cs-lg

FM-fMRI: Event Conditioned Flow Matching for Rest-to-Task fMRI Time-Series Synthesis

arXiv:2605.26423v1 Announce Type: new Abstract: Task-based fMRI provides a direct readout of task-evoked neural dynamics, but it is expensive and difficult to acquire at scale, motivating rest-to-task

safetyarxiv-cs-lg

FTibSuite: A Comprehensive Resource Suite for Tibetan Vision-Language Modeling

arXiv:2605.26601v1 Announce Type: new Abstract: Vision-language models have progressed rapidly, but Tibetan remains a severely underserved low-resource language due to the lack of reproducible trainin

safetyarxiv-cs-cv

Geometry-Aware Representation Denoising for Robust Multi-view 3D Reconstruction

model-releasesarxiv-cs-cv

arXiv:2605.26230v1 Announce Type: new Abstract: Multi-view 3D reconstruction has achieved remarkable progress with the advent of feed-forward 3D reconstruction models. However, these models are typica

Governed Evolution of Agent Runtimes through Executable Operational Cognition

arXiv:2605.27328v1 Announce Type: cross Abstract: Recent advances in agentic systems increasingly treat code as an executable operational substrate rather than as a disposable output artifact. Prior w

GraphDancer: Training LLMs to Explore and Reason over Graphs via Two-Stage Curriculum Post-Training

arXiv:2602.02518v2 Announce Type: replace-cross Abstract: Large language models (LLMs) increasingly rely on external knowledge to improve factuality, yet many real-world knowledge sources are organize

Harmonia: Enhancing Data Placement and Migration in Hybrid Storage Systems via Multi-Agent Reinforcement Learning

arXiv:2503.20507v4 Announce Type: replace-cross Abstract: Modern high-performance computing (HPC) environments rely on hybrid storage systems (HSS) that combine multiple storage devices with diverse l

agentsarxiv-cs-lg

Helicase: Uncertainty-Guided Supply Chain Knowledge Graph Construction with Autonomous Multi-Agent LLMs

arXiv:2605.26835v1 Announce Type: new Abstract: LLM-based multi-agent systems have been widely adopted for knowledge retrieval and report generation, synthesizing known information through web search

High-Quality Synthetic Financial Time-Series using a GAN-Diffusion Framework

arXiv:2605.27113v1 Announce Type: cross Abstract: In recent years, financial institutions and firms have increasingly adopted synthetic data to address data scarcity and to generate counterfactual mar

researcharxiv-cs-ai

HiSpec: Hierarchical Speculative Decoding for LLMs

arXiv:2510.01336v2 Announce Type: replace-cross Abstract: Speculative decoding accelerates LLM inference by using a smaller draft model to speculate tokens that a larger target model verifies. Verific

researcharxiv-cs-ai

Tutorials

How and What to Imagine? Visual Thinking in Unified Multimodal Models for Cross-View Spatial Reasoning

arXiv:2605.27310v1 Announce Type: new Abstract: Cross-view spatial reasoning remains a weak spot for vision-language models (VLMs): they often reason in language and lose the fine-grained geometry nee

tutorialsarxiv-cs-cv

How Reliable are LLMs for Reasoning on the Re-ranking task?

arXiv:2508.18444v2 Announce Type: replace-cross Abstract: With the improving semantic understanding capability of Large Language Models (LLMs), they exhibit a greater awareness and alignment with huma

safetyarxiv-cs-ai

Local Ai

Incremental Gauss-Newton Descent for Machine Learning

arXiv:2408.05560v2 Announce Type: replace Abstract: Stochastic gradient updates are widely used for their efficiency and scalability, but their effective step sizes can depend strongly on feature scal

local-aiarxiv-cs-lg

Intelligent Detection and Mitigation of Carpet-Bombing DDoS Attacks in SDN Using Retrieval-Augmented Generation and Large Language Models

arXiv:2605.26307v1 Announce Type: cross Abstract: Software-Defined Networking (SDN) provides flexible and programmable network management; however, its centralized control architecture remains highly

It's Not Always Sycophancy: Measuring LLM Conformity as a Function of Epistemic Uncertainty

arXiv:2605.27288v1 Announce Type: cross Abstract: Large language models (LLMs) are known to abandon their initial stance to conform to user pushback. While prior research largely attributes this behav

safetyarxiv-cs-ai

Hardware

JetViT: Efficient High-Resolution Vision Transformer with Post-Training Attention Search

arXiv:2605.26636v1 Announce Type: cross Abstract: We introduce JetViT, a novel family of hybrid-architecture Vision Transformer (ViT) models that match the accuracy of state-of-the-art full-attention

hardwarearxiv-cs-ai

Joint Instance Segmentation and Geometric Attribute Regression for Roof Structures in Aerial Imagery

arXiv:2605.26370v1 Announce Type: new Abstract: We present a method for jointly predicting instance-level roof segment masks together with three continuous geometric attributes -- building height, roo

researcharxiv-cs-cv

Kandinsky 5.0: A Family of Foundation Models for Image and Video Generation

arXiv:2511.14993v3 Announce Type: replace-cross Abstract: This report introduces Kandinsky 5.0, a family of state-of-the-art foundation models for high-resolution image and 10-second video synthesis.

KARMA: Karma-Aligned Reward Model Adaptation

arXiv:2605.26738v1 Announce Type: new Abstract: Human communication depends on implicit social signals where effectiveness is shaped by tone, context, and conversational norms rather than semantic con

LaRe: Latent Refocusing for Multimodal Reasoning

arXiv:2511.02360v4 Announce Type: replace-cross Abstract: Chain of Thought (CoT) reasoning enhances logical performance by decomposing complex tasks, yet its multimodal extension faces a trade-off. Th

Learnable Kernel Density Estimation for Graphs and Its Application to Graph-Level Anomaly Detection

model-releasesarxiv-cs-lg

arXiv:2505.21285v4 Announce Type: replace Abstract: This work proposes a framework LGKDE that learns kernel density estimation for graphs. The key challenge in graph density estimation lies in effecti

LearnedCache: An eBPF-Integrated Perceptron-Based Eviction Policy for the Linux Page Cache

arXiv:2605.26168v1 Announce Type: cross Abstract: Linux is the foundation of the digital age, accounting for the majority of the cloud and mobile OS markets. Any device that runs Linux uses the Linux

safetyarxiv-cs-lg