Search: “automated”

Diagnosing the Reliability of LLM-as-a-Judge via Item Response Theory

arXiv:2602.00521v2 Announce Type: replace Abstract: While LLM-as-a-Judge is widely used in automated evaluation, existing validation practices primarily operate at the level of observed outputs, offer

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

have manually read 1000s traces since joining LangChain! it’s a great way to learn and understand your agent but completely infeasible to do…

DGX agent

have manually read 1000s traces since joining LangChain! it’s a great way to learn and understand your agent but completely infeasible to do at agent scale 🙃 engine helps us automate that process so h

agentsharrison-chase--x

1 Jun 2026

Knowledge Boundary Probing and Demand-Guided Intervention for LLM-Based Power System Code Generation

model-releasesarxiv-cs-cl

arXiv:2605.31478v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used to automate power-system analysis, but many utilities and energy-research labs require on-premise s

Multilingual and Cross-Lingual Citation Needed Detection on Wikipedia for Lower-Resource Languages

arXiv:2605.31136v1 Announce Type: new Abstract: In automated fact-checking (AFC), check-worthiness detection identifies claims requiring verification based on domain-specific criteria. On Wikipedia, t

researcharxiv-cs-cl

Hardware

NVIDIA Factory Operations Blueprint Gives Factories a New AI Brain

As factories move from isolated automation to plant-wide intelligence, manufacturers need AI systems that can connect live machine signals, quality systems, work instructions and operational alerts in

hardwarenvidia-blog

REAL: Regression-Aware Reinforcement Learning for LLM-as-a-Judge

arXiv:2603.17145v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are increasingly deployed as automated evaluators that assign numeric scores to model outputs, a paradigm known a

Reinterpreting Safety Thresholds as Neuron Spiking Thresholds

arXiv:2605.30368v1 Announce Type: cross Abstract: Surrogate Safety Measures (SSMs) are extensively utilised in the evaluation of traffic risk in automated driving contexts. However, the majority of SS

Stop manually triaging agent failures. Let LangSmith Engine fix it.

LangSmith Engine is a tool designed to automatically diagnose and resolve agent failures, eliminating the need for manual troubleshooting and triage. The feature appears to leverage automated analysis

agentsharrison-chase--x

Agentic AI success helps UiPath swing to a profit, but investors weren’t impressed

Business automation software company UiPath Inc. delivered mixed results in its latest quarter, posting a solid revenue beat but falling short on earnings — but it did at least manage to return to pro

agentssiliconangle

Code-QA-Bench: Separating Code Reasoning from Documentation Memorization in Repository-Level QA

arXiv:2605.29277v1 Announce Type: cross Abstract: We present Code-QA-Bench, a fully automated framework for synthesizing repository-level code understanding benchmarks that separates genuine code comp

Inferring Code Correctness from Specification

arXiv:2605.29822v1 Announce Type: cross Abstract: Large language models (LLMs) have become integral to modern software development, enabling automated code generation at scale. However, validating the

K-FinHallu: A Hallucination Detection Benchmark for Multi-Turn RAG in Korean Finance

model-releasesarxiv-cs-lg

arXiv:2605.29523v1 Announce Type: new Abstract: Large Language Models (LLMs) have advanced financial automation through Retrieval-Augmented Generation (RAG), yet hallucinations remain a critical barri

Learning to Choose: An Empowerment-Guided Multi-Agent System with semantic communication for Adaptive Method Selection

arXiv:2605.30042v1 Announce Type: new Abstract: Automating scientific computing workflows requires more than generating executable code: autonomous systems must also select appropriate computational s

Mitigating Stethoscope-Induced Shortcuts in Respiratory Sound Classification under Federated Domain Generalization with Causality-Inspired Interventions

model-releasesarxiv-cs-ai

arXiv:2605.29862v1 Announce Type: cross Abstract: AI-driven respiratory sound classification (RSC) is promising for automated pulmonary disease detection, yet multi-site deployment is hindered by inte

Parameter-Efficient Subspace Decoupling ViT for Mitigating Multi-Task Negative Transfer in Histological Scoring

model-releasesarxiv-cs-cv

arXiv:2605.29852v1 Announce Type: new Abstract: Histological scoring is essential for diagnosing Non-Alcoholic Fatty Liver Disease (NAFLD), yet its automation remains challenging due to the high annot

PRO-CUA: Process-Reward Optimization for Computer Use Agents

arXiv:2605.29119v1 Announce Type: new Abstract: Computer use agents (CUAs) have shown strong potential for automating complex digital workflows, yet their training remains constrained by costly live e

SoundnessBench: Can Your AI Scientist Really Tell Good Research Ideas from Bad Ones?

model-releasesarxiv-cs-lg

arXiv:2605.30329v1 Announce Type: new Abstract: Autonomous AI research agents aim to accelerate scientific discovery by automating the research pipeline, from hypothesis generation to peer review. How

Local Ai

UI-KOBE: Knowledge-Oriented Behavior Exploration for Lightweight Graph-Guided GUI Agents

arXiv:2605.29534v1 Announce Type: new Abstract: Recent advances in mobile GUI agents have shown strong potential for automating mobile tasks, but most effective systems still depend on large vision-la

local-aiarxiv-cs-ai

Weakly Supervised Detection and Temporal Localization of Whale Calls in Long-Duration Bioacoustic Data

arXiv:2502.20838v3 Announce Type: replace-cross Abstract: Passive acoustic monitoring (PAM) systems generate continuous recordings spanning months, yet automated bioacoustic analysis of whale calls re

Who Am I? History-Aware Profiles for Student Simulation in Tutoring Dialogues

arXiv:2605.30051v1 Announce Type: new Abstract: A key part of developing large language model (LLM)-powered, automated tutoring tools is student simulation, i.e., using LLMs to role-play as students,

applicationsarxiv-cs-cl

Adaptive Cost-Efficient Evaluation for Reliable Patent Claim Generation

model-releasesarxiv-cs-cl

arXiv:2604.04295v3 Announce Type: replace Abstract: Automated patent claim validation demands low error tolerance. However, existing approaches face a rigidity-resource dilemma: lightweight encoders c

AutoScientists: Self-Organizing Agent Teams for Long-Running Scientific Experimentation

arXiv:2605.28655v1 Announce Type: new Abstract: Scientific research proceeds through iterative cycles of hypothesis generation, experiment design, execution, and revision. AI agents can automate parts

CircuitLM: A Multi-Agent LLM-Aided Design Framework for Generating Circuit Schematics from Natural Language Prompts

arXiv:2601.04505v3 Announce Type: replace Abstract: Generating accurate circuit schematics from high-level natural language descriptions remains a persistent challenge in electronic design automation

Mining Multi-Modality Spatio-Temporal Cues for Video Important Person Identification

arXiv:2605.28604v1 Announce Type: cross Abstract: Identifying key individuals in video scenes is essential for applications such as automated video editing and intelligent surveillance. Current method

MolLingo: Molecule-Native Representations for LLM-Powered Scientific Agents

model-releasesarxiv-cs-ai

arXiv:2605.27853v1 Announce Type: new Abstract: We present MolLingo, a multi-agent system that emulates the reasoning process of a chemist to automate molecular design. Existing LLM-based approaches e

One of the best ways to learn what LangSmith Engine is capable of is to talk to the team that built it. Join @bentannyhill for a live sessio…

One of the best ways to learn what LangSmith Engine is capable of is to talk to the team that built it. Join @bentannyhill for a live session on June 11th and see how your team can automate the agent

agentsharrison-chase--x

Poison with Style: A Practical Poisoning Attack on Code Large Language Models

arXiv:2605.27631v1 Announce Type: cross Abstract: Code Large Language Models (CLLMs) serve as the core of modern code agents, enabling developers to automate complex software development tasks. In thi

researcharxiv-cs-lg

RAG-Coding: Enhancing LLM Medical Coding with Structured External Knowledge

arXiv:2605.27377v1 Announce Type: cross Abstract: We present RAG-Coding, an agentic method for automated ICD-10-CM coding. RAG-Coding orchestrates four large language model (LLM) agents and grounds th

Agreement Between Large Language Models and Human Raters in Essay Scoring: A Research Synthesis

arXiv:2512.14561v2 Announce Type: replace Abstract: Despite the growing promise of large language models (LLMs) in automated essay scoring (AES), empirical findings regarding their reliability compare

researcharxiv-cs-cl

Cisco and OpenAI redefine enterprise engineering with Codex

Cisco and OpenAI partnered to integrate OpenAI's Codex AI model into Cisco's enterprise engineering tools to enhance software development and automation capabilities. The collaboration aims to improve

applicationsopenai

Datasets for Lane Detection in Autonomous Driving: A Comprehensive Review

arXiv:2504.08540v2 Announce Type: replace Abstract: Accurate lane detection is essential for automated driving, enabling safe and reliable vehicle navigation across a variety of road scenarios. Numero

agentsarxiv-cs-cv

For future-proof, build AI that's composable. Regardless of what you use, all these should be composable, iterative, and customizable: - LLM…

For future-proof, build AI that's composable. Regardless of what you use, all these should be composable, iterative, and customizable: - LLMs - Evals - Automations - MCP/CLI tools - Skills/Memory/Cont

agentsdair-ai--x

SEC-bench Pro: Can Language Models Solve Long-Horizon Software Security Tasks?

model-releasesarxiv-cs-lg

arXiv:2605.26548v1 Announce Type: cross Abstract: Large language models (LLMs) now support automated software security tasks, including vulnerability discovery and proof-of-concept (PoC) generation. E

Sleep-stage efficient classification using a lightweight self-supervised model

arXiv:2605.26295v1 Announce Type: new Abstract: Accurate classification of sleep stages is crucial for diagnosing sleep disorders and automating this process can significantly enhance clinical assessm

researcharxiv-cs-cv

Why Prompt Optimization Works, and Why It Sometimes Doesn't: A Causal-Inspired Edit-Level Analysis

model-releasesarxiv-cs-cl

arXiv:2605.26655v1 Announce Type: new Abstract: Automated prompt optimization methods (e.g., DSpy, TextGrad) can substantially improve the performance of large language model (LLM), however, their gen

Local Ai

YOLO26-RipeLoc Lite: A lightweight architecture for tomato ripeness detection and picking point localization in greenhouse robotic harvesting

arXiv:2605.27129v1 Announce Type: new Abstract: In greenhouse tomato production, automated harvesting requires accurate detection of ripe tomatoes, ripeness classification, and precise picking-point l

local-aiarxiv-cs-cv

Agent Manufacturing: Foundation-Model Agents as First-Class Industrial Entities

arXiv:2605.24823v1 Announce Type: new Abstract: Manufacturing has passed through four widely recognized paradigms - mechanization, electrification, programmable automation, and Smart Manufacturing - e

Tutorials

An Empirical Evaluation of LLM-Generated Code Security Across Prompting Methods

arXiv:2605.24298v1 Announce Type: cross Abstract: The growing use of Large Language Models (LLMs) for automated code generation has enhanced software development efficiency, but often at the cost of s

tutorialsarxiv-cs-ai

By Their Fruits You Will Know Them: Comparing Formalizations of Law by the Decisions They Encode

arXiv:2605.25186v1 Announce Type: cross Abstract: Formalizing legal provisions promises machine-accessible law and automated legal reasoning, and recent LLMs make it tempting to generate such formaliz

applicationsarxiv-cs-ai

Catching The Correct Answer Trap: Characterising AI Tutor Blind Spots When Analysing Student Reasoning

arXiv:2605.23925v1 Announce Type: cross Abstract: Intelligent tutoring systems increasingly provide automated feedback on student work, but robust feedback requires assessing reasoning, not only final

Generating Legal Commentaries from Case Databases via Retrieval, Clustering, and Generation

arXiv:2605.24534v1 Announce Type: new Abstract: We present a fully automated pipeline that transforms large collections of court decisions into legal commentaries for statutes - without providing any

applicationsarxiv-cs-cl

Generative AI impacts on intra-urban inequality and skill premium in Beijing

arXiv:2605.25505v1 Announce Type: cross Abstract: Generative artificial intelligence (GenAI) is the first automation wave to reach high-cognitive tasks at scale, yet its effects on intra-urban inequal

GreenSeg: Ground Segmentation Algorithm for Agricultural Robots in Mediterranean Greenhouses using RGB-D Point Clouds

model-releasesarxiv-cs-ro

arXiv:2605.25279v1 Announce Type: new Abstract: Greenhouse agriculture in the Mediterranean region faces significant automation challenges due to its unique structural and environmental constraints. T

HeartBeatAI: An Interpretable and Robust Deep Learning Framework for Multi-Label ECG Arrhythmia Detection

arXiv:2605.24588v1 Announce Type: new Abstract: While Deep Learning (DL) enhances automated electrocardiogram (ECG) analysis, clinical deployment is hindered by class imbalance and the generalization

Improving Labeling Consistency with Detailed Constitutional Definitions and AI-Driven Evaluation

arXiv:2605.24247v1 Announce Type: cross Abstract: Many automated labeling pipelines classify inputs into categories defined by a written specification, content moderation being a prominent use case. S

In Search of the Ingredients of Open-Endedness: Replicating Picbreeder with Large Vision-Language Models

arXiv:2605.23908v1 Announce Type: new Abstract: We are in the midst of large-scale industrial and academic efforts to automate the processes of scientific, technological and creative production throug

applicationsarxiv-cs-ai

Keep the Proof State Live: Snapshotting for Efficient Tactic Search in Lean 4

model-releasesarxiv-cs-ai

arXiv:2605.25556v1 Announce Type: cross Abstract: Automated theorem proving systems built on Lean 4 increasingly rely on parallel tactic search over partially specified proofs, such as those generated

manage your store with @perplexity_ai Computer do market research, generate product images, and design a theme in parallel another day, anot…

This post demonstrates how Perplexity AI can assist e-commerce store owners by automating multiple tasks simultaneously, including market research, AI-generated product imagery, and store design. The

agentsperplexity--x