Search: “automated”

Nemotron 3.5 Bolt Evaluation using real-world tasks

model-releasesr-localllama

I evaluate new models by giving them actual work tasks that have already been completed by a trusted model and then comparing the results. My typical workflow is to plan tasks/requests in Gemini and c

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Open Benchmark of AI Impact on Humans (ImpactBench): an expert-guided, open platform for the holistic evaluation of AI impact on humans

DGX agent

arXiv:2610.20690v1 Announce Type: cross Abstract: The present work is concerned with how to measure, at scale, the multi-dimensional impact of generative AI models on the individuals who use them. In

model-releasesarxiv-cs-ai

16 Oct 2026

PROBE: Learning to Audit Policy Compliance in Tool-Using LLM Agents

arXiv:2610.22124v1 Announce Type: new Abstract: Modern agentic systems extend language models with external tools, enabling them to complete complex tasks through multi-turn interactions. As these age

QuasiLeak-Bench: Evaluating LLM-Based Privacy Detectors on Policy-Conditioned Quasi-Evidence Group Recovery

arXiv:2610.21333v1 Announce Type: new Abstract: Natural language messages often contain quasi-identifiers that are weak in isolation but can jointly reveal an individual's private attributes. We call

Qwen-Audio-Jev: A Unified Interface for Audio Decisions

arXiv:2610.21614v1 Announce Type: cross Abstract: Large audio language models (LALMs) have made substantial progress in audio understanding. However, in high-throughput applications requiring frequent

ReviewPilot: A Multi-Agent System for Screening and Data Extraction in Systematic Reviews

arXiv:2610.21042v1 Announce Type: cross Abstract: Systematic literature reviews follow the PRISMA process of screening scholarly works and extracting evidence from included studies. Deep research tool

SciPivot: Benchmarking Principal-Investigator Judgment at Pivotal Moments of Scientific AutoResearch Agents

arXiv:2610.21082v1 Announce Type: new Abstract: Large language model (LLM) agents can keep scientific experiments running for months with little human supervision, but reliable autonomous research als

The SAVE method: Learn the fundamentals to engineer trustworthy generative media

model-releasesgoogle-cloud-ai

Google Cloud Consulting works with organizations every day to build generative media that’s trustworthy, brand-aligned, and stands out. Instead of relying on clever or complicated prompting, we’ve ide

Towards automatic digital garment assembly

arXiv:2610.20651v1 Announce Type: new Abstract: Creating digital garments from existing two-dimensional patterns remains a time-consuming process. Although patterns are widely available in digital for

researcharxiv-cs-cv

When Models Misread Ink: Auditing VLMs for Arabic Calligraphy Recognition

arXiv:2610.22018v1 Announce Type: new Abstract: Arabic calligraphy is a high-stakes cultural visual domain for Muslim communities, yet VLM evaluations rarely test its fine-grained script traditions. W

Writer-R1: Dynamic Rubric Mining for Reinforcement Learning of Open-Ended Writing

arXiv:2603.15061v2 Announce Type: replace Abstract: Training models for open-ended writing requires diverse prompts and sufficiently precise specifications of response quality. Constructing such speci

researcharxiv-cs-cl

X-RIC: An Agentic RAN-Intelligent Controller Benchmark for Enhancing Reinforcement Learning

arXiv:2610.22269v1 Announce Type: new Abstract: The O-RAN ALLIANCE introduces architectural flexibility through disaggregation and AI-driven control. While the RAN Intelligent Controller (RIC) enables

A Global View of How LLMs Value Human Time

arXiv:2610.18515v2 Announce Type: cross Abstract: Large language models (LLMs) increasingly act as personal assistants; however, little is known about how they capture national-level preferences on a

Applications

A Unified Response Framework for Questions and Tutoring Dialogues

arXiv:2610.19532v1 Announce Type: new Abstract: Existing student models in educational applications largely focus on student responses to questions. However, as tutoring becomes more accessible at lar

applicationsarxiv-cs-cl

Agentic Architect: An Agentic AI Framework for Architecture Design Exploration and Optimization

arXiv:2604.25083v2 Announce Type: replace Abstract: Computer Architecture research has traditionally required the exploration of vast, highly complex design spaces through manual human effort. Large L

AI-Driven, Timing-Aware Power Optimization

arXiv:2610.18890v1 Announce Type: cross Abstract: Post-route power recovery changes cell choices under tightly coupled timing, electrical and physical constraints, and the value of each change depends

safetyarxiv-cs-lg

@AIatMeta Together Serverless Inference gives developers a high-throughput, managed production path for running Muse Spark Open across agent…

@AIatMeta Together Serverless Inference gives developers a high-throughput, managed production path for running Muse Spark Open across agentic coding and multimodal workloads. Start building: https://

agentstogether-ai--x

Aligning Faithfulness for Theory-Scale Autoformalization

arXiv:2610.18498v1 Announce Type: cross Abstract: Autoformalization (AF) requires more than compilation: formal statements must preserve the meaning of their informal sources, a property known as fait

Local Ai

Analyzing and Mitigating Poisoning Attacks on Flow-Based Intrusion Detection

arXiv:2610.19766v1 Announce Type: cross Abstract: Although Artificial Intelligence (AI)-based Intrusion Detection Systems (IDSs) are increasingly deployed in operational networks, their dependence on

local-aiarxiv-cs-lg

ANCHOR: Assessing Naturalistic Constraint Hierarchies and Ordering in Repository-Grounded Agentic Coding

arXiv:2610.16859v2 Announce Type: replace Abstract: For repository-grounded coding agents, a functionally correct patch is not necessarily an acceptable one: developers also constrain how the task mus

AutoMARS: Automatic and Scalable Multi-Agent Large Language Model Framework for Supply Chain Risk Assessment

arXiv:2610.17206v1 Announce Type: new Abstract: We propose AutoMARS (Automatic Multi-Agent Risk Assessment), an agentic framework for automatic and scalable comparative risk assessment in supply chain

Beyond Perfect Teammates: Multi-Agent Collaboration with Unreliable Colleagues

arXiv:2610.16117v2 Announce Type: new Abstract: LLM-based multi-agent collaboration is increasingly used to solve complex tasks by dividing work among specialized agents and integrating complementary

Bringing the borderless Lakehouse into the agentic era with innovations for Gemini

model-releasesgoogle-cloud-ai

As enterprises shift their AI usage from experimental chatbots to autonomous agents, teams are hitting a critical bottleneck: accessing and reasoning over data scattered across multiple clouds, SaaS p

CktHGVAE: A Symmetric Design/State Heterogeneous Graph Variational Autoencoder for Transistor-level Analog/Mixed-signal Circuit Design and Analysis

arXiv:2610.19508v1 Announce Type: new Abstract: We propose CktHGVAE, a heterogeneous graph variational autoencoder for transistor-level analog/mixedsignal CMOS circuits that takes not only design vari

researcharxiv-cs-lg

DarKnight: Retrieval-Guided Agentic Framework for Breaking Dark Web CAPTCHA Gates

arXiv:2610.19830v1 Announce Type: cross Abstract: Cyber Threat Intelligence (CTI) investigators who monitor dark web marketplaces for leaked credentials and breach listings must pass the diverse CAPTC

DecisionRobust: Benchmarking Robustness for JEV Style Decision Models Across Text and Vision

arXiv:2610.19118v1 Announce Type: new Abstract: Emerging decision models such as JEV provide typed interfaces that map task instructions and observations directly to choices, judgments, and scores. As

Do you 'see' what I 'see'? A Multi-panel Visual Question Answer Dataset for Large Language Model Chart Analysis

arXiv:2610.14173v1 Announce Type: cross Abstract: Digital libraries increasingly host scientific publications whose figures encode primary research findings, yet making this visual content searchable,

researcharxiv-cs-ai

DTScribe: Generating Models for Digital Twin Reporting using Local Large Language Models

arXiv:2610.18635v1 Announce Type: cross Abstract: The development of a digital twin brings together many stakeholders and technical components. We have previously investigated the reporting of the con

Evidence-Anchored Overdose Death Prediction from Death Investigation Reports

arXiv:2610.19556v1 Announce Type: new Abstract: Confirmation of overdose deaths in the United States is often delayed due to the complexities of certifying drug-involved deaths. Death investigation re

researcharxiv-cs-cl

Framework for an AI-Ready ARPES Community Database

arXiv:2610.15236v1 Announce Type: cross Abstract: Condensed matter stands to gain profoundly from widespread adoption of artificial intelligence (AI). However, its current means of data organization i

researcharxiv-cs-ai

Giving my Dot a dedicated email address turned out to be surprisingly painless & solved a few problems around how to relate to a personal ag…

Giving my Dot a dedicated email address turned out to be surprisingly painless & solved a few problems around how to relate to a personal agent. I don't want it using my email or drafting messages on

agentsethan-mollick--x

Heterogeneous Agentic Coevolution

arXiv:2610.16078v1 Announce Type: new Abstract: Recent advances in self-improving LLM agents have demonstrated the potential of AI systems that drive their own intelligence. However, many domain-speci

Hidden in Plain Sight: Advancing Harmful Content Understanding via Perception-Aware Adversarial Self-Play

arXiv:2610.15449v2 Announce Type: new Abstract: Despite significant advances in language understanding, Large Language Models (LLMs) can still miss meaning hidden in plain sight, failing to identify h

Holi-Spatial 360: Generative Reconstruction from Sparse Panoramas for Spatial Rendering and Intelligence

arXiv:2610.19502v1 Announce Type: new Abstract: Spatial intelligence requires scalable 3D environments that are both photorealistic and semantically grounded, yet existing indoor datasets are dominate

IBM ties intelligent operations to agent safety and business value

Intelligent operations begin with a business question: What should artificial intelligence help an enterprise accomplish? As agents take on more work, organizations need an operating model that connec

safetysiliconangle

Identification of Entailment and Contradiction Relations for Natural Language Argumentation: A Neurosymbolic Approach

arXiv:2405.01259v2 Announce Type: replace Abstract: Argumentation is an important cognitive activity that involves the scrutiny of arguments and counterarguments. When given an argument, it is desirab

researcharxiv-cs-ai

KoAGE: Do Large Language Models Know, Learn, and Coin Korean Neologisms?

arXiv:2610.19399v1 Announce Type: new Abstract: Korean neologisms arise through diverse mechanisms, a demanding test of language models beyond lexical memorization. To enable systematic evaluation, we

Learning From a Steady Hand: A Weakly Supervised Agent for Robot Assistance under Microscopy

arXiv:2601.20776v2 Announce Type: replace Abstract: This paper rethinks steady-hand robotic manipulation by using a weakly supervised framework that fuses calibration-aware perception with admittance

agentsarxiv-cs-ro

Logarithmic Scores, Power-Law Discoveries: Disentangling Measurement from Coverage in Agent-Based Evaluation

arXiv:2604.00477v2 Announce Type: replace Abstract: LLM-based agent judges are an emerging approach to evaluating conversational AI, yet a fundamental uncertainty remains: can we trust their assessmen

MARS: Harmonizing Multimodal Convergence via Adaptive Rank Search

model-releasesarxiv-cs-lg

arXiv:2603.00720v2 Announce Type: replace Abstract: Fine-tuning Multimodal Large Language Models (MLLMs) with parameter-efficient methods like Low-Rank Adaptation (LoRA) is crucial for task adaptation

MS-Exam-Gen: An Automatic Benchmark Construction Toolkit for Evaluating LLMs on Multiple Sclerosis-MRI Imaging Knowledge

arXiv:2610.06170v2 Announce Type: replace Abstract: Biomedical large language model (LLM) evaluation requires auditable assessment of narrow, evolving, source-grounded subspecialty knowledge. Multiple

NavAble: A Large-Scale Dataset and Synthetic Data Generation Pipeline for Blind Navigation

arXiv:2610.19330v1 Announce Type: new Abstract: Reliable recognition of accessibility-critical objects (e.g., audible pedestrian signals, door-activation buttons, and handrails) is essential for assis

Applications

Nudge the Judge: Uncovering Program Decision Hijacking in Real-World Jev Applications

arXiv:2610.18612v1 Announce Type: cross Abstract: System One models such as Jev change how software makes decisions by mapping open-ended semantic contexts into structured judgments that directly driv

applicationsarxiv-cs-ai

Retell, Reward, Repeat: Reinforcement Learning for Narrative Theory-Informed Story Retelling

arXiv:2601.17226v3 Announce Type: replace-cross Abstract: Counterfactual storytelling exposes LLM shortcomings in causal reasoning, where few-shot prompting and SFT fail to produce logical and rationa

Robust Real-Time Monocular Human Pose Estimation with Insole-Based Sensor Fusion

arXiv:2610.19494v1 Announce Type: new Abstract: Real-time monocular human pose estimation is an important sensing component for human-centered intelligent systems. While recent camera-based methods ha

researcharxiv-cs-cv

RoTA-Bench: Evaluating 3D Spatial Reasoning through Interactive Projection Alignment

arXiv:2610.17665v2 Announce Type: new Abstract: Can vision-language models turn 2D observations into 3D understanding that supports precise action? This requires inferring object geometry, anticipatin

SolBehave: Evaluating the Behavioural Correctness of LLM-Generated Smart Contracts

arXiv:2610.18745v1 Announce Type: cross Abstract: Large language models increasingly generate Solidity smart contracts that, once deployed, can never be patched, making a single latent fault permanent

The Silent Failures in Agentic Data Science

arXiv:2610.14115v1 Announce Type: new Abstract: Large language models have significantly lowered the barrier to writing code. Naturally, this has also led to the development of data science agents tha