Search: “evaluation”

Twice Upon a Time: Complementary Representations for Time-Series Reasoning

arXiv:2610.22327v1 Announce Type: cross Abstract: Time Series Language Models (TSLMs) enable language-based understanding and reasoning over temporal data, yet a fundamental question remains: what inf

safetyarxiv-cs-ai

16 Oct 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

VoteGEO-Bench: Measuring the Impact of Generative Engine Optimization on Electoral Visibility

DGX agent

arXiv:2610.21330v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used for election information, yet little is known about how external web content shapes the political i

model-releasesarxiv-cs-cl

16 Oct 2026

Agents

WEAVE: Weaving Real-World Code Evolution into Dependency-Structured Tasks for Benchmarking and Training Code Agents

arXiv:2610.22039v1 Announce Type: cross Abstract: Real-world software engineering rarely consists of isolated changes. Features, migrations, and systematic fixes often unfold across multiple pull requ

agentsarxiv-cs-cl

16 Oct 2026

A LoRA is Worth a Thousand Pictures

model-releasesarxiv-cs-cv

arXiv:2412.12048v2 Announce Type: replace Abstract: Low-Rank Adaptation (LoRA) has become a standard approach for parameter-efficient fine-tuning of image diffusion models, with over 200K models train

A Scaled-Up Empirical Study of Syntactic Language Models

arXiv:2610.16837v1 Announce Type: cross Abstract: Syntactic language models (SLMs) that generate sentences along with their syntactic tree structures have shown promise in both syntactic generalizatio

Action Jets: Learning the Local Shape of the Action-conditioned Data Manifold

model-releasesarxiv-cs-cv

arXiv:2610.19007v1 Announce Type: new Abstract: World models are a powerful means of reasoning and planning, but many of these action-conditioned predictive models are high dimensional and computation

ActiveEvidence: Decision-Focused Evidence Graphs with Verifiable Acquisition Gaps

arXiv:2610.20532v1 Announce Type: cross Abstract: A multimodal agent must decide whether visual evidence is worth acquiring, which candidate or resolution to query, and when further interaction can no

safetyarxiv-cs-cv

Adaptive Compression and Targeted Perturbation: A Unified Framework for Generalized Audio Deepfake Detection

arXiv:2610.16049v1 Announce Type: cross Abstract: Existing audio deepfake detection (ADD) methods frequently exhibit limited generalization, as fixed bottleneck architectures fail to adapt to the hete

Adaptive Computation with Conformal Certification

arXiv:2610.19189v1 Announce Type: new Abstract: Scientific imaging data involving medical (e.g., 3D radiographic, microscopic images) and astronomical sensors pose different challenges from natural im

AFCS: Atomic-Fact-Conditioned Synthesis for Factual Knowledge Pretraining

arXiv:2610.20086v1 Announce Type: new Abstract: Synthetic data is increasingly used in language-model pretraining. Existing knowledge-corpus synthesis pipelines, including WRAP and Nemotron-CC, usuall

Hardware

AgriJev: Efficient Agricultural Candidate Scoring with Multi-Scale Adapted Models

arXiv:2610.19478v1 Announce Type: new Abstract: Agricultural systems make decisions over heterogeneous entity types, textual judgments, and knowledge-question options. Generating a textual answer adds

hardwarearxiv-cs-cl

Tutorials

Analyzing performance of Retrieval Augmented Generation models for Question Answering Tasks

arXiv:2610.20419v1 Announce Type: new Abstract: Retrieval-Augmented Generation (RAG) models have become almost a cornerstone of open-domain question answering tasks; in which the quality of answers ge

tutorialsarxiv-cs-cl

ANCHOR: Assessing Naturalistic Constraint Hierarchies and Ordering in Repository-Grounded Agentic Coding

arXiv:2610.16859v2 Announce Type: replace Abstract: For repository-grounded coding agents, a functionally correct patch is not necessarily an acceptable one: developers also constrain how the task mus

Anuvani-LID: Robust and Calibrated Spoken Language Identification for Indian Languages

arXiv:2610.20263v1 Announce Type: new Abstract: Every multilingual speech pipeline begins with a language decision, an error there propagates silently through recognition, translation and routing. In

AphaVoice: Text-to-Speech Model for Aphasia Patient Simulation

arXiv:2610.14479v1 Announce Type: cross Abstract: While language therapy is the primary treatment for post-stroke aphasia, limited clinical resources often restrict patient access to proper care. Addr

Hardware

AReaL-RSI: Adaptive Scaling and Coordination of Recursive Self-Improvement

arXiv:2610.18083v1 Announce Type: new Abstract: Scaling recursive self-improvement requires additional computation to produce useful research progress in reaching persistent objectives. Intuitively, m

hardwarearxiv-cs-ai

au-Emotion-Bench: Exposing the Interaction Fragility of LLM Agents through Real-World User Emotions

arXiv:2610.19560v1 Announce Type: cross Abstract: In long-horizon tool-calling tasks, LLM agents can fail not only because of tool-use errors, but also because of ineffective interaction with users. Y

Audit tools of the trade: Automated Auditor Elicitation Can Be Sensitive to the Context the Auditor Is Given

arXiv:2610.16911v1 Announce Type: new Abstract: Does providing additional context to automated AI auditors improve their effectiveness? Using the Petri tool to audit LLM coding agents, we test the imp

AuthGateBench: Benchmarking LLMs as Authorization Gate

arXiv:2610.16426v1 Announce Type: new Abstract: Automated approval systems let coding agents execute high-risk actions with minimal human oversight by delegating the authorization decision to a classi

AutoSec-RAN: Specification-Grounded LLM Fine-Tuning for Automated Security Analysis of O-RAN

arXiv:2610.15995v1 Announce Type: cross Abstract: This paper presents AutoSec-RAN, a specification-grounded large language model (LLM) framework for automated security triage of Open Radio Access Netw

Beyond Answer Sharing: TrueMAD for Targeted Peer Engagement in Multi-Agent Debate

arXiv:2610.18240v1 Announce Type: new Abstract: Multi-agent debate (MAD) aims to improve large language model reasoning by exposing agents to alternative solutions and enabling iterative revision. How

Beyond Successful Play: Diagnosing Opponent Modeling in Large Language Models

arXiv:2610.17310v1 Announce Type: new Abstract: Language-model agents are expected to adapt to others whose behavior changes through interaction. Yet adaptation may rely on learned behavioral patterns

Beyond Time Induction: Structured Conditional Neural Solvers for Parametric Stochastic-Volatility Pricing

arXiv:2610.19254v1 Announce Type: new Abstract: Physics-informed neural networks provide a flexible framework for learning parametric PDE solution families without labeled data, yet preserving accurat

Bridging Academia and Industry: A Comprehensive Benchmark for Attributed Graph Clustering

arXiv:2602.08519v2 Announce Type: replace Abstract: Attributed Graph Clustering (AGC) is a fundamental unsupervised task that integrates structural topology and node attributes to uncover latent patte

Can agents whose sole duty is to keep humans alive be hijacked to kill? Delayed multi-turn derived-action trap attacks in simulated high-stakes environments

arXiv:2610.15153v1 Announce Type: new Abstract: We ask whether a tool-using agent whose sole duty is to keep humans alive can be induced, by delayed prompt injection, to kill. The keep-alive duty is i

Agents

Can Generative AI Automate Data Extraction for Meta-Analysis? A Case Study on Intercropping Research

arXiv:2609.35089v2 Announce Type: replace Abstract: Meta-analysis is the synthesis of information from multiple sources to arrive at an overarching conclusion. There is a large need for meta-analysis

agentsarxiv-cs-ai

Claim Framing as a Driver of LLM Sycophancy

arXiv:2610.18159v1 Announce Type: cross Abstract: Sycophancy in Large Language Models, the tendency to align responses with user preferences over ground truth, has largely been studied using questions

Combining scEEG and PPG for reliable sleep staging

arXiv:2602.15042v2 Announce Type: replace-cross Abstract: Reliable sleep staging remains challenging for lightweight wearable devices such as single-channel electroencephalography (scEEG) or photoplet

Delegating Earth science model calibration to knowledge-guided LLM agents

arXiv:2610.18378v1 Announce Type: new Abstract: Applying process-based Earth science models to new sites and questions often requires expert calibration decisions. Reliable delegation to language-mode

Designing Textual Interfaces To Enhance Llm Reasoning On Audio-Visual Question Answering

arXiv:2610.20085v1 Announce Type: cross Abstract: Automatic prompt optimization (APO) has shown strong effectiveness for text-based LLMs and LLM systems, but its application to audio-visual understand

Detection of Potato Plant Leaf Diseases using Convolutional Neural Networks

arXiv:2610.20544v1 Announce Type: new Abstract: Potato is an important food-security crop in Ethiopia, but its production is affected by foliar diseases, particularly early blight and late blight. Thi

DiffGIPC: Differentiable Mixed-Coordinate Contact Dynamics on GPU

model-releasesarxiv-cs-ro

arXiv:2610.19091v1 Announce Type: cross Abstract: Contact-rich inverse problems require efficient gradients and reliable enforcement of non-penetration. Existing differentiable methods provide fast si

Do Theorem Provers Need Theorem-Proving Agents? mini-Lean-agent: A Coding-Agent Baseline for Lean

arXiv:2610.17331v1 Announce Type: new Abstract: General-purpose coding agents use standard shell and file interactions, yet formal theorem-proving agents often rely on specialized, ad-hoc tooling. Thi

Do Vision CIL Methods Transfer to Protein? A Diagnostic Benchmark of Frozen Protein Encoders

arXiv:2610.18879v1 Announce Type: new Abstract: Protein function annotation operates over an expanding label space, making class-incremental learning (CIL) a natural framework for incorporating newly

DTScribe: Generating Models for Digital Twin Reporting using Local Large Language Models

arXiv:2610.18635v1 Announce Type: cross Abstract: The development of a digital twin brings together many stakeholders and technical components. We have previously investigated the reporting of the con

Empowering Edge Agents: A Systematic Analysis of Edge-Cloud Collaboration in LLM Agent Execution

arXiv:2610.17816v1 Announce Type: new Abstract: Edge-cloud collaboration combines the lower inference overhead and greater data locality of edge-side execution with the stronger capabilities of cloud-

End-to-End Vision-Language-Action Policies for Autonomous Lunar Rover Docking

arXiv:2610.19224v1 Announce Type: new Abstract: Surface navigation on the Moon is subject to extreme illumination contrast and deployment-time perceptual disturbances. While modular navigation pipelin

safetyarxiv-cs-ro

Energy Consumption Analysis of Discrete Diffusion and Autoregressive Language Models

arXiv:2610.19855v1 Announce Type: new Abstract: As Large Language Models (LLMs) continue to scale, their energy consumption during inference has become a critical concern. While Autoregressive (AR) mo

Agents

F2A-ObjectNav: An Adaptive Agentic Architecture for Object-Goal Navigation

arXiv:2610.19618v1 Announce Type: new Abstract: Object-goal navigation requires an embodied agent to explore an unfamiliar environment, identify a target object, navigate toward candidate instances, a

agentsarxiv-cs-ro

FACES: Fine-grained Gated Semantic Alignment for Multimodal Emotional Support Conversation

arXiv:2610.20051v1 Announce Type: new Abstract: In recent years, with advances in multimodal interaction technologies and the growing demand for intelligent emotional support, Multimodal Emotional Sup

safetyarxiv-cs-cl

ForceBench: Benchmarking Force Integration for Robotic Manipulation

model-releasesarxiv-cs-ro

arXiv:2610.19604v1 Announce Type: new Abstract: Force feedback provides vision-language-action (VLA) policies with physical observations that can guide action selection and execution. However, differe

From Relation-Specific Heads to Shared Interventions: Contextual Entrainment in Language Models

arXiv:2610.18674v1 Announce Type: cross Abstract: Large language models rely on prompt context to perform in-context learning, follow formats, and adapt to local evidence. This ability, however, also

Frustratingly Easy Agentic RAG via Portable Skills: A Case Study in Customer Support

arXiv:2610.14428v1 Announce Type: new Abstract: Enterprise workflow automation typically requires retrieving a complete and accurate set of relevant information from large operational document corpora

Frustratingly Easy Majority Voting Using Length Conditioning

arXiv:2610.19890v1 Announce Type: new Abstract: Majority Voting (MV) is a simple and widely used strategy which improves the reasoning accuracy of Large Language Models (LLMs) by allocating additional

safetyarxiv-cs-cl

Generative Representation Learning for Scalable Latent Tokenization

arXiv:2610.20533v1 Announce Type: cross Abstract: We introduce an approach for self-supervised representation learning designed to be used as a tokenizer for generative modeling. Our objective supervi

researcharxiv-cs-cv

Get In, Decide, Prove: A Merchant-Side Readiness Benchmark for Agentic Commerce

arXiv:2610.17378v1 Announce Type: new Abstract: AI agents now browse and buy on people's behalf, and benchmarks measure how well the agents perform. Far less is known about the other side of the trans

HACHIMI-II: From Role-Play to Learner Behavior Modeling for Faithful Student Simulation

arXiv:2610.19654v1 Announce Type: new Abstract: Simulated students let researchers test tutoring systems and teaching strategies before real learners are available, but only if the simulation reproduc

researcharxiv-cs-cl

How Reliable Are Large Language Models for Soil Organic Carbon Assessment? An Australian Benchmark

arXiv:2610.18201v1 Announce Type: cross Abstract: Soil organic carbon (SOC) is an indicator of agricultural soil condition and carbon storage, but numerical outputs from large language models (LLMs) r