Search: “evaluation”

BharatGather: A Culturally-Informed Benchmark Dataset for Misinformation and Fake News Detection in Indian Public Events

arXiv:2609.02895v1 Announce Type: new Abstract: Large-scale public events, such as religious festivals, political rallies, and cultural gatherings, are increasingly vulnerable to the rapid disseminati

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

Bioinfoysis Technical Report

DGX agent

arXiv:2609.03871v1 Announce Type: new Abstract: Large language model agents have shown promise in bioinformatics, but most existing systems focus primarily on producing final answers, treating plannin

agentsarxiv-cs-ai

4 Sept 2026

Bounded Personas Match Retrieval on Classification but Not Regression for a Frozen Agent

arXiv:2609.02890v1 Announce Type: new Abstract: A personalized language agent must convert a user's interaction history into behavior on each new request at inference time. Two strategies dominate. Re

agentsarxiv-cs-cl

CASCADE: A Component Ablation and Corpus Audit of a Layered Local Defense for MCP-Based Systems

arXiv:2604.17125v2 Announce Type: replace-cross Abstract: The Model Context Protocol (MCP) widens the prompt injection attack surface of large language model applications to tool descriptions, paramet

Applications

Catalogue Photography as a Cold Start: Toward Deployable Carbide Burr Recognition

arXiv:2609.03995v1 Announce Type: cross Abstract: Verifying that manufactured batches of milling tools or carbide rotary burrs conform to production order sheets remains a largely manual and error-pro

applicationsarxiv-cs-ai

Caught in the Story: Narrative Captivity in Multi-turn LLMs Conversation

arXiv:2609.03407v1 Announce Type: new Abstract: People increasingly turn to large language models (LLMs) for everyday advice, making ethically charged interpersonal problems a practical moral-advisory

Chiaroscuro for Emotions: A Contrastive Emotion Benchmark Grounded in Appraisal Theory

arXiv:2609.03394v1 Announce Type: new Abstract: Emotion recognition benchmarks often predict one emotion per text, missing many real-world scenarios where two people arrive at opposing emotions from a

Clean Engineering, Unstable Measurement: A Preregistered Reliability Failure of Black-Box LLM Observers on Shared Endpoints

arXiv:2609.04198v1 Announce Type: new Abstract: Language-model judges now gate training data, score generations, and drive leaderboards. The judge is then a measurement instrument, resting on one rare

Continuous Actions from Discrete Minds: Latent-Aligned Planning for End-to-End Autonomous Driving

model-releasesarxiv-cs-cv

arXiv:2609.04070v1 Announce Type: new Abstract: Bridging the gap between the discrete reasoning of Vision-Language Models and the continuous, physics-constrained nature of autonomous driving remains a

Counterfactual Fairness Audits of Multi-Step Clinical LLM Agents Require a Measured Per-Action Instability Floor

arXiv:2609.03221v1 Announce Type: new Abstract: Counterfactual audits are the standard tool for checking whether a clinical agent treats demographically distinct but clinically identical patients diff

Counterfactual Routing Using Integer Programming with Constraint Generation

arXiv:2609.03707v1 Announce Type: new Abstract: We present our submission to the IJCAI 2025 'Counterfactual Routing Competition' (CRC 25). The goal of the competition is to find counterfactual explana

Differentially private federated learning with Byzantine-robust aggregation: A cross-domain framework for secure model training in banking and healthcare systems

arXiv:2609.03064v1 Announce Type: cross Abstract: Federated learning allows banks, hospitals, and other regulated organizations to train a shared model without moving raw records off their own servers

DisclosureBeta: A Measurement-Channel Theory for Regime-Conditioned Betas from LLM-Read Risk Disclosures

arXiv:2609.02900v1 Announce Type: cross Abstract: The problem is the beta a desk needs when a firm's price history is too short to trust: an S-1 filer, a recent listing, or a name just past a regime b

researcharxiv-cs-cl

Distilled Rapid Embedding Transfer (DRET): Parameter-Efficient Biomedical Domain Adaptation via Priority-Based Embedding Transfer

arXiv:2609.02898v1 Announce Type: new Abstract: Large domain-specific language models such as BioBERT and ClinicalBERT achieve strong performance on biomedical NLP tasks, but their computational deman

Do GUI Agents Know When Not to Act? Enabling Conflict-Aware Termination for Multimodal GUI Agents

arXiv:2609.03438v1 Announce Type: new Abstract: Graphical user interface (GUI) agents are increasingly used to execute natural-language instructions on user interfaces, yet real users may issue infeas

DropClick: Semi-Automated One-Click Segmentation for Agricultural Robotic Data

arXiv:2609.03680v1 Announce Type: new Abstract: Labelling vision datasets, especially for segmentation tasks, is a laborious and costly process that stymies novel developments in agricultural robotics

researcharxiv-cs-cv

ENEAS: Embedding-guided Neural Ensemble for Adaptive Segmentation

arXiv:2609.03756v1 Announce Type: cross Abstract: We present ENEAS, a unified, text-promptable method for instance tracking and semantic discovery. Text-promptable segmentation models, including the l

Enhancing Financial Question Answering: A Novel Benchmark Dataset of Banks' financial statements

arXiv:2609.03654v1 Announce Type: cross Abstract: The comparative analysis of banks' financial statements poses significant challenges for automated question answering systems due to their complexity,

Feasible but Not Safe: Constraint Violations and Report-Channel Attacks in Learned Cell-Free ISAC Association

arXiv:2609.03147v1 Announce Type: cross Abstract: Learning-based schedulers have been proposed to provide real-time user, target, and access point (AP) association in distributed cell-free integrated

Applications

Fill My Mirror: Geometry-Constrained Mirror Inpainting

arXiv:2609.03740v1 Announce Type: new Abstract: Mirrors are common in real-world images, yet producing geometrically consistent reflections with generative models remains challenging. Unlike most obje

applicationsarxiv-cs-cv

Finite-Time Convergence of Single-Trajectory Chi-Square Robust Q-Learning With Linear Function Approximation

arXiv:2510.01721v4 Announce Type: replace Abstract: Distributionally robust reinforcement learning seeks policies that remain effective when the deployment environment differs from the one that genera

FlexMap: Robust HD Map Construction under Flexible Camera Configurations

arXiv:2601.22376v2 Announce Type: replace Abstract: High-definition (HD) maps provide essential semantic information about road structures for autonomous driving, but existing HD map construction meth

agentsarxiv-cs-cv

Generative Nested Sampling of Atomistic Thermodynamic Landscapes

arXiv:2609.03193v1 Announce Type: cross Abstract: Nested sampling (NS) resolves the thermodynamics of an atomistic system from a single simulation, but its practical reach is limited by the Markov-cha

Geometry-Aware Graph Construction via Adaptive Spectral Bandwidth Control

arXiv:2609.03306v1 Announce Type: new Abstract: Kernelized graph methods - spectral clustering, diffusion maps, and sparse kernel -regression graphs - that use Gaussian kernels depend on the choice of

Grammar-Aligned Decoding

arXiv:2405.21047v4 Announce Type: replace Abstract: Large Language Models (LLMs) struggle with reliably generating highly structured outputs, such as program code, mathematical formulas, or well-forme

Safety

Hadronic Mono-Z Dark Matter Sensitivity with Flow Matching on CMS Open Data

arXiv:2609.02923v1 Announce Type: cross Abstract: We present a projected sensitivity study for hadronic mono-Z dark-matter production using CMS Run~2015D HTMHT open data corresponding to 2.256382381~i

safetyarxiv-cs-lg

HalluPeer: A Taxonomy-driven Benchmark for Detecting Hallucinations in Scientific Peer Reviews

arXiv:2609.03580v1 Announce Type: new Abstract: The growing scale of academic peer review has motivated the use of Large Language Models (LLMs) as review assistants, yet LLMs can generate fluent but u

HOMURA: Taming the Sand-Glass for Time-Constrained LLM Translation via Reinforcement Learning

arXiv:2601.10187v3 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have achieved remarkable strides in multilingual translation but are hindered by a systemic cross-lingual verbosi

Safety

Imagine-then-Plan: Agent Learning from Adaptive Lookahead with World Models

arXiv:2601.08955v3 Announce Type: replace-cross Abstract: Recent advances in world models have shown promise for modeling future dynamics of environmental states, enabling agents to reason and act wit

safetyarxiv-cs-ai

Safety

InSituMeasure: Probing Situated Measurement Grounding in Industrial Scenes with Multimodal Large Language Models

arXiv:2609.04014v1 Announce Type: new Abstract: For trained operators, gauge reading requires little specialized knowledge, low cognitive effort, and high repeatability. Yet Multimodal Large Language

safetyarxiv-cs-ai

It's the Problem, Not the Path: Budget and Difficulty Confounds in LLM Reasoning Trajectories

arXiv:2609.03436v1 Announce Type: cross Abstract: Reasoning traces of large language models are widely read as containing 'breakthrough' moments and early-legible fates. Both readings rest on measurem

K-NeAS: Scalable Multi-Material CT Reconstruction Using Neural SDFs

arXiv:2607.14415v2 Announce Type: replace Abstract: Computed Tomography (CT) carries significant ionizing radiation risks, driving the need for sparse-view reconstruction. Implicit scene representatio

researcharxiv-cs-cv

KernelFoundry: Hardware-aware evolutionary GPU kernel optimization

arXiv:2603.12440v2 Announce Type: replace-cross Abstract: GPU kernel optimization challenges LLMs beyond standard coding tasks, as it requires an understanding of hardware architecture, parallel compu

KhatianDoc: A Human-Verified Benchmark Diagnosing Multimodal LLM Failure on Bengali Legal Land Records

arXiv:2609.03597v1 Announce Type: new Abstract: Land ownership in Bangladesh is recorded in Ana-Ganda-Kora-Kranti-Til, a base-16 positional fraction system with dedicated Unicode glyphs, no mainstream

KnowVis: Knowledge-Centric Visual Summarization for Video Lectures

arXiv:2609.03742v1 Announce Type: cross Abstract: Video lectures are valuable educational resources, but their dense and lengthy formats often overwhelm novice learners. This difficulty stems from a f

researcharxiv-cs-cl

Landmark-Based Discrimination of Injury-Associated Athlete-Sessions from Minute-Resolution Multimodal Football Monitoring Data

arXiv:2609.03790v1 Announce Type: new Abstract: Athlete monitoring data may be recorded minute by minute throughout a match or training session, while injury information may only indicate whether the

LDC: Learning to Generate Research Idea with Dynamic Control

arXiv:2412.14626v3 Announce Type: replace-cross Abstract: Recent advancements in large language models (LLMs) have demonstrated their potential in automating the scientific research ideation. Existing

Learnable composition for neural operators

arXiv:2609.03069v1 Announce Type: new Abstract: Neural operators are fast, differentiable surrogates for physical simulation, but their accuracy often degrades when domain geometry, size, or operating

Learning What Not to Forget: Long-Horizon Agent Memory from a Few Kilobytes of Learning

arXiv:2606.20954v2 Announce Type: replace-cross Abstract: Long-running language-model systems accumulate interaction history that outgrows the context window, so they must continually evict. When an e

Tutorials

Listen to the Latents: Self-Correcting Speech Recognition in Large Audio Language Models Through Hidden-State Interactions

arXiv:2609.02940v1 Announce Type: cross Abstract: Recent automatic speech recognition (ASR) systems increasingly integrate large language models (LLMs) to leverage their semantic knowledge, either ext

tutorialsarxiv-cs-ai

LLM-Guided Reinforcement Learning for Adaptive NPC Behavior in Multi-Agent Combat Games

arXiv:2609.02931v1 Announce Type: cross Abstract: Scripted and rule-based non-player characters (NPCs) in combat video games often exhibit predictable behaviors that experienced players can exploit, w

Local Path Planning and Obstacle Avoidance for an Omnicopter Platform

arXiv:2609.03630v1 Announce Type: new Abstract: Autonomous unmanned aerial vehicles (UAVs) increasingly operate in cluttered environments where global planners such as RRT* are not directly deployable

agentsarxiv-cs-ro

Long-Horizon Consistent and Interaction-Aware World Models for Multi-Style End-to-End Driving

model-releasesarxiv-cs-ro

arXiv:2609.03225v1 Announce Type: new Abstract: End-to-end autonomous driving has increasingly adopted world model-based reinforcement learning frameworks to improve learning efficiency through extit{

Lose the Order, Keep the Hierarchy: Deordering HTN Plans

arXiv:2609.03912v1 Announce Type: new Abstract: Hierarchical Task Network (HTN) planning is a powerful planning formalism based on task decomposition. Although most of the literature studied plan gene

Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications

arXiv:2508.00669v2 Announce Type: replace-cross Abstract: The proliferation of Large Language Models (LLMs) in medicine has enabled impressive capabilities, yet a critical gap remains in their ability

agentsarxiv-cs-ai

MoMaStage: Skill-State Graph Guided Planning and Closed-Loop Execution for Long-Horizon Indoor Mobile Manipulation

arXiv:2603.08383v2 Announce Type: replace Abstract: Long-horizon indoor mobile manipulation (MoMa) requires robots to execute extended navigation-manipulation sequences whose feasibility depends on st

researcharxiv-cs-ro

No-Regret Bayesian Optimization with Finite-Library Input-Warped Kernels

arXiv:2609.02993v1 Announce Type: new Abstract: Gaussian-process Bayesian optimization (GP-BO) excels at black-box optimization of costly functions, e.g., hyperparameter optimization (HPO) and multi-a

agentsarxiv-cs-lg

Tutorials

OBER+: Continuity-Aware Reporting and Traceable Continuous Improvement in Outcome-Based Education

arXiv:2609.03770v1 Announce Type: cross Abstract: Institutions practising outcome-based education compute learning outcome attainment routinely, while reviews of curriculum analytics report an absence

tutorialsarxiv-cs-cl