Search: “evaluation”

Auditable Emergency Triage for Maternal and Newborn Care in India

arXiv:2609.09356v1 Announce Type: new Abstract: At Noora Health, our nurses answer more than 50,000 medical queries per month on our WhatsApp-based service that provides caregivers with on-demand supp

researcharxiv-cs-cl

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

AuthBench: A Large-Scale Multilingual Benchmark for Authorship Representation across Genres and Lengths

DGX agent

arXiv:2609.06771v1 Announce Type: cross Abstract: Authorship signals matter in settings where writing style carries identity: digital forensics, plagiarism analysis, account linking, misinformation in

model-releasesarxiv-cs-ai

10 Sept 2026

AutoKD: Autonomous Knowledge Discovery

arXiv:2609.06366v1 Announce Type: new Abstract: Scientific discovery in data-rich domains is currently constrained by human bandwidth: the growth in the volume and complexity of real-world data far ou

AVSRBench: A Multi-Condition AVSR Benchmark

arXiv:2609.10366v1 Announce Type: cross Abstract: While AVSR has achieved sub-1% word error rates on the standard LRS3 benchmark, its reliance on broadcast speech obscures whether this reflects true g

Benchmarking Hybrid Deep Research Across Database Querying and Web Search

arXiv:2609.09410v1 Announce Type: new Abstract: While autonomous agents have made significant strides in 'deep research' by iteratively navigating the open web to synthesize information, real-world pr

Better Together: Complementary Query Rewriting Under a Strong RAG Baseline

arXiv:2609.05637v2 Announce Type: replace Abstract: A popular way to improve Retrieval-Augmented Generation (RAG) is to rewrite the user's question into several variants and search with all of them. W

applicationsarxiv-cs-cl

Beyond Coherence: Benchmarking Professional Editing-Technique Execution in Multi-Shot Audio-Video Generation

arXiv:2609.08275v1 Announce Type: new Abstract: Recent multi-shot audio-video generators can produce increasingly coherent and cinematic outputs, but coherence does not imply the ability to execute ed

Beyond Cross-Lingual Transfer: Benchmarking Propagation Boundaries in Multilingual LLM Unlearning

arXiv:2609.05976v1 Announce Type: cross Abstract: Large Language Model (LLM) unlearning aims to suppress target knowledge while preserving general capabilities. In multilingual settings, unlearning mu

BTBR: A Bayesian-Theory-Driven Probabilistic-Fuzzy Framework for Implicit Bias Removal in Large Language Models

arXiv:2408.10608v2 Announce Type: replace Abstract: Large language models (LLMs) may encode biased associations from heterogeneous training corpora that are not immediately visible under ordinary prom

safetyarxiv-cs-cl

Building the Harness Automatically: Self-Play in Code Distills a Text Harness for Black-Box Optimization

arXiv:2609.09468v1 Announce Type: new Abstract: Can an agent learn a numerical search strategy through executable practice and then transfer that strategy as text? We study low-budget black-box optimi

Building Trustworthy Graph-Agentic RAG for Social Good: Architectures, Failure Propagation, and Assurance by Construction

arXiv:2609.06391v1 Announce Type: new Abstract: Graph-agentic retrieval-augmented generation combines structured evidence with adaptive controllers that can plan retrieval, traverse relations, verify

Can Artificial Intelligence Support Healthcare and Mental Health Through Early Cyberbullying Detection ? The Impact of Emotion-Aware AI on Proactive Online Safety

arXiv:2609.09735v1 Announce Type: cross Abstract: Healthcare systems, mental health, and public well-being are increasingly affected by cyberbullying and harmful online interactions. This paper presen

Compiling VGDL into Causal Models

arXiv:2609.05459v1 Announce Type: new Abstract: Reinforcement learning and large language models often struggle to accurately capture the causal mechanics of game environments. Standard reinforcement

Cost-Aware Post-Hoc Deferral Under Calibration and Shift: An Environmental AI Case Study

arXiv:2609.09235v1 Announce Type: cross Abstract: Choosing a deferral policy for a frozen classifier requires more than ranking uncertain cases: confidence may be miscalibrated, errors have unequal co

safetyarxiv-cs-lg

Cross-Model Agreement as a Deployment-Time Reliability Signal for Automatic Polyp Segmentation

arXiv:2609.10495v1 Announce Type: new Abstract: In real-time colonoscopy, ground-truth annotations are unavailable at inference, so polyp segmentation models can fail silently. We propose Referee-Base

Data-Centric Post-Training for Financial Reasoning: Mining, Distillation, and Verifiable Learning

arXiv:2609.10113v1 Announce Type: new Abstract: Financial text, textbooks, and question-answer pairs are abundant, but only a small fraction is directly usable for reasoning-focused post-training. Exi

applicationsarxiv-cs-cl

Deep and shallow biases in language models

arXiv:2609.09901v1 Announce Type: new Abstract: Large language models often repeatedly select the same answer even when many alternatives are plausible. Prior work treats this concentration as bias, b

safetyarxiv-cs-cl

Distillation of Synthetic Data for Time Series Foundation Models

arXiv:2609.09586v1 Announce Type: cross Abstract: Time series foundation models (TSFMs) are increasingly pre-trained on synthetically generated time series trajectories, where the data generating proc

researcharxiv-cs-lg

Local Ai

Do LLMs Make More Mistakes If They Do Not Believe the Input Data?

arXiv:2609.09363v1 Announce Type: new Abstract: Large language models (LLMs) are prone to hallucinating or misinterpreting facts, which impairs their usability in retrieval-augmented generation or dat

local-aiarxiv-cs-cl

Local Ai

EFQ-Softmax: Exp-Free Quantization for Softmax

arXiv:2609.09721v1 Announce Type: new Abstract: Low-bit attention accelerates Transformer inference by moving the QK^op and PV matrix multiplications to FP8 or FP4 matrix engines. However, the softmax

local-aiarxiv-cs-lg

EnvCraft: Synthesizing Executable Environments in Agentic RL for Claw-like Agent

arXiv:2609.05576v1 Announce Type: new Abstract: The paradigm of LLMs has rapidly shifted from passive language interfaces to autonomous Claw-like agents that execute long-horizon tasks across stateful

Evidential-Based Higher-Order Set Argumentation Framework

arXiv:2608.27824v2 Announce Type: replace Abstract: Evidential argumentation extends Dung's abstract argumentation by requiring arguments and interactions to be backed by chains of evidence rooted in

EvolveScaler: Synthesizing Information-Evolution Contexts via Executable State Machines and Natural-Language Rendering

arXiv:2609.08435v2 Announce Type: new Abstract: In persistent interactions, long contexts may encode an evolving process rather than a fixed record: later events can revise or revoke earlier informati

Experimental Analysis of Productive Interaction Strategy with ChatGPT: User Study on Function and Project-level Code Generation Tasks

arXiv:2508.04125v2 Announce Type: replace-cross Abstract: The application of Large Language Models (LLMs) is growing in the productive completion of Software Engineering tasks. Yet, studies investigat

Forgetting Only What Matters: Layer-Selective Unlearning toward Robust LLMs

arXiv:2609.10439v1 Announce Type: new Abstract: Large Language Models (LLMs) can memorize and reproduce sensitive, copyrighted, or otherwise undesirable training content, creating privacy, safety, and

Freezing of Gait Prediction Under Spatial Occlusion: An IMU-Supervised Cross-Modal Distillation Approach

arXiv:2609.09826v1 Announce Type: new Abstract: Parkinson's disease is a progressive neurodegenerative disorder characterised by gradual deterioration of movement control. Automated freezing-of-gait (

applicationsarxiv-cs-cv

From Few-Shot Segmentation to Clinician-in-the-Loop Medical Image Analysis

arXiv:2609.10001v1 Announce Type: new Abstract: Few-shot medical image segmentation (FSMIS) seeks to delineate unseen structures from a small support set, but its standard formulation fixes task-defin

safetyarxiv-cs-cv

From Symbolic Perception to Logical Deduction: A Framework for Guiding Language Models in Geometric Reasoning

arXiv:2609.10335v1 Announce Type: cross Abstract: Plane geometry remains a significant challenge in AI, requiring the integration of visual perception and mathematical reasoning. While Large Multimoda

From the Fluency Fallacy to the Micro-to-Macro Validity Gap: Opportunities and Pitfalls of LLMs in Social Simulation

arXiv:2507.19364v3 Announce Type: replace Abstract: The integration of Large Language Models (LLMs) into social simulation has generated considerable enthusiasm, but also raises substantial methodolog

safetyarxiv-cs-ai

Geometry Conditioning in an Embodied SLM: Training Controls and Robustness Diagnostics in a 0.8B Hybrid Model

arXiv:2609.09213v1 Announce Type: new Abstract: We study how physical-state inputs affect a 0.8B hybrid language model adapted for manipulation with 6.2M trainable parameters. Six conditions are train

safetyarxiv-cs-ro

HyperTrace: Hypothesis-Based Preference Tracing for Online LLM Personalization

arXiv:2609.09835v1 Announce Type: new Abstract: Personalized language models aim to adapt responses to individual users, whose preferences are often latent and revealed gradually through interaction.

IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifier

arXiv:2609.10494v1 Announce Type: new Abstract: Enterprises deploy systems, not checkpoints. Usable capability depends jointly on weights, serving route, precision, output contract, and harness, yet a

applicationsarxiv-cs-cl

In Medical Claims Data, Enhancing Predictive Performance for Major Adverse Cardiovascular Events Using Cross Attention

arXiv:2609.09824v1 Announce Type: new Abstract: Medical claims data comprise the financial details, including the expenses and billing information, as well as the clinical information, such as the dia

Inference-Time Graph Engineering for Multi-Agent LLM Workflows

arXiv:2609.05774v1 Announce Type: new Abstract: Recent multi-agent LLM systems increasingly rely on graph-structured communication to coordinate specialized agents. We revisit multi-agent orchestratio

Inferring the Unspoken: Aligning Embodied Agents with Implicit Preferences

arXiv:2502.00858v4 Announce Type: replace Abstract: Natural-language instructions rarely specify every detail required for embodied action. An agent asked to ``prepare an apple,'' for example, must st

Infra-Bench CLS: A Global, Open-Source Benchmark for Critical Infrastructure Classification with Earth Observation Foundation Models

arXiv:2609.09482v1 Announce Type: new Abstract: Critical infrastructure location data is often incomplete and unevenly distributed globally, especially in developing regions. Earth observation foundat

Intent Drift at SME Scale: Deployment Practice, Not Model Capability, Determines Agentic Compliance

arXiv:2609.05975v1 Announce Type: cross Abstract: We introduce Chain of Intent, a governance framework for agentic AI at small regulated firms, and validate it against a failure it was built to addres

safetyarxiv-cs-ai

Layerwise Tunable Lifting Scheme for the Convolutional Neural Network

arXiv:2609.09827v1 Announce Type: new Abstract: This work introduces a family of tunable lifting schemes for biorthogonal wavelet filter banks. We propose three lifting strategies: low-pass tuning (LS

LEBGen: An LLM-Enhanced Bayesian Network Framework for Few-Shot Travel Survey Data Generation

arXiv:2609.08288v1 Announce Type: new Abstract: Travel survey data are essential for transportation planning and travel behavior analysis, yet collecting large-scale representative samples is costly a

Less Is Personal: Learning Minimal Sufficient User Profiles for Personalized Language Models

arXiv:2609.08180v1 Announce Type: new Abstract: Retrieval-augmented personalization enables large language models to produce more accurate and preference-aligned outputs using relevant records retriev

MADS: Multi-Agent Dialogue Simulation for Diverse Persuasion Data Generation

arXiv:2510.05124v3 Announce Type: replace Abstract: We propose MADS (Multi-Agent Dialogue Simulation), a scalable framework for generating persuasive multi-turn dialogues via agent self-play. MADS emp

agentsarxiv-cs-cl

Local Ai

Maverick: Private and Verifiable LLM Inference Made Practical via Matrix-Vector Multiplication Delegation

arXiv:2609.10264v1 Announce Type: cross Abstract: Open-source large language models (LLMs) are increasingly competitive with closed-source models while offering transparency and the ability to run inf

local-aiarxiv-cs-lg

MeClear: Cooperative Game-Theoretic Attribution and Risk-Aware Memory Clearance for Long-Horizon LLM Agents

arXiv:2609.09115v1 Announce Type: new Abstract: Long horizon Large Language Model (LLM) agents rely on external memory systems to preserve user preferences and task knowledge across extended interacti

MOSAIC: A Universal Agent-Level Interface for Cross-Paradigm Agent Mixing and Human-AI Collaboration

arXiv:2603.01260v2 Announce Type: replace Abstract: Existing infrastructure cannot deploy agents from different decision-making paradigms within the same environment, making fair cross-paradigm compar

Myocardial Strain Drift Correction in Deep Learning Based Ultrasound Tracking

arXiv:2609.09577v1 Announce Type: cross Abstract: Myocardial strain from echocardiography is a key biomarker for cardiac function. Recent deep learning methods show strong performance for myocardial m

researcharxiv-cs-cv

NEXUS-MI: Communication-Aware Federated Personalization for Gateway-Coordinated Motor-Imagery Brain-Computer Interfaces

arXiv:2609.09786v1 Announce Type: new Abstract: Electroencephalography (EEG)-based motor-imagery brain-computer interfaces (MI-BCIs) vary across subjects and sessions, complicating personalization fro

researcharxiv-cs-lg

Noesis: Deterministic-First Retrieval with Two-Tier Context Hydration for Factuality-Critical Queries on Small Local Models

arXiv:2609.07663v1 Announce Type: cross Abstract: A wrong number is worse than no answer. Across factuality-critical domains -- audience metrics, scheduling and rights in media; dosages and lab values

safetyarxiv-cs-ai

On Scaling Coordinate-Based Neuroevolution: The Quadtree Bottleneck in ES-HyperNEAT

arXiv:2608.24480v1 Announce Type: cross Abstract: ES-HyperNEAT evolves substrate topology through adaptive quadtree subdivision; to our knowledge, no implementation with full population-level GPU para