Search: “evaluation”

Key Point Analysis Needs Structure Recovery: Task Definition, Dataset Diagnosis, and a Structure-Aware Benchmark

arXiv:2608.25854v1 Announce Type: new Abstract: Key Point Analysis (KPA) aims to identify a concise set of key points that summarize a collection of arguments together with their prevalence. We argue

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Applications

Label-Free Foundational Model Selection for Medical Image Classification under Distribution Shift via Pseudo Label Discrepancy

DGX agent

arXiv:2608.25810v1 Announce Type: new Abstract: Foundation models are increasingly deployed for medical image analysis. However, under the inter-institutional distribution shift typical of deployment,

applicationsarxiv-cs-cv

27 Aug 2026

Local Ai

LLMTrace: A Corpus for Classification and Fine-Grained Localization of AI-Written Text

arXiv:2509.21269v2 Announce Type: replace Abstract: The widespread use of human-like text from Large Language Models (LLMs) necessitates the development of robust detection systems. However, progress

local-aiarxiv-cs-cl

LUTSeg: A Longitudinal Multi-Expert Dataset for Ulcer Tissue Segmentation

model-releasesarxiv-cs-cv

arXiv:2608.25866v1 Announce Type: new Abstract: Quantifying wound tissue composition is essential for monitoring chronic ulcer progression and guiding treatment decisions. However, pixel-level annotat

OmniPhys: A Unified Multimodal Benchmark for Physics Understanding and Generation from Chinese Educational Corpora

arXiv:2608.25398v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have demonstrated strong abilities in solving diverse visual and textual reasoning tasks. However, their develo

ONNX-Net: Towards Universal Representations and Instant Performance Prediction for Neural Architectures

arXiv:2510.04938v2 Announce Type: replace-cross Abstract: Neural architecture search (NAS) automates the design process of high-performing architectures, but remains bottlenecked by expensive performa

PhaseShift: Topology-Aware Data Harmonization and Model Consolidation Across Signalized Intersections

arXiv:2608.25275v1 Announce Type: cross Abstract: Learned traffic-behavior models are commonly trained separately for each intersection, creating model portfolios that cannot share evidence across sit

researcharxiv-cs-ro

PointRL: Learning Point-Level Vision-Language Grounding from Verifiable Annotation Evidence

arXiv:2608.25299v1 Announce Type: new Abstract: Vision-language models (VLMs) increasingly rely on point coordinates as a compact and executable interface for visual grounding in GUI interaction, robo

researcharxiv-cs-cv

SciMIF: Understanding Multimodal Instruction Following in Scientific Domains

arXiv:2608.25973v1 Announce Type: cross Abstract: Understanding instruction-following capabilities in scientific domains is essential for effectively leveraging Multimodal Large Language Models (MLLMs

TurnBench: A Multi-Domain Benchmark for Turn-Taking Dynamics in Spoken Dialogue

arXiv:2608.25218v1 Announce Type: cross Abstract: Speakers in natural conversation take turns speaking and listening, deciding in real time when to take, hold, or yield the floor. However, turn-taking

VietAIDetector: An Open-Source Zero-Shot Detector for Vietnamese AI-Generated Text

arXiv:2608.25478v1 Announce Type: new Abstract: In recent years, distinguishing between AI-generated text and human-written text has remained a challenge. In this paper, we introduce VietAIDetector, a

researcharxiv-cs-cl

VisDocAgentBench: Benchmarking Agents for Visually Rich Document Retrieval

model-releasesarxiv-cs-cv

arXiv:2608.17889v1 Announce Type: cross Abstract: Visually rich documents encode relevance through language, layout, structured visual elements, and corpus context, yet retrieval is typically evaluate

Why and When Neural Networks Improve Local Approximation in Optimization

arXiv:2608.24963v1 Announce Type: new Abstract: Published experience with neural surrogates in derivative-free optimisation is contradictory: the same family of models that cuts the evaluation count o

A Geometric Theory of Robust Fairness Audits

arXiv:2608.24818v1 Announce Type: new Abstract: Neighborhood-based fairness audits evaluate individual fairness by comparing predictions among similar individuals in feature space. Despite their wides

Applications

A Multimodal Foundation Model for Longitudinal Patient Representation and Scalable Insight Generation in Oncology

arXiv:2608.24688v1 Announce Type: new Abstract: Precision oncology necessitates a longitudinal model of patient state that captures cancer evolution and treatment over time, integrating multimodal obs

applicationsarxiv-cs-lg

ASemConsist: Adaptive Semantic Feature Control for Training-Free Identity-Consistent Generation

arXiv:2512.23245v3 Announce Type: replace Abstract: Recent text-to-image diffusion models have significantly improved visual quality and text alignment. However, generating a sequence of images while

safetyarxiv-cs-cv

Beyond Executable Models: The Pufibara Agent Harness and the Modelica Agent Workflow Benchmark for Physical System Modeling

arXiv:2608.23653v1 Announce Type: cross Abstract: AI agents are increasingly used for simulation-driven engineering. Physical system modeling presents different requirements from general-purpose code

Conditional GraphGANFed: Optimizing Graph-Structured Molecule Generation in Federated Generative Adversarial Networks

arXiv:2608.24610v1 Announce Type: new Abstract: Generative adversarial networks (GANs) have garnered considerable attention in molecular discovery for their ability to generate novel and high-quality

researcharxiv-cs-lg

Exploit More, Explore Smarter for Budget-Constrained Agentic Search

arXiv:2608.23848v1 Announce Type: new Abstract: Budget-constrained agentic search arises when an LLM agent must refine candidates under a small evaluation budget, because validation is expensive, gene

'Ghaib in Translation' aka Unseen Harm: Measuring Cross-Script Safety Inconsistency with 'Missed-in-Urdu' Scores in LLM Hate Speech Detection

arXiv:2608.24191v1 Announce Type: cross Abstract: Urdu, the world's tenth most spoken language with 246 million speakers, remains almost entirely absent from mainstream LLM safety evaluation and nine

Applications

Markerless Pose Estimation for Resistance Training Technique Assessment

arXiv:2608.24384v1 Announce Type: cross Abstract: Resistance training can be a high risk activity, and safe form is essential to avoiding injury. Laboratory-based movement analysis provides quantitive

applicationsarxiv-cs-ai

NeuralParker: A Reinforcement Learning Planner for Irregular Parking Environments

arXiv:2608.24485v1 Announce Type: cross Abstract: Automated parking commonly assumes marked slots and short approach maneuvers. Delivery and service vehicles, however, may need to reach an operator-sp

safetyarxiv-cs-lg

Neurosymbolic Alignment for Physiologically-Safe Clinical Language Models

arXiv:2608.24534v1 Announce Type: new Abstract: Clinical LLMs can generate recommendations that are factually plausible yet physiologically unsafe. We investigate whether safety alignment can be impro

Object Counting Across Modalities: Taxonomies, Benchmarks, Applications, and Open Challenges

model-releasesarxiv-cs-cv

arXiv:2608.23845v1 Announce Type: new Abstract: Object-counting methods have rapidly shifted from class-specific density regression to open-vocabulary, foundation-model-backed counters. These methods

PeakBench: Benchmarking Resource-Aware Tool Invocation in LLM Agents

arXiv:2608.24509v1 Announce Type: new Abstract: LLM agents increasingly solve tasks by invoking multiple tools, where parallel execution is essential for low latency but difficult to manage safely. Ex

PhysicsBench: A Unified Leaderboard for Generative and Predictive Models in Engineering Design and Simulation

arXiv:2608.24056v1 Announce Type: new Abstract: Generative and predictive artificial intelligence models are increasingly used to generate geometry and to predict physical fields and scalar quantities

PROOF-Gen: From Optimized Data to Better Distillation

arXiv:2608.23911v1 Announce Type: new Abstract: Supervised fine-tuning on teacher-generated trajectories is the standard first stage for distilling tool-calling capabilities into deployable models. Po

Reading Is Not Using: Retrieval, Judgment, and the Design of AI Financial Research Workflows

arXiv:2608.24842v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly deployed as AI analysts to process financial disclosures and support AI-assisted investment decisions. Y

Right Diagnoses, Decorative Reasoning:A Perturbation Audit of Medical Chain-of-Thought

arXiv:2608.24790v1 Announce Type: new Abstract: Clinicians read chain-of-thought (CoT) rationales as evidence of medical reasoning, but whether the visible chain plays that role is rarely tested. Gene

Rubrics as Visual-Repair Context for Self-Evolving UI-to-Code Generation

arXiv:2608.24138v1 Announce Type: new Abstract: Large vision-language models have shown strong progress in UI-to-code generation, yet their test-time self-evolution remains unstable. We first identify

researcharxiv-cs-cv

Scientific Image Synthesis: Benchmarking, Methodologies, and Downstream Utility

arXiv:2601.17027v2 Announce Type: replace-cross Abstract: While synthetic data has proven effective for improving scientific reasoning in the text domain, multimodal reasoning remains constrained by t

StepGuard: Learning Step-Level Guardrails with Scalable Supervision and Safety-Utility Balancing

arXiv:2608.24777v1 Announce Type: new Abstract: LLM-based agents can interact with external environments through tool invocation, but this capability also introduces security risks such as file modifi

The Invisible Editorial Layer: Formalizing Undisclosed Inference-Time Steering, Probability Placement, and the Attribution Problem in Deployed Language Models

arXiv:2608.24662v1 Announce Type: new Abstract: Large language models (LLMs) are commonly evaluated under the assumption that their observable behavior is primarily determined by model weights, traini

Local Ai

TRACE: Transition-Aware Residual Control for Multi-Objective Materials Discovery

arXiv:2608.23631v1 Announce Type: new Abstract: Multi-objective materials discovery with LLM agents is often limited not only by how many candidates can be proposed, but by how effectively each costly

local-aiarxiv-cs-ai

Tutorials

UCO: A Multi-Turn Interactive Reinforcement Learning Method for Adaptive Teaching with Large Language Models

arXiv:2511.08873v3 Announce Type: replace Abstract: Large language models (LLMs) are shifting from answer providers to intelligent tutors in educational settings, yet current supervised fine-tuning me

tutorialsarxiv-cs-ai

When Less Is More: An Empirical Study of Minimal Responses in Counseling Dialogues and the Behavior of LLMs

arXiv:2608.24080v1 Announce Type: cross Abstract: In psychological counseling, effective support is not always delivered through long, information-rich responses. Minimal responses, such as backchanne

X-MULTI: VLM-based Imaging Factor Disentanglement for Factor-Aware Image Synthesis

arXiv:2608.24563v1 Announce Type: new Abstract: Imaging factor disentanglement in text-to-image generation aims to independently control image acquisition properties such as types of camera lenses, se

safetyarxiv-cs-cv

A Modular Multitask Reasoning Framework Integrating Spatio-temporal Models and LLMs

arXiv:2506.20073v2 Announce Type: replace-cross Abstract: Spatio-temporal data mining plays a pivotal role in informed decision making across diverse domains. However, existing models are often restri

AI University: An LLM-Powered Learning Assistant for Engineering---A Finite Element Method Case Study

arXiv:2504.08846v2 Announce Type: replace-cross Abstract: We introduce AI University (AI-U), a flexible framework for AI-driven course content delivery that adapts to a course's instructional style. A

Aligned Alone, Misaligned Together: Forecasting Adversarial Capture in LLM Agent Populations

arXiv:2608.22444v1 Announce Type: new Abstract: The unit of AI safety evaluation is still the individual model, yet language-model agents are increasingly deployed in interacting populations that read

safetyarxiv-cs-cl

Local Ai

Aligning Human Sense: Calibrated Distributional Reward Learning for Video Generation

arXiv:2608.21425v1 Announce Type: cross Abstract: Video generation is central to AI-powered content creation. Aligning generated videos with human preferences is a key criterion for evaluating generat

local-aiarxiv-cs-ai

ATP-Bench: Towards Agentic Tool Planning for MLLM Interleaved Generation

arXiv:2603.29902v2 Announce Type: replace Abstract: Interleaved text-and-image generation represents a significant frontier for Multimodal Large Language Models (MLLMs), offering a more intuitive way

Benchmarking and Boosting Multilingual Capabilities of LVLMs via OCR-Centric Reinforcement Learning

arXiv:2503.18484v3 Announce Type: replace-cross Abstract: Evaluating the multilingual capabilities of Large Vision-Language Models (LVLMs) remains challenging because most benchmarks rely on non-paral

Agents

Clinical Graph-JEPA: Predictive Patient-State Knowledge Graphs for Cognitive Decision Support

arXiv:2608.22583v1 Announce Type: cross Abstract: Clinical records contain rich evidence about patient state, but converting that evidence into reliable, structured knowledge graphs remains difficult

agentsarxiv-cs-ai

Competitive Memory Readout for Robust Video Object Segmentation: 2nd Place Technical Report for the MOSEv2 Track of the 8th LSVOS Challenge

arXiv:2608.22064v1 Announce Type: new Abstract: We present our solution for the MOSEv2 track of the 8th Large-scale Video Object Segmentation (LSVOS) Challenge at ECCV 2026. The challenge evaluates ro

researcharxiv-cs-cv

Agents

Compositional Chain-of-Relations for Faithful Knowledge Graph Question Answering with Large Language Models

arXiv:2608.22762v1 Announce Type: new Abstract: Knowledge graph question answering (KGQA) is a key task for evaluating KG-augmented Large Language Models (LLMs), and complex KGQA that requires multi-h

agentsarxiv-cs-ai

DeepSAGE: Stage-Aware Reinforcement Learning for Structured CBT Counseling Dialogue

arXiv:2608.22615v1 Announce Type: new Abstract: Large Language Model (LLM)-based counseling agents can generate fluent and supportive responses, but they often lack the structured, goal-directed progr

Diagnosing Capability Preservation and Task Sensitivity in Memory Augmented Document Classifiers

arXiv:2512.06582v2 Announce Type: replace-cross Abstract: End task accuracy alone cannot determine whether a memory mechanism preserves an acquired capability, exposes sample-specific stored informati