Search: “evaluation”

The First ChineseBabyLM Challenge: training data-efficient and cognitively plausible language models for Chinese

model-releasesarxiv-cs-cl

arXiv:2607.10745v2 Announce Type: replace Abstract: This paper presents the first ChineseBabyLM Challenge, organized as part of NLPCC 2026. The challenge asked participants to train language models fr

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metric

DGX agent

arXiv:2607.18237v2 Announce Type: replace Abstract: Human visual similarity judgments are context-dependent. For example, two images may be similar in shape but distinct in color. Existing perceptual

researcharxiv-cs-cv

18 Aug 2026

The Unwritten Benchmark: A New Challenge for Multimodal Machine Learning in Abstract Perceptual Reasoning

arXiv:2608.14558v1 Announce Type: new Abstract: Current multimodal models have demonstrated remarkable proficiency in recognizing static visual and auditory content. However, their capacity for abstra

Local Ai

THESIS-MoE: Trainable Hierarchical Extraction and SteerIng of Sycophancy in Mixture-of-Experts

arXiv:2608.15687v1 Announce Type: new Abstract: Sycophancy, the tendency of a language model to change its answer to match a user's stated belief, is a common alignment failure. Existing activation st

local-aiarxiv-cs-ai

Thinking Outside the (Gray) Box: A Context-Based Score for Assessing Value and Originality in Neural Text Generation

arXiv:2502.13207v4 Announce Type: replace-cross Abstract: Despite the increasing use of large language models for creative tasks, their outputs often lack diversity. Common solutions, such as sampling

Time-Correlated Video Bridge Matching

model-releasesarxiv-cs-lg

arXiv:2510.12453v3 Announce Type: replace Abstract: Diffusion models excel in noise-to-data generation tasks, providing a mapping from a Gaussian distribution to a more complex data distribution. Howe

Time to Reason: Scalable Neurosymbolic Learning for LTLf via Fuzzy Semantics

arXiv:2608.16443v1 Announce Type: new Abstract: Neurosymbolic (NeSy) Artificial Intelligence aims to integrate Deep Learning (DL) architectures with symbolic reasoning. While initial NeSy approaches h

Toward AI-Friendly Cartography: Understanding How Color Design Influences Foundation Model Spatial Reasoning on Sequential Choropleth Maps

arXiv:2608.15736v1 Announce Type: new Abstract: Foundation models (FMs) increasingly support multimodal and geospatial reasoning, yet it remains unclear whether cartographic principles designed for hu

Towards Computational Provenance: Carrying Causal-State Evidence in Generated Text

arXiv:2608.16868v1 Announce Type: cross Abstract: A language model's output does not by itself provide verifiable evidence about the internal computation that produced it. We study computational prove

Towards Zero-Shot Domain Generalization for ID Cards Presentation Attack Detection

model-releasesarxiv-cs-cv

arXiv:2608.16591v1 Announce Type: new Abstract: Presentation-Attack Detection (PAD) for national ID cards is limited by the lack of publicly available genuine samples, making it difficult for systems

TR-GS: High-Fidelity Sparse-View CT Volumetric Rendering via t-Distribution Gaussian Splatting and Ray-Confidence Modeling

arXiv:2608.16042v1 Announce Type: new Abstract: High-fidelity 3D medical visualization supports applications such as clinical assessment and surgical planning. Sparse-view computed tomography (CT) can

TRACE-BN: Transferring Bangla-English Tutoring Behavior to a Sub-1B Offline Language Model

model-releasesarxiv-cs-cl

arXiv:2608.15223v1 Announce Type: new Abstract: Bangla-English tutoring requires more than producing a correct translation: learners also need explanations of grammar differences, awareness of their l

Training-Free Multi-Concept Image Editing

arXiv:2602.20839v3 Announce Type: replace Abstract: Training-free image editing with diffusion models is highly desirable yet is complex and remains a significant challenge. While recent optimisation-

Training-Free Reconstruction-Based AI-Generated Image Detectors Are Inherently Vulnerable to Adversarial Examples

arXiv:2608.16646v1 Announce Type: new Abstract: The impressive visual quality and ubiquity of AI-generated images call for reliable and robust detection methods. Reconstruction-based detectors have em

TransfHAR: Self-Supervised Wrist Representations for On-Demand Activity Recognition

arXiv:2608.15861v1 Announce Type: new Abstract: Fine-grained wrist activity recognition can support applications such as procedural step guidance and context-aware assistance, yet acquiring labeled da

researcharxiv-cs-lg

Translating finite-domain integer constraint models to CP/SMT/ILP/PB/SAT solvers with CPMpy

arXiv:2608.15143v1 Announce Type: new Abstract: Constraint solving is a declarative approach for solving combinatorial satisfaction and optimization problems. The user specifies their problem through

Turning spectra into images improves plant trait retrieval with 2D-CNNs

arXiv:2608.16661v1 Announce Type: new Abstract: Hyperspectral reflectance spectroscopy enables non-destructive estimation of plant functional traits, yet current deep learning approaches process spect

UC-PSRO: Utility-Conditioned Policy-Space Response Oracles with a Communication-Dropout Curriculum for Game-Theoretic Course-of-Action Generation in Adversarial Swarms

arXiv:2608.15372v1 Announce Type: new Abstract: We study generating game-theoretically optimized Courses of Action (COAs) for a Blue UAS swarm against an adaptive Red adversary in a communication-degr

UI-Mate: Advancing Open-Weight Foundation GUI Agents with In-Context Demonstrations

arXiv:2608.15930v1 Announce Type: new Abstract: Foundation GUI agents can automate complex digital tasks, but deployment is hindered by scarce and biased training data, ambiguous prompts, and unreliab

Uncertainty Identifies Difficult Samples Across Methods: A Multi-Task Study on a Heterogeneous Skin Lesion Dataset

arXiv:2608.14768v1 Announce Type: new Abstract: Skin lesion classifiers can be confidently wrong on the cases that matter most, so knowing when a prediction should not be trusted is clinically as usef

Understanding AI Anxiety in the Workplace: A Multimethod Investigation Using Fear Acquisition Theory and the Technology Acceptance Model

arXiv:2608.14609v1 Announce Type: cross Abstract: As artificial intelligence (AI) rapidly diffuses and concerns about job displacement intensify, the psychological mechanisms underlying AI job replace

Unlocking Motion in Expressions: Temporal Calibration for Referring Video Object Segmentation

arXiv:2608.16332v1 Announce Type: new Abstract: Referring Video Object Segmentation (RVOS) aims to segment referred objects at the pixel level in video sequences based on natural language descriptions

Unlocking the Potential of Image Editing via Concept Scaling and Dense Supervision

arXiv:2608.16812v1 Announce Type: new Abstract: Existing image editing frameworks predominantly follow the training paradigm of text-to-image diffusion models. However, extending this paradigm to imag

Unraveling the Size Determination Mechanism of Nanocrystal Synthesis via Interpretable Neural Networks

arXiv:2608.14734v1 Announce Type: cross Abstract: Deep learning models of nanocrystal synthesis enable the prediction of size and shape by encoding precursors and reaction conditions. However, their b

Unsupervised Anomaly Detection for Image Dataset Quality Assurance in Multi-Center Breast MRI

arXiv:2608.16725v1 Announce Type: cross Abstract: Corrupted, inconsistent, or anomalous data silently threatens the safety and reliability of medical AI. Despite growing regulatory recognition of data

Tutorials

US-VLA: An Ultrasound Vision-Language-Action Model for Embodied Abdomina

arXiv:2608.16074v1 Announce Type: cross Abstract: Artificial intelligence-assisted ultrasound scanning enhances diagnostic reliability and efficiency by providing real-time guidance for standardized i

tutorialsarxiv-cs-cv

VicEdit: Learning to Edit Videos from Visual In-Context Examples

arXiv:2608.16745v1 Announce Type: new Abstract: Despite progress in instruction-based video editing, unimodal textual instructions inherently struggle to convey fine-grained textures and complex dynam

VirnyFlow: Optimizing ML Pipelines for Accuracy, Fairness, and Stability at Scale

arXiv:2506.01584v2 Announce Type: replace-cross Abstract: Developing machine learning (ML) systems for real-world deployment requires navigating context-dependent trade-offs among accuracy, fairness,

Vision Language Models Cannot Plan, but Can They Formalize?

model-releasesarxiv-cs-cl

arXiv:2509.21576v2 Announce Type: replace Abstract: The advancement of vision language models (VLMs) has empowered embodied agents to accomplish simple multimodal planning tasks, but not long-horizon

Agents

WARA: Toward Automated Wireless Optimization Research with Closed-Loop LLM Agents

arXiv:2608.14573v1 Announce Type: cross Abstract: Large language model (LLM) agents are increasingly capable of tool use, code execution, artifact inspection, and iterative revision, creating new oppo

agentsarxiv-cs-ai

We have paused some frontier RL training to ensure that we can meet the appropriate alignment, security and monitoring standards for the new…

We have paused some frontier RL training to ensure that we can meet the appropriate alignment, security and monitoring standards for the new level of capabilities in front of us. Model progress is now

safetysam-altman--x

We’re sharing the concrete changes we’re making to strengthen monitoring, security, and alignment as capabilities advance. We’ve introduced …

We’re sharing the concrete changes we’re making to strengthen monitoring, security, and alignment as capabilities advance. We’ve introduced stronger workload and network isolation, continuous security

safetyopenai--x

What the Reranker Sees: Multi-Aspect Page Annotation for Long-Document Multimodal Question Answering

arXiv:2608.14841v1 Announce Type: new Abstract: Long-document visual question answering (VQA) over documents of tens to hundreds of pages mixing text, tables, charts, and figures typically follows ret

When Agentic Executions Fail: Detecting and Localizing Runtime Faults from Telemetry

arXiv:2608.14680v1 Announce Type: new Abstract: Reliability in LLM-based agentic systems is a property of the whole execution (its tool calls, model calls, guardrails, and inter-agent messages), not o

When AI Rewrites, Classifiers Relax: Uncertainty-Aware Sentiment Analysis on Sarcastic and AI-Paraphrased Social Text

arXiv:2608.15338v1 Announce Type: cross Abstract: Sentiment classifiers are increasingly applied to social media content that is either sarcastic or AI-generated --- two distributional regimes where s

When Context Misleads: Intent-Guided Decoding for Robust Retrieval-Augmented Generation

arXiv:2608.16515v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) improves large language models by grounding generation in external evidence, but it also introduces a source trus

When Do LLMs Apply the Wrong Law? Diagnosing LLM Failures in Temporal Legal Reasoning

arXiv:2608.14610v1 Announce Type: new Abstract: Legal reasoning tasks such as legal judgment prediction (LJP) require identifying the temporally correct version of the law governing a case -- a capabi

When to Communicate: Belief Distributions and KL Divergence for Principled Gating in Multi-Agent RL

arXiv:2608.14559v1 Announce Type: new Abstract: Effective communication in multi-agent reinforcement learning requires agents to decide not only extit{what} to communicate, but when? Existing approach

When Uncertainty Isn't Enough: An Empirical Study of Self-Correction in Code Generation

arXiv:2608.14659v1 Announce Type: new Abstract: Large language models for code generation often produce incorrect solutions without reliable indicators of failure. We study whether uncertainty estimat

Wiola 13M, a Gated Spiral Attention Architecture for Parameter Efficient Small Language Models

arXiv:2608.14604v1 Announce Type: cross Abstract: Small language models in the ten to one hundred million parameter range are attractive for on device inference, rapid experimentation, and controlled

Wolff-Parkinson-White Detection at 471:1 Class Imbalance: A Leakage-Controlled Study of the Data Bottleneck

arXiv:2608.14633v1 Announce Type: cross Abstract: Wolff-Parkinson-White (WPW) syndrome is a congenital cardiac pre-excitation, clinically important and often missed on the resting 12-lead ECG. Detecti

researcharxiv-cs-lg

Zero-Shot Adaptation of Medical Vision Foundation Models for High-Frequency Micro-Ultrasound Prostate Segmentation

arXiv:2608.14796v1 Announce Type: new Abstract: Prostate cancer claims a life every 80 seconds. Early detection is needed to prevent disease progression, and both PSA density calculation and biopsy de

Local Ai

A Configuration-First Framework for Reproducible, Low-Code Localization

arXiv:2510.25692v4 Announce Type: replace-cross Abstract: As machine learning (ML) increasingly underpins critical applications, credible, comparable, and repeatable experimental results become more i

local-aiarxiv-cs-lg

A Graph-Based Reinforcement Learning Framework for Structured Drift Diagnosis and Recovery in Autonomous LLM Agents

arXiv:2608.14109v1 Announce Type: new Abstract: Autonomous LLM agents are increasingly deployed in complex real-world workflows, yet they remain vulnerable to runtime behavioral drift, a silent deviat

A Pathway to General-Purpose Scientific AI: Multimodal Comprehension of Scientific Images

arXiv:2608.14075v1 Announce Type: new Abstract: Scientific figures and tables encode essential experimental evidence, yet remain difficult for digital libraries and multimodal AI systems to retrieve a

A Systematic Comparison of Training Objectives for Out-of-Distribution Detection in Image Classification

arXiv:2603.07571v3 Announce Type: replace-cross Abstract: Out-of-distribution (OOD) detection is critical in safety-sensitive applications. While this challenge has been addressed from various perspec

Acoustic UAV Detection in Battlefield Scenarios: Handling Noise, Domain Shift, and Weak Labels

arXiv:2608.14287v1 Announce Type: cross Abstract: Passive acoustic sensing offers a critical, cost-efficient, and, crucially, passive alternative for detecting small unmanned aerial vehicles. However,

applicationsarxiv-cs-ai

Adaptive Protection for Evolutionary Feature Construction in Symbolic Regression with Application to Credit Classification

model-releasesarxiv-cs-lg

arXiv:2608.14209v1 Announce Type: new Abstract: Evolutionary feature construction has shown strong promise in symbolic regression by automatically discovering informative transformations of input feat