Search: “evaluation”

Unreliable Narrator Framing as a Cost-effective Mechanism for Satire Explanation of Australian and American Satirical News

model-releasesarxiv-cs-cl

arXiv:2610.12863v1 Announce Type: new Abstract: Satirical news is a unique form of misinformation: it is intended to be humorous by the original publication source but can be misinterpreted. Explanati

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

VETR: Execution-Grounded Self-Improving Agent for Symbolic Graphics Reasoning

DGX agent

arXiv:2610.13098v1 Announce Type: new Abstract: Visual agents for symbolic graphics reasoning depend on executable world representations, yet continued improvement remains bottlenecked by ambiguous su

model-releasesarxiv-cs-ai

12 Oct 2026

Tutorials

When Generative Models Act as Simulators

arXiv:2610.12847v1 Announce Type: cross Abstract: A simulator summarizes an environment in a state that users can read and change. Generative models learn representations of the world without explicit

tutorialsarxiv-cs-ai

When LLMs Sit Above Diagnostic Tools: Unrealized Complementarity in Industrial Fault Diagnosis

arXiv:2610.05031v2 Announce Type: replace Abstract: Large language models are increasingly used as integration layers above specialized tools, but a stronger component does not necessarily produce a s

When VLMs Destroy What They Know: Spatial Representations Fall Below Lexical Priors

model-releasesarxiv-cs-cl

arXiv:2610.13910v1 Announce Type: new Abstract: Vision-Language Models (VLMs) increasingly analyze and reason about images, yet it remains unclear whether their internal representations faithfully enc

Zai just debuted a legal specific model: GLM Legal, and it is the new #1 open-weight model on Harvey’s Legal Agent Benchmark and LegalBench.

model-releaseszhipu-ai--x

Zai recently launched a domain‑specific language model called **GLM Legal**. According to a tweet posted at 4:13 PM on Oct 12, 2026, GLM Legal became the leading open‑weight model on both **Harvey’s L

zip2zip++: Towards Inference-Time Token Compression with Minimal Quality Loss

arXiv:2610.13605v1 Announce Type: new Abstract: Dynamic vocabularies built on-the-fly via Lempel-Ziv-Welch (LZW) compression let a language model represent the same text in fewer tokens, but prior wor

Agents

New paper from the team at Sakana AI: Recursive Self-Improvement through Multi-Agent Self-Supervision (MASS) How do we keep improving AI whe…

New paper from the team at Sakana AI: Recursive Self-Improvement through Multi-Agent Self-Supervision (MASS) How do we keep improving AI when the tasks become too complex for humans to reliably evalua

agentsdavid-ha--x

11 Oct 2026

Safety

A look at a 1,700-member Slack run by Medicare agency CMS where Microsoft, OpenAI, and other companies help shape policy on AI apps and medical records access (CBS News)

CBS News: A look at a 1,700-member Slack run by Medicare agency CMS where Microsoft, OpenAI, and other companies help shape policy on AI apps and medical records access — A cadre of elite techies, fin

safetytechmeme

10 Oct 2026

Engineer / developer observations of Gemma4-31B, Qwen3.8-27B, and 6.1-Sol for software engineering work

model-releasesr-localllama

For what it's worth. I'm a mechanical engineer by education and software engineer in practice over the past ~20 years. Playing around with local models has been a recent hobby. Today I decided to do a

10 Oct 2026

A persistent accuracy ceiling in automated verbal deception detection

arXiv:2610.12118v1 Announce Type: new Abstract: Automated methods have been proposed to overcome the limitations of human verbal deception detection, but evidence remains fragmented across disciplines

A Survey on Industrial Anomaly Synthesis

arXiv:2502.16412v3 Announce Type: replace Abstract: This paper presents a comprehensive review of industrial anomaly synthesis (IAS). Existing surveys on industrial anomalies mainly focus on anomaly d

A Survey on LLM-Integrated Hardware Design Verification

arXiv:2610.10580v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly being integrated into hardware verification to automate specification interpretation, verification-artif

Adaptive Multi-Discriminator WGAN Framework for Resource-Constrained Internet of Vehicles Using Reinforcement Learning and Game Theory

arXiv:2610.10926v1 Announce Type: new Abstract: Managing machine learning workloads as a network service introduces a resource-orchestration problem distinct from conventional model training; which no

applicationsarxiv-cs-lg

Safety

Addressing Overcommitment in the Reasoning of Gendered Economic Memes under Multimodal Ambiguity

arXiv:2610.11724v1 Announce Type: new Abstract: Multimodal meme understanding is increasingly used to analyze socially sensitive content, yet existing models often exhibit biased behavior when interpr

safetyarxiv-cs-lg

Agent4RE: A Self-Refining Multi-agent Framework for End-to-End Software Requirements Engineering and Benchmarking

arXiv:2610.10628v1 Announce Type: cross Abstract: Existing LLM-based approaches for software Requirements Engineering (RE) typically rely on basic prompting strategies or rudimentary agent collaborati

Agents

AgentEvolver: System-Wide Self-Evolution Through Task Execution

arXiv:2610.11613v1 Announce Type: new Abstract: An agent can complete a task without improving how it works. Turning task experience into reusable capability requires connecting the changed component

agentsarxiv-cs-ai

An Explainable Header-Centric Framework for Large-Scale Semantic Table Interpretation and Data Quality Assessment

arXiv:2610.10541v1 Announce Type: new Abstract: Knowledge Graph (KG) quality depends not only on downstream graph validation, but also on the quality of tabular metadata used before integration. In me

Tutorials

An Interpretable Approach to PDE Solution Discovery via Structural Experience Distillation

arXiv:2610.12003v1 Announce Type: new Abstract: PDE solution discovery aims to identify explicit symbolic expressions for unknown physical fields from observations under known physical constraints. Ex

tutorialsarxiv-cs-ai

An Investigation of Robustness of LLMs in Mathematical Reasoning: Benchmarking with Mathematically-Equivalent Transformation of Advanced Mathematical Problems

arXiv:2508.08833v4 Announce Type: replace-cross Abstract: Frontier large language models (LLMs) now reach near-ceiling accuracy on standard mathematical-reasoning benchmarks and gold-medal-level perfo

researcharxiv-cs-ai

Arbiter: Detecting Interference in LLM Agent System Prompts

arXiv:2603.08993v2 Announce Type: replace-cross Abstract: System prompts for LLM-based coding agents are software artifacts that govern agent behavior, yet lack the testing infrastructure applied to c

Code Understanding is a Bottleneck for Coding Agents

arXiv:2610.10610v1 Announce Type: cross Abstract: Repository benchmarks (e.g., SWE-bench) for coding agents often assume that lines of code edited can predict task difficulty, but such datasets' poor

Coefficient Calibration as Selection Pressure in Symbolic Regression

arXiv:2610.10931v1 Announce Type: new Abstract: In memetic symbolic regression, candidate structures are compared after coefficient calibration, so the calibration protocol itself contributes to evolu

applicationsarxiv-cs-lg

Cognition-Oriented Emotion Tracing from Causes to Consequences in Real-World Social Scenes

arXiv:2610.11410v1 Announce Type: new Abstract: Affective computing has progressed from categorical emotion recognition to open-ended affective analysis with large multimodal models. Yet affective sci

applicationsarxiv-cs-ai

Collaboratively Guided Adversarial Robust Distillation with Teacher-Favorable Examples

arXiv:2610.11306v1 Announce Type: new Abstract: Adversarial distillation transfers robustness from high-capacity teachers to compact students. Existing adversarial distillation methods mainly use teac

Contrast Enhancement or Noise Reduction? On Improving Cervical Cancer Classification

arXiv:2610.11086v1 Announce Type: new Abstract: Purpose: Cervical cancer is one of the leading causes of mortality worldwide. Deep learning has shown promising performance in medical image classificat

Deep Learning vs. Statistical Models for Multi-Horizon Price Forecasting of Second-Hand Electronics: A Systematic Benchmark

model-releasesarxiv-cs-lg

arXiv:2610.10727v1 Announce Type: cross Abstract: Forecasting resale prices of used electronics is critical for subscription-based platforms where pricing errors translate directly into risk. Unlike s

Delphos: A reinforcement learning framework for assisting discrete choice model specification

model-releasesarxiv-cs-lg

arXiv:2506.06410v4 Announce Type: replace-cross Abstract: We introduce Delphos, a deep reinforcement learning framework for assisting discrete choice model specification process. Delphos aims to suppo

DiffuPlex: Accelerating Full-Duplex Spoken Dialog Models via Rolling Masked Diffusion

arXiv:2610.12214v1 Announce Type: cross Abstract: Recent full-duplex spoken dialog models enable simultaneous listening and speaking, but fine-grained models still advance their backbone autoregressiv

DiscoVL: Unveiling Disentangled C ross-Modal Representation Learning via Orthogonal Adversarial Regularization for V ision-Language Models

model-releasesarxiv-cs-cv

arXiv:2610.11113v1 Announce Type: new Abstract: Pre-trained vision-language models excel across varied perception tasks, but adapting them to novel downstream settings without sacrificing generalizati

DLC: A Metric-Guided Dynamic Loss Controller for Multi-Objective Training

arXiv:2610.11433v1 Announce Type: new Abstract: In this paper, we introduce a metric-guided dynamic loss controller (DLC) for multi-objective image restoration. Conventional image restoration pipeline

applicationsarxiv-cs-cv

Safety

EchoDiST: Self-distillation-based joint learning for diffusion-conditioned echocardiographic myocardial motion estimation

arXiv:2610.11431v1 Announce Type: new Abstract: Motion estimation in echocardiography is essential for quantitative assessment of cardiac function and myocardial mechanics, but remains challenging due

safetyarxiv-cs-cv

Elucidating the Space of Enzymatic Reaction: A Unified Benchmark and Pretrained Model

arXiv:2610.11694v1 Announce Type: cross Abstract: Existing reaction models primarily learn molecular transformations, whereas enzy- matic reactions depend jointly on molecular structure and catalytic

Few-Step Generation via Data-Space Iteration

arXiv:2610.12102v1 Announce Type: cross Abstract: Flow matching has emerged as a scalable paradigm for training high-quality generative models, but sampling from the learned probability flow requires

From Surface to Depth: Towards Cognitive Appraisal Reasoning in Multimodal Emotion Understanding

arXiv:2610.11918v1 Announce Type: cross Abstract: Recent multimodal large language models (MLLMs) increasingly incorporate explainable reasoning for emotion understanding. However, reasoning based mai

Gated Memory: Admission-Controlled Memory Formation for Conversational AI

arXiv:2610.11270v1 Announce Type: cross Abstract: Personalized conversational AI relies on long-term memory systems that extract facts from user utterances and store them in persistent vector stores.

Has LLM Screening Performance Stalled in Software Engineering Systematic Reviews?

arXiv:2610.10633v1 Announce Type: cross Abstract: Screening in systematic reviews (SRs) is manual and time-consuming. Prior work has explored large language models (LLMs) for automating this step, but

Incremental Open-Ended Deep Research with Structured Harness

arXiv:2610.11566v1 Announce Type: new Abstract: Existing Open-Ended Deep Research (OEDR) systems primarily generate reports from scratch, making them inefficient for scenarios where research reports n

Is Memorization Context-Sensitive? Prefix-Based Extraction Beyond Isolated Prefixes

arXiv:2610.12085v1 Announce Type: new Abstract: Large language models (LLMs) can expose memorized training sequences under prefix-based extraction: given a prefix from a training example, the model ma

researcharxiv-cs-ai

Large-Scale Benchmarking of Quantum Neural Network Configurations for Financial Time Series Forecasting

model-releasesarxiv-cs-lg

arXiv:2610.12148v1 Announce Type: new Abstract: Quantum machine learning, and quantum neural networks (QNNs) in particular, are advancing fields with growing potential. Although systematic comparisons

Leakage-Controlled Multimodal Learning for Diagnosis and Progression Prediction in Alzheimer's Disease Research

arXiv:2610.10648v1 Announce Type: new Abstract: Alzheimer's disease prediction involves irregular visits, heterogeneous measurements and incomplete modalities. This study presents a multimodal multita

researcharxiv-cs-lg

LIVIN: Benchmarking Spatial and Embodied Intelligence in Digital Twins of Lived-In Homes

model-releasesarxiv-cs-cv

arXiv:2610.12069v1 Announce Type: new Abstract: Realistic household simulation must capture not only diverse environments but also the lived-in object arrangements and spatial constraints that shape r

Look Back, Think Ahead: Visual Memory on Demand for Efficient Multimodal Reasoning

arXiv:2610.12060v1 Announce Type: new Abstract: Processing long visual token sequences from high-resolution images makes multi-step reasoning computationally expensive for multimodal Large Language Mo

Lossy Compressive Text Autoencoders

arXiv:2610.10738v1 Announce Type: new Abstract: Our work explores learning a compressed latent representation of text, at the intersection of data compression and representation learning. We propose a

Agents

MedMemoryBench: Benchmarking Agent Memory in Personalized Healthcare

arXiv:2605.11814v2 Announce Type: replace Abstract: The large-scale deployment of personalized healthcare agents demands memory mechanisms that are exceptionally precise, safe, and capable of long-ter

agentsarxiv-cs-ai

MissMAC-Bench: Building Solid Benchmark for Missing Modality Issue in Robust Multimodal Affective Computing

arXiv:2602.00811v2 Announce Type: replace Abstract: Current Multimodal Affective Computing (MAC) systems heavily rely on the completeness of multiple modalities to accurately understand human's affect

MultiWorldBench: Do Independently Controlled Views Describe One Shared World?

arXiv:2610.11723v1 Announce Type: new Abstract: Multiplayer world models must ensure that independently controlled views remain consistent with one shared and persistent world. We introduce MultiWorld

Neural Networks for Temporal Pattern Recognition and Dynamic Arm Gesture Speed Estimation for Robot Control

arXiv:2610.11631v1 Announce Type: cross Abstract: Deploying intelligent robotic systems that interact with humans through gestures requires neural networks capable of recognizing diverse temporal patt