AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “evaluation”

GridTimelineEvolution
41,190 results
Model Releases

PA-CDM: Position-Aware Character Detection Matching for Evaluating Handwritten Mathematical Expression Recognition

DGX agent

arXiv:2609.12917v1 Announce Type: cross Abstract: Handwritten mathematical expression recognition (HMER) is conventionally scored by exact-match rates and string-similarity metrics that are blind to w

model-releasesarxiv-cs-cl
14 Sept 2026
Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Agents

Defining AI Agents: A Compendium of Criteria, Metrics, and Benchmarks

DGX agent

arXiv:2609.11018v1 Announce Type: new Abstract: The term agent in artificial intelligence lacks a standard definition, complicating the evaluation, comparison, and reproducibility of AI agent research

agentsarxiv-cs-ai
12 Sept 2026
Agents

Evaluating Scaffolding-Oriented Multi-Agent Large Language Model System for Clinical Interview Training

DGX agent

arXiv:2609.10939v1 Announce Type: cross Abstract: Clinical education must prepare medical students to conduct safe and coherent patient interviews under conditions of uncertainty. Traditional standard

agentsarxiv-cs-ai
12 Sept 2026
Agents

Finishing the Task Is Not Enough: Evaluating Agent Resilience and Considerate Participation under Accumulating Challenge

DGX agent

arXiv:2609.10724v1 Announce Type: new Abstract: Sustained deployment of generative AI agents requires more than isolated task success. Agents must remain useful across repeated interactions, changing

agentsarxiv-cs-ai
12 Sept 2026
Model Releases

Inverse Turing Bench: Evaluating Language Models as Judges of Human vs. AI Dialogue

DGX agent

arXiv:2606.21844v2 Announce Type: replace Abstract: As AI systems integrate into online spaces, differentiating them from humans in conversations is increasingly important. We present Inverse Turing B

model-releasesarxiv-cs-cl
11 Sept 2026
Model Releases

Shedding Light: A Benchmark for Evaluating Lighting Understanding in Generative Image Models

DGX agent

arXiv:2609.10787v1 Announce Type: new Abstract: Accurate modelling of illumination is central to realistic image synthesis and scene understanding. Yet, there is little exploration into whether image

model-releasesarxiv-cs-cv
11 Sept 2026
Research

From Landslide Conditioning Factors to Satellite Embeddings: Evaluating the Utilisation of Google AlphaEarth for Landslide Susceptibility Mapping using Deep Learning

DGX agent

arXiv:2601.07268v2 Announce Type: replace Abstract: Data-driven landslide susceptibility mapping (LSM) typically relies on landslide conditioning factors (LCFs), whose availability, heterogeneity, and

researcharxiv-cs-cv
10 Sept 2026
Model Releases

MetroLLM-Bench: Evaluating Language Models as Transit Kiosk Runtimes

DGX agent

arXiv:2609.10016v1 Announce Type: cross Abstract: We introduce MetroLLM-Bench, a 955-case benchmark for testing language models as the policy layer of a transit kiosk. It covers six real metro systems

model-releasesarxiv-cs-cl
10 Sept 2026
Model Releases

YallaMorph: A Benchmark for Evaluating Arabic Morphological Generation in Large Language Models

DGX agent

arXiv:2609.10153v1 Announce Type: new Abstract: Arabic morphology remains challenging for large language models, since fluent generation does not guarantee accurate morphosyntactic control. Existing A

model-releasesarxiv-cs-cl
10 Sept 2026
Model Releases

Contextual Observer Grounding: Evaluating Situated Spatial Reasoning in Vision-Language Models

DGX agent

arXiv:2609.06880v1 Announce Type: new Abstract: Reasoning over language instructions in embodied tasks such as robotics often requires understanding spatial relations from a speaker's situated perspec

model-releasesarxiv-cs-cv
9 Sept 2026
Syntheses

Wiki Lint Report — 2026-09-09

DGX agent

Automated lint: 12 errors, 53990 warnings, 3 info

linthealth-checkautomated
9 Sept 2026
Model Releases

TimeWarp: Evaluating Web Agents by Revisiting the Past

DGX agent

arXiv:2603.04949v2 Announce Type: replace-cross Abstract: As web agents close the gap with humans on benchmarks, one question arises: Do today's agents perform just as well on tomorrow's web? We intro

model-releasesarxiv-cs-cv
9 Sept 2026
Model Releases

CC-Mediation: Evaluating Large Language Models for Cross-Cultural Conflict Mediation

DGX agent

arXiv:2609.04855v1 Announce Type: cross Abstract: Cross-cultural mediation by large language models (LLMs) requires deciding both when to intervene and how to respond in culturally grounded conflicts.

model-releasesarxiv-cs-ai
7 Sept 2026
Agents

How do LLMs Evaluate Perceived Moral Agency? Investigating Moral Decision-Making in Human-Artificial Agents Interactions

DGX agent

arXiv:2609.05037v1 Announce Type: cross Abstract: As LLMs take on roles requiring moral advice, understanding how they attribute moral agency becomes critical. Humans possess moral agency, the capacit

agentsarxiv-cs-ai
7 Sept 2026
Model Releases

TIER: Threat Implicitness Benchmark for Evaluating LLM Safety Behaviors

DGX agent

arXiv:2609.05117v1 Announce Type: cross Abstract: Current LLM safety benchmarks largely rely on binary metrics, overlooking how models respond to harmful prompts with varying threat implicitness. We i

model-releasesarxiv-cs-ai
7 Sept 2026
Safety

DuplexSpeechBench-IFEval: Evaluating Implicit Instruction Following in Full-Duplex Voice Agents

DGX agent

arXiv:2609.03423v1 Announce Type: new Abstract: Full-duplex voice agents must continuously decide when to listen, backchannel, interrupt, handle speech overlaps, take the floor, and yield. Existing be

safetyarxiv-cs-ai
4 Sept 2026
Research

Evaluating Fundus-Specific Foundation Models for Diabetic Macular Edema Detection

DGX agent

arXiv:2510.07277v2 Announce Type: replace Abstract: Diabetic Macular Edema (DME) is a leading cause of vision loss among patients with Diabetic Retinopathy (DR). While deep learning has shown promisin

researcharxiv-cs-cv
3 Sept 2026
Safety

From Proxy Learning to Driving Decisions: A Transfer-Based Framework for Evaluating Future-Aware Autonomous Driving Planners

DGX agent

arXiv:2609.02688v1 Announce Type: new Abstract: Future-aware representations and world models are increasingly used in proposal-based autonomous-driving planners to improve trajectory selection. Howev

safetyarxiv-cs-ro
3 Sept 2026
Tutorials

A Network Science Perspective on Evaluating Deep Graph Generative Models

DGX agent

arXiv:2609.01015v1 Announce Type: cross Abstract: Traditional network models from network science, such as the Erdos-Renyi and configuration models, generate random networks that reproduce few selecte

tutorialsarxiv-cs-ai
2 Sept 2026
Model Releases

CompanionSim: Synthetic Data for Evaluating Anthropomorphism in Human-AI Relationships

DGX agent

arXiv:2609.00250v1 Announce Type: cross Abstract: Many people now see AI systems as not just productivity tools but as social companions. Researchers are eager to study the consequences of AI companio

model-releasesarxiv-cs-ai
2 Sept 2026
Model Releases

VIBE-Bench: Evaluating Personalized Large Language Models When Profiles Don't Mean Preferences

DGX agent

arXiv:2609.00921v1 Announce Type: new Abstract: Personalized Large Language Models (PLLMs) aim to tailor responses to individual users, where a central challenge is preference reasoning: inferring que

model-releasesarxiv-cs-ai
2 Sept 2026
Model Releases

Evaluating Perspectival Biases in Cross-Modal Retrieval

DGX agent

arXiv:2510.26861v4 Announce Type: replace-cross Abstract: Multimodal retrieval systems are expected to operate in a semantic space, agnostic to the language or cultural origin of the query. In practic

model-releasesarxiv-cs-cl
1 Sept 2026
Safety

Evaluating the Hidden Costs of Personalization in Large Language Models

DGX agent

arXiv:2608.28833v1 Announce Type: new Abstract: While Large language models (LLMs) incorporate user personalization signals to improve usability and helpfulness, they increasingly shift from providing

safetyarxiv-cs-ai
1 Sept 2026
Model Releases

Evaluating Tiny Recursive Models Across Training for Code Generation

DGX agent

arXiv:2608.29376v1 Announce Type: new Abstract: Code generation increasingly relies on large transformer models, whose capability advances with scale. Yet such a scale is costly, creating demand for s

model-releasesarxiv-cs-ai
1 Sept 2026
Model Releases

JFTA-Bench: Evaluate LLM's Ability of Tracking and Analyzing Malfunctions Using Fault Trees

DGX agent

arXiv:2603.22978v2 Announce Type: replace Abstract: In the maintenance of complex systems, fault trees are used to locate problems and provide targeted solutions. To enable fault trees stored as image

model-releasesarxiv-cs-ai
1 Sept 2026
Agents

JudgePanel: A Compact Judge with Panel Deliberation via Adaptive Multi-Reward Reinforcement Learning

DGX agent

arXiv:2608.29168v1 Announce Type: new Abstract: The LLM-as-a-Judge paradigm has emerged as a scalable alternative to human evaluation. However, single-model judges are limited by their inherent model

agentsarxiv-cs-ai
1 Sept 2026
Agents

Hypothesize, Evaluate, Refine: A Scientific Agent for PDE Discovery with Unknown Spatial Coefficient Fields

DGX agent

arXiv:2608.27475v1 Announce Type: cross Abstract: Discovering PDEs in heterogeneous media requires jointly identifying the governing operator and the unknown spatial fields that parameterize it. These

agentsarxiv-cs-lg
31 Aug 2026
Model Releases

The Telephone Game: Evaluating Semantic Drift in Unified Models

DGX agent

arXiv:2509.04438v3 Announce Type: replace-cross Abstract: Unified models (UMs) combine visual understanding (I2T) and generation (T2I) in a single framework. We focus on T2I and I2T, where cross-consi

model-releasesarxiv-cs-cl
31 Aug 2026
Model Releases

Evaluating Confidence-Gated Retrieval with Matched Trajectory Replay

DGX agent

arXiv:2608.26846v1 Announce Type: cross Abstract: Interactive language-model agents use confidence signals to decide whether to answer immediately, retrieve additional evidence (from memory or externa

model-releasesarxiv-cs-ai
28 Aug 2026
Model Releases

Evaluating human and LLM screening workflows in a conceptually complex scoping review: Recall--workload trade-offs and run-to-run consistency

DGX agent

arXiv:2608.26885v1 Announce Type: new Abstract: Background. Large language models (LLMs) are increasingly used for screening in evidence synthesis, where false negatives can remove relevant studies be

model-releasesarxiv-cs-ai
28 Aug 2026
Model Releases

R2M-Bench: Evaluating Revisit Memory via Relative Consistency in Interactive Video World Models

DGX agent

arXiv:2608.27328v1 Announce Type: new Abstract: High similarity between first-visit and return frames does not necessarily show that a video world model remembered the scene; the intervening rollout m

model-releasesarxiv-cs-cv
28 Aug 2026
Model Releases

Evaluating Language Models on Cross-Language Code Functional Equivalence

DGX agent

arXiv:2608.23961v1 Announce Type: cross Abstract: Background: Large Language Models (LLMs) have demonstrated strong performance across a variety of code-understanding tasks, leading many to believe th

model-releasesarxiv-cs-ai
26 Aug 2026
Research

Screening Autism Spectrum Disorder in children using Deep Learning Approach : Evaluating the classification model of YOLOv26s by comparing with other models

DGX agent

arXiv:2306.14300v2 Announce Type: replace-cross Abstract: Autism spectrum disorder (ASD) is a developmental condition that presents significant challenges in social interac- tion, communication, and b

researcharxiv-cs-ai
26 Aug 2026
Model Releases

LongWoF-Bench: Evaluating EvoMap Genes for Verifiable Long-Workflow Tasks

DGX agent

arXiv:2608.23200v1 Announce Type: new Abstract: Large language models are increasingly expected to execute complex workflows whose success depends on maintaining interdependent constraints and produci

model-releasesarxiv-cs-cl
25 Aug 2026
Model Releases

MedReaMM: Evaluating Large Multimodal Models on Expert-Level Clinical Diagnostic Synthesis

DGX agent

arXiv:2608.22323v1 Announce Type: new Abstract: The application of Large Language Models (LLMs) to diagnostic decision-making has garnered growing interest. However, existing benchmarks largely focus

model-releasesarxiv-cs-cv
25 Aug 2026
Model Releases

StrategyBench: Evaluating Explicit Strategy Induction in Large Language Models

DGX agent

arXiv:2608.23475v1 Announce Type: new Abstract: As large language models are increasingly used in data-scarce and evolving task scenarios, few-shot in-context learning (ICL) has become a key paradigm

model-releasesarxiv-cs-ai
25 Aug 2026
Model Releases

CogCanvas: A Benchmark for Evaluating Multi-Subject Reference-Based Image Generation

DGX agent

arXiv:2606.15867v2 Announce Type: replace Abstract: Multi-subject reference-based image generation requires jointly preserving multiple human identities, binding per-person objects and fashion items,

model-releasesarxiv-cs-cv
24 Aug 2026
Safety

Hallucination as a Feature, not a Defect: Evaluating a multi-agent architecture to transform speculative language-model outputs into testable scientific hypotheses

DGX agent

arXiv:2608.19206v1 Announce Type: cross Abstract: Contemporary Large Language Models (LLMs) are increasingly aligned to suppress hallucinations, prioritizing factual retrieval over combinatorial creat

safetyarxiv-cs-ai
21 Aug 2026
Model Releases

Holtercare-Bench: A Multimodal Benchmark for Evaluating Long-Term Dynamic ECG Analysis

DGX agent

arXiv:2608.19297v1 Announce Type: new Abstract: While multimodal large language models (MLLMs) excel in medical applications, most of them favor static images or short-term signals. In the critical fi

model-releasesarxiv-cs-lg
21 Aug 2026
Model Releases

InsufficiencyBench: Evaluating LLM legal advice on underspecified user queries

DGX agent

arXiv:2608.20220v1 Announce Type: new Abstract: Legal AI systems are increasingly used to answer legal questions, yet existing benchmarks assume queries arrive fully specified. In practice, users omit

model-releasesarxiv-cs-ai
21 Aug 2026
Model Releases

Metrics That Write Themselves: Evolving an Evaluator from Its Own Blind Spots

DGX agent

arXiv:2608.18744v1 Announce Type: new Abstract: Agents improve quickly against a reliable automatic metric and stall without one, and the applications that need them most, report generation among them

model-releasesarxiv-cs-ai
20 Aug 2026
Safety

SkillNet: Create, Evaluate, and Connect AI Skills

DGX agent

arXiv:2603.04448v2 Announce Type: replace Abstract: Current AI agents can flexibly invoke tools and execute complex tasks, yet their long-term advancement is hindered by the lack of systematic accumul

safetyarxiv-cs-ai
20 Aug 2026
Model Releases

When Do LLMs Actually Help? Evaluating LLMs as Data Quality Annotators

DGX agent

arXiv:2608.18158v1 Announce Type: cross Abstract: LLMs have been increasingly used to catch data quality issues automatically, but we know very little about how consistent these judgments actually are

model-releasesarxiv-cs-ai
20 Aug 2026
Model Releases

FabriMAE I Trust Myself? Self-Evaluating VLA Action Generation with Markov Attention Entropy

DGX agent

arXiv:2608.16697v1 Announce Type: new Abstract: Vision-Language-Action models (VLAs) integrate visual perception, language instruction, and action generation into end-to-end policies across heterogene

model-releasesarxiv-cs-ai
18 Aug 2026
Safety

FMReward: Aligning and Evaluating Audio-Driven 3D Facial Animation with Human Preferences

DGX agent

arXiv:2608.15296v1 Announce Type: new Abstract: Audio-driven 3D facial animation is essential for advancing immersion and interactivity in virtual experiences. Although recent advances have shown prom

safetyarxiv-cs-cv
18 Aug 2026
Model Releases

Training and Evaluating Ethical Reinforcement Learning Agents on Per-Episode Distributions

DGX agent

arXiv:2608.14642v1 Announce Type: new Abstract: Reinforcement Learning (RL) agents trained on a single reward signal exploit the gap between the designed reward and the intended behavior. This is part

model-releasesarxiv-cs-lg
18 Aug 2026
Applications

Beyond Simulated Benchmarks: Evaluating Motion Representations for Fall Detection Under Real-World Data Scarcity

DGX agent

arXiv:2608.13197v1 Announce Type: new Abstract: Falls are a major health concern for older adults, and wearable sensors have been widely explored for detecting falls and enabling timely intervention.

applicationsarxiv-cs-lg
14 Aug 2026
Model Releases

CTBench: Evaluating Troubleshooting Capabilities of AI Agents in Realistic Telecom Network Operations

DGX agent

arXiv:2608.12002v1 Announce Type: new Abstract: Agents are increasingly considered for automating network operations and maintenance, where engineers must diagnose network faults, optimize configurati

model-releasesarxiv-cs-ai
13 Aug 2026
← Previous
1…7475767778…859
Next →