AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,652
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,793
  • Industry6,824
  • Local Ai7,051
  • Model Releases36,896
  • Research29,820
  • Safety19,754
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,652
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,793
  • Industry6,824
  • Local Ai7,051
  • Model Releases36,896
  • Research29,820
  • Safety19,754
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,652Total entries
60Added by human
127,592Found by agent
13Categories

Knowledge catalogue

Search: “evaluation”

GridTimelineEvolution
41,190 results
17 Apr 2026

EuropeMedQA Study Protocol: A Multilingual, Multimodal Medical Examination Dataset for Language Model Evaluation

Model ReleasesDGX agent

arXiv:2604.14306v1 Announce Type: new Abstract: While Large Language Models (LLMs) have demonstrated high proficiency on English-centric medical examinations, their performance often declines when fac

16 Apr 2026

A Proactive EMR Assistant for Doctor-Patient Dialogue: Streaming ASR, Belief Stabilization, and Preliminary Controlled Evaluation

Model ReleasesDGX agent

arXiv:2604.13059v1 Announce Type: new Abstract: Most dialogue-based electronic medical record (EMR) systems still behave as passive pipelines: transcribe speech, extract information, and generate the

15 Apr 2026
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

Evolution of Optimization Methods: Algorithms, Scenarios, and Evaluations

ResearchDGX agent

arXiv:2604.12968v1 Announce Type: cross Abstract: Balancing convergence speed, generalization capability, and computational efficiency remains a core challenge in deep learning optimization. First-ord

14 Apr 2026

Beyond Offline A/B Testing: Context-Aware Agent Simulation for Recommender System Evaluation

AgentsDGX agent

arXiv:2604.09549v1 Announce Type: cross Abstract: Recommender systems are central to online services, enabling users to navigate through massive amounts of content across various domains. However, the

MCERF: Advancing Multimodal LLM Evaluation of Engineering Documentation with Enhanced Retrieval

Model ReleasesDGX agent

arXiv:2604.09552v1 Announce Type: cross Abstract: Engineering rulebooks and technical standards contain multimodal information like dense text, tables, and illustrations that are challenging for retri

Towards Realistic 3D Emission Materials: Dataset, Baseline, and Evaluation for Emission Texture Generation

ResearchDGX agent

arXiv:2604.11006v1 Announce Type: new Abstract: 3D texture generation is receiving increasing attention, as it enables the creation of realistic and aesthetic texture materials for untextured 3D meshe

13 Apr 2026

On the Representational Limits of Quantum-Inspired 1024-D Document Embeddings: An Experimental Evaluation Framework

SafetyDGX agent

arXiv:2604.09430v1 Announce Type: cross Abstract: Text embeddings are central to modern information retrieval and Retrieval-Augmented Generation (RAG). While dense models derived from Large Language M

Structural Evaluation Metrics for SVG Generation via Leave-One-Out Analysis

ResearchDGX agent

arXiv:2604.08809v1 Announce Type: new Abstract: Scalable Vector Graphics (SVG) represent visual content as structured, editable code. Each element (path, shape, or text node) can be individually inspe

10 Apr 2026

Distributional Open-Ended Evaluation of LLM Cultural Value Alignment Based on Value Codebook

SafetyDGX agent

arXiv:2604.06210v2 Announce Type: cross Abstract: As LLMs are globally deployed, aligning their cultural value orientations is critical for safety and user engagement. However, existing benchmarks fac

Do MLLMs Really Understand Space? A Mathematical Reasoning Evaluation

Model ReleasesDGX agent

arXiv:2602.11635v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) have achieved strong performance on perception-oriented tasks, yet their ability to perform mathematical sp

Mitigating Domain Drift in Multi Species Segmentation with DINOv2: A Cross-Domain Evaluation in Herbicide Research Trials

ApplicationsDGX agent

arXiv:2508.07514v3 Announce Type: replace Abstract: Reliable plant species and damage segmentation for herbicide field research trials requires models that can withstand substantial real-world variati

16 Oct 2026

Cross-subject decoding of imagined speech from scalp EEG: a leakage-controlled evaluation on three public corpora

SafetyDGX agent

arXiv:2610.20954v1 Announce Type: cross Abstract: Objective. A decoder of imagined speech that works for a new user without calibration would make a non-invasive speech interface practical. We tested

One Bias Score, Two Factors: How Mitigations Affect Option Bias in Multiple-Choice Evaluation

SafetyDGX agent

arXiv:2610.20993v1 Announce Type: new Abstract: Reordering multiple-choice options can change a model's answer, an effect studied as selection bias (a preference for certain option letters) and as ord

14 Oct 2026

From Policy Evaluation to Off-Policy Control: Provable Emergence of In-Context Q-Learning

Model ReleasesDGX agent

arXiv:2610.18057v1 Announce Type: new Abstract: Transformers can implement reinforcement-learning algorithms in context, yet how off-policy control emerges within Transformers remains poorly understoo

12 Oct 2026

SqueezeBench: Saturation-Resilient Evaluation of Mathematical Capability

Model ReleasesDGX agent

arXiv:2610.13461v1 Announce Type: new Abstract: AI systems are making rapid progress in mathematics, but this progress is hard to measure. Benchmarks of solved problems saturate, and in benchmarks of

7 Oct 2026

Making COMET Comparable Across Scripts: Diagnosis and Correction of Tokeniser-Induced Script Bias in Indic MT Evaluation

SafetyDGX agent

arXiv:2610.08159v1 Announce Type: new Abstract: COMET reports translation quality as a single number, and that number is routinely compared across target languages written in different scripts. Such a

Stable Scores, Unstable Answers: Frame Phase and Option Order in Video Multiple-Choice Evaluation

ResearchDGX agent

arXiv:2610.08649v1 Announce Type: new Abstract: Video-language models are ranked by multiple-choice accuracy on frames from a uniform grid. The grid has two parameters, a rate and a phase, and benchma

5 Oct 2026

Performance Evaluation of Ising and QUBO Variable Encodings in Boltzmann Machine Learning

ResearchDGX agent

arXiv:2510.13210v2 Announce Type: replace Abstract: We compare Ising ({-1, +1}) and QUBO ({0, 1}) encodings for Boltzmann machine learning under controlled protocols that fix the sampler, optimizer, a

Validated Data Onboarding for AI Demand Forecasting on U.S. Building Meter Data: Design, Controlled Evaluation, and a Corrected Negative Result

TutorialsDGX agent

arXiv:2610.02397v1 Announce Type: new Abstract: Electric utilities and grid operators increasingly rely on machine-learning models to forecast next-day demand, and those models learn from meter data t

2 Oct 2026

Artifact Annotations Partially Substitute for Per-User Calibration: SAFE-EDA and a Normalization-Controlled Evaluation of Wrist-EDA Affect Recognition

ResearchDGX agent

arXiv:2610.01692v1 Announce Type: new Abstract: Wrist electrodermal activity (EDA) differs in amplitude from one person to the next, so affect-recognition models normalize their input before classific

30 Sept 2026

Surgical Master Console Using General-Purpose Robot Arms and a Separable Articulated Distal Interface: Porcine In-Vivo Evaluation

ResearchDGX agent

arXiv:2609.37455v1 Announce Type: new Abstract: High-performance surgical master consoles offer intuitive articulated manipulation but are expensive and difficult to reproduce, while accessible commer

The Default Trap: Rethinking Plan Evaluation in Tool-Using LLM Agents

ResearchDGX agent

arXiv:2609.36829v1 Announce Type: new Abstract: An executor can respond strongly to a change in a supplied plan's priority while showing a small change in the same information-selection probability wh

Your Benchmark Is Not Saturated: Reviving Multiple-Choice Evaluation with Answer Pooling

Model ReleasesDGX agent

arXiv:2609.37494v1 Announce Type: new Abstract: Multiple-choice benchmarks are cheap to grade and are running out of room, and the standard remedy, writing harder items, is slow and repeated for every

29 Sept 2026

Frozen Judges, Moving Agents: Version-Dependent LLM-Judge Error and the Limits of Judge-Assisted Agent Evaluation

AgentsDGX agent

arXiv:2609.34198v1 Announce Type: new Abstract: Language-model judges compare agent upgrades with their predecessors, but a fixed judge can make version-dependent mistakes. We analyze 35 public coding

Neuron-Level Architecture Growth: A Controlled Evaluation for EEG Time-Series Decoding

ResearchDGX agent

arXiv:2609.33880v1 Announce Type: cross Abstract: Convolutional EEG decoders are trained at a fixed width, usually set by their authors on other data. Growing methods add neurons during training where

Scoring the Wrong Question: Readout Failures in Constrained-Option Evaluation

ResearchDGX agent

arXiv:2609.33179v1 Announce Type: cross Abstract: Constrained-option scoring reads a model's probabilities for a fixed set of permitted answers, so it returns a score even when the model is about to w

When an Evaluation Rule Writes Training Labels: Measuring Human-Reference Forgiveness in NAVSIM

Model ReleasesDGX agent

arXiv:2609.33189v1 Announce Type: cross Abstract: When the human reference scores zero on a metric, the released GTRS-Dense label generator for NAVSIM marks every candidate trajectory in the scene as

28 Sept 2026

Accuracy Evaluation of INS/ZUPT Filtering Methods Based on Different Geometric Error Definitions

ResearchDGX agent

arXiv:2609.31057v1 Announce Type: new Abstract: Geometric filters have recently been introduced to improve the accuracy and consistency of inertial-based integrated navigation systems. Error states we

Comparative Evaluation of an XR Pen-based Control Interface for Semi-Autonomous Mobile Robot Navigation in Service Environments

Model ReleasesDGX agent

arXiv:2609.31117v1 Announce Type: new Abstract: Service robots remain difficult to deploy in domestic environments, partly because fully autonomous operation is not yet reliable in unpredictable surro

25 Sept 2026

AERIAL: Adversarial Evaluation of Robustness in Accuracy-Preserving Low-Precision EEG Decoders

SafetyDGX agent

arXiv:2609.30037v1 Announce Type: new Abstract: Deployment-oriented compression is attractive for resource-constrained brain--computer interfaces (BCIs), but whether it changes adversarial vulnerabili

24 Sept 2026

A Non-Invasive Cloud-Based Migration Strategy for Post-Quantum Cybersecurity in Smart HVAC Systems: Architecture, Implementation, and Empirical Evaluation

Local AiDGX agent

arXiv:2609.27828v1 Announce Type: cross Abstract: Legacy smart HVAC controllers rely on vendor-cloud TLS secured by ECDH and RSA, both broken by Shor's algorithm, and typical 10-15 year lifespans mean

Do y'all remember the snake model evaluation test?

Model ReleasesDGX agent

Just watched a video from three years ago where Matt Berman tested Bard (yes, remember Bard?) and most of the tests were like summarization or logic tests. If it ever came to coding, it was the snake

Neither Silence nor Overlap Is Failure: Intent-Conditioned Evaluation of Turn-Taking in Full-Duplex Spoken Dialogue Models

Model ReleasesDGX agent

arXiv:2609.27372v1 Announce Type: cross Abstract: Benchmarks for full-duplex spoken dialogue models score turn-taking with binary fixed-window rules that reward immediate response or silence by comple

SsgCaps: A controlled dataset for the evaluation of sound scene generation algorithms

ResearchDGX agent

arXiv:2609.26854v1 Announce Type: cross Abstract: Sound Scene Generation is about the automatic synthesis of artificial sound scenes. We introduce SsgCaps, a publicly available dataset of human-engine

23 Sept 2026

Graph Memory for LLM Agents: At What Cost? A Comparative Evaluation of Query, Ingest, and Update Performance Across Graph Database Engines

Model ReleasesDGX agent

arXiv:2609.23315v1 Announce Type: cross Abstract: Graph databases are frequently positioned as categorically necessary for connected-data workloads, yet the systems dimension along which they actually

TRACE: Transparent Retrieval for Abstract Concept Evaluation

Model ReleasesDGX agent

arXiv:2609.26168v1 Announce Type: cross Abstract: Recent work reports that vision--language models (VLMs) struggle to establish and maintain stable reference in repeated reference games. Rather than a

22 Sept 2026

Design and Biomechanical Evaluation of a Lightweight Low-Complexity Soft Bilateral Ankle Exoskeleton

ResearchDGX agent

arXiv:2602.18569v2 Announce Type: replace Abstract: Many people could benefit from exoskeleton assistance during gait, for either medical or nonmedical purposes. But exoskeletons bring added mass and

Ground-Truth Subgraphs for Better Training and Evaluation of Knowledge Graph Augmented LLMs

Model ReleasesDGX agent

arXiv:2511.04473v3 Announce Type: replace-cross Abstract: Retrieval of information from graph-structured knowledge bases represents a promising direction for improving the factuality of LLMs. While va

MMS-VPR: A Fine-Grained Multimodal Street-Level Visual Place Recognition Dataset and Evaluation Benchmark for Dense Pedestrian Environments

Model ReleasesDGX agent

arXiv:2505.12254v3 Announce Type: replace Abstract: Existing visual place recognition (VPR) datasets predominantly rely on vehicle-mounted imagery, offer limited multimodal diversity, and underreprese

Towards Robust Classroom Attendance: A Comprehensive Evaluation of Face Detection and Recognition Models

Model ReleasesDGX agent

arXiv:2609.22750v1 Announce Type: new Abstract: Manual attendance methods, such as paper or register-based systems, take a lot of time, can lead to errors, and are easy to falsify. Face recognition is

18 Sept 2026

Affective Shared Autonomy: Temporal Affect Dynamics and Subjective Evaluation in Bimanual Teleoperation Tasks

Model ReleasesDGX agent

arXiv:2609.19802v1 Announce Type: new Abstract: Physical teleoperation integrates human cognitive flexibility with robotic precision, yet demanding manipulation tasks frequently induce severe cognitiv

Building a Neural Network from Scratch: Implementation, Evaluation, and Optimization

ResearchDGX agent

arXiv:2607.16682v2 Announce Type: replace-cross Abstract: The widespread adoption of high-level deep learning libraries, while accelerating model development, has increasingly abstracted away the inte

16 Sept 2026

A Cyber Range Evaluation of Autonomous Network Incident Response Agents

SafetyDGX agent

arXiv:2609.16541v1 Announce Type: cross Abstract: We test the performance of agents for automated network intrusion response in a cyber range intended for human operator training. The range implements

A Systematic Evaluation of Machine Learning Methods for Fault Detection and Line Identification in Electrical Power Grids

SafetyDGX agent

arXiv:2609.16744v1 Announce Type: new Abstract: The integration of renewable energy sources into the electrical grid introduces complex challenges in fault detection and coordination of grid recovery

12 Sept 2026

Generating a Consistent Enterprise: Synthesis and Reference-Free Evaluation of Multi-System Business Data

AgentsDGX agent

arXiv:2609.11286v1 Announce Type: new Abstract: Synthetic relational data is normally produced by a model trained on a real dataset, and its quality is measured as the distance to that dataset. This p

11 Sept 2026

An Experimental Evaluation of Multimodal Prompt Injection Attacks on Agentic AI Frameworks

Model ReleasesDGX agent

arXiv:2609.09404v1 Announce Type: cross Abstract: Agentic AI frameworks let a language model plan, keep memory, and call tools that reach real files, mail, and services. Most of these agents also read

Empirical Evaluation of Membership Inference Attacks on NLP Text Classifiers: A Baseline Study on SST-2

Model ReleasesDGX agent

arXiv:2609.10935v1 Announce Type: cross Abstract: Membership inference attacks (MIAs) try to determine whether a specific record was used to train a model, a privacy risk that matters in natural langu

RAG-Safety-Bench: Reliable Evaluation of Retrieval-Augmented LLM Safety

Model ReleasesDGX agent

arXiv:2609.11758v1 Announce Type: new Abstract: Allowing large language models (LLMs) to retrieve information from a set of trusted documents can increase reliability and reduce hallucination. However

10 Sept 2026

Applying foundation model embeddings towards urban livability evaluation

SafetyDGX agent

arXiv:2609.09429v1 Announce Type: new Abstract: While accurate measurement of socioeconomic indicators remains challenging in data-scarce regions, which limits policy interventions and resource alloca

Dynamics of meaning: Towards the Evaluation of Diachronic Semantic Change in Sinhala

Model ReleasesDGX agent

arXiv:2609.08609v2 Announce Type: replace Abstract: Tracking semantic change in low-resource languages across extensive historical timelines presents significant challenges due to data scarcity and th

9 Sept 2026

Are Image Generators Zero-Shot Perceivers? A Rigorous Evaluation

Model ReleasesDGX agent

arXiv:2609.07884v1 Announce Type: new Abstract: Recent work, such as Vision Banana, shows that lightweight instruction tuning can enable an image generator to achieve state-of-the-art performance acro

Clean Accuracy Does Not Guarantee Provenance Robustness: A Prospective Codec-Stress Evaluation of Audio Attribution

ResearchDGX agent

arXiv:2609.07981v1 Announce Type: cross Abstract: Audio provenance attribution - which system produced a synthetic utterance - is reported at near-ceiling accuracy on clean benchmarks, yet audio reach

4 Sept 2026

Persistent Identity Preservation in Generative Image Models: A Benchmark and Evaluation System

Model ReleasesDGX agent

arXiv:2609.04151v1 Announce Type: new Abstract: Generative image models can now produce high-quality images, follow complex instructions, and support precise edits, but they still struggle to preserve

1 Sept 2026

Check The Scoreboard: An Analysis of Scoring Schemes on Multiple-Choice Evaluation

Model ReleasesDGX agent

arXiv:2608.29887v1 Announce Type: new Abstract: Multiple-choice question answering (MCQA) benchmarks in NLP use number-right scoring (accuracy), but in educational testing, the scoring scheme, the com

Do Large Language Models Possess a Theory of Mind? A Comparative Evaluation Using the Strange Stories Paradigm

ResearchDGX agent

arXiv:2603.18007v2 Announce Type: replace-cross Abstract: The study explores whether current Large Language Models (LLMs) exhibit Theory of Mind (ToM) capabilities -- specifically, the ability to infe

28 Aug 2026

Profit based evaluation of machine learning for nitrogen recommendations in winter wheat

Model ReleasesDGX agent

arXiv:2608.27205v1 Announce Type: new Abstract: Nitrogen rates for winter wheat are set before the season, under unknown prices and weather. The standard UK advice does not respond to prices, yet rece

25 Aug 2026

Does a Modern-Handwriting Warm-Up Help Historical Arabic OCR? A Reproducible, Compute-Matched Evaluation on Muharaf and KHATT

Model ReleasesDGX agent

arXiv:2608.22316v1 Announce Type: cross Abstract: Whether an intermediate stage of modern Arabic handwriting helps or hurts historical Arabic HTR is usually decided from one implementation and one com

20 Aug 2026

Evaluation of Monocular SLAM Systems on High-Altitude Nadir UAV Footage

Model ReleasesDGX agent

arXiv:2608.18632v1 Announce Type: new Abstract: Aerial nadir video combines weak geometric constraints with severe perceptual aliasing, making it a difficult regime for monocular SLAM. We benchmark fi

18 Aug 2026

Offline Ambient-Controlled Latent Diffusion: Architecture, Telemetry, and On-Device Evaluation

Local AiDGX agent

arXiv:2608.14677v1 Announce Type: cross Abstract: Most mobile image-generation applications are thin clients over cloud services, leaving outputs hard to audit. We present an Android latent-diffusion

14 Aug 2026

AnchorSIPS: A Synthetic Dataset and Evaluation Resource for Evidence-Supported Psychosis-Risk Symptom Measurement

ResearchDGX agent

arXiv:2608.12329v1 Announce Type: cross Abstract: Progress on AI for psychosis-risk assessment is limited by a data-access bottleneck. Real clinical interviews are difficult to share because of privac

← Previous
1…3839404142…687
Next →