AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “evaluation”

GridTimelineEvolution
41,190 results
14 Oct 2026

AIRRI: Towards a Human-Readable, Machine-Resistant Reading Interface

ApplicationsDGX agent

arXiv:2610.18724v1 Announce Type: new Abstract: The rapid advancement of image-to-text extraction systems and large language models (LLMs) poses new challenges for educational assessment by making ass

All-electron machine-learned orbital-free density functional for periodic CHNO systems

ResearchDGX agent

arXiv:2610.17975v1 Announce Type: cross Abstract: We introduce STRUCTURES-P, a machine-learned all-electron orbital-free density functional for periodic CHNO systems. Electrostatics are evaluated anal

AlphaPilot: Multi-Turn Tool-Using LLM Agents for Adaptive Alpha Mining with Reinforcement Learning

AgentsDGX agent

arXiv:2610.15488v1 Announce Type: cross Abstract: Formulaic alpha mining seeks interpretable expressions that rank assets by future returns. The task is challenging because it demands simultaneous pro

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

Bayesian Optimization under Uncertainty for Training a Scale Parameter in Stochastic Models

Model ReleasesDGX agent

arXiv:2510.06439v2 Announce Type: replace Abstract: Hyperparameter tuning is a challenging problem especially when the system itself involves uncertainty. Due to noisy function evaluations, optimizati

ChemExplain: A Multimodal Benchmark for Explanatory Chemical Reasoning

Model ReleasesDGX agent

arXiv:2610.17183v1 Announce Type: cross Abstract: Current chemistry benchmarks primarily evaluate outcome prediction or reaction pathway generation, but rarely test whether a model can explain why an

EgoOmniWorld: Unifying Egocentric Understanding via Ego-Action-World Interactions

Model ReleasesDGX agent

arXiv:2610.18499v1 Announce Type: new Abstract: Egocentric video understanding spans diverse capabilities, modalities, and evaluation formats, yet these are often studied in isolation despite their ti

EgoProbe: Benchmarking Long-Range and Exact Memory in Streaming Egocentric Videos

Model ReleasesDGX agent

arXiv:2610.17128v1 Announce Type: new Abstract: Egocentric video provides a continuous first-person record of everyday activities, making it a natural foundation for wearable AI assistants. Unlike off

ForeTac: Predictive Contact Guidance for Generative Robot Policies

SafetyDGX agent

arXiv:2610.18118v1 Announce Type: new Abstract: Visually similar actions can produce contact loss, jamming, slippage, or irreversible damage, while tactile feedback may arrive after a critical transit

From Classification to Cross-Modal Understanding: Leveraging Vision-Language Models for Fine-Grained Renal Pathology

Model ReleasesDGX agent

arXiv:2511.11984v2 Announce Type: replace Abstract: Fine-grained glomerular subtyping is essential for kidney biopsy interpretation, yet it presents a harder setting than the broad organ- or disease-l

Game2Real-Bench: Do Toy Games Reveal and Transfer to Real-World Visual Reasoning?

Model ReleasesDGX agent

arXiv:2610.18834v1 Announce Type: new Abstract: Visual reasoning is an important capability for vision-language models (VLMs) to understand visual evidence, spatial structure, constraints, and state c

Information-based Unified Design Framework for NMR Magnetic Tracking System

ResearchDGX agent

arXiv:2610.17873v1 Announce Type: new Abstract: Nuclear magnetic resonance (NMR) magnetic tracking offers a promising alternative to magnetic resonance imaging (MRI)-based localization for medical rob

Interaction-as-a-Judge

SafetyDGX agent

arXiv:2610.17895v1 Announce Type: new Abstract: Coding agents are tasked with producing sophisticated interactive applications such as websites, desktop applications, and games. While humans assess th

LLM-Augmented Bayesian Optimization with Adaptive Policies for Chiplet Design Space Exploration

SafetyDGX agent

arXiv:2610.14612v1 Announce Type: new Abstract: Chiplet technology is a key approach for extending Moore's Law. However, its design process is constrained by two primary challenges: the scarcity of ea

MARL-BattleGrounds: A Novel JAX-native Benchmark for Heterogeneous and Competitive Multi-agent RL

Model ReleasesDGX agent

arXiv:2610.14883v1 Announce Type: cross Abstract: We present MARL-BattleGrounds (MARL-BGs), an easy-to-use JAX-native benchmark for heterogeneous and competitive multi-agent reinforcement learning (MA

Poisoned into Action: Context Attacks on Typed Decision Workflows

SafetyDGX agent

arXiv:2610.15537v1 Announce Type: cross Abstract: Typed decision interfaces restrict models to predefined actions, yet schema-valid choices can still trigger policy-violating state changes. Evaluating

PsyBer-Agent: A Psychology-Driven User Agent for Recommender Systems

Model ReleasesDGX agent

arXiv:2610.13989v1 Announce Type: cross Abstract: Evaluating recommender systems before deployment requires simulators that remain realistic over long, closed-loop interaction cycles. Current LLM-base

Refined Grid Sampling for Efficient Implicit Neural Representations of Large-Scale Scientific Data

ResearchDGX agent

arXiv:2610.14205v1 Announce Type: new Abstract: Implicit neural representations (INRs) offer a powerful framework for modeling high-dimensional physical fields, but their training remains inefficient

Safety-Oriented Trajectory Ranking from BEV Perception Outputs

SafetyDGX agent

arXiv:2610.14066v1 Announce Type: cross Abstract: Bird's-Eye-View (BEV) representations are increasingly used as compact inputs for autonomous driving perception and planning. However, lightweight and

scHFBiMamba: a bidirectional Mamba autoencoder for cardiac disease-state classification from single-nucleus RNA-seq data

Model ReleasesDGX agent

arXiv:2610.15117v1 Announce Type: new Abstract: To evaluate whether a compact bidirectional state-space autoencoder improves joint classification of species, cell type, and disease state from single-n

TagBO: LLM-Driven Task-Aware Graph Bayesian Optimization for Scientific Discovery

ResearchDGX agent

arXiv:2610.14626v1 Announce Type: new Abstract: Mixed-variable optimization in scientific discovery often requires exploring large combinatorial spaces under costly experimental evaluations, making sa

TRIG: Toward Measuring Texture Realism in Image Generation

SafetyDGX agent

arXiv:2610.15164v1 Announce Type: new Abstract: This paper studies the backbone used by metrics for evaluating the quality of generated images. Although generative models have advanced rapidly, some o

Unsupervised Data Drift Monitoring for Deployed Deepfake Speech Detectors

ResearchDGX agent

arXiv:2610.16826v1 Announce Type: cross Abstract: Deepfake speech detectors are typically evaluated as binary classifiers on fixed benchmarks, but deployed systems face evolving attacks, codecs, speak

Use Of Convolutional Neural Networks In Detection Of Branch Dieback Disease In Pequi Trees

TutorialsDGX agent

arXiv:2610.15049v1 Announce Type: new Abstract: This study aims to evaluate and compare convolutional neural network (CNN) architectures, specifically AlexNet, Inception, LeNet, VGG16, and MobileNet,

What DNA Foundation Models Learn Beyond Sequence Composition

TutorialsDGX agent

arXiv:2610.15711v1 Announce Type: new Abstract: Do genomic foundation models (FMs) provide predictive information beyond simple sequence composition? We evaluate frozen representations from five DNA F

13 Oct 2026

Cross-cloud conversational analytics made simple with open standards

SafetyDGX agent

The reality for most organizations is that data lives everywhere. As engineering teams expand and adopt specialized platforms for their workloads, enterprise data naturally disperses across multiple c

Gemini 4 Argon available on Google Cloud, built to help solve your business’ hardest problems

Model ReleasesDGX agent

Last week we announced that Gemini Enterprise has evolved to make it even simpler to get work done, and introduced the Gemini agent, your new universal agent for work. It's always on and ready to answ

12 Oct 2026

A Baseline Assessment for the Agentic Web Technology Stack

Model ReleasesDGX agent

arXiv:2610.13703v1 Announce Type: new Abstract: The fast pace in which protocols, frameworks, and technologies are being proposed for LLM-based agents results in a complex scenario for anyone aiming t

Accelerating Linear Bandits with Persistent Candidate Sets

ResearchDGX agent

arXiv:2610.13407v1 Announce Type: new Abstract: Exhaustive optimistic scoring can make action selection costly in linear bandits with a large fixed set of K actions, requiring O(K) score evaluations p

AI Models Can Provably Hide Arbitrary Capabilities

ResearchDGX agent

arXiv:2610.13928v1 Announce Type: new Abstract: Capability evaluations aim to surface dangerous model behaviors before deployment, but their reliability depends on the assumption that hidden capabilit

Bridging Human and Model Attention: Explainability Analysis of CNN, Mamba, and ViT Architectures with Gaze-Based Validation

SafetyDGX agent

arXiv:2610.12703v1 Announce Type: cross Abstract: High-risk applications of deep learning require precise characterization of model decision-making. We conduct a systematic explainability evaluation a

Co-Modifying Application Code and Deployment Infrastructure: A Causal Study of AI Agent Pull Requests

AgentsDGX agent

arXiv:2610.12849v1 Announce Type: cross Abstract: Current software engineering agents are evaluated predominantly inside isolated sandboxes against synchronous local tests. However, deploying features

Critical Mass: Structure-Disjoint Splits Drift With the Libraries They Are Built On

ResearchDGX agent

arXiv:2610.12694v1 Announce Type: new Abstract: Molecular machine learning evaluates out-of-distribution performance with structure disjoint splits, a construction rule fixed once at the scale its lib

DataCupid: Stable Matching Repair for Training Data Acquisition with Delayed Feedback

ResearchDGX agent

arXiv:2610.12960v1 Announce Type: new Abstract: Matching repair after utility changes can reuse valid observations, but new evaluations must respect matching capacity and may return out of order. We s

DRYLAB-Bench: Benchmarking the Biosecurity Risk of Agentic LLM Mutation Design

Model ReleasesDGX agent

arXiv:2610.13116v1 Announce Type: new Abstract: As large language models (LLMs) acquire advanced biological design capabilities, they offer substantial research benefits but simultaneously introduce s

GeoFitBench-LLM: A Benchmark for Assessing Large Language Models' Capabilities in Geospatial Data Requirements Elicitation for Geo-Analytic Tasks

Model ReleasesDGX agent

arXiv:2610.12669v1 Announce Type: cross Abstract: Large language models are becoming central to GeoAI systems, yet their evaluation rarely considers the elicitation of geospatial data requirements. Th

How Reliable are AMR Parser Outputs? Uncertainty Estimation for AMR Parsing

ResearchDGX agent

arXiv:2610.13236v1 Announce Type: cross Abstract: Recent advances have significantly improved the performance of Abstract Meaning Representation (AMR) parsers, yet determining when their outputs can b

Introducing DigitalOcean Agent Data Services: The Data Foundation for Agents

AgentsDGX agent

Agents are only as capable as the context they can reach. An agent with reliable access to the right information makes decisions grounded in fact; one without it guesses. And the work agents produce i

Mind the Spatial Gap: A Benchmark for Geospatial Reasoning and Constrained Spatial Editing

Model ReleasesDGX agent

arXiv:2610.12881v1 Announce Type: new Abstract: Understanding and manipulating spatial relations is fundamental to AI systems that reason about physical environments and construct grounded world model

OccludeBench: Can VLMs Find What's Missing?

Model ReleasesDGX agent

arXiv:2610.13790v1 Announce Type: cross Abstract: How well can vision-language models (VLMs) reason about what is missing from an image? We study this question with OccludeBench, a manually curated be

Personalization Without Stereotyping: Do Speech LLMs Know When to Turn a Deaf Ear?

Model ReleasesDGX agent

arXiv:2610.13550v1 Announce Type: new Abstract: Recent speech LLMs can leverage rich paralinguistic cues, enabling more complex and personalized interactions. However, little work investigates how thi

SWE-Duel: Towards a Self-Scaling Arena for Coding Agents

Model ReleasesDGX agent

arXiv:2610.12569v1 Announce Type: new Abstract: Static coding benchmarks are fixed at release. Over time their tasks leak into training data, and stronger agents eventually saturate them. We argue tha

Towards Easier-to-Tune Training Algorithms: New Results from AlgoPerf

Model ReleasesDGX agent

arXiv:2610.13036v1 Announce Type: new Abstract: Evaluating deep learning optimizer is challenging because confounding factors such as hyperparameter tuning and optimizer-model co-design often obscure

What Do Audio-Language Judges of Generated Music Listen For? Four Probes with Controls from Expert Ratings

SafetyDGX agent

arXiv:2610.13247v1 Announce Type: cross Abstract: Open audio-language models are used as judges of generated music: given a clip and its text prompt, the model rates the clip, and the judge is validat

11 Oct 2026

Introducing Multi-Agent Self-Supervision (MASS): Recursive self-improvement through collective intelligence Blog: https://pub.sakana.ai/mass…

SafetyDGX agent

Introducing Multi-Agent Self-Supervision (MASS): Recursive self-improvement through collective intelligence Blog: https://pub.sakana.ai/mass/ As AI systems tackle increasingly open-ended research prob

9 Oct 2026

AdaptEvo: Adaptive Agent Learning with Evolving Supervision

SafetyDGX agent

arXiv:2610.11354v1 Announce Type: new Abstract: Rule-governed contextual decision tasks require models to apply specified rules to case-specific context and evidence. Written rules can leave gaps in d

Bernoulli Flow Models: Self-Consistent Generative Modeling for Binary Data

ResearchDGX agent

arXiv:2610.11362v1 Announce Type: cross Abstract: Binary diffusion models typically require a large number of function evaluations (NFEs) to generate high-quality samples, making practical inference c

DataSense-Bench: The First Step Toward an AI Scientist

Model ReleasesDGX agent

arXiv:2610.12190v1 Announce Type: new Abstract: As claims about recursive self-improvement (RSI) and artificial general intelligence (AGI) proliferate, we ask a simple question: do frontier AI models

Design Creativity Bench: Measuring creativity in LLM-Generated UI

Model ReleasesDGX agent

arXiv:2610.11539v1 Announce Type: cross Abstract: As leading LLMs improve on capability evaluations, their limitations in producing creative outputs on design tasks remain insufficiently characterised

Distillation for Incrimination and Distillation for Capabilities

SafetyDGX agent

arXiv:2610.11012v1 Announce Type: new Abstract: Powerful misaligned AI models might recognize alignment evaluations and strategically behave well on them, rendering direct audits uninformative. Howeve

Exploiting Gradients in Bayesian Inference of Expensive Simulators

TutorialsDGX agent

arXiv:2610.12076v1 Announce Type: new Abstract: Simulators based on differential equations are ubiquitous in science and engineering. They are often used in simulation-based inference to evaluate the

Language Models as AI Research World Models

HardwareDGX agent

arXiv:2610.12235v1 Announce Type: new Abstract: AI research agents automate the cycle of proposing, implementing, and evaluating experiments, opening a path toward recursive self-improvement. Yet thei

Marformer: A Transformer for Predicting Missing Data Distributions

ResearchDGX agent

arXiv:2610.12379v1 Announce Type: new Abstract: Real decisions are made under incomplete information. If we observe only some of the random variables we need, we can predict the others. The extbf{cond

MIMESIS: Learning User Simulators as Training Environments for Interactive Agents

Model ReleasesDGX agent

arXiv:2610.09484v2 Announce Type: replace Abstract: Training and evaluating interactive language agents typically requires rich user interactions, yet collecting human feedback is expensive and diffic

MindFlow: Mind Supernet Powered Thinking Flows for Research Idea Innovation

AgentsDGX agent

arXiv:2610.11966v1 Announce Type: new Abstract: Research idea innovation is a fundamental engine of scientific progress, yet it remains difficult to generate and evaluate in a scalable and controllabl

OpenProblemBench: Benchmarking AI on Open Problems in the Foundational Theoretical Sciences

Model ReleasesDGX agent

arXiv:2610.11118v1 Announce Type: new Abstract: The next frontier for artificial general intelligence is tackling unresolved scientific problems, calling for benchmarks that assess progress beyond est

Prompts versus Rules: Auditing and Controlling Speech Naturalness Behaviors in Voice User Simulators

AgentsDGX agent

arXiv:2610.11015v1 Announce Type: new Abstract: As voice agents gain more popularity commercially, the user simulators used to evaluate the deployed agents are also being developed to include more rea

RAG-Stress: Probing the Limits of Evidence Reliance in Retrieval-Augmented Generation

ResearchDGX agent

arXiv:2610.11183v1 Announce Type: cross Abstract: Following retrieved evidence does not guarantee factual correctness: misleading evidence can induce a model to replace an answer it previously gave co

READ-Bench: Benchmarking Historical Instance Retrieval for Time-Series Diagnosis

Model ReleasesDGX agent

arXiv:2609.32123v2 Announce Type: replace Abstract: Time-series diagnostic systems rarely rely on retrieving relevant historical cases, and when they do, retrieval is evaluated only indirectly through

Reasoning-Informed Visual Editing

Model ReleasesDGX agent

arXiv:2610.12343v1 Announce Type: new Abstract: Large Multi-modality Models (LMMs) have made significant progress in visual understanding and generation, but still face challenges in visual editing, p

SAVU-BENCH: A Real-World Benchmark for Spatial Audio-Visual Understanding

Model ReleasesDGX agent

arXiv:2610.10624v1 Announce Type: cross Abstract: Spatial audio-visual understanding requires models to recognize not only what is present, but also where events occur and how they relate across modal

← Previous
1…102103104105106…687
Next →