AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “evaluation”

GridTimelineEvolution
41,190 results
15 Oct 2026

HGRP: Heterogeneous Graph Neural Network for Routability Prediction

ResearchDGX agent

arXiv:2610.20209v1 Announce Type: new Abstract: Routability prediction enables rapid evaluation of placement quality without routing, providing effective feedback for routability-driven placement opti

Historical-Feature Residual Adaptation for Sequential Screening

SafetyDGX agent

arXiv:2610.19315v1 Announce Type: new Abstract: Sequential screening policies must use acquired feedback effectively under a fixed experiment budget. We study acquisition-time residual adaptation: a s

Horizon Scans can be accelerated using novel information retrieval and artificial intelligence tools

ApplicationsDGX agent

arXiv:2504.01627v2 Announce Type: replace-cross Abstract: Introduction: Horizon scanning in healthcare assesses early signals of innovation, crucial for timely adoption. Current horizon scanning faces

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

KoAGE: Do Large Language Models Know, Learn, and Coin Korean Neologisms?

Model ReleasesDGX agent

arXiv:2610.19399v1 Announce Type: new Abstract: Korean neologisms arise through diverse mechanisms, a demanding test of language models beyond lexical memorization. To enable systematic evaluation, we

Last Secure Code Benchmark: Is the Code You Vibe Secure?

Model ReleasesDGX agent

arXiv:2610.14766v1 Announce Type: cross Abstract: AI coding agents now write much of the code that ships, yet whether that code is secure remains unclear. We introduce the Last Secure Code Benchmark,

LifeSearch: Benchmarking Deep Research Agents for Real-World Life and Productivity

Model ReleasesDGX agent

arXiv:2610.18092v1 Announce Type: new Abstract: Deep research (DR) agents address open-ended information needs through multi-step reasoning, long-horizon web search, and evidence synthesis. However, e

LLM-Based Policy Compliance Verification of Loan Applications

SafetyDGX agent

arXiv:2610.20155v1 Announce Type: cross Abstract: Banks rely on extensive internal policy frameworks to ensure that corporate lending decisions comply with regulatory requirements and internal risk st

LLM-jp-4 Technical Report

ResearchDGX agent

arXiv:2610.19331v1 Announce Type: new Abstract: This paper presents LLM-jp-4, a family of Japanese sovereign large language models (LLMs) developed with an emphasis on transparency, reproducibility, a

LLMRec: Benchmarking Large Language Models on Recommendation Task

Model ReleasesDGX agent

arXiv:2308.12241v2 Announce Type: replace-cross Abstract: Recently, the fast development of Large Language Models (LLMs) such as ChatGPT has significantly advanced NLP tasks by enhancing the capabilit

MagicGarment: Benchmarking Single-Image Standalone 3D Garment Reconstruction

Model ReleasesDGX agent

arXiv:2610.19623v1 Announce Type: new Abstract: Single-image 3D reconstruction has advanced rapidly, yet standalone garments remain challenging due to thin-shell geometry, open boundaries, and layered

Model vs. User: Whose Values Prevail? Inference-Time Value Alignment in Multi-Turn Conversations

SafetyDGX agent

arXiv:2610.19817v1 Announce Type: new Abstract: Human values shape how we expect language models to behave. Dominant alignment approaches treat values as global objectives, although the appropriate va

Neural POS Tagging for the Low-Resource Saraiki

Model ReleasesDGX agent

arXiv:2610.20279v1 Announce Type: new Abstract: Part-of-speech tagging is a fundamental sequence labeling task and an important component for many downstream natural language processing applications.

nvidia/Nemotron-3.5-Embed-1B-BF16 · Hugging Face

Model ReleasesDGX agent

Nemotron-3.5-Embed-1B-BF16 is a versatile embedding model developed by NVIDIA for multimodal and multilingual question-answering retrieval. The model can embed a document page in the form of an image,

Paraphrase Consensus Is Not Self-Consistency: Instruction Reliance and Robustness in VLA Policies

SafetyDGX agent

arXiv:2610.19438v1 Announce Type: new Abstract: Vision-language-action (VLA) policies fine-tuned on LIBERO are trained and evaluated on the same ten instruction strings, and rewording the instruction

Passing Tests, Missing Semantics: Evidence of Interpretive Lock-In in Plan-Based DataFrame Code Generation

Model ReleasesDGX agent

arXiv:2610.15797v1 Announce Type: new Abstract: Planning and revision are intended to bring generated code closer to the task specification. Yet a mistaken interpretation can persist across the plan,

PatientWM: Towards Generalizable Clinical World Models via Unified Patient States

ResearchDGX agent

arXiv:2610.17059v1 Announce Type: new Abstract: Clinical decisions depend on anticipating how a patient's condition will evolve as treatment is adjusted and new evidence becomes available. Existing me

Quantifying privacy risks in foundation model representations of brain MRI

Model ReleasesDGX agent

arXiv:2610.20494v1 Announce Type: new Abstract: Pretrained representations are increasingly used to share and reuse information from medical images without exposing the original scans, but it is uncle

RASSG: Repair-Aware Semantic Survival Gating for Streaming Tool Execution

Model ReleasesDGX agent

arXiv:2610.14659v1 Announce Type: new Abstract: Streaming speech assistants can launch tools before users finish speaking, overlapping execution with incoming speech to reduce user waiting time. Howev

Read, Parse, Describe: Unified Document Parsing with Visual Element Description Generation

Model ReleasesDGX agent

arXiv:2610.20335v1 Announce Type: new Abstract: Document understanding systems are typically evaluated as separate components via layout analysis, optical text recognition, reading-order prediction, a

Recursive Environment Scaling for General Long-Horizon Agents

Model ReleasesDGX agent

arXiv:2610.16397v1 Announce Type: new Abstract: We study environment scaling as a way to increase agent-benchmark difficulty while holding core task objectives fixed. Our framework, Recursive Environm

Reliability-Aware Multimodal Sentiment Prediction Under Local Modality Missingness

Local AiDGX agent

arXiv:2610.20543v1 Announce Type: new Abstract: Multimodal sentiment models are usually evaluated on complete utterances, yet streams often lose a contiguous span of text, audio, or video. We study lo

Reliable Text-to-SQL in Resource-Constrained Settings with Small LLMs via Iterative Retry Workflows

Model ReleasesDGX agent

arXiv:2610.17305v1 Announce Type: new Abstract: Large Language Models (LLMs) have recently improved Text-to-SQL generation, but their computational cost can hinder deployment in resource-constrained s

Risk-Controlled DFT Selection for Machine-Learned Interatomic Potentials

ResearchDGX agent

arXiv:2610.19630v1 Announce Type: cross Abstract: Automated materials discovery requires evaluating large pools of candidate configurations, with density functional theory (DFT) as a major throughput

Same Attack, Different Judge: A First Controlled Adversarial Comparison of Jev, LLM Judges, and Purpose-Built Safety Classifiers

Model ReleasesDGX agent

arXiv:2610.17820v1 Announce Type: cross Abstract: TypeSafe AI's Jev is a new kind of safety judge. It generates no text and no label: it answers questions the developer defines in advance and returns

ScholarQuest: A Taxonomy-Guided Benchmark for Agentic Academic Paper Search in Open Literature Environments

Model ReleasesDGX agent

arXiv:2606.20235v2 Announce Type: replace-cross Abstract: Academic paper search is a core step in scientific research, and LLM-based search agents are emerging as a promising paradigm for iterative, i

SciRerankBench: Benchmarking Rerankers Towards Scientific Retrieval-Augmented Generation with LLMs

Model ReleasesDGX agent

arXiv:2508.08742v3 Announce Type: replace-cross Abstract: Scientific literature question answering is a pivotal step towards new scientific discoveries. Recently, extit{two-stage} retrieval-augmented

SkillHorizon: Constructing Long-Horizon Agent Tasks through Skill Composition

Model ReleasesDGX agent

arXiv:2610.14966v1 Announce Type: new Abstract: Long-horizon agents must complete workflows in which later activities depend on earlier outputs and changes to shared state. A key challenge for evaluat

SnapFlow: One-Step Action Generation for Flow-Matching VLAs via Progressive Self-Distillation

Local AiDGX agent

arXiv:2604.05656v2 Announce Type: replace Abstract: Vision-language-action (VLA) models with flow-matching action heads, such as {pi}0 and {pi}0.5, have become a standard recipe for generalist robot m

Spectral structure learning for clinical time series

TutorialsDGX agent

arXiv:2502.11680v2 Announce Type: replace Abstract: We develop and evaluate a structure learning algorithm for clinical time series. Clinical time series are multivariate time series observed in multi

Structure-Preserving Document-Level Data Augmentation via Discourse Parsing

ResearchDGX agent

arXiv:2610.19497v1 Announce Type: new Abstract: Data augmentation (DA) plays a vital role in improving model performance in low-resource or limited-supervision scenarios within Natural Language Proces

The Agentic Scientist: Orchestrating Coding Agents for Automated Scientific (Co-)Discovery Blog: https://pub.sakana.ai/agentic-scientist/ Gi…

Model ReleasesDGX agent

The Agentic Scientist: Orchestrating Coding Agents for Automated Scientific (Co-)Discovery Blog: https://pub.sakana.ai/agentic-scientist/ GitHub: https://github.com/SakanaAI/AI-Scientist-v3 arXiv: htt

ThreadBench: Benchmarking Realism in Agentic Simulation of Real-world Discussions

Model ReleasesDGX agent

arXiv:2606.14715v2 Announce Type: replace-cross Abstract: LLM agents are increasingly used to simulate real-world interactions, but it remains unclear whether simulated behaviors preserve the content

Unconstrained CTI-REALM with Open-Weights

Model ReleasesDGX agent

arXiv:2610.14180v1 Announce Type: new Abstract: Organisations that want language-model agents for security work face a choice between open-weight models, which they can run and audit themselves, and f

What We Talk About When We Talk About LLM Planning: Evidence for Two Distinct Planning Abilities

Local AiDGX agent

arXiv:2607.11197v2 Announce Type: replace Abstract: When LLMs exhibit uneven performance across planning tasks, these gaps are often attributed to task difficulty. We argue that this explanation is in

When Agents Commit Too Soon: Diagnosing Premature Commitment in LLM Agents

Model ReleasesDGX agent

arXiv:2606.22936v2 Announce Type: replace Abstract: Tool-using LLM agents make early choices about what to search for, which evidence to trust, and what to do next. A wrong early choice can steer ever

When Pleasing the User Compromises Care: AI Sycophancy in Caregiver-Mediated Healthcare

Model ReleasesDGX agent

arXiv:2610.14360v1 Announce Type: new Abstract: Large language model (LLM) alignment often assumes that the user interacting with a model is also the primary beneficiary of its behavior. Yet in many c

Words to World: Benchmarking LLMs in Interactive Physical Environments

Model ReleasesDGX agent

arXiv:2610.15228v1 Announce Type: new Abstract: Words are increasingly becoming an interface for action: large language models (LLMs) can now invoke tools, operate devices, and make decisions that aff

14 Oct 2026

A Few More Tokens Ahead: Reinforcing Parallelism in Diffusion LLMs

SafetyDGX agent

arXiv:2610.18200v1 Announce Type: new Abstract: Parallel generation is widely regarded as an inherent advantage of diffusion large language models. Yet our fixed-quota evaluation of four representativ

Benchmarking Interaction-Oriented Aerial Mobility across Heterogeneous Environments

Model ReleasesDGX agent

arXiv:2610.18381v1 Announce Type: new Abstract: Aerial mobile manipulation requires unmanned aerial vehicles (UAVs) to traverse heterogeneous environments such as indoor and outdoor domains, and conne

Benchmarking Self-Supervised 3D Medical Vision Foundation Models and Transferability Estimation

Model ReleasesDGX agent

arXiv:2610.17573v1 Announce Type: new Abstract: Self-supervised pretraining has expanded the pool of 3D medical foundation models, but published evaluations use different datasets, endpoints and fine-

Calibrated alpha-Barycenters for Multiobjective f-Divergence Optimization

Model ReleasesDGX agent

arXiv:2610.16819v1 Announce Type: cross Abstract: Matching one distribution to many targets can require repeated evaluations of every target. CAL-alpha-MODM aggregates a nonlinear predictor into one b

Certified Robustness via Sparse Second-Order Cone Relaxations

Model ReleasesDGX agent

arXiv:2610.16016v1 Announce Type: new Abstract: Certified robustness is critical for deploying neural networks in safety-sensitive settings, but computing exact certificates typically requires solving

ChronoScribe: Semantic-Numerical Specialization for Instruction-Driven Time Series Forecasting

Model ReleasesDGX agent

arXiv:2610.16345v1 Announce Type: cross Abstract: Recent advances in instruction-driven time series forecasting highlight a fundamental tension: systems must simultaneously master natural-language ins

CoCA: Criterion-Aware Credit Assignment for Rubric-Based Reinforcement Learning

ResearchDGX agent

arXiv:2610.17733v1 Announce Type: new Abstract: Rubric-based reinforcement learning (RL) evaluates responses against explicit criteria to construct rewards, offering a viable way to train large langua

Decoupling Knowledge Forgetting and Refusal Learning in MLLM Unlearning

Model ReleasesDGX agent

arXiv:2610.14605v1 Announce Type: cross Abstract: Current evaluations of multimodal unlearning typically focus on whether a model stops outputting target information. This surface-level criterion, how

DiffGA: Steering Frozen Diffusion Models for Materials Design via Evolutionary Search

ResearchDGX agent

arXiv:2610.14999v1 Announce Type: cross Abstract: Steering candidate generation toward user-defined objectives is central to inverse materials design, yet remains difficult when objectives are black-b

DTA-GT: Direction- and Topology-Aware Graph Transformer for Neural Network Representation Learning

ResearchDGX agent

arXiv:2610.16822v1 Announce Type: new Abstract: Architecture attribute predictors reduce the cost of neural architecture search by estimating accuracy or latency from a small set of evaluated candidat

Evidence-First Agentic Verification

Model ReleasesDGX agent

arXiv:2610.17724v1 Announce Type: cross Abstract: Long-horizon, semi-verifiable agentic tasks often rely on rubric-based evaluation, but the evidence needed to assess these tasks can be spread across

ExeWorldBench: Benchmarking Code-Based Executable 3D World Modeling

Model ReleasesDGX agent

arXiv:2610.15166v1 Announce Type: new Abstract: Coding agents are increasingly evolving beyond reproducing what a world looks like toward constructing executable worlds that capture how a world works.

Genesis: Visual Augmentation Primitives for Multimodal Chain-of-Thought Reasoning

Model ReleasesDGX agent

arXiv:2610.15565v1 Announce Type: new Abstract: Recent multimodal large language models achieve promising results on visual reasoning tasks, approaching human-level performance on existing STEM benchm

Geometric Parrots: Rule Absence vs. Rule Fragility in Spatial and Physical Reasoning for Vision-Language Models

Model ReleasesDGX agent

arXiv:2610.16170v1 Announce Type: new Abstract: Vision-language models (VLMs) can answer many geometric and physical reasoning questions correctly, yet still behave inconsistently in interaction, for

GeoNIRS: Geometry-Aware Pretraining for Heterogeneous fNIRS Representation Learning

Local AiDGX agent

arXiv:2610.17845v1 Announce Type: new Abstract: Functional near-infrared spectroscopy (fNIRS) provides portable and spatially localized measurements of cortical hemodynamics, but differences in channe

HALLMARK: How to Diagnose LLM Citation Verifiers and When to Deploy Them

Model ReleasesDGX agent

arXiv:2607.18360v2 Announce Type: replace-cross Abstract: GPTZero found 53 NeurIPS 2025 accepted papers with hallucinated citations, and venues now screen submissions with automated reference checkers

HybridDualPathNet: Cross-Fusion Attention of EfficientNetV2 and Swin Transformer for Brain MRI Classification of Alzheimer's and Parkinson's Disease

Local AiDGX agent

arXiv:2610.17251v1 Announce Type: new Abstract: Separating Alzheimer's Disease (AD), Parkinson's Disease (PD), and Healthy Controls (HC) using structural MRI remains challenging because disease signat

I2O2I-Nav: A Benchmark with a Modular Agent for Long-Horizon Indoor-to-Outdoor-to-Indoor Navigation

Model ReleasesDGX agent

arXiv:2610.18307v1 Announce Type: new Abstract: Service and delivery robots often need to complete long-horizon navigation missions spanning indoor and outdoor environments. Existing embodied navigati

Inference on the Value of Policy Improvement in Adaptive Experiments

SafetyDGX agent

arXiv:2610.15789v1 Announce Type: cross Abstract: In this paper, we develop an asymptotically normal estimator for the value of policy improvement (VPI) under adaptively collected data. This value, wh

InfoVis: Unified Slide Image Generation and Editing

Model ReleasesDGX agent

arXiv:2610.16784v1 Announce Type: new Abstract: Generating and editing presentation slides requires models to combine accurate text rendering, instruction following, visual grounding, aesthetic design

IsoVRBench: Video Reward Modeling Without Human Feedback

Model ReleasesDGX agent

arXiv:2610.17234v1 Announce Type: cross Abstract: Video reward models are trained and evaluated on human preferences between videos that often differ simultaneously on properties such as prompt alignm

LensErase: A Foundation Model for Erase Anything

ApplicationsDGX agent

arXiv:2610.18072v1 Announce Type: new Abstract: We introduce LensErase, a general-purpose mask-based Erase Anything foundation model designed to cover a broad spectrum of real-world erase scenarios. L

LynxScenes: A Large-Scale Real-World Benchmark for Outdoor Wheel-Legged Robot Perception, Navigation, Imagination and Reconstruction

Model ReleasesDGX agent

arXiv:2610.18093v1 Announce Type: new Abstract: Wheel-legged robots operating in outdoor spaces shared with humans require accurate perception, socially compliant navigation, future-scene reasoning, a

← Previous
1…132133134135136…687
Next →