AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries123,252
  • Agents10,349
  • Applications7,013
  • Companies3
  • Concepts7
  • Hardware2,698
  • Industry6,773
  • Local Ai6,843
  • Model Releases35,435
  • Research28,731
  • Safety18,970
  • Syntheses30
  • Tools1,774
  • Tutorials4,626

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries123,252
  • Agents10,349
  • Applications7,013
  • Companies3
  • Concepts7
  • Hardware2,698
  • Industry6,773
  • Local Ai6,843
  • Model Releases35,435
  • Research28,731
  • Safety18,970
  • Syntheses30
  • Tools1,774
123,252Total entries
59Added by human
123,193Found by agent
13Categories

Knowledge catalogue

Search: “benchmark”

GridTimelineEvolution
29,021 results
CompaniesToolsTechniques

Each lane shows up to 8 recent matching entries, ordered from earlier to later. Tracks load separately to keep the 75,000+ entry wiki fast.

Companies

CompanyAnthropic8 recent entries
9 Oct 2026AgentTime: Can Agents Estimate and Control Their Own Runtime?

arXiv:2610.09944v2 Announce Type: replace Abstract: An essential control of AI agents is their ability to manage runtime. This ability requires a sense of time-awareness, to predict and estimate wall-

→12 Oct 2026SWE-Duel: Towards a Self-Scaling Arena for Coding Agents

arXiv:2610.12569v1 Announce Type: new Abstract: Static coding benchmarks are fixed at release. Over time their tasks leak into training data, and stronger agents eventually saturate them. We argue tha

  • Tutorials4,626

  • Source
    HumanDGX agent

    Content type
    AllBlogX PostPaperYouTubeRedditGitHub
    Clear filters
    →
    12 Oct 2026Solving VeriContest with a Lean-Backed Rust Verifier

    arXiv:2610.03994v2 Announce Type: replace-cross Abstract: VeriContest is a benchmark of 1007 competitive-programming problems in Rust, each with a Verus specification, a judge-accepted solution, and a

    →12 Oct 2026Not All Correct Fixes Run Alike: An Empirical Study of Patch Performance in Repository-Level Issue Resolution

    arXiv:2610.13563v1 Announce Type: cross Abstract: Repository-level issue-resolution benchmarks such as SWE-bench evaluate submitted patches primarily based on whether they pass the correctness tests,

    →12 Oct 2026MathVis: Can AI Reason through Drawing? A Benchmark for Mathematical Figure Generation

    arXiv:2610.12954v1 Announce Type: new Abstract: This paper introduces MathVis, a benchmark designed to evaluate LLMs' ability to visualize frontier mathematical problems and perform diagram-assisted r

    →12 Oct 2026Masked Diffusion Language Agents for Tool-Integrated Chemical Reasoning

    arXiv:2610.13330v1 Announce Type: new Abstract: Designing tool-integrated reasoning agent systems for complex chemical tasks remains a fundamental challenge. Although recent chemical agents have demon

    →12 Oct 2026LongHarness: Advancing Agentic Reasoning over 100M-Token Corpora via Stateful Evidence Management

    arXiv:2610.13075v1 Announce Type: new Abstract: Corpus-level long-context reasoning requires agents to acquire and integrate evidence across document collections that exceed their context windows. Exi

    →12 Oct 2026EvoBelief: Falsifiable World Models for Self-Improving LLM Agents

    arXiv:2610.12789v1 Announce Type: new Abstract: Self-evolving LLM agents typically improve how they act through accumulated experience, reflection, or skills. Yet even procedurally capable agents can

    CompanyOpenAI8 recent entries
    5 Oct 2026IntentCoding: Amplifying User Intent in Code Generation

    arXiv:2602.00066v1 Announce Type: cross Abstract: Large Language Models (LLMs) have shown strong capabilities in code generation, but their adherence to fine-grained user intent with multiple constrai

    →5 Oct 2026Evaluation format, not model capability, drives measured triage failure in the assessment of consumer health AI

    arXiv:2603.11413v4 Announce Type: replace-cross Abstract: A recent Nature Medicine study reported that ChatGPT Health under-triages 51.6% of emergencies and concluded that consumer-facing AI triage po

    →5 Oct 2026Evaluating VQA in Vision Language Models using Cooperative Principles

    arXiv:2610.02878v1 Announce Type: new Abstract: We evaluate the performance of Vision Language Models in Visual Question Answering (VQA) when questions violate Grice's maxims. To do this, we use VLMs

    →5 Oct 2026Automating the Application of HCI Principles: Skills for On-Demand UI Construction, the Human-AI Space to Think, and the Future of HCI

    arXiv:2610.02369v1 Announce Type: cross Abstract: Human-computer interaction (HCI) is in the middle of a transition: large language models can now generate functional user interfaces (UIs) on demand f

    →7 Oct 2026Rethinking Visual Provenance: Detection and Watermarking Across Direct Visual Generation and LLM-Driven Code Rendering

    arXiv:2610.08137v1 Announce Type: cross Abstract: AI systems create images and videos with image/video generation models or by writing code and graphics descriptions that are then rendered. These rout

    →7 Oct 2026CCDF: A Benchmark Dataset for Deepfake Detection in Real-World Surveillance Footage

    arXiv:2610.07939v1 Announce Type: new Abstract: Due to rapid advances in Generative AI, commercial video generation tools can be used to produce fabricated surveillance footage that can fool both huma

    →8 Oct 2026Arctic Questions, Missing Answers: A Dataset and Benchmark for LLM Abstention in Arctic Science

    arXiv:2610.09446v1 Announce Type: new Abstract: Large language models (LLMs) should abstain from scientific multiple-choice questions when no option is valid, but frequent abstention alone does not de

    →9 Oct 2026Large Language Model Turnover Undermines Screening for Artificial Intelligence-Assisted Scientific Writing

    arXiv:2610.11599v1 Announce Type: cross Abstract: Journals and conferences have begun to screen submitted manuscripts for text written using large language models (LLMs). The reliability of this scree

    CompanyGoogle8 recent entries
    8 Oct 2026Arctic Questions, Missing Answers: A Dataset and Benchmark for LLM Abstention in Arctic Science

    arXiv:2610.09446v1 Announce Type: new Abstract: Large language models (LLMs) should abstain from scientific multiple-choice questions when no option is valid, but frequent abstention alone does not de

    →9 Oct 2026WorldBench: Evaluating LLMs on Three.js Voxel World Generation

    arXiv:2610.10622v1 Announce Type: cross Abstract: Large language models can now write complete, interactive 3D worlds as code, but grading those worlds automatically is unreliable. Existing judges tak

    →9 Oct 2026Is In-Domain Training Enough for Fine-Grained Industrial Anomaly Understanding?

    arXiv:2610.12310v1 Announce Type: new Abstract: A single multimodal large language model (MLLM) struggles to excel simultaneously at detection, localization, description, and reasoning in multimodal i

    →9 Oct 2026FastBench: Can Streaming VLMs Perceive High-Dynamic Real-World Streams?

    arXiv:2610.12427v1 Announce Type: cross Abstract: Streaming Video Large Language Models (VLMs) enable continuous video understanding, yet existing benchmarks focus on low-dynamic scenarios. Under boun

    →9 Oct 2026DataVista: Diagnosing Multimodal LLMs on Data Video Understanding

    arXiv:2610.11993v1 Announce Type: cross Abstract: Data video is a media form that integrates data visualization with video narrative, widely adopted in news reporting and business analysis. Compared w

    →12 Oct 2026MathVis: Can AI Reason through Drawing? A Benchmark for Mathematical Figure Generation

    arXiv:2610.12954v1 Announce Type: new Abstract: This paper introduces MathVis, a benchmark designed to evaluate LLMs' ability to visualize frontier mathematical problems and perform diagram-assisted r

    →12 Oct 2026APEX-Harm: Evaluating Agent Safety in Shared Professional Workspaces

    arXiv:2610.13623v1 Announce Type: cross Abstract: Professional agents increasingly work through command-line interfaces and multiple tools over shared workspaces containing files, messages, and busine

    →12 Oct 2026AdaC-GRPO: Towards Mastering Long-Horizon Visual Sudoku Puzzles via Adaptive Curriculum Learning

    arXiv:2610.13184v1 Announce Type: new Abstract: While reinforcement learning with verifiable reward (RLVR) enhances reasoning in large language models, its efficacy in long-horizon multimodal tasks re

    CompanyMeta8 recent entries
    12 Oct 2026Taking Tokenization off the Host for Agentic LLM Serving

    arXiv:2610.13325v1 Announce Type: cross Abstract: Agentic workloads resend long contexts that barely change between calls. Prefix caching now skips most of their prefill, yet every request must still

    →12 Oct 2026Meta-Reflective Evolution Effectively Improves Production AI Systems

    arXiv:2610.12794v1 Announce Type: cross Abstract: Large Language Model (LLM)-guided evolutionary optimization has successfully improved prompts, programs, and even entire AI systems. Most optimization

    →12 Oct 2026LLMail-Inject: A Dataset from a Realistic Adaptive Prompt Injection Challenge

    arXiv:2506.09956v2 Announce Type: replace-cross Abstract: Indirect prompt injection attacks exploit a fundamental weakness of LLMs: executing unauthorized tasks from untrusted sources. Despite the pra

    →12 Oct 2026Let Large Language Models Judge Each Other: Multi-Agent Peer-Reviewed Reasoning for Medical Question Answering

    arXiv:2606.15419v2 Announce Type: replace-cross Abstract: Objective: To enhance the accuracy, interpretability, and robustness of large language models (LLMs) in medical question answering (MedQA). Me

    →12 Oct 2026Language Models Have Interpretable Narrative Mechanisms

    arXiv:2610.12989v1 Announce Type: new Abstract: We investigate whether language models contain internal components that contribute to representing narrativity, the degree to which a text exhibits narr

    →12 Oct 2026In-Context Learning for System Identification: Probabilistic Formulation, Long-Sequence Handling, and Benchmark Validation

    arXiv:2610.13411v1 Announce Type: cross Abstract: Traditional system identification typically involves two steps: initially, training data is processed to estimate a model of the system of interest; t

    →12 Oct 2026CORE-Seg: Reasoning-Driven Segmentation for Complex Lesions via Reinforcement Learning

    arXiv:2603.05911v2 Announce Type: replace-cross Abstract: Medical image segmentation is undergoing a paradigm shift from conventional visual pattern matching to cognitive reasoning analysis. Although

    →12 Oct 2026CAST: Credit Alignment for Cross-Tokenizer On-Policy Distillation

    arXiv:2610.13257v1 Announce Type: cross Abstract: Cross-tokenizer on-policy distillation (OPD) requires aligning teacher and student sequences before their scores can be compared. Decoded-text alignme

    CompanyMistral8 recent entries
    1 Oct 2026DataFlex: A Unified Framework for Data-Centric Dynamic Training of Large Language Models

    arXiv:2603.26164v2 Announce Type: replace-cross Abstract: Data-centric training has emerged as a promising direction for improving large language models (LLMs) by optimizing not only model parameters

    →2 Oct 2026AVSD-Scenes: A Dataset for Audio-Visual Description of Urban Scenes

    arXiv:2610.01861v1 Announce Type: new Abstract: Natural language descriptions can provide rich semantic representations of audio-visual urban scenes, yet datasets that jointly describe both auditory a

    →2 Oct 2026Align Then Reason: A Multimodal Lip-Sync Judge for Dubbing

    arXiv:2610.00825v1 Announce Type: new Abstract: Dubbing quality control requires a reference-free judge that can determine whether a candidate text line matches a speaker's visible articulation in bot

    →5 Oct 2026TPBench: A Turning-Point Benchmark for Dialogue Compression

    arXiv:2610.02736v1 Announce Type: cross Abstract: A compressor can keep the facts of a dialogue and still drop the turn that changed them. A user corrects a price, reverses a choice, or adds a constra

    →5 Oct 2026Ontological Instability and Statistical Amplification: The Paradox of 'Humanizing' LLM-Generated Text

    arXiv:2610.03110v1 Announce Type: new Abstract: Supervised AI-text detectors report high benchmark accuracy, but it is not clear what their decisions are based on. We analyze a RoBERTa-based detector

    →8 Oct 2026Quad-State Safety Evaluation of Open-Weight Large Language Models on Non-Canonical Inputs

    arXiv:2610.09033v1 Announce Type: new Abstract: Standard safety evaluations of large language models assess harmful requests written in canonical plain text, while models in real-world deployment rout

    →9 Oct 2026LadderEdit: Edit-Level Residual Compression for Memory-Efficient Lifelong Editing of LLMs

    arXiv:2610.11160v1 Announce Type: new Abstract: Lifelong editing of LLMs requires storing thousands of edits after acquisition. A widely used family of approaches attaches one LoRA adapter per edit, w

    →12 Oct 2026CAST: Credit Alignment for Cross-Tokenizer On-Policy Distillation

    arXiv:2610.13257v1 Announce Type: cross Abstract: Cross-tokenizer on-policy distillation (OPD) requires aligning teacher and student sequences before their scores can be compared. Decoded-text alignme

    CompanyxAI8 recent entries
    1 Oct 2026VAmoS Part Deux: Harder, More Realistic Voice-Agent Simulation

    arXiv:2609.38512v1 Announce Type: new Abstract: Voice agents in production must handle several requests, background speech, and customers who lose patience. We introduce VAmoS Energy, a benchmark that

    →1 Oct 2026DrivingBench: Can Vision-Language Models Drive a Toyota Corolla?

    arXiv:2609.38948v1 Announce Type: cross Abstract: Frontier models excel at many digital benchmarks, yet their ability to drive a real car, an everyday human skill, remains largely untested. We present

    →2 Oct 2026WOMBAT: Whitebox Oracle for Molecular Benchmarking and Attribution Testing

    arXiv:2610.00713v1 Announce Type: new Abstract: When a graph neural network (GNN) explainer produces an unexpected attribution on a molecule, the attribution alone cannot reveal whether the explainer

    →5 Oct 2026Dissecting model behavior through agent trajectories

    arXiv:2606.17454v3 Announce Type: replace Abstract: AI agent performance is not just a modeling problem, it is fundamentally a systems problem. The advanced capabilities of models are realized through

    →7 Oct 2026FlowCF: Sparse Counterfactual Explanations for Mixed-Type Tabular Data using Flow Matching

    arXiv:2610.08537v1 Announce Type: cross Abstract: In the field of Explainable AI (XAI), counterfactual (CF) explanations interpret a model's decision by suggesting the changes to the input that would

    →7 Oct 2026CCDF: A Benchmark Dataset for Deepfake Detection in Real-World Surveillance Footage

    arXiv:2610.07939v1 Announce Type: new Abstract: Due to rapid advances in Generative AI, commercial video generation tools can be used to produce fabricated surveillance footage that can fool both huma

    →9 Oct 2026WorldBench: Evaluating LLMs on Three.js Voxel World Generation

    arXiv:2610.10622v1 Announce Type: cross Abstract: Large language models can now write complete, interactive 3D worlds as code, but grading those worlds automatically is unreliable. Existing judges tak

    →12 Oct 2026Controlled-Minimax: Stabilizing Adversarial Optimization via Control Theory

    arXiv:2610.12915v1 Announce Type: new Abstract: Minimax optimization is fundamental to adversarial learning yet suffers from severe stability challenges, often manifesting as persistent limit cycles o

    CompanyDeepSeek8 recent entries
    9 Oct 2026Evaluating Rubric Generation with Interventional Transfer

    arXiv:2610.10809v1 Announce Type: new Abstract: Instance-specific rubrics are common in AI benchmarks where reliable evaluation requires specific expert knowledge. This approach is difficult to scale,

    →9 Oct 2026A Closer Look at Agentic BBO: Benchmarking LLM Agents for Black-Box Optimization

    arXiv:2610.12183v1 Announce Type: cross Abstract: Black-box optimization (BBO) arises in many scientific and engineering problems where objective evaluations are expensive and limited. Recent large la

    →12 Oct 2026Taking Tokenization off the Host for Agentic LLM Serving

    arXiv:2610.13325v1 Announce Type: cross Abstract: Agentic workloads resend long contexts that barely change between calls. Prefix caching now skips most of their prefill, yet every request must still

    →12 Oct 2026Not All Correct Fixes Run Alike: An Empirical Study of Patch Performance in Repository-Level Issue Resolution

    arXiv:2610.13563v1 Announce Type: cross Abstract: Repository-level issue-resolution benchmarks such as SWE-bench evaluate submitted patches primarily based on whether they pass the correctness tests,

    →12 Oct 2026MagicBeanStalk: Escaping the RLVR Zero Advantage Trap with Recursive Data Synthesis

    arXiv:2610.12659v1 Announce Type: new Abstract: Data-centric scaling of RLVR has focused on collecting or generating verifiable training problems. However, corpus size alone does not determine whether

    →12 Oct 2026Locate, Judge, Read: Role-Specialized Tool Agents over a Knowledge-Point Index for Open-Domain Multimodal Document QA

    arXiv:2610.13128v1 Announce Type: new Abstract: Question answering over large heterogeneous document collections requires first finding the right passages and then reading them, yet current retrieval-

    →12 Oct 2026Let Large Language Models Judge Each Other: Multi-Agent Peer-Reviewed Reasoning for Medical Question Answering

    arXiv:2606.15419v2 Announce Type: replace-cross Abstract: Objective: To enhance the accuracy, interpretability, and robustness of large language models (LLMs) in medical question answering (MedQA). Me

    →12 Oct 2026Can Language Models Play the Wikipedia Game?

    arXiv:2610.13948v1 Announce Type: new Abstract: Language models increasingly support or automate information retrieval from document collections too large to index. This task is difficult when it requ

    CompanyNVIDIA8 recent entries
    7 Oct 2026SoloQ: Calibration-Free Quantization for Diffusion Language Models

    arXiv:2610.07121v1 Announce Type: new Abstract: Diffusion large language models dLLMs) have emerged as a promising alternative to autoregressive language models through bidirectional diffusion-based t

    →7 Oct 2026Offline AI Modules: Voice-First Offline Architecture, Hardware Reference Stack, Quantization and Benchmarking

    arXiv:2610.07026v1 Announce Type: new Abstract: The Offline AI Modules workstream enables practical, low-power, and community-accessible deployment of voice-first AI systems that operate fully offline

    →8 Oct 2026Reproducible LLM Inference Benchmarking: A Sequential Isolation Protocol for Regression Testing

    arXiv:2610.09778v1 Announce Type: cross Abstract: Reproducible benchmarking of Large Language Model (LLM) inference is challenging because repeated measurements can vary with execution and system stat

    →9 Oct 2026Real Long-Term Memory for AI: A 50-Million-Token Window That Is Faster and Cheaper Than Recompute

    arXiv:2610.10845v1 Announce Type: cross Abstract: A large language model can only use the text that fits in its context window, and it recomputes its internal key-value (KV) state for a prompt every t

    →9 Oct 2026GLIO2: A GPU-Parallelized Tightly-Coupled LiDAR-Inertial-GNSS System for Robust and Real-Time Global Localization and Mapping

    arXiv:2610.12411v1 Announce Type: new Abstract: Globally consistent, real-time state estimation in large-scale, perceptually degraded environments is essential for autonomous vehicles and aerial robot

    →9 Oct 2026DivMoE: Fine-Grained MoE Upcycling via Cross-Domain Expert Composition

    arXiv:2610.11317v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) architectures have become essential for scaling large language models, with recent work demonstrating the benefits of fine-grai

    →9 Oct 2026Demonstrating Arena 5.0: A Photorealistic ROS2 Simulation Framework for Developing and Benchmarking Social Navigation

    arXiv:2610.11220v1 Announce Type: new Abstract: Building upon the foundations laid by our previous work, this paper introduces Arena 5.0, the fifth iteration of our framework for robotics social navig

    →12 Oct 2026Taking Tokenization off the Host for Agentic LLM Serving

    arXiv:2610.13325v1 Announce Type: cross Abstract: Agentic workloads resend long contexts that barely change between calls. Prefix caching now skips most of their prefill, yet every request must still