AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “benchmark”

GridTimelineEvolution
32,708 results
3 Sept 2026

GPT‑6 Astra

Model ReleasesDGX agent

GPT‑6 Astra GPT-6 Astra is 'rolling out today to a limited set of organizations and over the coming days will become available to all ChatGPT Plus, Pro, Business, and Enterprise users, as well as thro

Harness Engineering in LLM Tool Use via Agent-Native Reusable Tool Primitives

Model ReleasesDGX agent

arXiv:2609.01736v1 Announce Type: cross Abstract: Large language models (LLMs) augmented with external tools have demonstrated remarkable capability in solving complex real-world tasks. However, exist

How Output Format Confounds Data Quality and Capability in Instruction Tuning

ResearchDGX agent

arXiv:2609.02015v1 Announce Type: new Abstract: Instruction-tuning data are judged by quality metrics, and tuned models are judged by benchmarks, but both judgments pass through an output interface: t

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

ICE: Intervention-Consistent Explanation Evaluation with Statistical Grounding for LLMs

ResearchDGX agent

arXiv:2603.18579v2 Announce Type: replace-cross Abstract: Evaluating whether explanations faithfully reflect a model's reasoning remains an open problem. Existing benchmarks use single interventions w

RecKAN: Kolmogorov-Arnold Networks with a Learnable Recursive Polynomial Basis

Model ReleasesDGX agent

arXiv:2609.01729v1 Announce Type: cross Abstract: Kolmogorov--Arnold Networks (KANs) replace the fixed scalar weights of a standard network with learnable univariate functions on each edge, but existi

SCX Router: Streaming Zero-Shot Model Selection with a Decoder-KV Classifier and a Real-World Task Ontology

Model ReleasesDGX agent

arXiv:2609.02292v1 Announce Type: new Abstract: The rapid proliferation of large language models (LLMs) and the growing diversity of their applications presents a unique optimization opportunity: sele

SignMatch: Matching Dictionary Signs to Continuous Sign Language Video

Model ReleasesDGX agent

arXiv:2609.01886v1 Announce Type: new Abstract: The objective of this paper is to match dictionary sign videos to corresponding signs in continuous signing videos, where a match is defined by the visu

The Memory Trust Gap: Capability-Dependent Failures in Persistent-Memory Agents

Model ReleasesDGX agent

arXiv:2609.01852v1 Announce Type: new Abstract: Persistent memory supports personalized agents, but a stale stored fact can override current authoritative evidence without warning. We study when this

Toward Robust LiDAR Semantic Segmentation for Real-World Deployment: Evaluation under Coarse Labels, Adverse Conditions, and Domain Shifts

Model ReleasesDGX agent

arXiv:2609.02830v1 Announce Type: new Abstract: LiDAR-based semantic segmentation is a core perception module for autonomous vehicles and mobile robots. Despite the strong performance of recent state-

VakyArth: Evaluating Pragmatic Competence in LLMs across Indic Languages

Model ReleasesDGX agent

arXiv:2609.01788v1 Announce Type: cross Abstract: Real-world communication often requires pragmatic reasoning: interpreting meanings implied through context and cultural convention rather than stated

Vals analysis: open-weight models performing multi-stage tasks, like building a web app, can have an environmental impact 10K times greater than simple queries (Bloomberg)

IndustryDGX agent

Bloomberg: Vals analysis: open-weight models performing multi-stage tasks, like building a web app, can have an environmental impact 10K times greater than simple queries — Benchmarker Vals AI finds t

2 Sept 2026

A Dataset for Modeling Iterative Problem-Solving

Model ReleasesDGX agent

arXiv:2609.00940v1 Announce Type: new Abstract: Solving problems through repeated attempts is a sequential modeling task: at each step, the solver receives feedback and decides how to revise their sol

Bridging Lexical Divergence: LLM-Assisted, Cost-Efficient, Zero-shot Scientific Entity Linking

Model ReleasesDGX agent

arXiv:2609.00228v1 Announce Type: new Abstract: Scientific domain entity linking (EL) differs from general domain EL because mentions and entity names often lack lexical overlap. Another challenge is

Data-Driven Persona-Conditioned Agents for A/B Test Simulation

Model ReleasesDGX agent

arXiv:2609.01038v1 Announce Type: new Abstract: A/B testing is the gold standard for evaluating product changes, but each experiment requires real user traffic, engineering effort, and weeks of measur

DiagEvo: Diagnosis-Guided Self-Evolution via Hierarchical Error Memory

ResearchDGX agent

arXiv:2609.00768v1 Announce Type: new Abstract: Self-play is an effective paradigm for language-model self-evolution, but without guidance, solver performance can plateau or decline across rounds. Ung

Do General NLP Embeddings Capture Ontological Reasoning?

Model ReleasesDGX agent

arXiv:2609.00177v1 Announce Type: cross Abstract: General-purpose NLP embedding models perform well on linguistic tasks, but their ability to capture symbolic ontological structure remains unclear. We

Do Multimodal LLMs See Before They Read? Diagnosing Contextual Sycophancy

Model ReleasesDGX agent

arXiv:2609.00067v1 Announce Type: cross Abstract: External text can override conflicting image evidence in multimodal large language models, a failure we call multimodal contextual sycophancy. We intr

Evaluating Multimodal LLMs as Generalist Vision-Language-Action Agents for Drone Control: Commanding, Approaching, Tracking and Searching

Model ReleasesDGX agent

arXiv:2609.01404v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) are strong perceivers of images and video. We ask how far that reach extends into acting: dropping an MLLM di

Foundation models for electricity price forecasting and battery arbitrage: Can they replace market-specific forecasting models?

Model ReleasesDGX agent

arXiv:2609.00089v1 Announce Type: new Abstract: Foundation models promise accurate forecasts with little or no task-specific training, but whether they can replace models designed specifically for ele

HiveTraceGuard-Pro: A Compact Generative Guardrail for Prompt Injection, Jailbreaks, and Adversarial Obfuscation

Model ReleasesDGX agent

arXiv:2609.01046v1 Announce Type: cross Abstract: Production LLMs must handle inputs that attempt to override system instructions, bypass safety policies or elicit harmful responses. A common mitigati

How Correct Is Your Answer? A Semantic Correctness Framework for Open QA Evaluation

Model ReleasesDGX agent

arXiv:2609.01369v1 Announce Type: new Abstract: Reliable evaluation of open-ended question answering remains a bottleneck for measuring answer correctness of modern LLMs. Unlike multiple-choice tasks,

Investigating Linear Probe Robustness to Linguistic Register, Medical Specialty, and Corpus Shifts in Medical QA

Model ReleasesDGX agent

arXiv:2609.01361v1 Announce Type: new Abstract: Linear classifiers trained on hidden states of a large language model (LLM), linear probes, can flag factual errors from a single forward pass. Geometri

LEAP: Likelihood Elicitation and Aggregation for LLM-based Probabilistic Forecasting

Model ReleasesDGX agent

arXiv:2609.01337v1 Announce Type: new Abstract: LLM-based forecasting systems have improved on real-world tasks such as financial markets and sports outcomes, largely through stronger search and tool

NSIDDx: A Design Framework for Neuro-Symbolic, Practitioner-First Differential Diagnosis in Low-Resource Settings

AgentsDGX agent

arXiv:2609.00256v1 Announce Type: new Abstract: LLM-based diagnostic systems achieve high semantic accuracy on benchmarks, but open-ended evaluation on clinically uncommon presentations reveals a syst

Qwen3.8 Flash AP Quants

Local AiDGX agent

Quite surprised to be beating other high quality quants. It took a lot of benchmarking to get here and we are quite pleased with these, hope they are useful to the community. It required a modified wa

Retrieval, Scoring, and Decoding Shape Performance and Stability in LLM-based Conversational Recommendation

Model ReleasesDGX agent

arXiv:2609.00086v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used as rerankers in conversational recommender systems, yet measured gains depend strongly on the retri

Same Request, Different Boundary: Evaluating Cybersecurity Assistance across Conversational Contexts

Model ReleasesDGX agent

arXiv:2609.00578v1 Announce Type: new Abstract: Large Language Models (LLMs) can solve complex problems, but their misuse in high-risk domains can lead to severe consequences. Model providers therefor

SciTrue: Reliable Scientific Claim Validation with Frontier and Open Language Models at the NTCIR SciClaimEval Task

Model ReleasesDGX agent

arXiv:2609.00654v1 Announce Type: new Abstract: We describe the SciTrue team's participation in both subtasks of the NTCIR-19 SciClaimEval task~ite{sciclaimeval}, which asks systems to verify scientif

Separating perception from reasoning in vision-language models: a model-free render ceiling for crystal structures

Model ReleasesDGX agent

arXiv:2609.00663v1 Announce Type: new Abstract: Multimodal evaluations cannot say whether a vision-language model misread an image or misreasoned about it, because every existing method for separating

Simple Additions, Substantial Gains: Expanding Scripts, Languages, and Lineage Coverage in URIEL+

Model ReleasesDGX agent

arXiv:2510.27183v3 Announce Type: replace Abstract: The URIEL+ linguistic knowledge base supports multilingual research by encoding languages through geographic, genetic, and typological vectors. Howe

SOVER: Formal Certification of Optimization Reformulations via LLM-Assisted SMT Verification

Model ReleasesDGX agent

arXiv:2609.00728v1 Announce Type: new Abstract: Large Language Models (LLMs) have shown remarkable promise in translating and reformulating complex mathematical optimization problems across modeling l

Spatial Autoregressive Modeling of DINOv3 Embeddings for Unsupervised Anomaly Detection

Model ReleasesDGX agent

arXiv:2603.02974v2 Announce Type: replace Abstract: DINO models provide rich patch-level representations that have recently enabled strong performance in unsupervised anomaly detection (UAD). Most exi

TopoAlign: A Framework for Aligning Code to Math via Topological Decomposition

Model ReleasesDGX agent

arXiv:2510.11944v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) excel at both informal and formal (e.g. Lean 4) mathematical reasoning but still struggle with autoformalisation,

Uncovering the Computational Ingredients of Human-Like Representations in LLMs

Model ReleasesDGX agent

arXiv:2510.01030v2 Announce Type: replace Abstract: The human ability to translate diverse perceptual and linguistic inputs into structured behavior has been thought to rest on learning robust represe

ViTAL-X: Video-Text Alignment with Cross-Modal Temporal Edits

Model ReleasesDGX agent

arXiv:2609.00505v1 Announce Type: new Abstract: Video-text models adapted from image-text architectures (e.g., CLIP) frequently exhibit temporal blindness, the inability to perceive fundamental cues l

VoiceLongMemEval: Do Assistants Remember How You Sounded?

Model ReleasesDGX agent

arXiv:2609.00570v1 Announce Type: new Abstract: With the growing scale of multi-agent architectures and large language models, deployed AI assistants are increasingly tasked with reasoning over long,

1 Sept 2026

AgentRx: Diagnosing AI Agent Failures from Execution Trajectories

Model ReleasesDGX agent

arXiv:2602.02475v2 Announce Type: replace Abstract: AI agents often fail in ways that are difficult to localize because executions are probabilistic, long-horizon, multi-agent, and mediated by noisy t

An Explainable Coherence Score for Detecting Temporal Inconsistencies in Political News

Model ReleasesDGX agent

arXiv:2608.29175v1 Announce Type: new Abstract: Temporal inconsistencies, such as mandates attributed outside their real interval, events presented as past before they occurred, or inverted causal seq

Analytic Dynamics: Learning Physics-Grounded Representation for Fast Intrinsic Dynamics Inference from Monocular Videos

Model ReleasesDGX agent

arXiv:2608.31025v1 Announce Type: new Abstract: Inferring object dynamics from visual observations is essential for intelligent agents to reason about and interact with the physical world, yet remains

AnnotateAnything: Automatic Annotation of 3D Assets for Robot Manipulation

Model ReleasesDGX agent

arXiv:2606.17446v2 Announce Type: replace-cross Abstract: Simulation enables scalable robot data collection, but raw 3D assets provide only geometry, lacking the semantic, interactive, and physical kn

Aspire: Can Models Self-Evolve from Vague Goals?

Model ReleasesDGX agent

arXiv:2608.31111v1 Announce Type: new Abstract: Many important forms of human learning begin with a vague goal, such as 'become a better physicist' or 'improve at research.' Learners must interpret th

Beyond Good Intentions: When Does the Framing of Multilingual and Low-Resource NLP Research Become a Caricature?

ApplicationsDGX agent

arXiv:2608.30866v1 Announce Type: new Abstract: Building language technologies and conducting NLP research for low-resource languages---particularly when led by native speakers or involving participat

Ceiling-Clipped Acceptance Histograms Indicate Stranded Speed-up in Block-Diffusion Speculative Decoding

Model ReleasesDGX agent

arXiv:2608.30427v1 Announce Type: new Abstract: Speculative decoding speeds up generation with an efficient draft model (drafter) that proposes tokens for a target model to verify in one pass, preserv

Coarse composition suffices: tabular in-context learning for multi-activity antimicrobial peptide profiling

Model ReleasesDGX agent

arXiv:2608.30337v1 Announce Type: new Abstract: Antimicrobial peptides (AMPs) often act against multiple pathogen classes, making multi-label activity prediction a more realistic screening target than

ConCA: Concentration-Aware Channel Attention for Fine-Grained Visual Recognition

Model ReleasesDGX agent

arXiv:2608.30183v1 Announce Type: cross Abstract: Lightweight channel attention mechanisms are widely used in image classification, yet their effectiveness in fine-grained visual recognition (FGVR) re

Dimple: Discrete Diffusion Multimodal Large Language Model with Parallel Decoding

Model ReleasesDGX agent

arXiv:2505.16990v3 Announce Type: replace Abstract: In this work, we propose Dimple, the first Discrete Diffusion Multimodal Large Language Model (DMLLM). We observe that training with a purely discre

DocIntent: Answerability-Guided Agentic Restoration for Real-World Document Visual Question Answering

Model ReleasesDGX agent

arXiv:2608.29037v1 Announce Type: cross Abstract: Real-world degradations such as blur, shadow, distortion, and moire patterns severely impair the document question-answering capabilities of Multimoda

EmoLASP: Emotion Recognition with Language Models and Answer Set Programming

Model ReleasesDGX agent

arXiv:2608.29035v1 Announce Type: new Abstract: Emotion recognition in conversations is increasingly tackled with language models, but these models can be unstable and expensive to fine-tune or to pro

Evaluating LLM-based AI agents integrated with materials synthesis tools: the case of atomic layer deposition

AgentsDGX agent

arXiv:2608.29309v1 Announce Type: cross Abstract: This work provides an overview of the different strategies that can be used to evaluate the performance of AI models and agents based on large languag

Evaluating Perspectival Biases in Cross-Modal Retrieval

Model ReleasesDGX agent

arXiv:2510.26861v4 Announce Type: replace-cross Abstract: Multimodal retrieval systems are expected to operate in a semantic space, agnostic to the language or cultural origin of the query. In practic

Evidence-Bounded Mental Health Reasoning from Heterogeneous Speech Protocols

Model ReleasesDGX agent

arXiv:2608.31014v1 Announce Type: new Abstract: Computational mental health screening using multimodal speech and text has shown great promise. However, existing models often assume all clinical speec

Expert-validated STEM QA

Model ReleasesDGX agent

arXiv:2608.28591v1 Announce Type: new Abstract: Recent advancements in AI are helping scientists achieve breakthroughs in fields such as mathematics, medicine, and materials sciences. New evaluation d

From Location Phrases to Geographic Entities: Task-Adapted Retrieval for People Search

Model ReleasesDGX agent

arXiv:2608.28965v1 Announce Type: new Abstract: People search must map free-form location phrases to geographic entities used as structured retrieval filters. Lexical standardizers handle canonical na

Generating Workflow DAGs from Natural Language with Non-Reasoning LLMs

Model ReleasesDGX agent

arXiv:2608.30250v1 Announce Type: new Abstract: This paper addresses the problem of translating natural-language routing rules written by business administrators into executable workflow graphs for en

GenRubric: Self-Evolving Rubric Generation for Scalable LLM Evaluation

ResearchDGX agent

arXiv:2608.29856v1 Announce Type: new Abstract: Large language models are increasingly used as scalable evaluators for open-ended tasks. However, many LLM judges derive query-specific criteria during

GeoRay: Gauge-Aware Feed-Forward Satellite 3D Reconstruction in the Geodetic Frame

Model ReleasesDGX agent

arXiv:2608.29680v1 Announce Type: new Abstract: Feed-forward 3D foundation models reconstruct perspective scenes in one pass. Satellite photogrammetry needs a different product, one that domain adapta

Ignorance or Incompetence? Constructing Knowledge-Gated, Verifiable Tasks for LLM Agents

AgentsDGX agent

arXiv:2608.30322v1 Announce Type: new Abstract: Professional agent tasks often depend on conventions that are absent from public corpora, yet benchmarks rarely control whether an agent has access to t

Interpretable Predictability-Based AI Text Detection: A Replication Study

Model ReleasesDGX agent

arXiv:2603.15034v2 Announce Type: replace-cross Abstract: This paper replicates and extends the system used in the AuTexTification shared task for authorship attribution of machine-generated texts. Ex

Interpreting and Steering for Safe and Correct Code Generation

Model ReleasesDGX agent

arXiv:2608.30025v1 Announce Type: new Abstract: Large language models (LLMs) frequently generate source code containing vulnerabilities, yet little work studies the internal mechanisms that distinguis

Item-Mean Surrogates: Why Richer Persona Data Fail to Improve LLMs as Human Surrogates

Model ReleasesDGX agent

arXiv:2608.29455v1 Announce Type: new Abstract: LLMs are increasingly used as human surrogates, often on the premise that richer persona data could make them substitutes or exploratory tools for speci

← Previous
1…125126127128129…546
Next →