AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “benchmark”

GridTimelineEvolution
32,708 results
27 Aug 2026

PlanSightRAG: A Visual-First Multimodal RAG for Automating Question Answering and Compliance Checking for Civil Standard Plans

Model ReleasesDGX agent

arXiv:2608.26091v1 Announce Type: cross Abstract: Civil infrastructure compliance checking has long relied on engineers manually reading legacy 2D plans; however, OCR-based automation strips away the

Reconstructing the Right Episode: Evaluating Interleaved Conversational Memory Beyond Long Context

Model ReleasesDGX agent

arXiv:2608.25655v1 Announce Type: new Abstract: Conversations with chat assistants increasingly span many topics in a single long-running thread, challenging memory systems. Existing long-context and

SciMIF: Understanding Multimodal Instruction Following in Scientific Domains

Model Releases
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
DGX agent

arXiv:2608.25973v1 Announce Type: cross Abstract: Understanding instruction-following capabilities in scientific domains is essential for effectively leveraging Multimodal Large Language Models (MLLMs

Unfolding Scientific Papers into Multi-Turn Generation Trajectories for Continued Pre-Training

Model ReleasesDGX agent

arXiv:2608.25826v1 Announce Type: new Abstract: A recent line of synthetic-data work reconstructs the thinking behind existing text rather than rewriting the text itself, but it operates on short web

Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalization

Model ReleasesDGX agent

arXiv:2608.26103v1 Announce Type: cross Abstract: Zero-shot cross-task generalization, where a policy must execute manipulation tasks never seen during training, remains a central challenge in robot l

26 Aug 2026

Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Review

Model ReleasesDGX agent

arXiv:2504.18346v4 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have been transformative across many domains. However, hallucination, i.e., confidently outputting incorrect info

Evaluating Multiple LLM Generations with Validated Task Coverage

Model ReleasesDGX agent

arXiv:2608.24228v1 Announce Type: new Abstract: Many LLM applications are most useful when they provide several candidate outputs for comparison, validation, or combination. Predominant evaluation set

More GPUs or a Smaller Cache? Tensor Parallelism versus KV Compression for Memory-Bound LLM Serving

Model ReleasesDGX agent

arXiv:2608.23962v1 Announce Type: new Abstract: When an LLM serving deployment runs out of KVcache room, there are two well-established ways out. Tensor parallelism shards the weights and the KV cache

TangramPuzzle: Evaluating Multimodal Large Language Models with Compositional Spatial Reasoning

Model ReleasesDGX agent

arXiv:2601.16520v2 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) have achieved remarkable progress in visual recognition and semantic understanding, yet precise compo

ToolRobustBench: Stage-Wise Perturbation Evaluation and Failure Diagnosis for Tool-Calling Agents

Model ReleasesDGX agent

arXiv:2608.23635v1 Announce Type: cross Abstract: Large language models (LLMs) rely on tool calling as a fundamental agent capability, enabling them to invoke external systems and complete tasks beyon

Underrated Muse Glimmer

Model ReleasesDGX agent

Benchmarked qwen3.8 xhigh, medium and muse glimmer. Xhigh effort mode with qwen3.8 took almost 30hrs. (And still failed on 16 cases because of the 32K output token limit) Medium effort mode and muse g

25 Aug 2026

EviSafe: Evidence-Grounded Safety Evaluation for Vision-Language Models

Model ReleasesDGX agent

arXiv:2608.23313v1 Announce Type: new Abstract: Vision-language model safety benchmarks typically evaluate only final responses: whether a model refuses, warns, or complies. This outcome-level view ca

Mac Studio M5 Max Cost Analysis

Model ReleasesDGX agent

At $10k, you could get - 6.2B tokens with Qwen 3.8 Max (Qwen Pro plan) - 5.7B tokens with DeepSeek V4 Pro OpenRouter - 100B tokens with DeepSeek V4 Flash OpenRouter As a firm believer of local inferen

MedReaMM: Evaluating Large Multimodal Models on Expert-Level Clinical Diagnostic Synthesis

Model ReleasesDGX agent

arXiv:2608.22323v1 Announce Type: new Abstract: The application of Large Language Models (LLMs) to diagnostic decision-making has garnered growing interest. However, existing benchmarks largely focus

What's the Catch? Evaluating Temporal Consistency in Vision-Language Models

Model ReleasesDGX agent

arXiv:2608.23474v1 Announce Type: cross Abstract: Vision-language models (VLMs) achieve strong performance on video and image-sequence benchmarks, yet it remains unclear whether they capture temporal

24 Aug 2026

AgentX - InferenceXv3: Does CUDA Moat Hold up in Agentic Inferencing?

HardwareDGX agent

AgentX 1.0 is the first fully open‑source multi‑turn agentic coding inference benchmark (Apache 2.0), released August 2026 with a 1 million‑token context and over 1 million tokens of dataset built at

Beyond Raw Transcripts: Structured Persona Extraction for LLM-Based Digital Twins

Model ReleasesDGX agent

arXiv:2608.20344v1 Announce Type: new Abstract: LLM-based 'digital twins' aim to simulate how an individual would behavein new environments or respond to novel questions, given some representation of

Can Legal AI Know When It Is Wrong? And Do Students Know When It Is?

Model ReleasesDGX agent

arXiv:2608.21089v1 Announce Type: new Abstract: Integrating Large Language Models (LLMs) into the Indian judiciary promises access to justice but introduces severe risks. We identify the 'inertia of c

Can Scientific Claims Be Removed from Large Language Models? A Systematic Evaluation of Claim-Level Unlearning

Model ReleasesDGX agent

arXiv:2608.20960v1 Announce Type: new Abstract: Language models (LMs) are trained on static scientific corpora, whereas scientific knowledge continuously evolves through correction and revision. Scien

Do SpeechLMs Hear Their Own Opinions? Diagnosing and Mitigating Previous-Belief Contamination in Streaming Emotion Understanding

Model ReleasesDGX agent

arXiv:2608.20769v1 Announce Type: cross Abstract: Streaming emotion understanding uses historical state while continuously interpreting current audio, often feeding the model's previous prediction bac

Free-Text Evaluation of LLMs for 5G Domain Knowledge and Fault Analysis using LLM-as-Judge

Model ReleasesDGX agent

arXiv:2608.21021v1 Announce Type: cross Abstract: Real-world fault analysis in 5G and emerging 6G networks demands domain expertise to analyze free-text diagnostics, including root-cause explanations

How NVIDIA Groq 3 LPX Unlocks Ultrafast Interactivity at Long Context on NVIDIA Vera Rubin

HardwareDGX agent

NVIDIA Groq 3 LPX, when paired with the Vera Rubin NVL72 platform, delivers a record‑setting 3,431 output tokens/second on the Artificial Analysis 100K context benchmark using Gemma 4 31B, demonstrati

Human-JEPA: A Human-Centric Vision Model that Perceives and Anticipates

Model ReleasesDGX agent

arXiv:2608.21160v1 Announce Type: new Abstract: Machines that understand humans should perceive the present and anticipate the future. Existing human-centric vision model are pretrained on human image

KoViDoRe: Korean Visual Document Retrieval

Model ReleasesDGX agent

arXiv:2608.20840v1 Announce Type: cross Abstract: Recent advances in multimodal retrieval have improved the ability to retrieve information from visually rich documents such as PDFs and reports. Howev

Natural-Language-Guided Generator-Agnostic Shortlisting for Protein Binder Design

Model ReleasesDGX agent

arXiv:2608.20755v1 Announce Type: new Abstract: Modern de novo design workflows generate many candidate protein binders, but wet-lab validation capacity remains limited, making shortlisting a major bo

Qwen 3.8 27B Aider score

Model ReleasesDGX agent

I ran the Aider benchmark on Qwen 3.8 27B FP8 with FP8 KV cache 256K context vLLM. The score: 72.9 This matches Gemini 2.5 Pro from 2025-04-12 which also scored 72.9. Beats Claude Opus 4 from 2025-05-

Real local agentic coding on a 12GB VRAM budget.

Model ReleasesDGX agent

Thanks to Unsloth Dynamic 3.0 quants coming in slightly leaner and better preserved, I settled on Qwen 3.8 27B (`UD_Q4_K_XL`) at 100K context as my daily driver for Hermes Agent and OpenCode. On an RT

23 Aug 2026

Has anyone actually made 64k feel like 300k+ with recursive local agents?

Model ReleasesDGX agent

I'm running Qwen 3.8 27B locally on a single GPU. I can push the context to 131k, but I'd rather run it faster at 64k if the agent can manage context properly. What I have in mind is pretty simple: on

21 Aug 2026

A Strong Linear Baseline for Whole-Heart Cardiac Shape Completion on CT, with an Open Eleven-Structure Statistical Shape Model

Model ReleasesDGX agent

arXiv:2608.19932v1 Announce Type: new Abstract: Public cardiac cohorts annotate different subsets of the heart, so shapes from separate sources cannot be pooled without shared correspondence. Among re

BeyondMasks: Evaluating Causal and Physical Consistency in Video Object Removal

Model ReleasesDGX agent

arXiv:2608.20107v1 Announce Type: new Abstract: Recent advances in generative video models have significantly improved visual realism in video object removal, yet evaluation protocols still focus on m

Can Agent Memory Systems Track Evolving State?

Model ReleasesDGX agent

arXiv:2608.19652v1 Announce Type: new Abstract: As LLM-based agents are deployed for longer and higher-stakes tasks, their memory systems continue to have crucial gaps. While existing memory benchmark

Fastest NVFP4 quant of Qwen3.8 27B out there

Model ReleasesDGX agent

Here's a brand new Blackwell-native, prefill-optimized 4-bit quant that runs 50% faster on compatible hardware than a Q4 quant of the same memory footprint. And it runs 4-7% faster than other NVFP4 qu

GRACE: Grounded Reasoning via Adapter Composition and Evidence-Aware Calibration for Educational Visual Question Answering

Model ReleasesDGX agent

arXiv:2608.19355v1 Announce Type: cross Abstract: Educational visual question answering, or VQA, requires models to solve curriculum-oriented multiple-choice questions using both language and visual e

Harvey is a great example of how American companies are building world-class specialized models: they took an open-source base (Kimi K3), po…

TutorialsDGX agent

Harvey is a great example of how American companies are building world-class specialized models: they took an open-source base (Kimi K3), post-trained it on legal data, and delivered state-of-the-art

PersonalBench: Measuring the Authorship Gap in LLM Personalization

Model ReleasesDGX agent

arXiv:2608.19746v1 Announce Type: new Abstract: Personalized text generation aims to make LLMs write in a specific individual's style, yet existing benchmarks measure task accuracy or preference align

Remember, Verify, or Ask? Cross-Family Evaluation of Memory Commitment in LLM Agents

Model ReleasesDGX agent

arXiv:2608.19564v1 Announce Type: new Abstract: Persistent memory can personalize an LLM agent, but an incorrect durable update can silently distort future behavior. We study the memory-clarification

Rule-Compliant Visual Spatial Planning for Multimodal Large Language Models

Model ReleasesDGX agent

arXiv:2608.20237v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) combine linguistic reasoning with visual perception, yet their ability to perform visual spatial planning under

STEP: Score-Based Temporal Energy for Human Pose Video Anomaly Detection

Model ReleasesDGX agent

arXiv:2608.19987v1 Announce Type: new Abstract: Skeleton-based Video Anomaly Detection (VAD) offers a robust, privacy-preserving solution for identifying abnormal behaviors. To model the distribution

Towards Clinically Faithful Medical Image Captioning via Enhanced Vision-Language Alignment

Model ReleasesDGX agent

arXiv:2608.19825v1 Announce Type: cross Abstract: Medical image captioning is a technique that accelerates early-stage diagnostic workflows and enhances the interpretability of medical diagnostic AI s

20 Aug 2026

A FEM-Based Surrogate Modelling and Optimization Framework for Physics-Constrained Electromagnetic Coil Design

Model ReleasesDGX agent

arXiv:2608.18903v1 Announce Type: new Abstract: This work evaluates surrogate-assisted optimization of a seven-parameter current-excited coil--core benchmark subject to geometric, manufacturing, and s

Fine-tuning Cactus Needle 2 can match DeepSeek v4 on the specific task

Model ReleasesDGX agent

Hey LocalLlama, Henry from Cactus here! When we trained Needle 2, I had a strict rule to not expose the model to any data sample that remotely felt like these benchmarks. It seemed over-the-top, but b

FinSkillBench: Evaluating AI Agents and Domain Skills for Investment Management

Model ReleasesDGX agent

arXiv:2608.18099v1 Announce Type: new Abstract: Investment management is a high-stakes domain in which agentic AI systems must do more than generate plausible text. They must retrieve point-in-time da

ForeSightGuide: An Anticipatory Framework toward Accurate and Low-Redundancy Guidance for the Visually Impaired

Model ReleasesDGX agent

arXiv:2608.18993v1 Announce Type: new Abstract: Electronic travel aids are pivotal for the independent mobility of the visually impaired. While Vision-Language Models (VLMs) offer rich environmental u

MAVEN: A Macro-Societal Value Evaluation Framework of Multimodal Content with Compact Aligned Evaluators

Model ReleasesDGX agent

arXiv:2608.18096v1 Announce Type: new Abstract: Assessing whether multimodal content aligns with macro-societal values, such as peace, justice, and freedom, has become an increasingly urgent challenge

MemFuse: Multi-Source Memory Fusion from Fragmented Observations

Model ReleasesDGX agent

arXiv:2608.18704v1 Announce Type: cross Abstract: Long-term memory is essential for agents that operate across extended interactions, yet existing memory systems and benchmarks predominantly focus on

On the Robustness of Vision-Language Models in Zero-shot Privacy Classification

Model ReleasesDGX agent

arXiv:2510.09253v2 Announce Type: replace Abstract: Automatic systems for document understanding require multimodal models that accurately identify sensitive visual content, even in the presence of im

StateTrace: An Object-Centric Framework for Hidden-State Spatiotemporal Reasoning in Long Videos

Model ReleasesDGX agent

arXiv:2608.18532v1 Announce Type: new Abstract: Existing VLMs have achieved strong performance in video understanding, yet they struggle with long-video spatiotemporal reasoning when target objects be

Task-Conditioned Least-Privilege Learning for Executable Terminal and MCP Agents

Model ReleasesDGX agent

arXiv:2608.18351v1 Announce Type: cross Abstract: Tool-using large language-model agents can complete a task while exercising authority that the user did not grant or the task does not need, causing e

UMER: Unifying Embedding and Ranking via Pair-Aware Discriminative Reasoning for Universal Multimodal Retrieval

Model ReleasesDGX agent

arXiv:2608.18504v1 Announce Type: new Abstract: Universal multimodal retrieval aims to support diverse instruction-aware retrieval tasks, demanding both efficient corpus-scale matching and fine-graine

VTONQA: A Multi-Dimensional Quality Assessment Dataset for Virtual Try-on

Model ReleasesDGX agent

arXiv:2601.02945v2 Announce Type: replace Abstract: With the rapid development of e-commerce and digital fashion, image-based virtual try-on (VTON) has attracted increasing attention. However, existin

19 Aug 2026

Domain-Adapted Molecular Language Models for Efficient Search of Make-on-Demand Libraries

Model ReleasesDGX agent

arXiv:2608.17567v1 Announce Type: cross Abstract: Pretrained molecular language models are increasingly used as molecular encoders for learning structure-property relationships. However, their practic

Effects of Answer Format Variation on Gender Bias in Large Language Models

Model ReleasesDGX agent

arXiv:2608.17516v1 Announce Type: new Abstract: Gender bias or other social biases in large language models (LLMs) are frequently evaluated with question answering or survey benchmarks where the LLM n

Efficient Dynamic Shielding for Parametric Safety Specifications

Model ReleasesDGX agent

arXiv:2505.22104v2 Announce Type: replace Abstract: Shielding has emerged as a promising approach for ensuring safety of AI-controlled autonomous systems. The algorithmic goal is to compute a shield,

Explicit State Elicitation Is Not Enough: A Controlled Audit of Memory-Policy Classification

Model ReleasesDGX agent

arXiv:2608.17247v1 Announce Type: new Abstract: Personalized agents must decide whether retrieved user memory should be used, ignored, updated, or queried before it affects a current task. We use this

Foundation Agents Meet Agentic Deep Research: Evidence-Grounded Clinical Code Forecasting

Model ReleasesDGX agent

arXiv:2608.17075v1 Announce Type: cross Abstract: Next-encounter ICD forecasting predicts which standardized diagnosis codes will be documented at a future visit from the longitudinal record available

PathoArgus: Advancing Evidence-Grounded Long-Context Visual Reasoning across Gigapixel Whole-Slide and Multi-Slide Case Contexts

Model ReleasesDGX agent

arXiv:2608.17607v1 Announce Type: new Abstract: Whole-slide pathology reasoning requires models to integrate gigapixel-scale visual evidence across complete case-linked slides, yet current question-an

SW-ProxyCE: Zero-Query Adversarial Transfer from Public EEG Encoders to Private Downstream Models

Model ReleasesDGX agent

arXiv:2608.16931v1 Announce Type: new Abstract: Electroencephalography (EEG) foundation models have recently emerged as a promising paradigm for EEG decoding by learning reusable representations from

Temporal Leakage in Financial News NLP: A Multi-Architecture Audit with a Regime-Specific M&A Signal

Model ReleasesDGX agent

arXiv:2608.17223v1 Announce Type: new Abstract: Financial-news direction prediction has become a popular NLP benchmark, yet reported gains depend critically on whether the train-test split is chronolo

18 Aug 2026

Beyond Pass@k: Measuring Reliability and Security of Agentic Code Generation

Model ReleasesDGX agent

arXiv:2608.14711v1 Announce Type: new Abstract: AI coding agent benchmarks rank agents with the Chen et al. (2021) pass@k estimator, but current implementations misapply it: they set n to the number o

Do Uncertainty Signals Help? A Systematic Study of Uncertainty-Aware Decoding with Rollback Mechanisms

ResearchDGX agent

arXiv:2608.14653v1 Announce Type: cross Abstract: Prediction uncertainty is a widely adopted metric for quantifying model confidence, with downstream applications spanning model explanation, data sele

← Previous
1…104105106107108…546
Next →