Search: “benchmark”

STEP: Score-Based Temporal Energy for Human Pose Video Anomaly Detection

arXiv:2608.19987v1 Announce Type: new Abstract: Skeleton-based Video Anomaly Detection (VAD) offers a robust, privacy-preserving solution for identifying abnormal behaviors. To model the distribution

21 Aug 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Towards Clinically Faithful Medical Image Captioning via Enhanced Vision-Language Alignment

DGX agent

arXiv:2608.19825v1 Announce Type: cross Abstract: Medical image captioning is a technique that accelerates early-stage diagnostic workflows and enhances the interpretability of medical diagnostic AI s

model-releasesarxiv-cs-cl

21 Aug 2026

A FEM-Based Surrogate Modelling and Optimization Framework for Physics-Constrained Electromagnetic Coil Design

model-releasesarxiv-cs-lg

arXiv:2608.18903v1 Announce Type: new Abstract: This work evaluates surrogate-assisted optimization of a seven-parameter current-excited coil--core benchmark subject to geometric, manufacturing, and s

Fine-tuning Cactus Needle 2 can match DeepSeek v4 on the specific task

model-releasesr-localllama

Hey LocalLlama, Henry from Cactus here! When we trained Needle 2, I had a strict rule to not expose the model to any data sample that remotely felt like these benchmarks. It seemed over-the-top, but b

FinSkillBench: Evaluating AI Agents and Domain Skills for Investment Management

arXiv:2608.18099v1 Announce Type: new Abstract: Investment management is a high-stakes domain in which agentic AI systems must do more than generate plausible text. They must retrieve point-in-time da

ForeSightGuide: An Anticipatory Framework toward Accurate and Low-Redundancy Guidance for the Visually Impaired

arXiv:2608.18993v1 Announce Type: new Abstract: Electronic travel aids are pivotal for the independent mobility of the visually impaired. While Vision-Language Models (VLMs) offer rich environmental u

MAVEN: A Macro-Societal Value Evaluation Framework of Multimodal Content with Compact Aligned Evaluators

arXiv:2608.18096v1 Announce Type: new Abstract: Assessing whether multimodal content aligns with macro-societal values, such as peace, justice, and freedom, has become an increasingly urgent challenge

MemFuse: Multi-Source Memory Fusion from Fragmented Observations

arXiv:2608.18704v1 Announce Type: cross Abstract: Long-term memory is essential for agents that operate across extended interactions, yet existing memory systems and benchmarks predominantly focus on

On the Robustness of Vision-Language Models in Zero-shot Privacy Classification

arXiv:2510.09253v2 Announce Type: replace Abstract: Automatic systems for document understanding require multimodal models that accurately identify sensitive visual content, even in the presence of im

StateTrace: An Object-Centric Framework for Hidden-State Spatiotemporal Reasoning in Long Videos

arXiv:2608.18532v1 Announce Type: new Abstract: Existing VLMs have achieved strong performance in video understanding, yet they struggle with long-video spatiotemporal reasoning when target objects be

Task-Conditioned Least-Privilege Learning for Executable Terminal and MCP Agents

arXiv:2608.18351v1 Announce Type: cross Abstract: Tool-using large language-model agents can complete a task while exercising authority that the user did not grant or the task does not need, causing e

UMER: Unifying Embedding and Ranking via Pair-Aware Discriminative Reasoning for Universal Multimodal Retrieval

arXiv:2608.18504v1 Announce Type: new Abstract: Universal multimodal retrieval aims to support diverse instruction-aware retrieval tasks, demanding both efficient corpus-scale matching and fine-graine

VTONQA: A Multi-Dimensional Quality Assessment Dataset for Virtual Try-on

arXiv:2601.02945v2 Announce Type: replace Abstract: With the rapid development of e-commerce and digital fashion, image-based virtual try-on (VTON) has attracted increasing attention. However, existin

Domain-Adapted Molecular Language Models for Efficient Search of Make-on-Demand Libraries

arXiv:2608.17567v1 Announce Type: cross Abstract: Pretrained molecular language models are increasingly used as molecular encoders for learning structure-property relationships. However, their practic

Effects of Answer Format Variation on Gender Bias in Large Language Models

arXiv:2608.17516v1 Announce Type: new Abstract: Gender bias or other social biases in large language models (LLMs) are frequently evaluated with question answering or survey benchmarks where the LLM n

Efficient Dynamic Shielding for Parametric Safety Specifications

arXiv:2505.22104v2 Announce Type: replace Abstract: Shielding has emerged as a promising approach for ensuring safety of AI-controlled autonomous systems. The algorithmic goal is to compute a shield,

Explicit State Elicitation Is Not Enough: A Controlled Audit of Memory-Policy Classification

arXiv:2608.17247v1 Announce Type: new Abstract: Personalized agents must decide whether retrieved user memory should be used, ignored, updated, or queried before it affects a current task. We use this

Foundation Agents Meet Agentic Deep Research: Evidence-Grounded Clinical Code Forecasting

arXiv:2608.17075v1 Announce Type: cross Abstract: Next-encounter ICD forecasting predicts which standardized diagnosis codes will be documented at a future visit from the longitudinal record available

PathoArgus: Advancing Evidence-Grounded Long-Context Visual Reasoning across Gigapixel Whole-Slide and Multi-Slide Case Contexts

arXiv:2608.17607v1 Announce Type: new Abstract: Whole-slide pathology reasoning requires models to integrate gigapixel-scale visual evidence across complete case-linked slides, yet current question-an

SW-ProxyCE: Zero-Query Adversarial Transfer from Public EEG Encoders to Private Downstream Models

model-releasesarxiv-cs-lg

arXiv:2608.16931v1 Announce Type: new Abstract: Electroencephalography (EEG) foundation models have recently emerged as a promising paradigm for EEG decoding by learning reusable representations from

Temporal Leakage in Financial News NLP: A Multi-Architecture Audit with a Regime-Specific M&A Signal

arXiv:2608.17223v1 Announce Type: new Abstract: Financial-news direction prediction has become a popular NLP benchmark, yet reported gains depend critically on whether the train-test split is chronolo

Beyond Pass@k: Measuring Reliability and Security of Agentic Code Generation

arXiv:2608.14711v1 Announce Type: new Abstract: AI coding agent benchmarks rank agents with the Chen et al. (2021) pass@k estimator, but current implementations misapply it: they set n to the number o

Research

Do Uncertainty Signals Help? A Systematic Study of Uncertainty-Aware Decoding with Rollback Mechanisms

arXiv:2608.14653v1 Announce Type: cross Abstract: Prediction uncertainty is a widely adopted metric for quantifying model confidence, with downstream applications spanning model explanation, data sele

researcharxiv-cs-ai

Graph Machine Learning: An Opportunity for Power Systems

arXiv:2608.16494v1 Announce Type: cross Abstract: Modern power systems face growing operational complexity driven by the integration of renewable energy sources, decentralization, and the need for rea

HLE-Verified: A Systematic Verification and Structured Revision of Humanity's Last Exam

arXiv:2602.13964v4 Announce Type: replace Abstract: Humanity's Last Exam (HLE) has become a widely used benchmark for evaluating frontier large language models on challenging, multi-domain questions.

Listen, Reason, and Segment: Aligning LALMs with Editorial Judgment for Media Chapterization

arXiv:2608.16539v1 Announce Type: cross Abstract: Large Audio Language Models (LALMs) have made rapid progress on standardized benchmarks, yet their deployment in practical media workflows, curation,

Safety

LLM Safety Alignment in Low-Resource Languages: A Systematic Literature Review

arXiv:2608.14626v1 Announce Type: cross Abstract: Large Language Models (LLMs) have achieved substantial progress in safety alignment, yet their safety guarantees remain significantly weaker in low-re

safetyarxiv-cs-ai

What Do Compliance Detectors Read? An Audit of Activation Probes and Guard Models

arXiv:2608.16852v1 Announce Type: new Abstract: Regulatory compliance monitoring in deployed language models is increasingly implemented as a legal and audit control, checking model outputs against wr

Whose Gold? Annotator-Pool Disagreement Is Large at the Item Level, and Hidden by Small Leaderboards

arXiv:2608.15980v1 Announce Type: new Abstract: Preference benchmarks are built by hiring annotators, and the identity of those annotators is treated as an implementation detail. We measure what that

A Pathway to General-Purpose Scientific AI: Multimodal Comprehension of Scientific Images

arXiv:2608.14075v1 Announce Type: new Abstract: Scientific figures and tables encode essential experimental evidence, yet remain difficult for digital libraries and multimodal AI systems to retrieve a

From Passive Delegates to Strategic Negotiators: Reinforcing Social Reasoning in Small Language Models with SocialRL

arXiv:2608.13787v1 Announce Type: new Abstract: AI agents increasingly act on their users' behalf, handling tasks such as scheduling meetings, comparing offers, and haggling over prices. These princip

Implementing Computational Law in Wolfram Language for the Governance of Artificial Intelligence

arXiv:2608.13958v1 Announce Type: new Abstract: How do we govern AI systems whose reasoning we cannot fully inspect? Governance does not require understanding a system's reasoning. It requires stating

Ordinal-Aware Calibration for Ordinal Classification

arXiv:2410.15658v4 Announce Type: replace-cross Abstract: Deep neural networks frequently produce overconfident, miscalibrated predictions. In ordinal classification, predictions must also adhere to a

PRM-as-a-Judge 1.5: A Toolkit for Robot Process Assessment

arXiv:2608.14284v1 Announce Type: cross Abstract: Fine-grained robotic evaluation matters for understanding embodied models, going beyond binary success rates and rule-based process scores. We present

Reinforcement Learning-Based Production Scheduling in an Industry-Based Coating Scenario Using the Digital Model Playground

arXiv:2608.14122v1 Announce Type: new Abstract: Production scheduling in complex manufacturing environments is challenging when sequence-dependent setup times, stochastic disturbances, and due-date co

Qwen 3.8 27B is excellent, but it defaults to wildly overthinking things

model-releasessimon-willison

Friday's big release was Qwen 3.8 27B, an Apache 2 licensed 27B parameter vision-capable LLM from Alibaba's Qwen research lab. I've been looking forward to this one: 27B is an excellent size for runni

16 Aug 2026

Beyond Visual Evidence: Revealing and Mitigating Relational Privacy Leakage in Document MLLMs

arXiv:2608.12911v1 Announce Type: new Abstract: While the privacy risks of multimodal large language models (MLLMs) have drawn significant attention, the unique vulnerabilities of domain-specific MLLM

DeepSeek-V4-Pro-0813 is live Day-0 on Fireworks! Built for agentic and tool-augmented workflows, it outperforms Opus 4.8 on quality benchmar…

model-releasesfireworks-ai--x

DeepSeek-V4-Pro-0813 is live Day-0 on Fireworks! Built for agentic and tool-augmented workflows, it outperforms Opus 4.8 on quality benchmarks like Terminal Bench 2.1, Cybergym, and DeepSWE at up to 6

Don't Want Your LLM to Recommend Nuclear Strike? Try Asking It in Japanese

arXiv:2608.12373v1 Announce Type: new Abstract: Large language models are increasingly used in strategic and advisory contexts, yet their safety alignment is typically evaluated in English only. We te

HC-RAG: Evidence-Centric Retrieval-Augmented Generation over Heterogeneous Financial Filings

arXiv:2608.12335v1 Announce Type: new Abstract: Financial question answering over annual reports requires more than retrieving semantically similar passages. It often involves identifying relevant com

How Do VLMs Behave When Blind or Misled? Behavioral Evaluation of VLMs on Scientific Figures

arXiv:2608.13267v1 Announce Type: cross Abstract: Existing vision-language model (VLM) benchmarks emphasize perception and reasoning accuracy (how well VLMs describe and reason about what they see in

Large-scale Testing Global Optimization Methods with Black-box Adversarial Attacks

arXiv:2608.13296v1 Announce Type: cross Abstract: Existing global optimization benchmark suites are of a moderate size and are based on a small number of analytical functions that date back even to th

Research

Numeracy in Large Language Models: Fundamental Limitations and Paths to Improvement

arXiv:2608.13129v1 Announce Type: new Abstract: Large language models (LLMs) achieve strong results on mathematical reasoning benchmarks yet remain unreliable on elementary numerical tasks, including

researcharxiv-cs-ai

Polish Medical Visual Question Answering: Vision-Language Models Underutilize Visual Evidence

arXiv:2608.12928v1 Announce Type: new Abstract: We introduce a Polish-language medical visual question answering (VQA) benchmark, built from Polish Board Certification Examination questions for licens

Privacy-Preserving RAG by Concealing Sensitive Information from External LLMs

arXiv:2608.12675v1 Announce Type: new Abstract: Retrieval-Augmented Generation (RAG) is widely used to improve the performance of Large Language Models (LLMs) in answering user queries. Existing priva

Revolutionizing Finance with LLMs: An Overview of Applications and Insights

arXiv:2401.11641v5 Announce Type: replace Abstract: In recent years, Large Language Models (LLMs) like ChatGPT have seen considerable advancements and have been applied in diverse fields. Built on the

Scaling Representation Diversity: Modulated Attention and Reconstructive Regularization for Visual Grounding

arXiv:2608.12748v1 Announce Type: new Abstract: Referring Expression Comprehension (REC) is commonly studied under dataset-specific fine-tuning, resulting in specialist models with limited cross-datas

Spatial Memory Agent: Experience-Grounded Procedure Memory for Spatial Intelligence

arXiv:2608.12743v1 Announce Type: new Abstract: Spatial intelligence is becoming a foundation for embodied agents, robotic planning, and multimodal assistants. To improve the spatial reasoning ability