Search: “benchmark”

BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agents

arXiv:2609.12394v2 Announce Type: replace Abstract: Mobile GUI agents are shifting from multi-module frameworks to native models trained end-to-end, yet industrial deployment faces three persistent ga

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Bridging the Gap in ECG-Based Emotion Recognition: A Unified Evaluation of Deep Learning Models

DGX agent

arXiv:2609.15055v1 Announce Type: cross Abstract: Deep learning has led to numerous proposed architectures for Automated Emotion Recognition (AER) from electrocardiogram (ECG) data, but inconsistencie

model-releasesarxiv-cs-lg

15 Sept 2026

CAL-MOS: Bridging Layers with Adapters for Robust MOS Prediction Across Speech Foundation Models

arXiv:2609.14956v1 Announce Type: cross Abstract: Speech Quality Assessment (SQA) is essential for modern speech technologies, and recent non-intrusive SQA predictors increasingly rely on Speech Found

Chemical and geometric representation fidelity improves drug--target affinity prediction

arXiv:2609.13230v1 Announce Type: cross Abstract: Predicting drug--target binding affinity (DTA) requires models to distinguish subtle chemical and structural determinants underlying molecular recogni

Agents

CoArena: Evaluating Computer-Use and Multi-Agent Systems in Real Time

arXiv:2609.14239v1 Announce Type: new Abstract: Static benchmarks for computer-use agents fix a task set at release and score every system against it once. That makes them reproducible, and it lets th

agentsarxiv-cs-lg

Diagnosing Faults in Reinforcement Learning Simulators and World Models with Canonical Polynomial Invariants

arXiv:2609.13194v1 Announce Type: cross Abstract: A large literature builds physical structure into learned dynamics on the premise that models respecting the underlying physics predict better. We tes

Efficiency Hallucination: Formalizing and Measuring Behavioral Calibration in LLM-Based Code Optimization

arXiv:2609.14839v1 Announce Type: cross Abstract: The integration of Large Language Models (LLMs) into automated code optimization introduces a critical reliability risk we term the Efficiency Halluci

Research

Evaluation of MLLM-Agnostic Plug-and-Play Keyframe Selection Methods for Long Video Understanding

arXiv:2609.13250v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) cannot process every frame of a long video because of limitations in visual-token and computational budgets.

researcharxiv-cs-ai

Fusing Spectral Signatures and Activation Clustering for Backdoor Detection in Healthcare Imaging Models: Method, Implementation, and Evaluation

arXiv:2609.14290v1 Announce Type: cross Abstract: Machine learning models are increasingly deployed in healthcare imaging pipelines for diagnostic support, and training-time attacks against them are a

HazardAuditor: From Executable Threats to Safer Computer-Use Agents

arXiv:2609.15134v1 Announce Type: new Abstract: Computer-use agents increasingly interact with browsers, terminals, file systems, and external services, introducing safety risks that emerge through ru

Hindsight Bias in Clinical Temporal Reasoning: How Future Data Exposure Affects Large Language Model Judgment

arXiv:2609.13454v1 Announce Type: cross Abstract: Clinical decisions are prospective, but clinical language models are often evaluated on retrospective records that reveal the final diagnosis, treatme

Interpretable Temporal Video Reasoning with EventGraph and EventField

arXiv:2609.13258v1 Announce Type: cross Abstract: We present a structured temporal video reasoning pipeline built around a discrete EventGraph, a continuous EventField, and a human-readable EventGlyph

Language-Guided Representation Learning for Robust Cross-Sensor Material Recognition

arXiv:2609.14783v1 Announce Type: cross Abstract: Robots need touch to manipulate objects safely and reliably, as many properties, such as softness, texture, and contact stability, are hard to infer f

LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents

arXiv:2609.13287v1 Announce Type: cross Abstract: Diffusion large language models (dLLMs) achieve high decoding efficiency through block-parallel, arbitrary-order generation, making them attractive fo

LLM Probability Concentration: How Alignment Shrinks the Generative Horizon

arXiv:2506.17871v4 Announce Type: replace-cross Abstract: Despite their impressive capabilities, aligned large language models (LLMs) often generate outputs that lack diversity. What drives this consi

MambaMPD: A Mamba-Driven Segmentation Framework for Marine Pollution Detection from Remote Sensing Imagery

arXiv:2609.15676v1 Announce Type: new Abstract: Accurate marine pollution detection (MPD) is essential for protecting coastal ecosystems and marine biodiversity. Vision Mamba models have shown promise

Tutorials

Part Grounding, Not Action Knowledge: Locating the Bottleneck in VLM Affordance Prediction

arXiv:2609.13225v1 Announce Type: new Abstract: Benchmarks agree that vision-language models reason poorly about low-level manipulation, but an aggregate accuracy score does not say which step fails.

tutorialsarxiv-cs-cv

POLARIS: Training-Free Audio Fingerprinting with Saliency-Based Landmarks and Delaunay Grouping

arXiv:2609.14820v1 Announce Type: cross Abstract: This work presents POLARIS, a training-free audio fingerprinting system that selects landmarks from a locally normalized saliency field and groups the

Positioning manuscripts in the scientific landscape with agentic AI

arXiv:2609.13760v1 Announce Type: new Abstract: Publishing a research manuscript is a routine yet demanding part of scientific life: time-consuming, stressful, and often uncertain in outcome. Recent a

Reconstructing Is Not Acting: Action-Centric Latent Dynamics Modeling

arXiv:2609.15189v1 Announce Type: new Abstract: Latent action models (LAMs) learn action representations from unlabeled videos by inferring latent actions from visual transitions and reconstructing fu

Rolling Day-Wise Mortality Prediction in Critically Ill Patients With AKI on CRRT Utilizing Machine Pressure Waveforms

arXiv:2609.13524v1 Announce Type: cross Abstract: Critically ill patients with acute kidney injury (AKI) on continuous renal replacement therapy (CRRT) face high mortality, yet current risk assessment

Sanity Checking Causal Representation Learning on a Simple Real-World System

arXiv:2502.20099v3 Announce Type: replace-cross Abstract: We evaluate methods for causal representation learning (CRL) on a simple, real-world system that satisfies the basic problem setup of CRL. The

Scalable partial information decomposition for symptom networks via supervised embeddings

arXiv:2609.13203v1 Announce Type: new Abstract: Pairwise relationships among mental-health symptoms are routinely summarised asscalar edge weights, which cannot express whether two symptoms carry over

SENTINEL: A Multi-Pathway Architecture for Detecting Living-Off-the-Land APT Attacks on Windows Command Lines

arXiv:2609.14593v1 Announce Type: cross Abstract: Living-Off-the-Land (LOTL) is the dominant evasion technique of Advanced Persistent Threat (APT) actors, exploiting legitimate Windows utilities to co

SkillAtlas: An Attack Trace Library for Agent Skills

arXiv:2609.13353v1 Announce Type: cross Abstract: Agent skills are reusable units for language-model agents, but their risks emerge through model decisions, user context, tool calls, and execution fee

Small Object Detection in Drone Aerial Imagery with LAF-YOLOv10

arXiv:2609.14560v1 Announce Type: new Abstract: General-purpose object detectors lose accuracy on UAV footage, where targets span only a handful of pixels and onboard compute is limited. Prior work co

Industry

So @deepseek_ai v4.1 Flash I estimate cost $10m to train, 100x less than GPT-6 Astra. It also costs 100x less to run and scores about the sa…

So @deepseek_ai v4.1 Flash I estimate cost $10m to train, 100x less than GPT-6 Astra. It also costs 100x less to run and scores about the same on everyday design and other benchmarks What's the bull c

industryemad-mostaque--x

TEAR: Table Extraction with Attribute Recommendation from Texts via Large Language Models

arXiv:2609.15205v1 Announce Type: cross Abstract: Table extraction from texts is an important task for information systems, and recent approaches that prompt large language models (LLMs) with instruct

The Universe of Universes: Benefit Yield Functions, Implosion Thresholds, and Infrastructure-Aware Optimization in Multi-LLM Systems

arXiv:2609.15314v1 Announce Type: cross Abstract: We introduce the Universe of Universes (UoU) framework, which treats the full ecosystem of major large language models (LLMs) as a structured retrieva

To See is Not to Master: Teaching LLMs to Use Private Libraries for Code Generation

arXiv:2603.15159v5 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have shown strong potential for code generation, yet they remain limited in private-library-oriented code generat

Hardware

Towards Practical Precision Agriculture: Real-Time Fruit Detection and Video Analytics on Embedded Edge Hardware

arXiv:2609.13551v1 Announce Type: new Abstract: Static-image benchmarks do not capture the computational and temporal requirements of practical orchard video analytics. This study presents an end-to-e

hardwarearxiv-cs-cv

Research

Transfer Learning for Socioeconomic Estimation in Forced-Displacement Settings

arXiv:2609.15773v1 Announce Type: cross Abstract: Progress in inclusive household surveys has strengthened socioeconomic evidence for forcibly displaced populations, providing indispensable benchmarks

researcharxiv-cs-ai

VideoScout: Learning Agentic Active Exploration with Adaptive Reasoning Pacing for Long Video Understanding

arXiv:2609.15606v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) have achieved remarkable progress on short video understanding yet remain limited on long videos due to the l

What Does the Encoder Actually Decide? A Controlled Comparison of Vision Backbones on Joint Tree Segmentation and Stereo Depth

arXiv:2609.13232v1 Announce Type: new Abstract: A robot pruning trees needs two facts per pixel: whether it belongs to a tree, and its distance. Both are usually obtained via task heads attached to a

Adaptive Chemotherapy Control under Tumor Heterogeneity via Reinforcement Learning

arXiv:2609.12264v1 Announce Type: new Abstract: Designing effective chemotherapy regimens is hindered by tumor heterogeneity and drug resistance, which complicate the deployment of patient-specific mo

Animated transition from AA Intelligence Index v4.1 to v4.3

model-releasesr-localllama

I had all the data saved from AA's v4.1 index, so when they upgraded it in the wake of Astra's release, I could actually generate a before/after comparison. All intelligence and price per task are sam

Tutorials

Beyond Ambiguous Visual Cues: Studying Physiological Disruptions and Cross-Modal Inconsistencies in Deepfake Videos

arXiv:2609.12668v1 Announce Type: new Abstract: Recent deepfake detection studies increasingly suggest remote photoplethysmography (rPPG) signals as an authenticity cue. However, existing benchmarks l

tutorialsarxiv-cs-cv

Certified AI Triage of ICU Alarms

arXiv:2609.12365v1 Announce Type: new Abstract: In the VTaC benchmark 71% of ventricular-tachycardia alarms are false, but silencing a real one can delay recognition of a dangerous arrhythmia. We refr

Dan Selsam is a current OpenAI capabilities researcher. (since 2022) He was my boss for a while. He doesn't have a twitter account but has m…

model-releasessonya-huang--x

Dan Selsam is a current OpenAI capabilities researcher. (since 2022) He was my boss for a while. He doesn't have a twitter account but has made this public statement of his views on AI risk and sent i

ExpertHTR: Unified Handwritten Text Recognition with Multi-Task Learning and Sparse Mixture-of-Experts

arXiv:2609.12705v1 Announce Type: new Abstract: Handwritten text recognition resources are often small and distributed across collections that differ in language, script, document structure, and annot

HypoKG: Evidence-Disciplined Biomedical Hypothesis Generation Beyond Endpoint Knowledge

arXiv:2609.12260v1 Announce Type: new Abstract: Large language models (LLMs) can generate biomedical hypotheses, but it remains unclear whether they truly reason from scientific evidence or simply pro

Local Edits, Global Ripples: Replay-Informed Policy Adaptation for Workflow Synthesis

arXiv:2609.12127v1 Announce Type: new Abstract: Prompt-policy editing offers a practical way to improve agents that synthesize executable workflows without updating the underlying model. However, pers

Meddies-PII: A Multilingual Framework for Personally Identifiable Information Extraction in Clinical De-identification

arXiv:2609.12544v1 Announce Type: new Abstract: Clinical de-identification relies on accurately identifying personally identifiable information (PII). However, manually annotated datasets are costly t

MP-Bench: Evaluating Voice Agents as a Multiparty Conversation Participant

arXiv:2609.13076v1 Announce Type: cross Abstract: Conversational voice agents have advanced significantly, offering increasingly natural human-machine interactions through both cascaded and end-to-end

One Skill Does Not Fit All: Automatic Discovery and Taxonomy-Guided Routing of Frame-Selection Skills for Long-Video Question Answering

arXiv:2609.12517v1 Announce Type: new Abstract: Long-Video Question Answering (LVQA) requires locating decisive evidence in hour-scale videos under a limited frame budget. Most training-free methods a

PA-CDM: Position-Aware Character Detection Matching for Evaluating Handwritten Mathematical Expression Recognition

arXiv:2609.12917v1 Announce Type: cross Abstract: Handwritten mathematical expression recognition (HMER) is conventionally scored by exact-match rates and string-similarity metrics that are blind to w

SUCCESS-GS: Survey of Compactness and Compression for Efficient Static and Dynamic Gaussian Splatting

arXiv:2512.07197v2 Announce Type: replace Abstract: 3D Gaussian Splatting (3DGS) has emerged as a powerful explicit representation enabling real-time, high-fidelity 3D reconstruction and novel view sy

SWARM: A Multilingual Human-Annotated Dataset for Russian Propaganda Detection in Search Engine Results

arXiv:2609.12653v1 Announce Type: new Abstract: Russian state propaganda spreads across many languages and online spaces. Yet, most computational work examines only one such space, usually social medi