Search: “benchmark”

Fortunate Recall: Ontology-Driven Memory Lifecycle Management for Persistent Coherence in LLMs

arXiv:2609.10413v1 Announce Type: new Abstract: Current LLM memory systems treat all personal facts identically, so stores grow without bound while retrieval precision degrades. The core challenge is

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

LAION-Mobile: Evaluating Deepfake Detectors On One Million Smartphone Photos

DGX agent

arXiv:2609.11134v1 Announce Type: new Abstract: Most Deepfake detectors report near-perfect AUC scores on their reference benchmarks. However, a recent ICML position paper argues that these evaluation

local-aiarxiv-cs-cv

11 Sept 2026

Learning structural balance of graphs from quantum spectral features

arXiv:2609.11736v1 Announce Type: cross Abstract: We develop a quantum approach to spectral feature extraction from the density of states (DOS) of a problem-dependent Hamiltonian, and apply it to mach

Measuring Progress in Reasoning Toward Mathematical Discovery with Automatic Verification

arXiv:2603.15617v2 Announce Type: replace Abstract: Can AI make progress on important, unsolved mathematical problems? Large language models are now capable of sophisticated mathematical and scientifi

Optimizing AI Inference Across the Deployment Stack

arXiv:2609.10550v1 Announce Type: cross Abstract: AI deployment performance is shaped not by model architecture alone, but by interactions among compression, compiler transformations, and serving poli

PRAGMA: Evaluating Personalized Guidance with Memory Alignment in Lifelong Conversations

arXiv:2609.09664v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed as personalized assistants that interact with users over extended periods of time. As conversatio

RESCUE-BENCH: Towards Relation-Aware Multi-Party Emotional Support Conversation Systems

arXiv:2609.09657v1 Announce Type: new Abstract: Existing emotional support conversation systems mainly focus on one-on-one seeker-supporter interactions and individual emotional states, leaving interp

RetroThinker: Enabling Retrospective Thinking in Speech LLMs

arXiv:2609.11864v1 Announce Type: cross Abstract: Speech large language models (SpeechLLMs) offer reduced latency and retain paralinguistic nuances that are typically lost in cascaded automatic speech

Studying Without a Syllabus: Task-Agnostic Environment Preprocessing

arXiv:2609.10824v1 Announce Type: cross Abstract: Before an LLM agent tackles tasks in a new environment, it can inspect available corpora and tools and construct reusable resources such as indices, s

A Later Test Set Is Not a New Domain: Pretraining Familiarity Survives a Contamination-Free Hold-Out

arXiv:2609.10357v1 Announce Type: new Abstract: Time-series foundation models are evaluated almost exclusively on public archives that predate them, so a strong score cannot be separated from having s

A visual large language foundational model for medical image recognition using clinician-oriented social media

arXiv:2609.06914v1 Announce Type: new Abstract: Large language models (LLMs) have demonstrated strong capabilities across diverse domains, showing considerable potential in medicine. However, their ap

Alignment Whack-a-Mole : Finetuning Activates Verbatim Recall of Copyrighted Books in Large Language Models

arXiv:2603.20957v4 Announce Type: replace-cross Abstract: Frontier LLM companies have repeatedly assured courts and regulators that their models do not store copies of training data. They further rely

Automated Design of Inventory Policy with Large Language Models: An Exploratory Study

arXiv:2609.08071v1 Announce Type: new Abstract: Firms making inventory decisions have access to operational data, optimization tools, and large language models (LLMs). Typically, data characterize the

Beyond One-Size-Fits-All: Sample-Adaptive Strategy Routing for Vision Token Pruning in MLLMs

arXiv:2609.10346v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) process hundreds or thousands of visual tokens per image, incurring prohibitive inference costs. While existing

Research

BIO-MEMART: Biometric-Aware KV Cache Memory for Multi-User LLM Agents

arXiv:2609.08566v1 Announce Type: new Abstract: KV cache is evolving from a serving optimization into an external memory substrate for long-term LLM agents. In a shared multi-user deployment, however,

researcharxiv-cs-ai

CHIMERA Challenge Task 2 and 3: Response Subtypes Classification and Progression Survival Prediction in Bladder Cancer Patients using Multimodal Datasets

arXiv:2609.09510v1 Announce Type: cross Abstract: High-risk non-muscle-invasive bladder cancer (HR-NMIBC) carries substantial risks of recurrence and progression, while current clinical risk stratific

Closing the Consistency Gap: Self-Evolving Agents That Learn to Stay on Course

arXiv:2609.08832v1 Announce Type: new Abstract: Large language model (LLM)-powered agents can be accurate on average yet unreliable in production, a discrepancy that has been observed but remains larg

Do Web Agents Investigate Before They Decide?

arXiv:2602.05354v3 Announce Type: replace Abstract: Autonomous web agents are increasingly deployed in moderation and policy enforcement, where correct decisions often depend on evidence that is not i

DSAEval: Evaluating Data Science Agents on a Wide Range of Real-World Data Science Problems

arXiv:2601.13591v3 Announce Type: replace Abstract: Recent LLM-based data agents aim to automate data science tasks ranging from data analysis to deep learning. However, the open-ended nature of real-

From Symbolic Perception to Logical Deduction: A Framework for Guiding Language Models in Geometric Reasoning

arXiv:2609.10335v1 Announce Type: cross Abstract: Plane geometry remains a significant challenge in AI, requiring the integration of visual perception and mathematical reasoning. While Large Multimoda

GANDR: Claim Auditing for Verifiable Legal Answer Generation

arXiv:2609.10293v1 Announce Type: new Abstract: In high-stakes domains such as legal practice, a language-model answer is only useful to the extent that a reader can verify each claim against the sour

OntoKG-EQ: A provenance-grounded, competency-question-governed knowledge graph for auditable analyst querying

arXiv:2609.08869v1 Announce Type: cross Abstract: Analysts in emerging equity markets keep answering the same questions. Did fundamentals match the market's response? How does the local currency co-mo

OntologyAligner: Ontology-Aligned Retrieval and Hierarchy-Guided Large Language Model Reranking for Biomedical Ontology Normalization

arXiv:2609.10055v1 Announce Type: cross Abstract: Biomedical ontology normalization maps free-text expressions to standardized concepts, enabling consistent integration and analysis of biomedical data

Programmable World Model

arXiv:2609.10540v1 Announce Type: new Abstract: Recent video world models generate increasingly realistic and interactive visual experiences, yet lack reliable mechanisms for maintaining persistent wo

RAP: Research Attention Prediction Reveals Target-Conditioned Evidence Acquisition Biases

arXiv:2609.10092v1 Announce Type: cross Abstract: Large language models (LLMs) increasingly act as research agents, yet their ability to track shifts in research attention is difficult to evaluate bec

Reasoning-Aware Compression: Identifying and Protecting Vulnerable Reasoning Circuits for Energy-Efficient LLM Deployment

arXiv:2609.05512v1 Announce Type: new Abstract: Large Reasoning Models (LRMs) impose substantial energy costs during deployment, yet current compression methods apply uniform quantization across all c

Scoring Without the Engine: Validating a Deterministic, Manipulation-Resistant Content Score for Generative Engines, End to End

arXiv:2609.07559v1 Announce Type: new Abstract: How do you validate a cheap, deterministic proxy for an oracle that is expensive, rate-limited, and non-stationary? We present a protocol built on adver

Staying on the Attack Path: Structured State for Long-Horizon Automated Penetration Testing

arXiv:2609.07344v1 Announce Type: cross Abstract: Large language model (LLM) based agents are increasingly applied to cybersecurity tasks such as vulnerability discovery and automated penetration test

Agents

UnitBoost: Managing Compound LLM Systems with a Merge Operator, Not a Model

arXiv:2609.09815v1 Announce Type: cross Abstract: Compound LLM systems often solve a coordination problem by adding a higher-level LLM. The resulting meta-agent reads workers' outputs, writes the fina

agentsarxiv-cs-cl

VST: Verifiable Structured Transport for Auditable Agent-to-Agent Alpha Discovery

arXiv:2609.07065v1 Announce Type: new Abstract: Agent-to-agent (A2A) alpha discovery is slowed by repeated feedback cycles between mining and evaluation agents, whose hand-offs, in contemporary LLM mu

When Agent Governance Helps

arXiv:2609.05531v1 Announce Type: cross Abstract: No specification says how a governed autotelic AI agent organization, where agents pursue self-generated goals inside guardrails, should be designed a

When Intelligence Becomes Agency: A Theory of Governed, Proactive Agency for Symbiotic AI Systems

arXiv:2609.07741v1 Announce Type: new Abstract: Persistent AI assistants are intended to extend human attention, memory, and coordination across changing digital and physical environments. To be truly

A Statistical and Machine Learning Framework for Quantifying Offensive Impact in Professional Box Lacrosse

arXiv:2609.06610v1 Announce Type: new Abstract: Professional box-lacrosse statistics summarize outcomes but provide limited information about shot quality or the roles behind scoring opportunities. Th

Are Image Generators Zero-Shot Perceivers? A Rigorous Evaluation

arXiv:2609.07884v1 Announce Type: new Abstract: Recent work, such as Vision Banana, shows that lightweight instruction tuning can enable an image generator to achieve state-of-the-art performance acro

CHILD: Human-in-the-Loop OOD Detection for Safe Clinical Deployment

arXiv:2609.07188v1 Announce Type: new Abstract: Out-of-distribution (OOD) detection is critical for safe deployment of medical AI systems. Recently, test-time adaptation (TTA) has emerged as a new par

Research

Clean Accuracy Does Not Guarantee Provenance Robustness: A Prospective Codec-Stress Evaluation of Audio Attribution

arXiv:2609.07981v1 Announce Type: cross Abstract: Audio provenance attribution - which system produced a synthetic utterance - is reported at near-ceiling accuracy on clean benchmarks, yet audio reach

researcharxiv-cs-lg

Compressed Recurrent Feedback in Tsetlin Machines: A Reproducible Boolean-FSM Study

arXiv:2609.06133v1 Announce Type: new Abstract: Sequential inference on small devices requires a model to retain useful history without repeatedly processing a long input record. A Recurrent Tsetlin M

Research

CS-CLIP: Compositional Scene Graph-guided CLIP for Robust Compositional Reasoning

arXiv:2609.08242v1 Announce Type: new Abstract: Vision-language models (VLMs) demonstrate strong performance across compositional reasoning benchmarks, which require reasoning over semantic perturbati

researcharxiv-cs-cv

Dual-Latent Memory Routing for Vision-Language Reasoning

arXiv:2609.05539v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have recently made strong progress in vision-language reasoning, yet their performance often degrades as genera

Enhancing Table Structure Recognition via Bounding Box Guidance

arXiv:2609.08705v1 Announce Type: new Abstract: Table Structure Recognition (TSR) aims to extract the bounding boxes of cells and table structure (e.g., HTML) from table images. Although current appro

Evolution of Multimodal Question Answering: From Modality-Adaptive Extraction to Unified Language Representation

arXiv:2609.08896v1 Announce Type: cross Abstract: The rapid growth of multimodal data has intensified the need for question answering (QA) systems capable of reasoning across heterogeneous sources suc

Hardware

FALCON-S: Fixed-wing ground-effect Aerodynamics Simulator and Flight Control Learning Suite

arXiv:2609.06046v1 Announce Type: cross Abstract: We present a modular, high-fidelity simulation framework for the development and benchmarking of flight control strategies in fixed-wing aerial robots

hardwarearxiv-cs-lg

How Well Can Modern LLMs Act as Agent Cores in Radiology Environments?

arXiv:2412.09529v4 Announce Type: replace Abstract: Radiology, with its heterogeneous modalities, anatomies, and evolving protocols, is a natural yet high-stakes testbed for agentic AI. As LLMs grow m

MOLE: Detecting Insider Threats in AI Agents

arXiv:2609.06966v1 Announce Type: new Abstract: Model misalignment, prompt injection, or operator misuse could lead AI agents operating frontier-lab accounts to exfiltrate model weights, poison traini

On the Recall Scaling Laws in Mamba: A Theoretical and Mechanistic Study via Hashing

arXiv:2609.07681v1 Announce Type: new Abstract: Associative Recall (AR) is the cognitive ability to learn and retrieve links between items in memory. In NLP, AR is used as a benchmark for evaluating t

PhysVidBench: Language-Grounded Evaluation of Physical Commonsense in Text-to-Video Models

arXiv:2507.15824v2 Announce Type: replace Abstract: Text-to-video (T2V) models now produce striking visuals, yet they routinely violate everyday physics; objects float, tools are misused, and causal s

PhysWeep: Does a Video Generator Realize the Physics You Ask For?

arXiv:2609.06207v1 Announce Type: new Abstract: Image-to-video generators are often credited with absorbing physical dynamics as implicit world models, a claim the community currently checks with plau

SAFER-Activities: A Dataset for Smart Assessment of Fall Events and Routine Activities

arXiv:2609.08038v1 Announce Type: new Abstract: Smart healthcare monitoring systems require precise action recognition to ensure well-being and timely intervention in critical situations such as falls