Search: “benchmark”

BI-Agent and BI-Bench: Towards Automating End-to-End Business Intelligence

arXiv:2609.20886v1 Announce Type: cross Abstract: Business intelligence (BI) is a cornerstone of enterprise decision-making and is widely used by enterprise users in software such as Power BI and Tabl

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

Boosting Deepresearch and LongContext Ability with Self-Generated Deepresearch Rollouts Traces

DGX agent

arXiv:2609.20844v1 Announce Type: new Abstract: Deepresearch (DR) agents interact with real-world web environments through multi-turn search and visit, causing their contexts to grow rapidly over time

agentsarxiv-cs-cl

21 Sept 2026

Can Agents Design Better Chips with a Higher Level Abstraction?

arXiv:2609.21157v1 Announce Type: new Abstract: Large Language Model (LLM) agents are increasingly being explored for chip design, but most existing approaches operate directly at RTL. We ask whether

COMPLEX: A Closed-Form Certified Embedding of Multiparameter Persistence Modules

arXiv:2609.22012v1 Announce Type: new Abstract: Every multiparameter persistence vectorization we know of carries a one-sided Lipschitz upper bound and nothing below it: without a lower gauge there is

researcharxiv-cs-lg

Designer-RSI: Evolving Procedural Memory from User Traffic for Agentic Graphic Design

arXiv:2609.22086v1 Announce Type: new Abstract: Professional graphic design is a long-horizon agentic task in which structured, editable artifacts emerge from many interdependent actions, yet outcomes

Local Ai

Detecting Hallucination in LLMs: Tracing the Topological Signatures of Impaired Context Sharing

arXiv:2609.21096v1 Announce Type: new Abstract: In this work, we examine the topology of information flow patterns within attention graphs to effectively distinguish hallucinated from non-hallucinated

local-aiarxiv-cs-ai

One Prompt Does Not Fit All: Self-Meta-Evolve for Personalized Information Extraction

arXiv:2609.21626v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed for enterprise information extraction (IE), where the same document must be reorganized different

Tutorials

RACER: Role-Aligned Competence Estimation for Human-AI Routing

arXiv:2609.21953v1 Announce Type: new Abstract: Learning to defer asks a predictive system when to act autonomously and when to defer to a human expert. Population-adaptive deferral extends this probl

tutorialsarxiv-cs-lg

RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agents

arXiv:2609.22000v1 Announce Type: new Abstract: Computer-use agents (CUAs) have advanced along two separate lines: graphical interaction and software development through code and the command line. Rea

SafeStage: Evaluating Safety Before, During, and After Vision-Language-Conditioned Robot Manipulation

model-releasesarxiv-cs-ro

arXiv:2609.21223v1 Announce Type: new Abstract: Vision-language-conditioned robot policies integrate perception, language understanding, and control for general-purpose manipulation. However, existing

SkelWAM: A Skeleton-Guided World-Action Model for Zero-Shot Cross-Embodiment Manipulation

model-releasesarxiv-cs-ro

arXiv:2609.21983v1 Announce Type: new Abstract: Reusing manipulation experience across robot embodiments is important for scaling robot learning and reducing repeated task-specific data collection. Ho

Souper-Model: How Simple Arithmetic Unlocks State-of-the-Art LLM Performance

arXiv:2511.13254v2 Announce Type: replace Abstract: Large Language Models (LLMs) have displayed remarkable capabilities across diverse domains, but their training remains resource- and time-intensive,

A Network Science Approach to Granular Time Series Segmentation

arXiv:2505.17640v3 Announce Type: replace Abstract: Time series segmentation assigns a label to each part of a sequence. We formulate dense univariate segmentation as node classification on a graph wh

An Analysis of Training-Free Self-Reported Confidence in Language Models

arXiv:2609.20541v1 Announce Type: new Abstract: Large language models can report a numerical confidence together with generated content, but it is unclear whether this report is more than calibrated r

Architectural Design, Not Only Model Intelligence, Governs Multi-Agent LLM Performance

arXiv:2602.03128v2 Announce Type: replace Abstract: Multi-agent LLM frameworks are data-intensive systems that govern how agents orchestrate tasks, manage state, and coordinate decisions. These archit

AVTrace: Diagnosing Audio-Visual Temporal Reasoning in Omni Models

arXiv:2609.19991v1 Announce Type: cross Abstract: Omni models can describe video content, but can they locate events in time, preserve event order, and judge audio-visual synchronization? We introduce

Chronicle: Cut-Point Replay for Regression Testing of LLM Agents

arXiv:2609.20625v1 Announce Type: cross Abstract: Large language model responses are non-deterministic, so failures in LLM agents are hard to reproduce: a failure depends on inference that is not bitw

Closed-World Resolution Against Tool Hallucination in LLM Agents

arXiv:2609.19425v1 Announce Type: new Abstract: Tool-augmented large language model (LLM) agents fail in a way no tool-selection or tool-security method addresses: they call tools that do not exist an

CoRef-GS: Cooperative Referring Gaussian Splatting for Multi-Agent Scene Understanding

arXiv:2609.20586v1 Announce Type: cross Abstract: Referring scene understanding for embodied robots requires grounding object- and relation-centric language queries from a designated viewpoint. While

Cross-Architecture Foundation-Model Distillation for Edge Flood Segmentation

arXiv:2609.20441v1 Announce Type: new Abstract: Geospatial foundation models can provide strong flood-segmentation performance, but their size limits deployment on memory-constrained edge hardware. We

Evaluating Communicative Success in Machine-Translated Conversation

arXiv:2609.19885v1 Announce Type: new Abstract: Interpreter agents built on machine translation (MT) increasingly mediate live conversation between people who do not share a language, yet we still eva

F^{2}DR: A Fine-Grained Full-Pipeline Reward Framework for DeepSearch Workflows

arXiv:2609.19827v1 Announce Type: new Abstract: With the widespread industrial deployment of Large Language Models (LLMs), DeepSearch has emerged as the dominant paradigm for resolving complex user qu

FINSKILLOPS: A Self-Evolving Multi-Agent System for SEC Filing QA

arXiv:2609.19680v1 Announce Type: new Abstract: Financial QA systems are typically improved before deployment through better retrieval, prompting, or agent coordination, leaving their reliability beha

GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Model

arXiv:2609.19716v1 Announce Type: new Abstract: Pre-trained 3D vision models have substantially advanced point cloud analysis, yet adapting them to downstream tasks via full fine-tuning is computation

Grounded Product Understanding in Livestream Videos

arXiv:2609.20508v1 Announce Type: new Abstract: E-commerce livestreams have emerged as an important channel for presenting products to online consumers, containing multiple products whose information

How to Guide Your Language Flow

arXiv:2609.19356v1 Announce Type: cross Abstract: We introduce a new method to guide flow matching models. Our approach, which we call probe guidance, uses the frozen internal states of an existing di

JEPA-WAM: Connecting Generated Visual Instructions to World Action Models through JEPA Latent Representations

arXiv:2609.20277v1 Announce Type: new Abstract: World Action Models (WAMs) have demonstrated strong robotic manipulation capabilities by augmenting pretrained video generative models with action exper

Less Is More: Graph-free Multimodal RAG via Multi-signal Late Fusion

arXiv:2609.19417v1 Announce Type: new Abstract: Graph-based retrieval-augmented generation (RAG) is widely used for multimodal, cross-document question answering. However, building corpus-level graphs

LinePilot Digitizer: Line-Plot Recovery with Manual and Automatic Calibration

arXiv:2609.19377v1 Announce Type: cross Abstract: Recovering numerical series from line plots requires accurate axis calibration and reliable curve extraction. We present LinePilot Digitizer (LinePilo

Online Adaptation of Visual Odometry Frontends with Image-Conditioned Reinforcement Learning

arXiv:2603.21785v2 Announce Type: replace Abstract: Visual odometry (VO) frontends are typically tuned offline by domain experts on pre-recorded datasets and then deployed with fixed hyperparameters.

PosteriorBench: From Point Estimates to Posterior Matching in Evaluating Generative Inverse Solvers

arXiv:2609.20794v1 Announce Type: new Abstract: Generative models are increasingly used to solve scientific inverse problems, but existing evaluations still focus primarily on whether a method can pro

PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving

arXiv:2609.19657v1 Announce Type: cross Abstract: Repeated prompt prefixes are increasingly common in LLM serving workloads, appearing in system prompts, templated retrieval-augmented generation pipel

RAFT: A Stateful Retrieval-Augmented Framework for Troubleshooting Agents

arXiv:2609.20754v1 Announce Type: new Abstract: Effective troubleshooting agents in enterprise customer support depend on retrieving actionable guidance from similar historical cases, yet existing ret

Redemption Score: A Multi-Modal Evaluation Framework for Image Captioning via Distributional, Perceptual, and Linguistic Signal Triangulation

arXiv:2505.16180v3 Announce Type: replace-cross Abstract: Evaluating image captions requires cohesive assessment of both visual semantics and language pragmatics, which is often not entirely captured

SceneTeract: Probing and Improving Agent-Aware Activity Reasoning in 3D Indoor Scenes

arXiv:2603.29798v2 Announce Type: replace Abstract: Indoor 3D scenes are ultimately meant to be used: an embodied agent should be able to navigate, reach objects, and complete diverse activities. Yet

Local Ai

SCGFM-ART: Amortized Relational Transport for Structure-Centric Graph Foundation Models

arXiv:2609.20419v1 Announce Type: cross Abstract: Graph foundation models (GFMs) aim to learn transferable representations across severely heterogeneous graph domains. However, severe domain shifts in

local-aiarxiv-cs-ai

SplashSplat: Reconstructing Splashing Liquids from Real-World Multi-View Videos

arXiv:2609.20818v1 Announce Type: new Abstract: A splash lives for a fraction of a second: sheets tear into ligaments and droplets, appearance is view-dependent and nearly textureless, and little pers

To Memories and Beyond: From Remembering to Knowing You across Long-Term Multimodal Personal Archives

arXiv:2609.19167v1 Announce Type: new Abstract: As AI systems evolve into personalized digital companions, a central capability is reasoning over a user's long-term personal history: not merely storin

When Does Retrieval Help Time-Series Forecasting?

arXiv:2609.20193v1 Announce Type: new Abstract: Retrieval plug-ins supply a deep forecaster with information its lookback window cannot carry. Published evaluations report consistent gains, and each c

researcharxiv-cs-lg

A Non-Linear Neuron Based Detection of Isolated Pixels in Binary and Grayscale Images using Contrast Sensitive Receptive Fields

arXiv:2609.18399v1 Announce Type: cross Abstract: Identifying isolated points is important in image processing applications such as medical imaging, astronomy and quality control management. Other dom

researcharxiv-cs-ai

Safety

A Probe Shift Is Not a Fairness Fix: The Limits of Representation Steering in Speech Models

arXiv:2609.18533v1 Announce Type: new Abstract: Automatic speech recognition (ASR) systems exhibit unequal error rates across speaker groups, motivating interventions on their internal representations

safetyarxiv-cs-cl

A Survey on Bridging EEG Signals and Generative AI: From Image and Text to Beyond

arXiv:2502.12048v4 Announce Type: replace Abstract: Decoding neural activity into human-interpretable representations is a key research direction in brain-computer interfaces (BCIs) and computational

researcharxiv-cs-ai

Adaptive hybrid coupling with operator inference, the overlapping Schwarz alternating method and reinforcement learning

arXiv:2609.17837v1 Announce Type: cross Abstract: Hybrid domain decomposition methods provide a flexible framework for coupling full order models (FOMs) and reduced order models (ROMs), but typically

Agora: Git as Shared Memory for Collective AutoResearch

arXiv:2609.18094v1 Announce Type: cross Abstract: Autonomous research loops such as AutoResearch show that one coding agent can improve a training setup unattended. Run several of them and each sessio

Fourier Analysis of Parametrized Interactive Quantum Classifiers

arXiv:2609.17991v1 Announce Type: cross Abstract: Interactive Quantum Classifiers (IQCs) constitute a family of quantum machine learning models inspired by open quantum systems, in which the interacti

HALT: Hallucination Assessment via Log-probs as Time series

arXiv:2602.02888v2 Announce Type: replace-cross Abstract: Hallucinations remain a major obstacle for large language models (LLMs), especially in safety-critical domains. We present HALT (Hallucination

How AI Assistants Respond to Repeated Abuse

arXiv:2609.17547v1 Announce Type: new Abstract: AI assistants are expected to remain useful during difficult interactions, but little is known about how repeated verbal abuse changes their engagement

JigSync: Gauge-Resolved Synchronization for Jigsaw Reassembly under Unknown Piece Orientation

arXiv:2609.18379v1 Announce Type: new Abstract: Square jigsaw reassembly requires recovering the spatial arrangement of shuffled fragments from their visual content and pairwise relationships. While r