Search: “benchmark”

APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents

arXiv:2609.07712v1 Announce Type: new Abstract: Mobile GUI agents can execute tasks from natural-language instructions, but their evaluation remains difficult to make both realistic and reproducible.

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

ASDA: Automated Skill Distillation and Adaptation for Financial Reasoning

DGX agent

arXiv:2603.16112v2 Announce Type: replace-cross Abstract: Adapting large language models (LLMs) to specialized financial reasoning typically requires expensive fine-tuning that produces model-locked e

model-releasesarxiv-cs-ai

10 Sept 2026

Tutorials

Asking the Right Questions: Ontology-Grounded Interpretable Embeddings for Biomedical Text

arXiv:2603.01690v3 Announce Type: replace-cross Abstract: While dense biomedical embeddings achieve strong performance, their opaque dimensions limit transparency in biomedical NLP. Recent question-ba

tutorialsarxiv-cs-ai

Assembling Two Parts in One Hand

model-releasesarxiv-cs-ro

arXiv:2609.10137v1 Announce Type: new Abstract: A hallmark of human dexterity is the cooperative use of fingers, where different fingers take on distinct yet coordinated roles to accomplish fine manip

AutoFyn Technical Report: Non-Parametric Expert Iteration for Long-Horizon Agents

arXiv:2609.05446v1 Announce Type: new Abstract: We introduce AutoFyn, an agent harness inspired by the Expert Iteration algorithm, adapting a frozen model across many rounds by updating persistent sta

Bait-and-Recover: Poisoning Internal Refusal Signals to Defend LLMs against White-Box Editing Jailbreaks

arXiv:2609.05794v1 Announce Type: cross Abstract: Open-weight large language models face a low-cost white-box threat from representation engineering attacks. Attackers can estimate refusal directions

BETA-Labeling for Multilingual Dataset Construction in Low-Resource IR

arXiv:2602.14488v3 Announce Type: replace-cross Abstract: IR in low-resource languages remains limited by the scarcity of high-quality, task-specific annotated datasets. Manual annotation is expensive

Beyond Prompts: Measuring and Optimizing LLM Tool-Agent Harnesses

arXiv:2609.05736v2 Announce Type: new Abstract: LLM tool agents can be improved without retraining by modifying the runtime harness around a fixed model: prompts, tool interfaces, middleware, state ha

Beyond Top-k Skill Retrieval: Diversity-Aware Skill Routing for LLM Agents

arXiv:2609.05824v1 Announce Type: new Abstract: Large language model (LLM) agents increasingly rely on external skills, but routing user requests over large skill registries is difficult because many

Beyond Top Words: MonoTM for Topic Modeling with Interpretable Monosemantic Features

arXiv:2609.09575v1 Announce Type: new Abstract: Topic models summarize large text corpora, but top-ranked words often provide only a limited representation of topic semantics. Sparse autoencoders (SAE

Tutorials

Building Multilingual Bridges: Data Mixing as the Pillar of Generalization for In-Language Reasoning

arXiv:2609.10445v1 Announce Type: new Abstract: Reasoning language models have made substantial advances on a variety of complex tasks, yet their capabilities remain overwhelmingly English-centric: mo

tutorialsarxiv-cs-cl

Building the Harness Automatically: Self-Play in Code Distills a Text Harness for Black-Box Optimization

model-releasesarxiv-cs-lg

arXiv:2609.09468v1 Announce Type: new Abstract: Can an agent learn a numerical search strategy through executable practice and then transfer that strategy as text? We study low-budget black-box optimi

Cascading Gradient Inversion via LT-Code Inspired Peeling in Federated Learning

arXiv:2609.09659v1 Announce Type: new Abstract: Federated learning shares model updates rather than raw data, yet these updates can be inverted to reconstruct the clients' training data. Analytic reco

researcharxiv-cs-lg

CIT-CAD: Constraint Intent Tree-based CAD Code Generation and Verification

arXiv:2609.07434v1 Announce Type: new Abstract: Natural-language Computer-Aided Design (CAD) code generation aims to turn design intent into executable and editable parametric programs. Large language

CIVI: A Framework for Diagnosing Search Agent Failures in Civic Information

arXiv:2609.08094v1 Announce Type: new Abstract: Large Language Models are increasingly deployed in public-sector settings, where incorrect guidance can cause irreversible harm. We introduce CIVI, the

Climate-ModernBERT: Revisiting Corpus Composition for Domain-Adaptive Continued Pretraining

arXiv:2609.07798v1 Announce Type: cross Abstract: Natural Language Processing (NLP) in the climate domain requires models to process heterogeneous text sources, including scientific literature, policy

CoGe-GCD: Reframing Generalized Category Discovery with Compositional Generalization

arXiv:2609.10158v1 Announce Type: new Abstract: Generalized Category Discovery (GCD) assigns unlabeled instances, mixed with labeled data, to known or novel categories, requiring human-like compositio

safetyarxiv-cs-lg

Applications

Constraint-Aware Discrete Black-Box Optimization Using Tensor Decomposition

arXiv:2609.09370v1 Announce Type: new Abstract: Discrete black-box optimization is often addressed using approaches such as Sequential Model-Based Optimization (SMBO), which aims to improve sample eff

applicationsarxiv-cs-lg

Cross-Model Agreement as a Deployment-Time Reliability Signal for Automatic Polyp Segmentation

model-releasesarxiv-cs-cv

arXiv:2609.10495v1 Announce Type: new Abstract: In real-time colonoscopy, ground-truth annotations are unavailable at inference, so polyp segmentation models can fail silently. We propose Referee-Base

CWF: A Collaborative Writing Framework for Personalized and Reliable Popular Science Writing

arXiv:2609.06126v1 Announce Type: new Abstract: We introduce Personalized and Reliable Popular Science Writing, a novel task that requires adapting scientific explanations to audiences with different

Decision-Focused Active Learning for Scale-Aware Critical-Materials Recovery

model-releasesarxiv-cs-ro

arXiv:2609.09413v1 Announce Type: cross Abstract: Choosing a recovery process for scale-up requires connecting laboratory results with product requirements, process costs, and scale effects. We analyz

DeepSeek V4.1 Flash: Stronger, Faster, More Accessible

model-releasesr-localllama

Original Source from DeepSeek WeChat Official Account: https://mp.weixin.qq.com/s/qg0NU3NNUbp1co2PdkAPAg Today we're officially releasing the DeepSeek V4.1 Flash model. It is the smallest model in our

Tutorials

DiffLUT-Net: Differentiable Training of FPGA LUT Networks with Learnable Connectivity

arXiv:2609.09254v1 Announce Type: new Abstract: Field-programmable gate arrays (FPGAs) enable efficient neural-network inference, but most deployment flows either accelerate multiply-accumulate operat

tutorialsarxiv-cs-lg

Diffs vs. Whole Files: An Empirical Comparison of Iterative Edit-Based and Direct Generation for Flutter/Dart Code Models

arXiv:2609.05779v1 Announce Type: cross Abstract: Large language models used for code editing can be trained and deployed in at least two output regimes: direct generation, where the model emits the e

Local Ai

DiSCo: A Distribution-First Steering and Cultural Prior Evaluation Framework for Measuring Cultural Preference Bias in LLMs

arXiv:2609.10253v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed in globally used assistants, yet their default choices in culturally grounded everyday situations

local-aiarxiv-cs-cl

Distilling Image Prototypes for Guided Test-Time Adaptation

arXiv:2609.09737v1 Announce Type: new Abstract: Test-Time Adaptation (TTA) enhances the robustness of models against distribution shifts but faces two critical challenges: error accumulation from nois

researcharxiv-cs-cv

Distribution-Consistent Inference for Dynamic Sparse Mixture-of-Experts

arXiv:2609.09241v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) architectures have emerged as a powerful paradigm for scaling model capacity while preserving efficient inference in large fo

safetyarxiv-cs-cl

Do Dynamic Routers Need Memory? HeRo: History-Aware Routing for Efficient LLM Inference

arXiv:2609.08189v1 Announce Type: new Abstract: Dynamic layer routing reduces the inference cost of Large Language Models (LLMs) by learning to skip layers for individual tokens. Existing methods, how

Do Large Language Models Know What They Don't Know II? A Fully Behavioral, Non-Cognitive Measure of Epistemic Honesty

arXiv:2609.07879v1 Announce Type: new Abstract: Large Language Models (LLMs) are frequently confident, eloquent, and well versed. A natural question arises: do they know what they don't know? To answe

Edu-QuRating: Multi-Dimensional Educational Data Curation with Distilled Pairwise Judgements

arXiv:2609.09425v1 Announce Type: new Abstract: Educational data filters have become a practical way to improve language-model pre-training, but most filters treat educational value as a single scalar

EEGBind: Detecting Source-Level Interictal Epileptiform Discharges via EEG-Centric Multimodal Binding

model-releasesarxiv-cs-lg

arXiv:2609.09728v1 Announce Type: new Abstract: Source-level analysis of interictal epileptiform discharges (IEDs) is relevant to presurgical evaluation and treatment planning because it helps charact

Enhanced Deformable Convolution with Center-invariant Offset and Edge-aware Mask

model-releasesarxiv-cs-cv

arXiv:2609.10387v1 Announce Type: new Abstract: Deformable convolution networks have recently become popular for many computer vision tasks, especially for semantic segmentation, because of their exce

Evidence-Aligned Entity Verification for Hallucination Detection in Retrieval-Augmented Generation

arXiv:2609.08267v1 Announce Type: new Abstract: Hallucination detection is crucial for large language models (LLMs), as hallucinated content creates significant barriers in applications requiring fact

EvolveScaler: Synthesizing Information-Evolution Contexts via Executable State Machines and Natural-Language Rendering

arXiv:2609.08435v2 Announce Type: new Abstract: In persistent interactions, long contexts may encode an evolving process rather than a fixed record: later events can revise or revoke earlier informati

ExpertLens: Visualizing Embedding Spaces for Post-Hoc Explainability in MoE Enhanced Retrievers

arXiv:2609.06155v1 Announce Type: cross Abstract: Neural models, including dense retrievers, have been widely adopted in Information Retrieval (IR), often delivering state-of-the-art performance. Desp

Explaining AI Agents Through Execution Traces

arXiv:2609.06063v1 Announce Type: new Abstract: AI Agents are increasingly deployed in real-world settings, where they interact with external tools and make sequential decisions with limited human ove

Explaining f-Divergence-Based Regularization via Local Curvature and Sharpness-Aware Minimization

model-releasesarxiv-cs-lg

arXiv:2609.09367v1 Announce Type: new Abstract: Divergence-based regularization and Sharpness-Aware Minimization (SAM) are two prominent approaches for improving generalization in deep learning, both

Exposing Weaknesses in Emotion Recognition in Conversations

arXiv:2609.05806v1 Announce Type: new Abstract: Emotion Recognition in Conversations (ERC) aims to identify speakers' emotions in multi-turn dialogue. Accurate emotion recognition can support a wide r

FastE: Readout-Triggered Token Compression for LLM Embedding Inference

arXiv:2609.08407v1 Announce Type: new Abstract: In this study, we identify depth-dependent prefix redundancy in final-readout LLM embedding models, notably across representative backbones including Qw

FATS: A Prompt Injection Attack Utilizing Feign Security Agents with Deceptive Few-shots Learning

arXiv:2410.08776v3 Announce Type: replace-cross Abstract: Large Language Models (LLMs) face significant security risks despite their advanced capabilities. While techniques like Reinforcement Learning

Fine-Tuning a KV Cache Concatenation-Aware Model or Recomputing KV Caches? Why Not Both?

arXiv:2609.09768v1 Announce Type: cross Abstract: In Retrieval-Augmented Generation (RAG) systems, a large number of retrieved chunks are concatenated to form the input context so that users can recei

Local Ai

From Concentration to Differentiation and Back: Routing Effective Rank in MoE Reasoning Cohorts

arXiv:2609.06403v1 Announce Type: new Abstract: Test-time scaling produces cohorts of reasoning rollouts, yet there is no standard label-free account of how their internal computation reorganizes as i

local-aiarxiv-cs-ai

From Event Logs to Governed Action: A BlueSky Agenda for Agentic Process Mining

arXiv:2609.07984v1 Announce Type: new Abstract: Process mining has long turned event logs into process knowledge: discovered models, conformance evidence, bottleneck diagnoses, and runtime predictions

From Fixed Keys to Readable Schemas: Small Language Models for Vehicle Agent Function Calls

arXiv:2609.09476v1 Announce Type: cross Abstract: In-vehicle assistants must translate natural-language requests into accurate vehicle function calls under strict memory and latency constraints, makin

From Simulated Citizens to Simulated Deliberation: Challenges in Representation and Interaction

arXiv:2609.07573v1 Announce Type: new Abstract: Multi-agent LLM deliberation has been explored as a scalable way to simulate public deliberation. For such simulations to be informative, persona agents

Future-Aware Flow Planning for Safe UAV Target Following

arXiv:2609.10166v1 Announce Type: new Abstract: UAV target following in cluttered environments is inherently predictive: current-state followers can lag behind turns, choose blocked corridors, or trad

safetyarxiv-cs-ro

Great paper from AWS. I use a similar setup where an agent orchestrator sits on top of a multi-agent system. (bookmark it) This work introdu…

Great paper from AWS. I use a similar setup where an agent orchestrator sits on top of a multi-agent system. (bookmark it) This work introduces one of the many approaches available to manage compound

agentsdair-ai--x

HaWMPO: Hallucination-Aware World Model-based Policy Optimization for Generalist Robot Policy

model-releasesarxiv-cs-ro

arXiv:2609.09941v1 Announce Type: new Abstract: Generalist robot policies have demonstrated strong generalization across robotic manipulation tasks, yet their success rates remain limited in com- plex