Search: “evaluation”

UK-PRBENCH: A Paragraph-Level Precedent Retrieval Benchmark for United Kingdom Case Law

arXiv:2609.24613v1 Announce Type: cross Abstract: Prior case retrieval (PCR) aims to identify precedent cases relevant to a given query case. Existing PCR benchmarks and methods predominantly operate

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Video-based Surgical Skill Assessment Using Dynamics-and-Uncertainty-Aware Tree-based Gaussian Process Classifier

DGX agent

arXiv:2609.24619v1 Announce Type: new Abstract: The proposed pipeline integrates a representation-flow convolutional neural network with a dynamics- and uncertainty-aware tree-based Gaussian Process c

model-releasesarxiv-cs-cv

22 Sept 2026

vla.simd: Efficient CPU Inference for Language-Conditioned Manipulation

arXiv:2609.24274v1 Announce Type: new Abstract: Deploying language-conditioned manipulation without a dedicated GPU requires efficient inference and action chunks that cover the delay between policy q

VLPSA: Vision-Language-Poisson-Safe Actions for Full-Body Safety of Learned Policies

arXiv:2609.22462v1 Announce Type: new Abstract: Vision-language-action (VLA) models enable increasingly general-purpose robotic manipulation, but such learned policies do not provide safety guarantees

What Can a Recurrent State Safely Forget?

arXiv:2609.23366v1 Announce Type: new Abstract: Recurrent models must preserve information that changes future behavior while suppressing hidden-state error. These objectives conflict: contraction imp

safetyarxiv-cs-lg

What Makes a Good Medical Image Tokenizer? Rethinking Reconstruction and Generation in Medical Image Tokenization

arXiv:2609.24691v1 Announce Type: new Abstract: Latent diffusion models now dominate medical image generation, and every such pipeline rests on a tokenizer that compresses images into the latent codes

When Does Touch Matter? Charting the Vision-Interaction Gap in Cluttered Dexterous Grasping

model-releasesarxiv-cs-ro

arXiv:2609.24068v1 Announce Type: new Abstract: Dexterous grasping in clutter poses a basic sensing question: when do tactile measurements and external wrench estimates improve on visual geometry? Occ

WildfireSpreadBench: The Metric Decides the Model in Wildfire Spread Prediction

arXiv:2609.22191v1 Announce Type: cross Abstract: Machine learning is being increasingly used to predict where active wildfires will burn the following day, helping inform evacuation boundaries and co

2D GauSS-MI: Efficient Active Scene Reconstruction with Balanced Visual and Geometric Quality

arXiv:2609.21516v1 Announce Type: new Abstract: Active reconstruction requires efficient active view selection to achieve high-quality reconstruction within limited onboard computational resources. Ex

Aligning with Lived Experience: Heterogeneous Benefits of Fine Tuning in Mental Health Support Generation

arXiv:2609.21075v1 Announce Type: cross Abstract: As access to professional mental healthcare remains limited, many individuals turn to online platforms such as Reddit to seek peer support situated wi

safetyarxiv-cs-ai

An Interpretable Memory Decision Controller for LLM Agents Based on Three-Signal Complementarity: Decoupling Confidence and Consistency

arXiv:2609.22043v1 Announce Type: new Abstract: Memory systems for large language models have focused predominantly on efficient retrieval, whereas the decision of whether retrieved memories should be

ArenaFlow: From Trajectory Ranking to Hierarchical Credit Propagation for Open-Ended Agent RL

arXiv:2609.21378v1 Announce Type: new Abstract: Reinforcement learning has substantially improved large language model (LLM) agents in verifiable domains, but remains difficult to apply to open-ended

safetyarxiv-cs-cl

Local Ai

Assessment of Machine Learning-Based Critical Heat Flux Models in the CTF Subchannel Code for Square Rod Bundle Prediction

arXiv:2609.21995v1 Announce Type: new Abstract: The prediction of critical heat flux (CHF), a key safety-related quantity in nuclear thermal hydraulics, remains an important challenge due to its direc

local-aiarxiv-cs-lg

Can Agents Design Better Chips with a Higher Level Abstraction?

arXiv:2609.21157v1 Announce Type: new Abstract: Large Language Model (LLM) agents are increasingly being explored for chip design, but most existing approaches operate directly at RTL. We ask whether

Chinese Competitive Debating Dataset and Benchmark

arXiv:2609.21637v1 Announce Type: cross Abstract: Debate adjudication requires tracking how arguments develop through interaction, yet existing datasets rarely combine fine-grained debate transcripts

Local Ai

coding agents are moving fast from prototype to production. the infrastructure question is what's left. join @parthsareen from @ollama and @…

coding agents are moving fast from prototype to production. the infrastructure question is what's left. join @parthsareen from @ollama and @zainhas Hasan from Together AI at @AIconference for a breako

local-aitogether-ai--x

CounterPlay: Counterfactual Post-Training for Self-Play Driving Policies

arXiv:2609.21617v1 Announce Type: new Abstract: Self-play in high-throughput simulators yields driving policies with robust closed-loop performance, but improvement per unit of simulation diminishes a

Cross-sector generalization of accident-process role classification in occupational accident narratives

arXiv:2609.22081v1 Announce Type: new Abstract: Occupational accident narratives contain valuable information about work situations, unfavourable conditions, accident events, and their consequences. A

researcharxiv-cs-cl

Cube-Splat: High-Fidelity 360{eg} Gaussian Splatting SLAM via Cubemap Factorization and Adjoint-Consistent Optimization

arXiv:2609.21347v1 Announce Type: new Abstract: Recent progress in 3D Gaussian Splatting (3DGS) has enabled dense visual SLAM with pinhole cameras, yet most pipelines are not designed for panoramic im

EnterpriseVal: Quantifying the Efficacy, Reliability and Value of Generative AI in the Enterprise

arXiv:2609.21841v1 Announce Type: new Abstract: Frontier language models now produce professional deliverables that expert graders judge to match human work on a substantial share of economically valu

Applications

FAN: Foresight Action Normalization for Continual Adaptation of Vision-Language-Action Models

arXiv:2609.21358v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models pre-trained on large-scale, closed datasets have demonstrated remarkable success across diverse robotic manipulation

applicationsarxiv-cs-ro

From Stress to Affect: Multimodal Deep Learning for Physiological Emotion Recognition Across Wearable Sensor Modalities

arXiv:2609.20991v1 Announce Type: new Abstract: Physiological emotion recognition using wearable sensors has important applications in mental health monitoring, affective computing, and human-computer

researcharxiv-cs-lg

Generative inversion for early ranking of competing geologic interpretations

arXiv:2609.20978v1 Announce Type: new Abstract: High-consequence subsurface decisions are often made under severe data scarcity. Experts may arrive at competing interpretations of the same subsurface

Gradient-Stable Attention Heads Signal LLM Correctness

arXiv:2602.13699v2 Announce Type: replace Abstract: Large language models (LLMs) often generate plausible yet incorrect answers, posing risks in safety-critical settings such as medicine. Human evalua

safetyarxiv-cs-lg

HE-Guardrail: A Homomorphic Guardrail Against Jailbreak Attacks for Encrypted Large Language Model Inference

arXiv:2609.21484v1 Announce Type: cross Abstract: Homomorphic encryption (HE) has emerged as a promising approach to privacy-preserving machine learning (PPML), enabling computation directly over encr

HMB-GAN: Hybrid Multi-Bezier GAN for Vector Shape Synthesis

arXiv:2609.21158v1 Announce Type: new Abstract: We explore the use of hybrid quantum-classical generative adversarial networks for synthesising CAD-ready vector geometries. Unlike prior work that oper

Image-Derived PM10 Estimation in Cattle Feedlot Using Machine Learning: Addressing Concentration Ranges Beyond Existing Digital Imaging Methods

arXiv:2609.20975v1 Announce Type: new Abstract: Affordable dust monitoring remains a pressing need for the cattle feedlot industry, yet camera-based PM estimation, despite its growing body of research

Learning Cardiac Features: ECG Biometrics Across Time and~Exercise

arXiv:2609.21962v1 Announce Type: new Abstract: Electrocardiograms (ECGs) carry subject-specific patterns enabling reliable individual discrimination, forming the basis of ECG biometrics. Beyond authe

researcharxiv-cs-ai

Learning End-to-End Control for Omnidirectional Aerial Motion on Overactuated Tilt-rotor Quadrotors

arXiv:2602.21583v2 Announce Type: replace Abstract: While reinforcement learning (RL) has been successfully applied to conventional quadrotors for agile and robust flight, whether actuator-level RL ca

LLMs as Feature Engineers for Text-and-Tabular Prediction

arXiv:2609.21894v1 Announce Type: new Abstract: We introduce an iterative framework that automates the extraction of interpretable, schema-bound categorical features from unstructured text for tabular

researcharxiv-cs-lg

Multi-Subject Pretraining Enables Short-Calibration Personalization for Closed-Corpus Surface EMG Speech Decoding

arXiv:2609.21288v1 Announce Type: new Abstract: Surface electromyography (sEMG)-based silent speech interfaces are limited by cross-user variability and calibration burden. We study a limited-data set

Not All Irregularity Is Equal: Causally Isolating a Rare Failure Mode in Japanese Morphological Inflection

arXiv:2609.21179v1 Announce Type: new Abstract: Neural morphological generation systems often achieve high aggregate accuracy on benchmark datasets, yet such performance can conceal systematic errors

On the Limitations of Large Language Models for Conceptual Database Modeling

arXiv:2605.11986v2 Announce Type: replace Abstract: This article analyzes the use of Large Language Models (LLMs) as support for the conceptual modeling of relational databases through the automatic g

researcharxiv-cs-ai

OpenMAS-GCom. A Diagnostic Benchmark for Graph-enhanced Multi-Agent Systems

arXiv:2609.21527v1 Announce Type: new Abstract: Graph-enhanced multi-agent systems (G-MAS) coordinate large language model agents through communication graphs and role assignments, which determine how

OverThink: Slowdown Attacks on Reasoning LLMs

arXiv:2502.02542v5 Announce Type: replace Abstract: A reasoning language model (RLM) generates costly reasoning tokens, often hidden from the users, that help it excel at many tasks. Our Overthink att

safetyarxiv-cs-lg

Particle Competition and Cooperation for Robust Graph Convolutional Network Learning Under Label Noise

arXiv:2609.22053v1 Announce Type: new Abstract: Graph Convolutional Networks (GCNs) are highly sensitive to label noise, since corrupted supervision can propagate through the graph and degrade learned

PlaceReasoner-Beta: Reasoning-Driven Macro Placement and Benchmarking

arXiv:2609.21263v1 Announce Type: new Abstract: Automated macro placement remains a fundamental challenge in VLSI physical design. Despite decades of research, existing approaches predominantly optimi

Potential-Field Action Representation for Reinforcement Learning in Contact-Rich Manipulation

arXiv:2609.21609v1 Announce Type: cross Abstract: Model-free reinforcement learning can acquire contact-rich robotic manipulation skills through trial-and-error interaction, but it often requires the

safetyarxiv-cs-ai

PRISM-BN: A Controlled Corpus and Benchmark for Text-to-Parameterized Bayesian Network Extraction

arXiv:2609.21673v1 Announce Type: new Abstract: Probabilistic Graphical Models (PGMs), especially Bayesian Networks (BNs), expose directed structure and probabilistic parameters, making them natural s

PRIVET: PRoximIty leakage detection Via Extreme value Theory

arXiv:2510.24233v2 Announce Type: replace Abstract: Deep generative models are often trained on sensitive data, such as genetic sequences, health data, or more broadly, any copyrighted, licensed or pr

researcharxiv-cs-lg

Reading Anxiety or Reading the Label? Comparing Fine-Tuned and Frontier Models for Anxiety Detection on Social Media

arXiv:2609.20847v1 Announce Type: new Abstract: Anxiety is among the most common mental health conditions, and people often write about it online well before seeking clinical help. Practitioners build

Rectify, Don't Regret: On-Policy Closed-Loop Training for Multimodal Trajectory Prediction

arXiv:2603.23393v2 Announce Type: replace Abstract: Current trajectory prediction models are primarily trained in an open-loop manner, which often leads to covariate shift and compounding errors when

Reinforcement Learning under External Influence: Guarantees, Algorithms, and Sample Complexity

arXiv:2305.16056v5 Announce Type: replace-cross Abstract: In this paper, we study the problem of reinforcement learning under the influence of external events. For this, we consider Markov decision pr

safetyarxiv-cs-ai

Safe Real-Time Policy Steering via Noise-Space Trajectory Optimization for One-Step Generative Policies

arXiv:2609.21220v1 Announce Type: new Abstract: Generative robot policies can represent diverse, multimodal behaviors, but adapting pretrained policies to deployment-time constraints such as collision

SAGE: Schema-Guided LLMs for Grant Review

arXiv:2609.20829v1 Announce Type: new Abstract: Grant reviewers must apply detailed criteria to application forms, budgets, and supporting documents while producing assessments that colleagues can ins

researcharxiv-cs-cl

Scaling Vision-Language Reward Learning for Robot Manipulation in Parallel Simulation

model-releasesarxiv-cs-ro

arXiv:2609.21767v1 Announce Type: new Abstract: Vision-language models (VLMs) can replace human annotators in preference-based reward learning, but sequential API requests and single-environment data

[Splash Engine] Qwen3.8-27B in native 8-bit at 37–55 tok/s on Apple Silicon: Extending Splash to Q8, 256k context scaling, and the 'Reasoning Cliff'

model-releasesr-localllama

https://preview.redd.it/nulsv53o8vqh1.png?width=4500&format=png&auto=webp&s=74765dbd409f4c221640f9f6000a685f6fdbb242 Spent weekend benchmarking the Splash engine (by Incoai) and extending its architec

The Communication Bottleneck: A Round-Trip Study of Tree-Structured Expression Serialization in Language Models

arXiv:2609.21509v1 Announce Type: new Abstract: When language models reason in chain-of-thought or exchange free-text intermediates, they serialize structured information into natural language. How mu