Search: “evaluation”

Long-Lived Characters, Local Inference: Incremental Memory Maintenance for Game NPCs

model-releasesarxiv-cs-cl

arXiv:2609.18935v1 Announce Type: new Abstract: A game character should not have to reread its entire life before every conversation. For locally deployed language-model characters, however, revising

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Machine Translation between English and Syriac (East Syriac Dialect) using Statistical Machine Learning

DGX agent

arXiv:2609.18529v1 Announce Type: new Abstract: UNESCO considers the Assyrian (Syriac) language an endangered language. Although Assyrians speak the language worldwide, the speaking population is unce

safetyarxiv-cs-cl

17 Sept 2026

MiST: Mid-Training LLMs for Cybersecurity

arXiv:2609.18496v1 Announce Type: cross Abstract: Cybersecurity combines high-stakes analysis with complex technical language, making it an impactful and challenging domain for LLMs. We present MiST (

MSR: Multiple Subject Reference for Video Generation

model-releasesarxiv-cs-cv

arXiv:2609.18393v1 Announce Type: new Abstract: Conditioning a video generator on multiple images requires preserving appearance while associating each reference with its intended role. We present MSR

Not All Patches Are Equally Forgettable: Spatially Localized Domain Unlearning in Vision-Language Models

arXiv:2609.17790v1 Announce Type: new Abstract: Pre-trained vision-language models (VLMs) exhibit strong cross-domain recognition performance even without additional training. However, this robustness

Objective vs. Search: Decomposing What Makes a Good Tokeniser

arXiv:2609.19145v1 Announce Type: cross Abstract: Two dominant tokenisation algorithms are used by modern language models: byte-pair encoding (BPE) and UnigramLM. These differ along two orthogonal axe

researcharxiv-cs-ai

Online Multimodal Workload Assessment in Contact-Rich Physical Human-Robot Interaction

arXiv:2609.18031v1 Announce Type: new Abstract: Contact-rich physical human--robot interaction (pHRI) imposes time-varying demands associated with physical interaction, motor regulation, and physiolog

researcharxiv-cs-ro

PACT: Can Enterprise AI Assistants Be Trusted Under Pressure?

arXiv:2609.18605v1 Announce Type: cross Abstract: As corporate AI adoption continues to grow, enterprise-grade LLM agents are being deployed into sensitive contexts such as hiring, healthcare, and fin

PANORAMA: Panoptic Grounded Captioning via Mask Proposal Selection

model-releasesarxiv-cs-cl

arXiv:2609.19143v1 Announce Type: cross Abstract: Intelligent systems that act in the world require image understanding that is both comprehensive and spatially grounded. Current vision-language model

Peak-Aware Short-Term Load Forecasting Across Distribution Grid Aggregation Levels

arXiv:2609.18588v1 Announce Type: new Abstract: For distribution system operators, short-term load forecasting (STLF) supports congestion management, voltage control, and asset protection. Most existi

PersonaPath: Towards Knowledge-Centric Personalized Learning Path Planning

model-releasesarxiv-cs-cl

arXiv:2609.18861v1 Announce Type: new Abstract: Adaptive learning systems commonly formulate learning path planning as Exercise-Centric (EC) recommendation, where the next step is inferred from item-l

Physics-based prediction, uncertainty quantification and decision-making for IN718 crystallographic texture intensity across LPBF defocus regimes

arXiv:2609.18863v1 Announce Type: new Abstract: Reliable prediction of crystallographic texture in laser powder bed fusion is critical for linking process conditions with anisotropic response and for

Q-BIOLAT: Binary Latent Protein Fitness Landscapes for QUBO-Based Optimization

arXiv:2603.27526v2 Announce Type: replace Abstract: Protein fitness optimization is a discrete search problem, and the representation used for prediction also determines the neighborhood graph travers

Qwen 3.8 27b is a amazing model, for the first time I see a local model found its own away to open a browser and test

model-releasesr-localllama

I was testing this quantization IQ3_XXS from GSQ-RCO with PI. It is a heavy quantization case, the model is in IQ3_XXS and KV cache in (Q4_0, Q4_0). I asked it to make the flight simulator, using that

RAFAIL: Relationship-Aware Failure Detection for Robotic Manipulation

arXiv:2609.18324v1 Announce Type: new Abstract: Detecting failures during execution is essential for reliable robotic manipulation. Vision-language models (VLMs) can assess task outcomes semantically

safetyarxiv-cs-ro

ReDIL-GNN: Resynthesis Domain Incremental Learning for Circuit Graph Neural Networks

arXiv:2609.18595v1 Announce Type: new Abstract: Logic resynthesis preserves circuit functionality while changing gate vocabulary, topology, and structural statistics, creating domain shift for circuit

Local Ai

ReRadar: Robust Radar Global Localization via Rotation-Equivariant Descriptor Learning

arXiv:2609.18092v1 Announce Type: new Abstract: Global localization with scanning millimeter-wave radar remains challenging because place-recognition descriptors often discard spatial structure needed

local-aiarxiv-cs-ro

Rethinking Domain Specialization for Open-Ended Scientific Reasoning in Astronomy Language Models

arXiv:2609.17644v1 Announce Type: cross Abstract: Domain-specialized language models are widely used for scientific question answering, but stronger general-purpose systems raise a sharper question: w

Schmidhuber was building recursive self-improving systems back in 1987. His new post covers four decades of RSI, from meta-evolution and sel…

Schmidhuber was building recursive self-improving systems back in 1987. His new post covers four decades of RSI, from meta-evolution and self-modifying policies to the Gödel Machine and modern LLM age

safetydavid-ha--x

Securing quantum error correction against misleading advice from AI agents

arXiv:2609.19090v1 Announce Type: cross Abstract: Can an attacker turn influence over an artificial intelligence (AI) adviser into a harmful quantum error-correction update? We identify an ambiguity i

researcharxiv-cs-ai

Local Ai

Selection Is Retrieval, Abstention Is Not: On-Device Tool Routing over 70 Korean-English Actions

arXiv:2609.18672v1 Announce Type: new Abstract: An AI assistant that calls tools makes two decisions on every request: which tool to invoke, and whether any available tool applies. In the usual design

local-aiarxiv-cs-cl

STRADAViT: Self-Supervised Domain Adaptation of Vision Transformer Backbones for Radio Astronomy

arXiv:2603.29660v4 Announce Type: replace-cross Abstract: Next-generation radio astronomy surveys are delivering millions of resolved sources, yet scalable morphology analysis remains difficult across

Hardware

The Inference Engineering Pareto Atlas: Which Optimizations Dominate the Cost, Quality, and Latency Frontier?

arXiv:2609.17863v1 Announce Type: new Abstract: LLM inference optimizations report speedups on different models, GPUs, prompts, and quality metrics, making them hard to compare or combine. We build a

hardwarearxiv-cs-ai

The Mirage of Calibrated Confidence: Trajectory-Independence of Verbalized Confidence in Vision-Language Models

arXiv:2609.18453v1 Announce Type: new Abstract: A calibrated Vision-Language Model (VLM) can repeatedly self-correct, say 'Wait, I should recheck,' arrive at the wrong answer, and still report high co

researcharxiv-cs-ai

The Missing 'I Don't Know': Why Three Reasoning-Reliability Findings Converge on Calibrated Abstention

arXiv:2609.17686v1 Announce Type: cross Abstract: Three recent results describe what look like unrelated LLM reliability problems. Yin et al. (2026) show reasoning RL collapses tool-reliability repres

The Unbearable Weight: Scaling Models and Methods for UAV Audio Classification

model-releasesarxiv-cs-lg

arXiv:2609.17884v1 Announce Type: cross Abstract: As unmanned aerial vehicles (UAVs) become increasingly prevalent in consumer and defense settings, classifying them reliably from limited, modality-sp

TRACER: Adaptive Multi-Robot Social Navigation via Joint Human-Response Prediction and Interaction-Aware Replanning

model-releasesarxiv-cs-ro

arXiv:2609.18776v1 Announce Type: new Abstract: Multi-robot navigation in human-shared spaces is inherently interactive: coordinated robot motions influence how nearby entities respond, while those re

Understanding Dynamic Scenes at Gigapixel Scale: Wide-Area Spatio-Temporal Perception from UAVs

arXiv:2609.18210v1 Announce Type: new Abstract: UAV-borne imaging has advanced from megapixel to gigapixel sensors, shifting aerial perception from recognizing individual targets to understanding enti

Tutorials

Variational Quantum Transformer Architecture for Synthetic Language Generation

arXiv:2609.18565v1 Announce Type: cross Abstract: We propose a compact NISQ-compatible quantum transformer architecture for synthetic QNLP sequence modelling. The model preserves the autoregressive ne

tutorialsarxiv-cs-cl

VCTP: Vehicle-Conditioned Terrain Planning for Off-Road Navigation

arXiv:2609.17834v1 Announce Type: new Abstract: A vehicle's heading affects both the surfaces beneath its tires and its pitch and roll. We present Vehicle-Conditioned Terrain Planning (VCTP), which re

researcharxiv-cs-ro

Voice of Reason: Reinforcement Learning for Spoken Math

arXiv:2609.18677v1 Announce Type: new Abstract: Speech language models enable richer spoken interactions between humans and machines than cascaded systems, allowing access to paralinguistic informatio

researcharxiv-cs-cl

VoiceTrace: A Benchmark and Retrieval Framework for Who-Said-What Speech Retrieval

arXiv:2609.18521v1 Announce Type: cross Abstract: Speech retrieval has become increasingly important as spoken content continues to grow across meetings, lectures, podcasts, and videos. Existing bench

VQ-bench: a Composable Vector Quantization Framework

VQ-bench is an open‑source framework that lets researchers construct vector quantization schemes from a small set of reusable primitive operations, enabling easy comparison of different methods on the

model-releasespinecone

WaveTLM: Reliable Time-Series Language Modeling through Task Compilation

model-releasesarxiv-cs-lg

arXiv:2609.18812v1 Announce Type: new Abstract: Time-series language models provide a shared natural-language interface across temporal tasks, but plausible text does not guarantee reliable task outpu

Whom Do AI Agents Work For? Role Assignment Induces Sponsorship Bias in LLM Recommenders

arXiv:2609.17989v1 Announce Type: cross Abstract: Large language models (LLMs) now serve as conversational shopping assistants on platforms that also sell advertising. These AI agents face a conflict

safetyarxiv-cs-ai

AssemblyGrid v1: A Benchmark for Multi-Robot Production with Temporary Coalitions, Local Information, and Geometric Constraints

arXiv:2609.16075v1 Announce Type: cross Abstract: Flexible robotic production requires joint decisions on process progression, material routing, resource assignment, temporary cooperation, and simulta

Agents

AURA: Agentic Diagnosis and Refinement for Production Recommender Systems at Scale

arXiv:2609.16625v1 Announce Type: cross Abstract: How and why does a recommender system fail the users it serves? Oftentimes, practitioners are left to improve their algorithms based on a combination

agentsarxiv-cs-ai

Banger report from Salesforce. Pretty interesting to see more of these custom enterprise models. Salesforce trained the enterprise agent mod…

Banger report from Salesforce. Pretty interesting to see more of these custom enterprise models. Salesforce trained the enterprise agent model from the same files it uses to configure agents. Koa star

model-releasesdair-ai--x

Tutorials

Beyond 'ChatGPT Can Make Mistakes': Designing Interventions to Support Metacognitive Monitoring in AI-Assisted Work

arXiv:2609.17065v1 Announce Type: cross Abstract: AI assistance places a metacognitive demand on users, who must judge their own competence and the system's. Yet designers lack comparative evidence on

tutorialsarxiv-cs-ai

Bias Audits Detect Bias but Disagree on Ranking: Evidence from Ten Instruments and Ten Frontier Models

arXiv:2609.15995v1 Announce Type: new Abstract: Emerging AI regulation mandates bias audits of high-risk systems, and audit scores are beginning to be used to rank models. Both uses assume different a

safetyarxiv-cs-cl

Can current MiniCPM5-2B/any best SOTA under 10B + modern harness beat pre-March 2025 frontier models like Grok 3/GPT-4o?

model-releasesr-localllama

Hey experts! I genuinely have this question and would love a general consensus from people actually using these models. LLMs have advanced a lot in benchmarks and in practical usage. Even GPT-4o and G

Can Knowledge Transfer Parameters Be Learned? LePoKet for Efficient Robotic Vision

model-releasesarxiv-cs-cv

arXiv:2609.16637v1 Announce Type: new Abstract: Efficient perception is central to robotic systems operating under constrained computation, memory, and latency budgets. Knowledge transfer from larger

Can We Do Interpretable NLI with Graphs Based on Atomic Propositions?

arXiv:2609.16814v1 Announce Type: new Abstract: While Large Language Model (LLM)-based Natural Language Inference (NLI) systems achieve high accuracy, their decision-making processes lack auditable st

Channel-Informed Neural Network for Physical Layer Key Generation

arXiv:2609.16341v1 Announce Type: new Abstract: Physical-layer key generation (PKG) enables wireless devices to establish shared keys from reciprocal channel observations without directly exchanging t

Coaching Qwen3 Coder 30B to Think Like a CodeClash Arena Agent

arXiv:2609.16096v1 Announce Type: cross Abstract: Large language model coding agents have recently become useful for software tasks, but weaker or open-weight agents still struggle to reliably interpr

Agents

Coding Agents Have Converged: Why the SWE-bench Leaderboard Can No Longer Order Its Top Entries, and What to Measure Instead

arXiv:2609.17394v1 Announce Type: cross Abstract: Small differences on coding-agent leaderboards are often read as an ordering of systems. We audit whether the published verdicts support this reading,

agentsarxiv-cs-ai

Local Ai

Cognitive Admission Control: Risk-Conditioned Assurance for Consequential Actions in Agentic Distributed Systems

arXiv:2609.16313v1 Announce Type: cross Abstract: In agentic distributed systems, an agent may be authorized to mutate external infrastructure while lacking evidence that the mutation is ready to exec

local-aiarxiv-cs-ai

Conditioning noise is a free regularizer for LoRA fine-tuning: no pathology encoder required for diffusion-based artifact detection in histopathology

arXiv:2609.16032v1 Announce Type: cross Abstract: Diffusion-based artifact detectors score whole-slide image patches by reconstruction error under a model fine-tuned on clean tissue. We show that cond