Search: “evaluation”

arXiv:2609.39185v1 Announce Type: new Abstract: Mamba-style and hybrid language models compress their past into a fixed-size recurrent state that is rewritten at every generated token. Storing this st

applicationsarxiv-cs-lg

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Making LLMs Say What They Think: Measuring and Improving CoT-Interpretability Alignment

DGX agent

arXiv:2609.38972v1 Announce Type: cross Abstract: Chain-of-thought (CoT) traces often serve as a proxy for how Large Language Models (LLMs) arrive at their answers. However, growing evidence shows tha

safetyarxiv-cs-ai

1 Oct 2026

Marking Contour Tones in Yoruba

arXiv:2609.38627v1 Announce Type: new Abstract: Yoruba is a tonal language in which contour tones pose persistent orthographic challenges. These are especially notable for personal names and lexical i

researcharxiv-cs-cl

Markovian Dynamics Enforcer: Feasibility Preserving Correction on Learned Dynamics Manifolds

arXiv:2609.39888v1 Announce Type: new Abstract: Neural trajectory predictors can reach low prediction error while violating dynamics, actuator limits, or state constraints, especially when controls ar

researcharxiv-cs-lg

Mid-Harness: Scaling Actions Between Model and Harness for Terminal Agents

arXiv:2609.39982v1 Announce Type: cross Abstract: Terminal agents act through stochastic model generations, yet the ability to generate a useful action does not ensure its reliable execution. A poor c

MiniRep: Robust Reputation-Based Aggregation for Multi-Agent Debate

arXiv:2609.39297v1 Announce Type: new Abstract: Autonomous agents powered by large language models (LLMs) are rapidly evolving into an open agentic ecosystem. To support trustworthy collaboration, ind

agentsarxiv-cs-ai

Local Ai

Mitigating Memorization In Language Models

arXiv:2410.02159v3 Announce Type: replace-cross Abstract: Language models (LMs) can 'memorize' information, i.e., encode training data in their weights in such a way that inference-time queries can le

local-aiarxiv-cs-ai

Mitigating Object Hallucination in Large Vision-Language Models via False Discovery Controlled Visual Data Splitting

arXiv:2609.38979v1 Announce Type: new Abstract: Multiple object hallucination, where large vision-language models (LVLMs) generate objects not supported by the visual input, is a persistent challenge

researcharxiv-cs-cv

Molecular Property Prediction under Structural Shift with Tabular Foundation Models

arXiv:2609.38744v1 Announce Type: new Abstract: Predicting molecular properties for compounds that differ structurally from labeled training molecules is important for drug discovery and materials des

Multi-LLM Collaborative Alignment via Stackelberg Games

arXiv:2609.39076v1 Announce Type: new Abstract: A pool of language models can collaborate and improve collectively by learning from one another's responses. These interactions depend on the instructio

safetyarxiv-cs-ai

Applications

NEXUS: Perceptive Whole-Body Control for Terrain-Adaptive Teleoperation

arXiv:2609.39000v1 Announce Type: new Abstract: Whole-body teleoperation requires a humanoid robot to reproduce a human operator's behavior even when their terrains differ. This demands that the robot

applicationsarxiv-cs-ro

No Corners Cut: State-Grounded Transitions for Mid-Stream Prompt Switches in Video Generation

model-releasesarxiv-cs-cv

arXiv:2609.38691v1 Announce Type: new Abstract: Streaming video generators allow users to dynamically modulate video synthesis via mid-stream prompt switching. Existing streaming methods can respond t

No Task Vector Is an Island: A Comprehensive Study on the Composability of Task Vectors from On-Policy Distillation

arXiv:2609.39405v1 Announce Type: new Abstract: Task vectors provide a simple mechanism for composing learned capabilities through model merging. However, the composability of task vectors produced by

OccluDex: Hierarchical 3D Visuo-Tactile Representation Learning for Egocentric Dexterous Manipulation under Self-Occlusion

arXiv:2609.39017v1 Announce Type: new Abstract: Reliable dexterous manipulation requires continuous estimation of object geometry and hand-object contact throughout interaction. With egocentric sensin

researcharxiv-cs-ro

On the Complexity of Preference-Based Bandits

arXiv:2609.39351v1 Announce Type: new Abstract: We study preference-based bandits with general reward function classes, where a learner sequentially selects pairs of arms and observes binary preferenc

On the (Generative) Linear Sketching Problem

arXiv:2603.14474v2 Announce Type: replace Abstract: Sketch techniques have been extensively studied in recent years and are especially well-suited to data streaming scenarios, where the sketch summary

researcharxiv-cs-lg

Hardware

Onboard Vision and MPC Navigation for Underwater Robots: An Open BlueROV2 Platform for Multi-Robot Experiments & Docking

arXiv:2609.38511v1 Announce Type: new Abstract: Autonomous underwater robots require robust perception, estimation and control to operate in confined environments. This paper presents an open-source B

hardwarearxiv-cs-ro

Online Evolution Strategy for Flow-Matching VLA Policies via Self-Supervised Trajectory Distribution Optimization

arXiv:2609.38855v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models based on generative frameworks, such as Flow Matching, have recently achieved impressive performance in robotic ma

OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoning

arXiv:2609.39150v1 Announce Type: new Abstract: Omni-modal large language models deployed in real-world environments encounter external noise that can interfere with their perception and understanding

safetyarxiv-cs-cv

OpenAI says that as of September 26, it has informed 100+ third-party organizations about unauthorized activity involving its AI agents (Arasu Kannagi Basil/Reuters)

Arasu Kannagi Basil / Reuters: OpenAI says that as of September 26, it has informed 100+ third-party organizations about unauthorized activity involving its AI agents — OpenAI has informed more than 1

agentstechmeme

Optimal Design for Active Preference Learning with Biased LLM Judges

arXiv:2609.38860v1 Announce Type: cross Abstract: Learning from human preferences is central to large language model (LLM) alignment, but human preference annotation is costly. Active preference learn

safetyarxiv-cs-ai

Overview of BioASQ 2026: The fourteenth BioASQ Challenge on Large-Scale Biomedical Semantic Indexing and Question Answering

arXiv:2609.39975v1 Announce Type: cross Abstract: This paper presents an overview of the fourteenth edition of the BioASQ challenge, organized in the context of the Conference and Labs of the Evaluati

Tutorials

P-SRM: Selective Recovery of Rejected Predictions in Visual Tracking

arXiv:2609.39832v1 Announce Type: new Abstract: Many visual tracking methods use rejection mechanisms to suppress unreliable predictions. However, these mechanisms can also reject correctly localized

tutorialsarxiv-cs-cv

PANDA: A Decentralized Architecture with Flexible Orchestration for Scalable, Fault-Tolerant Multi-Agent Systems

arXiv:2609.38482v1 Announce Type: cross Abstract: Existing architectures for LLM-based multi-agent systems (MAS) cannot reliably and efficiently solve multi-step tasks at scale: they struggle to suppo

Parameterization method of reservoir properties for ensemble-based data assimilation using intermediate latent space of StyleGAN

arXiv:2609.39626v1 Announce Type: cross Abstract: Ensemble smoothers are the most successful and efficient techniques currently available for history matching. However, because these methods rely on G

Path-Following Control and Terramechanics Analysis for Planetary Rovers Under Wheel-to-Wheel Traction Asymmetry

arXiv:2609.38715v1 Announce Type: new Abstract: This paper proposes a control strategy for path following that is model-free and relies solely on deceleration for skid-steering planetary rovers naviga

researcharxiv-cs-ro

PathAnchor: Path-Structured Evidence for Scientific Agents

arXiv:2609.38766v1 Announce Type: new Abstract: Scientific agents can retrieve relevant passages yet still lose functional order, mix evidence across sources, or state conclusions that exceed the retr

agentsarxiv-cs-ai

Patient-Centered Treatment Planning for Chronic Multimorbidity: A Hierarchical Reinforcement Learning Framework for Preference Modeling

arXiv:2609.39911v1 Announce Type: new Abstract: Patient preference, defined as a patient's demonstrated willingness and capacity to adhere to clinical recommendations, is a primary determinant of ther

researcharxiv-cs-lg

Perceptual Color Difference Modeling Using Machine Learning and Human Similarity Judgments

arXiv:2609.39130v1 Announce Type: new Abstract: Accurate assessment of color differences is essential for applications ranging from digital design to quality control. While existing color difference m

researcharxiv-cs-cv

Personalized State-Transition-Aware Memory for Clinical Agents

arXiv:2609.38490v1 Announce Type: cross Abstract: Large language model (LLM) agents that reason over clinical records must track changes in a patient's state while preserving the history needed to und

PhasePlan: Ordered Future-Phase Planning for Robot Brain Models

arXiv:2609.39970v1 Announce Type: new Abstract: Robot brain models integrate vision, language, and robot state to generate actions for complex manipulation tasks. Most predict fixed-length action chun

safetyarxiv-cs-ro

Physics-Informed Method of Group Data Handling: Adaptive Construction of Functional Representations with an Application to the Navier-Stokes Equations

arXiv:2609.39291v1 Announce Type: new Abstract: Physics-informed computational methods usually optimize parameters within a functional representation whose structure is fixed in advance. This work pro

PISCO: Precise Video Instance Insertion with Sparse Control

arXiv:2602.08277v3 Announce Type: replace-cross Abstract: The landscape of AI video generation is undergoing a pivotal shift: moving beyond general generation - which relies on exhaustive prompt-engin

Plan-Conditioned Imitation for Robust Object Retrieval under Self-Occlusion in Dense Clutter

model-releasesarxiv-cs-ro

arXiv:2609.38857v1 Announce Type: new Abstract: Retrieving objects from dense clutter requires rearrangement during which the manipulator can occlude objects while moving them. Repeated arm withdrawal

Applications

PneuTac: Tactile Manipulation with Soft Pneumatic Robots via Unified MPM-Gaussian Splatting Simulation

arXiv:2609.38418v1 Announce Type: new Abstract: Soft robots and tactile sensors have demonstrated great potential in delicate manipulation tasks. Soft pneumatic robots enable safe contact through comp

applicationsarxiv-cs-ro

Prediction is Better than Detection: Traffic Congestion Control using Drones

arXiv:2609.39637v1 Announce Type: new Abstract: A central question in deploying teams of mobile robots for persistent monitoring is how task performance scales with fleet size, and whether this scalin

safetyarxiv-cs-ro

PrivMeSA: Privacy-Aware Self-Evolving Multi-Agent System for Medicine via Local-Remote LLM Collaboration

arXiv:2609.38458v1 Announce Type: new Abstract: Clinical large language model (LLM) agents deployed locally can consult more capable remote models, but doing so risks exposing patient information. Pri

Provable Test-Time Scaling for Beam Search in LLM Reasoning

arXiv:2609.38672v1 Announce Type: cross Abstract: Beam-search-based test-time methods provide an effective way to improve large language model (LLM) performance on long-horizon generation by pruning i

Tutorials

Pseudo-Label-Triggered Retraining from Forecast Errors for Online Time Series Forecasting

arXiv:2609.39789v1 Announce Type: cross Abstract: Real-world time series forecasting systems operate under non-stationary data streams, where forecasting performance may degrade over time. Although re

tutorialsarxiv-cs-ai

QATFactory: A Versatile, Deployment-Aligned Framework for Quantization-aware Training and Distillation of LLMs

arXiv:2609.39223v1 Announce Type: new Abstract: Large language model (LLM) inference is increasingly moving toward lower precision to realize the throughput of hardware accelerators, but aggressive po

Qwen3.8-27B Q4_K_M on one RTX 3090 + OpenCode: throughput, four coding tasks, and a reasoning-budget failure

model-releasesr-localllama

I put an old RTX 3090 to work as a local coding agent with Qwen3.8-27B, llama.cpp, and OpenCode. Here are the setup and results, including what failed. This is a summary of my own blog post, linked be

RAGScope: A Leakage-Controlled, Cost-Aware Evidence-Gating Protocol for RAG Hallucination Triage

arXiv:2609.39075v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) systems need inexpensive ways to route generated answers: accept low-risk outputs, review uncertain ones, and res

Rank-Constrained Adaptation for Reliable Real-World Performance

arXiv:2602.06924v3 Announce Type: replace Abstract: Deep learning models trained to optimize average accuracy often exhibit systematic failures on particular subpopulations. In real-world settings lik

Reach Into The CHOIR: Free-List Elicitation Uncovers Distinct Model Voices in LLM Ensembles

arXiv:2609.38448v1 Announce Type: new Abstract: Open-ended LLM homogeneity can create false plurality when several systems appear to offer independent perspectives while returning the same familiar de

RefCon: Iterative Refinement and Contrastive Memory Extraction for Context-Evolving Agent

arXiv:2609.39143v1 Announce Type: new Abstract: Long-horizon agent interactions generate useful but noisy experience, and retraining models to absorb it is expensive. Context-evolving agents therefore

agentsarxiv-cs-ai

Reliability-Aware Checkpoint Selection for Domain Generalization

arXiv:2609.39934v1 Announce Type: cross Abstract: Checkpoint selection in domain generalization often relies on source-validation accuracy, yet the selected checkpoint need not provide reliable probab

researcharxiv-cs-cv

Residual Wrench Certification and Margin-Aware Control Synthesis for Aerial Physical Interaction

arXiv:2609.38707v1 Announce Type: new Abstract: We develop a task-relative framework for certifying residual wrench authority after hover and contact loading in multirotors with bounded actuators. Usi

researcharxiv-cs-ro

ResidualKV: Residual-Based KV Cache Compression for Efficient Long-Context Inference

arXiv:2602.08005v2 Announce Type: replace-cross Abstract: Efficient long-context inference faces two coupled bottlenecks: KV-cache memory grows linearly with context length, while attention computatio