Search: “evaluation”

Training Witnesses: Trusting the Training without Trusting the Trainer

arXiv:2609.33915v1 Announce Type: new Abstract: Progress in machine learning cannot outpace our ability to verify it. With an explosion in papers today, every scientific claim rests initially on trust

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

TriDrive: Joint Driver, Vehicle, and Road Modeling for Forecasting and Driver Monitoring

DGX agent

arXiv:2609.33000v1 Announce Type: cross Abstract: Predicting how drivers, vehicles, and road scenes interact and evolve together is central to driver monitoring. Prior work models in-cabin activity or

model-releasesarxiv-cs-cv

29 Sept 2026

Applications

Two Heads Are Better Than One: Aggregating Weaker LLMs for Better Forecasts

arXiv:2609.33257v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used to forecast real-world events, but access to the strongest individual forecaster may be costly or oth

applicationsarxiv-cs-lg

Type-Balanced Federated Learning for Visual Analog Meter Reading

arXiv:2609.31998v1 Announce Type: new Abstract: Analog dial meters are widely deployed in industrial applications and utility sites, where environments and meter types vary and inspection data may be

Local Ai

Typed Temporal Interaction Features for Simulation-Backed Forecasting of Open-Source Game Release Incidents

arXiv:2609.31647v1 Announce Type: new Abstract: Open-source video-game quality depends on inter-actions among code, assets, configuration, tests, contributors, and issue workflows, yet conventional de

local-aiarxiv-cs-lg

Uncertainty-Aware Selection of Online Algorithms with Simulator Ensembles

arXiv:2609.32170v1 Announce Type: new Abstract: The performance of online reinforcement learning depends critically on design choices, especially those that affect exploration. These choices are often

USAI-Quant: A Quantitative Reasoning Benchmark for Vision-Language Models in Built Environments

arXiv:2609.32813v1 Announce Type: new Abstract: Large vision-language models (VLMs) have emerged as a powerful paradigm for urban and spatial AI. However, current state-of-the-art large VLMs still str

Local Ai

VCRE-Fib: View-Conditioned Regional Evidence for Fine-Grained Ultrasound Grading of Schistosoma japonicum-Associated Liver Fibrosis

arXiv:2609.32840v1 Announce Type: new Abstract: Accurate assessment of Schistosoma japonicum-associated liver fibrosis is essential for disease management and long-term follow-up in endemic regions. U

local-aiarxiv-cs-cv

We’re also reopening Pro 200 subscriptions, with continued access to frontier models like Astra, including our new GPT-6.1 Sol model which b…

We’re also reopening Pro 200 subscriptions, with continued access to frontier models like Astra, including our new GPT-6.1 Sol model which brings near-Astra capabilities to a model you can use every d

model-releasesopenai--x

When Do Model Internals Help? Exploring the Role of Representation Engineering in LLM Safety

arXiv:2609.34771v1 Announce Type: cross Abstract: Reliable AI safeguards require both control mechanisms that reduce unsafe behavior and monitoring mechanisms that detect safety risks during model int

safetyarxiv-cs-lg

When Does an Image Determine the Answer? Benchmarking Visual Answerability across Charts and Scenes

arXiv:2609.34480v1 Announce Type: new Abstract: Reliable visual question answering requires correct answers when evidence is sufficient and abstention when it is not. We introduce a benchmark that con

Where Memory Belongs: Ledger, an Object Ledger for Memory-Augmented VLAs

arXiv:2609.34554v1 Announce Type: new Abstract: Memory is essential for long-horizon, partially observed robotic manipulation: a robot must remember which object was placed in a drawer, whose cup it m

safetyarxiv-cs-ro

WirelessMathBench-XL: An Auditable Benchmark for Wireless Mathematical Reasoning

model-releasesarxiv-cs-lg

arXiv:2509.23219v2 Announce Type: replace Abstract: Technical-domain benchmarks constructed from arXiv papers can overlap the same public text used in LLM pretraining. Auditing this risk at training-c

YuE2: Unifying Symbolic and Audio Music Generation at Frontier Quality

model-releasesarxiv-cs-lg

arXiv:2609.33757v1 Announce Type: cross Abstract: Symbolic models make melody, harmony, rhythm, and form explicit but typically stop before a finished recording; audio models produce complete songs wh

A Framework for Identifying, Categorizing, and Explaining Bias in AI-Generated Code

arXiv:2609.30642v1 Announce Type: cross Abstract: As Large Language Models (LLMs) become integrated into software development workflows, concerns regarding unintentional biases in AI-generated code. A

A Mechanistic Study of AI-Text Detection Neurons in Frozen BERT: Sparse Probing and Activation Patching on RAID

arXiv:2609.30287v1 Announce Type: cross Abstract: AI-generated text detectors achieve high accuracy on standard benchmarks, yet the internal representations that drive these predictions remain poorly

Action Forcing: Training World Models on Unsupervised Video by Recovering Underlying Egomotion Bases

arXiv:2609.30595v1 Announce Type: cross Abstract: Synchronised action annotations are needed to train controllable world models and these datasets remain elusive. Existing approaches make use of instr

researcharxiv-cs-ai

Agents

Agentic Limit Order Books: Phase Transitions and Market Impact

arXiv:2609.31260v1 Announce Type: cross Abstract: We investigate the systemic macroscopic dynamics emerging from Limit Order Books (LOBs) populated exclusively by autonomous reinforcement-learning age

agentsarxiv-cs-ai

Agents

AgentXploit: Autonomous Repository-to-Runtime Red-Teaming for AI Agents

arXiv:2609.31318v1 Announce Type: cross Abstract: AI agents combine language models with external data and tools that can modify files, call APIs, or execute code. Security failures can arise when adv

agentsarxiv-cs-ai

An OpenAI agent security executive discusses the Hugging Face incident, OpenAI's response, sandboxing improvements, alignment, 'reasonable paranoia', and more (Joe/@joedaroo)

Joe / @joedaroo: An OpenAI agent security executive discusses the Hugging Face incident, OpenAI's response, sandboxing improvements, alignment, “reasonable paranoia”, and more — Took a minute to write

safetytechmeme

Auditing System-1 Models on Biosecurity-Relevant Benchmarks: Calibration, Selective Prediction, and Permutation Instability in a Non-Generative Model

arXiv:2609.30454v1 Announce Type: new Abstract: Non-generative 'System-1' models return structured probabilistic decisions in a single forward pass, without autoregressive decoding, at a small fractio

Backbone-Adaptive Evidence Routing for Robust Pairwise LLM Judging

arXiv:2609.30751v1 Announce Type: new Abstract: Pairwise language-model judges can gather evidence through direct comparison, reasoning, or reference-based verification, but no single protocol is best

Applications

BreathGRU: A Novel Semi-Supervised Bidirectional Gated Recurrent Unit Framework for Speech and Breath Segmentation for Respiratory Audio

arXiv:2609.31165v1 Announce Type: cross Abstract: Speech-breath segmentation is a fundamental preprocessing step in respiratory audio analysis, enabling applications such as respiratory acoustic bioma

applicationsarxiv-cs-lg

Bridging LLM Agents and Data Spaces: An Architectural Mediation Approach using the Model Context Protocol

arXiv:2609.30341v1 Announce Type: new Abstract: Data Spaces enable sovereign and governed data sharing across organizational boundaries, but their integration with AI agents remains challenging due to

safetyarxiv-cs-ai

Agents

Bringing AI to Autonomous Systems -- From Cognition to Collective Intelligence

arXiv:2609.30291v1 Announce Type: new Abstract: The purpose of this article is to highlight the central role of autonomous systems as the ultimate stage in the development of AI, to explain the underl

agentsarxiv-cs-ai

Can a Robot Read Braille? - Learning to Adapt Contact via Imitation Learning for Tactile Braille Recognition

arXiv:2609.30676v1 Announce Type: new Abstract: For people who are blind, touch provides an essen-tial channel for accessing written information through Braille. Bringing a similar capability to robot

safetyarxiv-cs-ro

Can Linguistic Reasoning Vectors Enhance Multimodal Reasoning Ability?

arXiv:2609.31140v1 Announce Type: new Abstract: Most Vision-Language Models (VLMs) are built by extending pretrained Large Language Models (LLMs) with visual modules and multimodal alignment. However,

Can Pixels Alone Reveal Image Origin? Minimax Limits and Learnable Interfaces for Passive Provenance

arXiv:2609.30997v1 Announce Type: cross Abstract: Passive image provenance asks whether pixels alone can reveal where an image came from: a human, an aggregate AI class, or a particular generator. Thi

Common-Mode Collapse and Recovery in Direct Feedback Alignment

arXiv:2609.31589v1 Announce Type: new Abstract: Direct feedback alignment (DFA) trains hidden layers through fixed random projections of output error. With tanh hidden units and independent sigmoid ou

safetyarxiv-cs-lg

Applications

Completed Pairs Hide Capped Failures: A ReVerPi Case Study of Selective Context Projection

arXiv:2609.31381v1 Announce Type: new Abstract: Context projection replaces older tool observations with compact, addressable excerpts, reducing repeated input while potentially adding evidence-retrie

applicationsarxiv-cs-ai

ConsultMind:Towards Automated Diagnostic Consultation via Uncertainty-Aware Reasoning

arXiv:2609.30796v1 Announce Type: new Abstract: Diagnostic consultation is an online sequential decision-making process in which clinicians gather evidence through patient interaction until a diagnosi

Containing Behavioral Cascades from Manipulated Claims in LLM-Powered Multi-Robot Systems

arXiv:2609.30523v1 Announce Type: new Abstract: Large language model (LLM)-powered multi-robot systems are vulnerable to semantic manipulation: an accepted false world-state claim can trigger a fleet-

researcharxiv-cs-ro

CRNDiff: Count-Native Diffusion Framework via Chemical Reaction Networks

arXiv:2609.31149v1 Announce Type: new Abstract: Scientific measurements such as single-cell RNA (scRNA) sequencing often take the form of nonnegative integer counts, whereas continuous-state diffusion

DGT-Map: Directional Global Traversability Mapping Utilizing Multi-Task Learning for Heterogeneous Vehicles

arXiv:2609.30461v1 Announce Type: new Abstract: Off-road traversability is direction-dependent and vehicle specific, yet most global maps assign a single isotropic cost to each location. Existing lear

researcharxiv-cs-ro

Diagnosing the Sources of Compositional Failure in Vision-Language Models: A Controlled Analysis

arXiv:2609.31456v1 Announce Type: new Abstract: Vision-language models (VLMs) often struggle with compositional reasoning tasks, but the reasons for this underperformance remain unclear. A common hypo

Differentiable RNA Secondary Structure Extraction for Deep Learning

arXiv:2609.30752v1 Announce Type: new Abstract: Many deep learning approaches to RNA secondary structure prediction have recently been proposed. They typically output a weight matrix W where W_{ij} is

Hardware

every agent will need a sandbox and the harness should live outside it - separate the brains from the hands great to see nvidia open sourcin…

hardwareharrison-chase--x

every agent will need a sandbox and the harness should live outside it - separate the brains from the hands great to see nvidia open sourcing tools here, agree with Andrew this is part of the harness

FeatMark: Feature-level Watermark Protection against Mimicry Attacks with Diffusion Models

arXiv:2609.30980v1 Announce Type: cross Abstract: Text-to-image diffusion models enable data-efficient 'mimicry' attacks, wherein adversaries fine-tune the model on a handful of public photos to synth

FedHisto-PAST: Parameter-Efficient Stain-Aware Federated Learning for Cross-Site Lung Histopathology Classification

arXiv:2609.31150v1 Announce Type: cross Abstract: Cross-site lung histopathology classification must account for stain variation, non-IID client data, missing classes, and the cost of adapting large p

Gauss What You Need: Compact Gaussian Splatting Across Scene Scales

arXiv:2609.31248v1 Announce Type: new Abstract: 3D Gaussian Splatting reconstructs a scene as a collection of Gaussian primitives from a set of posed photographs called the capture. The number of prim

Highlight-Then-Summarize: Learning to Compress Evidence for Long-Context Understanding

arXiv:2609.31382v1 Announce Type: cross Abstract: Long-context understanding requires large language models (LLMs) to reason over lengthy documents, conversations, and code, yet task-relevant evidence

How DigitalOcean Manages Credentials for Autonomous Agents

** Built to align with NVIDIA’s Agent Safety Platform strategy for securing autonomous agents When an agent handles confidential material, it needs enough access to do the job and nothing else. The ha

safetydigitalocean

Image Reconstruction from Phase with Untrained Neural Priors

arXiv:2609.30659v1 Announce Type: cross Abstract: Fourier phase encodes important spatial image structure, but recovering an image without measured spectral magnitude requires additional constraints a

KneePreM: Towards 3D Knee MRI Foundation Models via Large-Scale Unlabeled Pretraining and Label-Efficient Fine-Tuning

arXiv:2609.31461v1 Announce Type: new Abstract: Background: Large volumes of unlabeled knee MRI scans are available across repositories but remain insufficiently leveraged. We developed KneePreM, a kn

Hardware

KuaFu: Compressing Long User Behavior into Understanding at Billion Scale

arXiv:2609.31045v1 Announce Type: cross Abstract: Conversational agents, generative recommenders, and personalized advertising all rest on one capability: understanding each user from raw behavior. Pr

hardwarearxiv-cs-cl

LEAD: An EEG Foundation Model for Alzheimer's Disease Detection

arXiv:2502.01678v5 Announce Type: replace-cross Abstract: Electroencephalography (EEG) provides a non-invasive, highly accessible, and cost-effective approach for detecting Alzheimer's disease (AD). H

researcharxiv-cs-ai

LensDesigner: A Self-Improving Agent for Optical Lens Design

arXiv:2609.30450v1 Announce Type: new Abstract: Optical lens design is a complex, non-convex optimization challenge that relies heavily on human experience and intuition. Existing optimized-based auto

MA-WAM: Multi-Agent World-Action Model for Test-Time Planning

arXiv:2609.31281v1 Announce Type: new Abstract: Multi-agent cooperative tasks require different agents to execute a joint action simultaneously, and each agent's action affects both the observations a

safetyarxiv-cs-ai