Search: “evaluation”

We discovered and communicated with a Chinese AI agent fleet. We believe this is the first time that researchers have ever made contact with…

We discovered and communicated with a Chinese AI agent fleet. We believe this is the first time that researchers have ever made contact with a rogue agent fleet in the wild. Nearly all prior public ag

agentsemad-mostaque--x

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

What AI Safety needs is better tooling and engineering. For instance, building stronger red-teaming tools. Great to see this open-source eff…

DGX agent

What AI Safety needs is better tooling and engineering. For instance, building stronger red-teaming tools. Great to see this open-source effort to red-team image models. It seems to learn better ways

model-releasesdair-ai--x

14 Oct 2026

What Can Language Models Inherit from Solomonoff Induction? Limits, Attainable Properties, and What Served Conditionals Reveal

arXiv:2610.14007v1 Announce Type: new Abstract: A familiar line of reasoning runs as follows: language models are flexible approximators trained under a strictly proper loss, so scale brings them clos

What Limits Cross-Task Generalization in World Action Models?

arXiv:2610.16641v1 Announce Type: new Abstract: Cross-task generalization remains difficult for world action models (WAMs), even when their predicted futures depict plausible manipulation. This gap ca

researcharxiv-cs-ro

When LLM Agents See a Conflict but Still Proceed: Cross-Domain Dependencies in Network Slicing

arXiv:2610.17118v1 Announce Type: cross Abstract: Future AI-native networks are being designed to apply autonomous agents built on large language models (LLMs) in network management through intents. W

agentsarxiv-cs-lg

Local Ai

When Missingness Follows the Graph: Beyond Feature Propagation for Missing Features

arXiv:2610.18113v1 Announce Type: new Abstract: Graph Neural Networks (GNNs) commonly assume that node features are fully observed, despite missing features being pervasive in real-world applications.

local-aiarxiv-cs-lg

When Repeated Measurements Hurt Tabular Foundation Models

arXiv:2610.16801v1 Announce Type: cross Abstract: Tabular foundation models (TFMs) achieve state-of-the-art performance on IID benchmarks, but how do they respond to repeated measurements at the same

researcharxiv-cs-lg

When, Where, and Why: Hierarchical Causal Explainability for Video Face Understanding with MLLMs

arXiv:2610.17791v1 Announce Type: new Abstract: Understanding facial behaviour in video requires answering three fundamental questions: when a key facial expression occurs, where the model attends on

researcharxiv-cs-cv

Where Small Mistakes Matter: Quantifying State Criticality for Imitation Learning

arXiv:2610.17709v1 Announce Type: new Abstract: Imitation learning typically treats every demonstration state as equally important, optimizing a behavior-cloning objective uniformly across the dataset

safetyarxiv-cs-lg

Which Optimizer Leaks Most? Optimizer Implicit Bias as a Training-Data Privacy Controller

arXiv:2610.18294v1 Announce Type: new Abstract: Releasing a neural network checkpoint can leak information about its training data, and existing reconstruction results rely on gradient-descent trainin

safetyarxiv-cs-lg

Who to Trust in Multi-Robot Systems: Joint Robot and Object Hypothesis Trust Inference via Neural-Symbolic Cross-Validation

model-releasesarxiv-cs-ro

arXiv:2610.14530v1 Announce Type: new Abstract: Multi-robot systems (MRS) offer significant advantages over single-robot platforms by enabling information sharing and coordination for different tasks

WIRE: Weight Space Implicit Representation Encoding of Frozen Video LLMs

model-releasesarxiv-cs-cv

arXiv:2610.17355v1 Announce Type: new Abstract: Video language models represent a video as a long sequence of visual embeddings in a decoder's input. Every visual embedding is processed by every decod

WisdomNet: trustable machine learning toward error-free classification

arXiv:2610.15299v1 Announce Type: new Abstract: Misclassification is a critical problem in many machine learning applications. Since even the classifier models with high accuracy (e.g., > 95%) still i

researcharxiv-cs-lg

World2TS: Real-World Event Context for Time-Series Forecasting

arXiv:2610.14861v1 Announce Type: new Abstract: Time-series forecasting plays a vital role in a wide range of real-world applications. Recent approaches have achieved strong performance by modeling te

agentsarxiv-cs-lg

YOUDrive: Driving Style as a Composable Direction for End-to-End Autonomous Driving

model-releasesarxiv-cs-cv

arXiv:2610.14802v1 Announce Type: new Abstract: End-to-end driving policies can achieve strong task performance while offering limited control over their driving style. Driving style describes how a v

ZOIF: Zeroth-Order Influence Function Estimation for LLM Data Selection Using Only Forward Passes

arXiv:2610.15336v1 Announce Type: new Abstract: Influence functions enable principled data selection for large language models (e.g., identifying influential training samples for model editing, debugg

zPocket: Better Pocket Finding with Frozen Co-Folding Features

arXiv:2610.17696v1 Announce Type: new Abstract: Identifying protein-ligand binding sites (pockets) is important for understanding protein function and developing drugs. However, no public method has l

Local Ai

A gap that has been fixed in our methodology that highlighted a decline was not including local models (GGUF, AWQ, ONNX, etc). Earlier, thes…

A gap that has been fixed in our methodology that highlighted a decline was not including local models (GGUF, AWQ, ONNX, etc). Earlier, these were far harder to track and closer to a rounding error. N

local-aiclem-delangue--x

Inside Action Gateway in Managed Agents

A coding agent finishes a change and wants to open a GitHub issue with a link to its results. The agent can describe the issue, but creating it belongs to a different system. It needs a tool that can

safetydigitalocean

Update: Converting dense models into Mixture-of-Experts

model-releasesr-localllama

This is an update to my previous post which can be found here: https://www.reddit.com/r/LocalLLaMA/s/n7sgRZZc4z Since my last post I have continued working on the conversion process and also convertin

Where do LLMs actually earn their place in a recommender system? Kim Falk’s new book + 5 ebook giveaway [D]

model-releasesr-machinelearning

Hi r/MachineLearning, Stjepan from Manning here. The mods approved this post, and I appreciate being welcomed back to share another book with you. We’ve just launched AI Recommender Systems: Transform

10 Years of the SRE book: Announcing the second edition of 'Site Reliability Engineering”

model-releasesgoogle-cloud-ai

A decade ago, Google released Site Reliability Engineering: How Google Runs Production Systems with O'Reilly Media. What began as a collection of our practices for managing large-scale infrastructure

Local Ai

A Local Agentic AI Framework to Generate Edge Case Scenarios for Safety Assurance

arXiv:2610.13479v1 Announce Type: new Abstract: Generating edge case scenarios is crucial for training, testing and safety assuring autonomous systems. This identifies hazardous failures to increase s

local-aiarxiv-cs-ai

A Step Harder, Not a Step Too Far: The Benefits and Limits of Curriculum Difficulty Progression in GRPO

arXiv:2610.13669v1 Announce Type: new Abstract: Curriculum learning typically organizes training samples from easy to hard. In GRPO, medium-difficulty samples are attractive for online selection becau

ABLEIST: Intersectional Disability Bias in LLM-Generated Hiring Scenarios

arXiv:2510.10998v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are increasingly under scrutiny for perpetuating identity-based discrimination in high-stakes domains such as hir

Applications

Acoustic Biomarkers for Alzheimer's Disease Detection from Spontaneous Speech

arXiv:2610.12500v1 Announce Type: cross Abstract: Alzheimer's disease (AD) remains a major public health challenge, and early identification is crucial for timely intervention and care planning. Recen

applicationsarxiv-cs-lg

AdaC-GRPO: Towards Mastering Long-Horizon Visual Sudoku Puzzles via Adaptive Curriculum Learning

arXiv:2610.13184v1 Announce Type: new Abstract: While reinforcement learning with verifiable reward (RLVR) enhances reasoning in large language models, its efficacy in long-horizon multimodal tasks re

Agent4Spec: An LLM-based Agentic System to Optimize API Specifications through Automated Validation and Market Analysis

arXiv:2610.13273v1 Announce Type: cross Abstract: API specifications serve as critical documentation for modern software development, directly impacting integration efficiency and client code generati

agentsarxiv-cs-ai

AgentSWE: Can Coding Agents Build the Agent You Actually Want?

arXiv:2610.13361v1 Announce Type: cross Abstract: As the production of software passes into the hands of software itself, coding agents are increasingly commissioned to build agents fitted to their us

AI-Mediation in Retail Markets: Revenue Effects and Assortment Optimization

arXiv:2610.12917v1 Announce Type: new Abstract: AI shopping assistants increasingly influence which products consumers consider. We study retail assortment planning under AI mediation, where a retaile

researcharxiv-cs-ai

Industry

Anthropic researchers say small AI models may be months away from being able to self-replicate on IoT devices like smart ovens and off-brand Android TV boxes (Anthropic)

Anthropic: Anthropic researchers say small AI models may be months away from being able to self-replicate on IoT devices like smart ovens and off-brand Android TV boxes — Our experiments suggest that

industrytechmeme

Attention Sees, MLP Refuses: Tracing the Attention-to-MLP Safety Pathway in LLMs

arXiv:2610.13078v1 Announce Type: new Abstract: Safety-aligned large language models (LLMs) remain vulnerable to jailbreaks and can over-refuse benign requests. Understanding these failures requires d

AudioTETRIS: Token Elimination via Transitional Importance Signals for Efficient Audio LLMs

arXiv:2610.13600v1 Announce Type: cross Abstract: Large Audio Language Models (LALMs) achieve strong performance on speech-text tasks, but standard audio encoders produce hundreds of tokens for even s

Behind-the-Meter Photovoltaic Visibility from Net Smart Meters: Deployment Regimes and Operational Insights

arXiv:2610.12527v1 Announce Type: new Abstract: Distribution operators need visibility of behind-the-meter photovoltaic (PV) generation, yet most residential customers are observed only through net sm

BenCoDiC: A Large-Scale Contextual Cyberbullying Corpus for Bengali Political News Discourse FULL VERSION

arXiv:2610.13121v1 Announce Type: new Abstract: Cyberbullying is a growing concern in online communities, yet existing Bengali corpora remain limited in contextual information, annotation transparency

researcharxiv-cs-cl

Beyond Binary Verifiable Rewards: Behavioral Self-Rewarding for SWE Agents

arXiv:2610.12598v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) provides reliable supervision for software engineering agents through executable tests, but binary

Beyond Semantic IDs: Finite-Beam Reachability and Continuous-Query Generation in Generative Recommendation

arXiv:2610.12977v1 Announce Type: new Abstract: Generative recommendation (GR) of social media platforms commonly retrieves items by autoregressively decoding discrete Semantic IDs (SIDs) with finite-

researcharxiv-cs-ai

Beyond Successful Robot Demonstrations: Learning from Human Interactions and Modeling Failure Dynamics

arXiv:2610.13522v1 Announce Type: new Abstract: Action-conditioned world models offer a promising foundation for generalist robotic intelligence by predicting the consequences of actions. However, exi

safetyarxiv-cs-ro

Boole-1.7B: A 1-bit Qwen3-1.7B model that outperforms Bonsai-1.7B

model-releasesr-localllama

We're launching Precision Numerics by releasing Boole-1.7B, a 1-bit version of Qwen3-1.7B. 247 MB packed weights: 13.9× smaller than BF16. 85.9% of the BF16 model’s average score across our 10-task ev

Branching On-Policy Distillation

arXiv:2610.13481v1 Announce Type: new Abstract: On-policy distillation (OPD) provides teacher supervision on student-generated trajectories, but a single trajectory realizes only one continuation at e

Byzantine-Resilient Federated Large Language Model via Hypergraph Message Passing

arXiv:2610.12711v1 Announce Type: new Abstract: Federated Large Language Models (FedLLMs) are promising to deliver privacy-preserving, collaborative intelligence. The decentralized training process is

Cancerous Backdoor Attack: Gradual Activation via Invisible Tokens and A Stage Controller

arXiv:2610.12644v1 Announce Type: cross Abstract: Backdoor Attacks on Large Language Models (LLMs) typically follow a trigger-response pattern, where satisfying a trigger condition activates a single

researcharxiv-cs-ai

CAST: Credit Alignment for Cross-Tokenizer On-Policy Distillation

model-releasesarxiv-cs-cl

arXiv:2610.13257v1 Announce Type: cross Abstract: Cross-tokenizer on-policy distillation (OPD) requires aligning teacher and student sequences before their scores can be compared. Decoded-text alignme

CB-Orchestrator: Adaptive Workflow Optimization for LLM Agents via Contextual Bandits

arXiv:2610.13064v1 Announce Type: new Abstract: Large Language Model (LLM) agents have demonstrated remarkable capabilities in tackling complex tasks through agentic workflows. However, manually desig

agentsarxiv-cs-lg

CLEAT: Learning Value-Guided Clarification for Interactive Agents

arXiv:2610.12655v1 Announce Type: new Abstract: LLM agents can execute increasingly complex tasks, but effective assistance also requires aligning their actions with goals and constraints that users m

Collaborative Learning and Reasoning over Model Slices

arXiv:2610.12927v1 Announce Type: new Abstract: Large language models (LLMs) excel across diverse tasks, benefiting from knowledge priors, in-context reasoning, and test-time computation. Despite thes

Constrained Probabilistic Numerics: Gaussian Process Solvers for Linear PDEs under Linear Inequality Constraints

arXiv:2610.13804v1 Announce Type: cross Abstract: Gaussian process solvers for linear partial differential equations (PDEs) return posteriors rather than point estimates, but they condition only on eq

Constructing Pareto Frontiers of Optimal Reasoning Termination Methods for Overthinking in Reasoning Models

arXiv:2610.13570v1 Announce Type: new Abstract: Reasoning models can benefit from test-time scaling, but continued reasoning may become ineffective or harmful, a phenomenon termed overthinking. Evalua