Search: “evaluation”

LLMs Struggle to Measure What Distinguishes Students of Different Proficiency Levels: A Study of Item Discrimination in Reading Comprehension Assessment

arXiv:2606.18709v2 Announce Type: replace Abstract: Existing work on LLM-based educational assessment has focused largely on item difficulty, but difficulty alone does not indicate whether an item mea

safetyarxiv-cs-cl

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Long-term Measurements: Towards a Longitudinal Understanding of Human-AI Interactions

DGX agent

arXiv:2608.02491v2 Announce Type: replace Abstract: Language models have taken on the role of a very new type of technology, by virtue of their 'human-ness' and rapid integration into users' daily liv

safetyarxiv-cs-ai

6 Aug 2026

Looking in the Mirror: Introspecting Side-Effect Misalignments Induced by Fine-Tuning

arXiv:2608.04347v1 Announce Type: new Abstract: Fine-tuning enables a source model to acquire desired capabilities and behaviors in a target domain while retaining much of its general-purpose competen

safetyarxiv-cs-lg

LoRetta: A Foundation Model and Extensive Dataset for Global-Scale Remote Sensing Dense Image Matching

arXiv:2608.04106v1 Announce Type: new Abstract: Dense image matching establishes pixel-wise correspondences and underpins broad applications in computer vision and photogrammetry. However, extending d

Mamba with Hierarchical Memory: Solving Representation Bottleneck in Long Sequence Modeling

arXiv:2608.02347v2 Announce Type: replace Abstract: Recurrent linear attention models (RLAs) such as Mamba offer efficient linear-time sequence modeling as an alternative to Transformers, yet their fi

researcharxiv-cs-ai

Manipulation-Proof Oblivious Audits against Deceptive Model Providers

arXiv:2608.04365v1 Announce Type: new Abstract: Audits have emerged as a critical instrument for algorithmic governance, providing a mechanism for external scrutiny and governance of machine learning

safetyarxiv-cs-lg

MarsCast: Transfer Learning of AI Weather Foundation Models to Planetary Atmospheres

arXiv:2608.05054v1 Announce Type: cross Abstract: We investigate the transferability of Earth weather foundation models to planetary atmospheres by adapting the GraphCast graph neural weather forecast

researcharxiv-cs-ai

Mimir: A Neuro-Symbolic Memory System with Dynamic Grounding for Embodied Agents in Interactive Environments

model-releasesarxiv-cs-ro

arXiv:2608.04933v1 Announce Type: new Abstract: Long-horizon embodied task requires agents to act under partial observability while preserving both scene belief and execution progress. Flat histories

Mirendil taps AI Hypercomputer TPUs and GPUs for pre- and post-training applications

model-releasesgoogle-cloud-ai

Nearly every major AI lab uses Google Cloud infrastructure, including for training of models, inference for agents, and new frontier research. Google Cloud also continues to be the platform of choice

MOAT: Model-Agnostic Randomized Transformations for preventing Efficiency Degradation Attacks on ViTs

arXiv:2608.04680v1 Announce Type: cross Abstract: To adopt the Vision Transformers (ViTs) in resource-constrained environment, token pruning is widely used to reduce computational cost without impacti

Monte Carlo Tree Search for Table-to-Multimodal Report Generation

arXiv:2608.04071v1 Announce Type: new Abstract: Automatically generating professional multimodal reports comprising both textual analysis and visual charts from structured tabular data is a critical c

Tutorials

NeuMoSync: End-to-End Neuromodulatory Control for Plasticity and Adaptability in Continual Learning

arXiv:2608.04358v1 Announce Type: new Abstract: Continual learning (CL) requires models to learn tasks sequentially, yet deep neural networks often suffer from plasticity loss and poor knowledge trans

tutorialsarxiv-cs-ai

NOLLI: A Difficulty-Calibrated Puzzle Benchmark for Diagnosing the English-Korean Performance Gap

model-releasesarxiv-cs-cl

arXiv:2608.04397v1 Announce Type: new Abstract: We introduce NOLLI, a procedurally generated English-Korean puzzle benchmark designed to diagnose where Korean performance gaps arise. It comprises 15 p

Nonparametric Goodness-of-fit Testing under Covariate Shift

arXiv:2608.04860v1 Announce Type: cross Abstract: This paper develops procedures for nonparametric goodness-of-fit testing under covariate shift, where labelled data are drawn from a source population

researcharxiv-cs-lg

Not All Redundant Tokens Are Alike: Analyzing Visual Token Pruning through Token Roles

arXiv:2608.04483v1 Announce Type: new Abstract: Vision-language models (VLMs) process an image as a sequence of visual tokens, which creates a substantial computational bottleneck during inference. Re

safetyarxiv-cs-cv

Not Every Divergence Should Be Suppressed: Counterfactual Recoverability in On-Policy Distillation

arXiv:2608.04408v1 Announce Type: cross Abstract: On-policy distillation (OPD) supervises student-visited trajectories, yet divergence-based rules cannot determine whether an erroneous prefix remains

safetyarxiv-cs-ai

NSF-HRPT: Neural Semantic Field meets Hierarchical Risk Perception Tree for Safety-Critical Scenario Assessment

arXiv:2608.04776v1 Announce Type: new Abstract: The ability to accurately assess and anticipate risks in safety-critical scenarios is crucial for autonomous driving systems. While existing research ha

safetyarxiv-cs-ai

NuclearDiffusion: Text-to-Image Foundation Models for Learning Nuclear Energy Concepts

arXiv:2608.04030v1 Announce Type: cross Abstract: Generative artificial intelligence (AI) has transformed text-to-image synthesis, yet its ability to represent specialized engineering domains remains

Agents

OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modeling

arXiv:2608.05141v1 Announce Type: new Abstract: Context lengths of language models (LMs) have dramatically increased, driven by the demands for in-context learning, self-improvement, and long-horizon

agentsarxiv-cs-ai

ODRA: Synthesizing Cognitive Behavioral Therapy Sessions with Structured Chain-Of-Thought and Dynamic Patient Resistance

arXiv:2608.04524v1 Announce Type: new Abstract: Synthetic generation of Cognitive Behavioral Therapy (CBT) sessions is challenged by two competing demands: adhering to strict therapeutic structure whi

safetyarxiv-cs-cl

OmniVR: Joint Video-Audio Conditional Generation for Restoring Degraded Historical Films

arXiv:2608.04224v1 Announce Type: new Abstract: Historical films suffer from co-occurring visual and audio degradations---blur, noise, flicker, hiss, clipping, and dropout---yet existing methods resto

On The Suitability of Differential Dataflow For Datalog Interpretation In Highly Dynamic Settings

arXiv:2308.04214v2 Announce Type: replace-cross Abstract: In the domain of knowledge representation and reasoning within AI, datalog engines play an ever-increasingly crucial role. The crux of their o

researcharxiv-cs-ai

Agents

OneDayAgent: Towards a Long-Horizon Harness for Autonomous Agents

arXiv:2608.05013v1 Announce Type: cross Abstract: LLM agents are increasingly applied to open-ended everyday requests that span work, study, and life. These tasks are long-horizon, cross-environment,

agentsarxiv-cs-ai

Optimizing the Preconditioner: A Black-box Online-to-Nonconvex Conversion with Static Regret Minimization Oracles

arXiv:2607.17607v2 Announce Type: replace Abstract: We study whether stochastic nonconvex optimization can be reduced to ordinary static regret minimization in online convex optimization in a black-bo

researcharxiv-cs-lg

Optimizing What Policies Learn From: Recoverability-aware Rollout Intervention Learning

arXiv:2608.05080v1 Announce Type: cross Abstract: Critic-free group-based reinforcement learning has become a scalable approach for post-training large language models. However, most existing methods

safetyarxiv-cs-cl

OutLangSplat: 3D Language Gaussian Splatting for UAV Outdoor Scenes

arXiv:2608.04560v1 Announce Type: new Abstract: 3D Language Gaussian Splatting embeds open-vocabulary language features into 3D Gaussian Splatting, providing an efficient explicit representation for t

safetyarxiv-cs-cv

Overcoming Statistical Bias in Action-Controllable World Models

arXiv:2608.04653v1 Announce Type: new Abstract: Action-conditioned world models aim to predict how visual environments evolve under an agent's actions. Yet future frames are often highly predictable f

safetyarxiv-cs-cv

PhysMind: From Video to Executable Worlds for Training-Free Physical Reasoning

arXiv:2608.04575v1 Announce Type: cross Abstract: Reliable physical reasoning from video requires understanding how objects move, interact, and respond to interventions. Existing vision-language model

Predicting Brain Morphometry with MT-GNN: Mesh Evolution in Continuous Time with Graph-Based Metric Tensor Embeddings

arXiv:2608.05132v1 Announce Type: new Abstract: Predicting how a subcortical structure's shape will evolve from a few prior scans could support prognosis and clinical-trial enrichment. Existing longit

Local Ai

Promptable Animal Pose Tracking Across Species

arXiv:2608.04995v1 Announce Type: new Abstract: Animal pose estimation and tracking is important for wildlife monitoring and conservation research, and with limited expert time for labelling automated

local-aiarxiv-cs-cv

Local Ai

Provable Limits and Certified Deferral for Verbalized Uncertainty in Small Language Models

arXiv:2608.05064v1 Announce Type: cross Abstract: Small open-weight language models increasingly run in private, offline, and cost-sensitive settings, where the key deployment question is not only wha

local-aiarxiv-cs-ai

PSI3D: Plug-and-Play 3D Stochastic Inference with Slice-wise Latent Diffusion Prior

arXiv:2512.18367v2 Announce Type: replace-cross Abstract: Diffusion models are highly expressive image priors for Bayesian inverse problems. However, most diffusion models cannot operate on large-scal

researcharxiv-cs-lg

Radar4D-VLM: Proposal-Grounded Temporal 4D Radar Reasoning Across Frozen Language Models

arXiv:2608.04130v1 Announce Type: new Abstract: Vision-language models for autonomous driving primarily rely on cameras and LiDAR, leaving 4D radar largely unexplored as a standalone perceptual modali

Reasoning Core: Designing Broad Procedural Data for Completion-Supervised Reasoning Training

arXiv:2608.05148v1 Announce Type: new Abstract: Procedural generators produce useful verifiable reasoning problems at scale, but have received less attention as data for completion-supervised fine-tun

researcharxiv-cs-cl

RegisterBridgeMM: A Register-Centric Framework for RGB-Infrared Object Detection

arXiv:2608.04833v1 Announce Type: new Abstract: RGB-infrared (RGB-IR) object detection benefits from complementary visible and thermal cues, but effective fusion remains challenging under illumination

Relational Response Fields: A General Theory of Black-Box LLM Response Consistency and Recovery

arXiv:2608.04552v1 Announce Type: new Abstract: Black-box language-model reliability is commonly pursued by sampling, prompting, voting, verifying, or iteratively revising individual answers. We ask a

researcharxiv-cs-cl

Relevant but Incomplete: Referential Dangling as a Paradigm-Level Failure Mode in Hard Prompt Compression

model-releasesarxiv-cs-cl

arXiv:2608.04569v1 Announce Type: new Abstract: Hard prompt compression reduces long-context inference cost by independently scoring tokens, sentences, or chunks and retaining the highest-scoring unit

RepairFormer: Automated Repair of Structured Inputs Using Transformers

arXiv:2608.05060v1 Announce Type: cross Abstract: Structured input files such as JSON, DOT, OBJ, INI, S-expression, and TinyC are widely used in software systems, but small corruptions can cause parse

Representing Visual Evidence for Item Difficulty Prediction: Visual Textualization and Image-Native Modeling

arXiv:2608.04554v1 Announce Type: new Abstract: Predicting item difficulty from content can provide an initial estimate for newly developed questions before sufficient student responses are available.

researcharxiv-cs-cl

Rethinking Pixel Mean Flows via Interval Denoiser

arXiv:2608.04818v1 Announce Type: new Abstract: Modern diffusion and flow-based models are increasingly moving toward few-step, latent-free generation to bypass the computational overhead of multi-ste

Reward Structure Shapes the Interaction Between Episodic Exploration and Neural Memory in Reinforcement Learning

arXiv:2608.05111v1 Announce Type: new Abstract: In partially observable reinforcement learning, agents face a dual bottleneck: they must explore to encounter rewarding states and retain that experienc

safetyarxiv-cs-lg

REZE: Recognition-Based Zero-Shot Extraction for Video Temporal Grounding

arXiv:2608.04480v1 Announce Type: new Abstract: Video temporal grounding (VTG) refers to the task of identifying the time interval in a video that corresponds to a given natural-language query. A comm

SafeLand: Safe Autonomous Landing in Unknown Environments with Bayesian Semantic Mapping

arXiv:2603.17430v2 Announce Type: replace Abstract: Autonomous landing of uncrewed aerial vehicles (UAVs) in unknown, dynamic environments poses significant safety challenges, particularly near people

safetyarxiv-cs-ro

Same Formulas, Different Semantics: Do Language Models Follow Modal Logic Specifications?

model-releasesarxiv-cs-cl

arXiv:2608.05097v1 Announce Type: new Abstract: Reasoning about necessity and possibility depends on assumptions about accessibility between worlds and about which objects exist at each one. The same

Semantic Frame Interpolation

arXiv:2507.05173v2 Announce Type: replace Abstract: Generating intermediate video content of varying lengths based on given first and last frames, along with text prompt information, offers significan

Short-term load forecasting under EU-AI Act Requirements in Safety-Critical Environments: Results from a 41-day live challenge on the aggregated German transmission-grid load

arXiv:2608.05018v1 Announce Type: new Abstract: Short-term load forecasting (STLF) play a vital role in the electric power industry. It serves infrastructure that European and German law designate as

SpikingNav: Robust Embodied Navigation with Spiking Neural Policies

arXiv:2608.05078v1 Announce Type: new Abstract: Embodied navigation requires an agent to make sequential decisions from egocentric observations in a physical environment. Existing Artificial Neural Ne

safetyarxiv-cs-ro

Agents

Spoken Function Calling: A New Perspective on Spoken Language Understanding for Large Audio Language Models

arXiv:2608.05126v1 Announce Type: new Abstract: Spoken Language Understanding (SLU) is the core component of task-oriented dialogue systems and a pivotal link in achieving seamless human-agent interac

agentsarxiv-cs-cl