Search: “evaluation”

Less Is More: Cognitive Load and the Single-Prompt Ceiling in LLM Mathematical Reasoning

arXiv:2604.18897v1 Announce Type: new Abstract: We present a systematic empirical study of prompt engineering for formal mathematical reasoning in the context of the SAIR Equational Theories Stage 1 c

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Mask World Model: Predicting What Matters for Robust Robot Policy Learning

DGX agent

arXiv:2604.19683v1 Announce Type: new Abstract: World models derived from large-scale video generative pre-training have emerged as a promising paradigm for generalist robot policy learning. However,

safetyarxiv-cs-ro

22 Apr 2026

Mind the (DH) Gap! A Contrast in Risky Choices Between Reasoning and Conversational LLMs

arXiv:2602.15173v2 Announce Type: replace Abstract: The use of large language models either as decision support systems, or in agentic workflows, is rapidly transforming the digital ecosystem. However

agentsarxiv-cs-ai

One Persona, Many Cues, Different Results: How Sociodemographic Cues Impact LLM Personalization

arXiv:2601.18572v2 Announce Type: replace Abstract: Personalization of LLMs by sociodemographic subgroup often improves user experience, but can also introduce or amplify biases and unfair outcomes ac

safetyarxiv-cs-cl

PC2Model: ISPRS benchmark on 3D point cloud to model registration

arXiv:2604.19596v1 Announce Type: new Abstract: Point cloud registration involves aligning one point cloud with another or with a three-dimensional (3D) model, enabling the integration of multimodal d

PLaMo 2.1-VL Technical Report

arXiv:2604.19324v1 Announce Type: cross Abstract: We introduce PLaMo 2.1-VL, a lightweight Vision Language Model (VLM) for autonomous devices, available in 8B and 2B variants and designed for local an

agentsarxiv-cs-ai

Applications

Prompt to Pwn: Automated Exploit Generation for Smart Contracts

arXiv:2508.01371v3 Announce Type: replace-cross Abstract: Smart contracts are important for digital finance, yet they are hard to patch once deployed. Prior work has mainly explored LLMs for smart con

applicationsarxiv-cs-ai

Protecting Bystander Privacy via Selective Hearing in Audio LLMs

arXiv:2512.06380v3 Announce Type: replace-cross Abstract: Audio Large language models (LLMs) are increasingly deployed in the real world, where they inevitably capture speech from unintended nearby by

QTMRL: An Agent for Quantitative Trading Decision-Making Based on Multi-Indicator Guided Reinforcement Learning

arXiv:2508.20467v2 Announce Type: replace-cross Abstract: In the highly volatile and uncertain global financial markets, traditional quantitative trading models relying on statistical modeling or empi

ReefNet: A Large-Scale Dataset and Benchmark for Fine-Grained Coral Reef Recognition

arXiv:2510.16822v3 Announce Type: replace-cross Abstract: Coral reefs are rapidly declining under anthropogenic pressures (e.g., climate change), creating an urgent need for scalable and automated mon

Rethinking Dataset Distillation: Hard Truths about Soft Labels

arXiv:2604.18811v1 Announce Type: cross Abstract: Despite the perceived success of large-scale dataset distillation (DD) methods, recent evidence finds that simple random image baselines perform on-pa

researcharxiv-cs-cv

Revac: A Social Deduction Reasoning Agent

arXiv:2604.19523v1 Announce Type: new Abstract: Social deduction games such as Mafia present a unique AI challenge: players must reason under uncertainty, interpret incomplete and intentionally mislea

agentsarxiv-cs-ai

Revisiting Catastrophic Forgetting in Continual Knowledge Graph Embedding

arXiv:2604.19401v1 Announce Type: cross Abstract: Knowledge Graph Embeddings (KGEs) support a wide range of downstream tasks over Knowledge Graphs (KGs). In practice, KGs evolve as new entities and fa

researcharxiv-cs-ai

SAHM: A Benchmark for Arabic Financial and Shari'ah-Compliant Reasoning

arXiv:2604.19098v1 Announce Type: cross Abstract: English financial NLP has progressed rapidly through benchmarks for sentiment, document understanding, and financial question answering, while Arabic

SAVOIR: Learning Social Savoir-Faire via Shapley-based Reward Attribution

arXiv:2604.18982v1 Announce Type: new Abstract: Social intelligence, the ability to navigate complex interpersonal interactions, presents a fundamental challenge for language agents. Training such age

SCURank: Ranking Multiple Candidate Summaries with Summary Content Units for Enhanced Summarization

arXiv:2604.19185v1 Announce Type: cross Abstract: Small language models (SLMs), such as BART, can achieve summarization performance comparable to large language models (LLMs) via distillation. However

researcharxiv-cs-ai

Self-Improving Tabular Language Models via Iterative Group Alignment

arXiv:2604.18966v1 Announce Type: cross Abstract: While language models have been adapted for tabular data generation, two fundamental limitations remain: (1) static fine-tuning produces models that c

local-aiarxiv-cs-ai

Semantic Needles in Document Haystacks: Sensitivity Testing of LLM-as-a-Judge Similarity Scoring

arXiv:2604.18835v1 Announce Type: cross Abstract: We propose a scalable, multifactorial experimental framework that systematically probes LLM sensitivity to subtle semantic changes in pairwise documen

safetyarxiv-cs-ai

Separating Geometry from Probability in the Analysis of Generalization

arXiv:2604.19560v1 Announce Type: new Abstract: The goal of machine learning is to find models that minimize prediction error on data that has not yet been seen. Its operational paradigm assumes acces

StrikeWatch: Wrist-worn Gait Recognition with Compact Time-series Models on Low-power FPGAs

arXiv:2510.24738v2 Announce Type: replace-cross Abstract: Running offers substantial health benefits, but improper gait patterns can lead to injuries, particularly without expert feedback. While prior

local-aiarxiv-cs-lg

Tadabur: A Large-Scale Quran Audio Dataset

arXiv:2604.18932v1 Announce Type: cross Abstract: Despite growing interest in Quranic data research, existing Quran datasets remain limited in both scale and diversity. To address this gap, we present

researcharxiv-cs-ai

The PROPER Approach to Proactivity: Benchmarking and Advancing Knowledge Gap Navigation

arXiv:2601.09926v3 Announce Type: replace Abstract: Current approaches to proactive assistance move beyond the ask-and-respond paradigm by anticipating user needs. In practice, they either burden user

Uncertainty Quantification in Detection Transformers: Object-Level Calibration and Image-Level Reliability

arXiv:2412.01782v4 Announce Type: replace-cross Abstract: DETR and its variants have emerged as promising architectures for object detection, offering an end-to-end prediction pipeline. In practice, h

local-aiarxiv-cs-ai

VIGIL: An Extensible System for Real-Time Detection and Mitigation of Cognitive Bias Triggers

arXiv:2604.03261v2 Announce Type: replace Abstract: The rise of generative AI is posing increasing risks to online information integrity and civic discourse. Most concretely, such risks can materialis

safetyarxiv-cs-cl

Virtual boundary integral neural network for three-dimensional exterior acoustic problems

arXiv:2604.18636v1 Announce Type: cross Abstract: This paper presents a virtual boundary integral neural network (VBINN) for exterior acoustic problems in three dimensions. The method introduces a vir

VLA Foundry: A Unified Framework for Training Vision-Language-Action Models

arXiv:2604.19728v1 Announce Type: cross Abstract: We present VLA Foundry, an open-source framework that unifies LLM, VLM, and VLA training in a single codebase. Most open-source VLA efforts specialize

What’s new in GKE at Next ‘26

model-releasesgoogle-cloud-ai

This week at Google Cloud Next ‘26, we are sharing the evolution of Google Kubernetes Engine (GKE), delivering leading performance, efficiency, security, and scale for your most demanding and complex

A Benchmark Study of Segmentation Models and Adaptation Strategies for Landslide Detection from Satellite Imagery

arXiv:2604.16663v1 Announce Type: new Abstract: Landslide detection from high resolution satellite imagery is a critical task for disaster response and risk assessment, yet the relative effectiveness

A Model and Estimation of the Bitcoin Transaction Fee

arXiv:2604.17183v1 Announce Type: cross Abstract: Bitcoin transaction fees will become more important as the block subsidy declines, but fee formation is hard to study with blockchain data alone becau

Applications

A multimodal and temporal foundation model for virtual patient representations at healthcare system scale

arXiv:2604.18570v1 Announce Type: cross Abstract: Modern medicine generates vast multimodal data across siloed systems, yet no existing model integrates the full breadth and temporal depth of the clin

applicationsarxiv-cs-cl

A Survey of Spatial Memory Representations for Efficient Robot Navigation

arXiv:2604.16482v1 Announce Type: new Abstract: As vision-based robots navigate larger environments, their spatial memory grows without bound, eventually exhausting computational resources, particular

A Unified Compliance Aggregator Framework for Automated Multi-Tool Security Assessment of Linux Systems

arXiv:2604.17256v1 Announce Type: cross Abstract: Assessing the security posture of modern computing systems typically requires the use of multiple specialized tools. These tools focus on different as

Adaptive Text Anonymization: Learning Privacy-Utility Trade-offs via Prompt Optimization

arXiv:2602.20743v2 Announce Type: replace Abstract: Anonymizing textual documents is a highly context-sensitive problem: the appropriate balance between privacy protection and utility preservation var

Agentic Large Language Models for Training-Free Neuro-Radiological Image Analysis

arXiv:2604.16729v1 Announce Type: new Abstract: State-of-the-art large language models (LLMs) show high performance in general visual question answering. However, a fundamental limitation remains: cur

AIM 2025 Rip Current Segmentation (RipSeg) Challenge Report

arXiv:2508.13401v3 Announce Type: replace Abstract: This report presents an overview of the AIM 2025 RipSeg Challenge, a competition designed to advance techniques for automatic rip current segmentati

Applications

AlphaContext: An Evolutionary Tree-based Psychometric Context Generator for Creativity Assessment

arXiv:2604.18398v1 Announce Type: new Abstract: Creativity has become a core competence in the era of LLMs and human-AI collaboration, underpinning innovation in real-world problem solving. Crucially,

applicationsarxiv-cs-cl

Althea: Human-AI Collaboration for Fact-Checking and Critical Reasoning

arXiv:2602.11161v2 Announce Type: replace-cross Abstract: The web's information ecosystem demands fact-checking systems that are both scalable and epistemically trustworthy. Automated approaches offer

An Edge-Host-Cloud Architecture for Robot-Agnostic, Caregiver-in-the-Loop Personalized Cognitive Exercise: Multi-Site Deployment in Dementia Care

arXiv:2604.16408v1 Announce Type: new Abstract: We present Speaking Memories, a distributed, stakeholder-in-the-loop robotic interaction platform for personalized cognitive exercise support. Rather th

local-aiarxiv-cs-ro

An `Inverse' Experimental Framework to Estimate Market Efficiency

arXiv:2604.18130v1 Announce Type: new Abstract: Digital marketplaces processing billions of dollars annually represent critical infrastructure in sociotechnical ecosystems, yet their performance optim

Annotation-Assisted Learning of Treatment Policies From Multimodal Electronic Health Records

arXiv:2507.20993v3 Announce Type: replace Abstract: We study how to learn treatment policies from multimodal electronic health records (EHRs) that consist of tabular data and clinical text. These poli

ArgBench: Benchmarking LLMs on Computational Argumentation Tasks

arXiv:2604.17366v1 Announce Type: new Abstract: Argumentation skills are an essential toolkit for large language models (LLMs). These skills are crucial in various use cases, including self-reflection

Asset Harvester: Extracting 3D Assets from Autonomous Driving Logs for Simulation

arXiv:2604.18468v1 Announce Type: new Abstract: Closed-loop simulation is a core component of autonomous vehicle (AV) development, enabling scalable testing, training, and safety validation before rea

safetyarxiv-cs-cv

AstroSURE: Learning to Remove Noise from Astronomical Images Without Ground Truth Data

arXiv:2604.16793v1 Announce Type: cross Abstract: In astronomical imaging, the low photon count of exposures necessitates extensive post-processing steps, including contamination removal and denoising

researcharxiv-cs-cv

AutoVQA-G: Self-Improving Agentic Framework for Automated Visual Question Answering and Grounding Annotation

arXiv:2604.17488v1 Announce Type: new Abstract: Manual annotation of high-quality visual question answering with grounding (VQA-G) datasets, which pair visual questions with evidential grounding, is c

agentsarxiv-cs-cv

Back into Plato's Cave: Examining Cross-modal Representational Convergence at Scale

arXiv:2604.18572v1 Announce Type: new Abstract: The Platonic Representation Hypothesis suggests that neural networks trained on different modalities (e.g., text and images) align and eventually conver

safetyarxiv-cs-cv

BengaliMoralBench: A Benchmark for Auditing Moral Reasoning in Large Language Models within Bengali Language and Culture

arXiv:2511.03180v2 Announce Type: replace Abstract: As multilingual Large Language Models (LLMs) gain traction across South Asia, their alignment with local ethical norms, particularly for Bengali, sp

BOOKAGENT: Orchestrating Safety-Aware Visual Narratives via Multi-Agent Cognitive Calibration

arXiv:2604.16541v1 Announce Type: new Abstract: Recent advancements in Large Generative Models (LGMs) have revolutionized multi-modal generation. However, generating illustrated storybooks remains an

Brain-CLIPLM: Decoding Compressed Semantic Representations in EEG for Language Reconstruction

arXiv:2604.16370v1 Announce Type: new Abstract: Decoding natural language from non-invasive electroencephalography (EEG) remains fundamentally limited by low signal-to-noise ratio and restricted infor

researcharxiv-cs-cl