Search: “evaluation”

Mixture-Greedy for Online Generative Model Selection: Is UCB Necessary in Diversity-Aware Multi-Armed Bandits?

arXiv:2603.21716v2 Announce Type: replace-cross Abstract: Efficient selection among multiple generative models is increasingly important in modern generative AI, where sampling from suboptimal models

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

More Capable, Less Faithful: A Multilingual Analysis of Mathematical (Un)Solvability Detection in LLMs

DGX agent

arXiv:2608.30463v1 Announce Type: new Abstract: Solvability detection is one of the most challenging aspects of mathematical reasoning for Large Language Models (LLMs). While prior work has studied th

model-releasesarxiv-cs-cl

1 Sept 2026

MRpro: open framework for model-based, learned, and quantitative MR imaging

arXiv:2507.23129v2 Announce Type: replace-cross Abstract: We preseent an open-source image reconstruction package built upon PyTorch, enabling modern deep-learning reconstructions. It uses open data f

Applications

Multi-Sensor Mapping of Vulnerable Urban Settlements Using SAR, Multispectral, and Hyperspectral Imagery: A Case Study in Cordoba, Argentina

arXiv:2608.28680v1 Announce Type: new Abstract: Informal settlements represent a major urban challenge in rapidly expanding cities, yet their identification from Earth Observation (EO) data remains di

applicationsarxiv-cs-cv

Multi-Step Forecasting of Grape Berry Temperature based on LSTM Model with Feed-Forward Attention

arXiv:2608.29008v1 Announce Type: new Abstract: Accurate forecasting of grape berry temperature (Tb) is essential for enabling timely heat stress management in vineyards. In this study, a feed-forward

Hardware

NepScript Genesis: Neural Architecture Search for Handwritten Devanagari Digit Synthesis

arXiv:2608.29540v1 Announce Type: new Abstract: This paper introduces NepScript Genesis, a Neural Architecture Search (NAS) framework for automated Generative Adversarial Network (GAN) discovery, appl

hardwarearxiv-cs-cv

nnMNet: Baseline for Martian Terrain Semantic Segmentation

arXiv:2608.29609v1 Announce Type: new Abstract: Semantic segmentation is a crucial task for understanding Mars, the most Earth-like planet in our solar system. However, it is challenging because the M

Not Your Typical Sycophant: The Elusive Nature of Sycophancy in Large Language Models

arXiv:2601.15436v3 Announce Type: replace Abstract: We propose a novel perspective for probing LLM sycophancy in a direct and neutral way, mitigating various forms of uncontrolled bias, noise, or mani

On the Role of MRI Sequences in Cross-Dataset Generalization for Brain Tumor Segmentation

arXiv:2608.29944v1 Announce Type: new Abstract: Brain tumor segmentation in magnetic resonance imaging (MRI) is a critical task for diagnosis and treatment planning. Despite the success of deep learni

One note in three: a verified census of three deployed AI scribes, and the instrument that counted it

arXiv:2608.31017v1 Announce Type: cross Abstract: Ambient AI scribes draft clinical notes under the reassurance that a clinician signs every note. We audited three commercial AI scribes on the same 14

PaperBanana-Interact: Scientific Diagram Refinement with Multi-Turn Human Feedback

model-releasesarxiv-cs-cl

arXiv:2608.30241v1 Announce Type: new Abstract: Recent efforts have aimed to automate scientific diagram generation from paper content (Lin et al., 2026; Zhu et al., 2026a). However, fully satisfying

Local Ai

PAUSE: Editable Strategy Artifacts for Long-Form Cultural Story Adaptation

arXiv:2608.28633v1 Announce Type: cross Abstract: Generative AI systems increasingly mediate cultural adaptation, but their cultural decisions are often hidden inside prompts, transient model plans, o

local-aiarxiv-cs-ai

Peer Oversight in Collective Decision Making

arXiv:2608.28754v1 Announce Type: cross Abstract: This article introduces peer k-oversight, a property of sequential collective decision mechanisms requiring at least k agents to be responsible for ev

PermitGPT: A Unified Generative-AI Pipeline for Construction Hazard Forecasting, Permit Prediction, and Community Impact

arXiv:2608.28728v1 Announce Type: new Abstract: Urban construction governance requires early decisions that connect workplace safety, permitting requirements, and community impact, yet the relevant ev

Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusion

arXiv:2603.03485v4 Announce Type: replace-cross Abstract: Recent video diffusion models have achieved impressive capabilities as large-scale generative world models. However, these models often strugg

Pixel-wise Geo-registration of Drone and Satellite Images

arXiv:2608.28891v1 Announce Type: new Abstract: Pixel-level cross-view geo-registration aims to align a query image (e.g., drone) to a geo-referenced satellite map so that every query pixel can be map

Applications

PromptKWS: A Novel Prompt-Guided Open-Vocabulary Keyword Spotting Framework

arXiv:2608.28640v1 Announce Type: cross Abstract: In this paper, we present PromptKWS, a novel Prompt-guided keyword spotting (KWS) framework to improve the accuracy of open vocabulary KWS systems. In

applicationsarxiv-cs-ai

Quantifying and Mitigating Korean Jamo-Level Typographical Vulnerabilities in Large Language Models

model-releasesarxiv-cs-cl

arXiv:2608.30229v1 Announce Type: new Abstract: Korean introduces an additional typographical perturbation level not captured by ordinary character-level edit models: because syllable blocks are inter

Quantum-Grassmann-Plucker Token Mixing for Deep Learning-Based Post-Disaster Damage Assessment

arXiv:2608.30633v1 Announce Type: new Abstract: Timely post-disaster building damage assessment from satellite imagery is a critical engineering decision support task, yet it remains constrained by cl

Reachability-Based Capability Confinement for LLM Agents under Indirect Prompt Injection

arXiv:2608.30041v1 Announce Type: cross Abstract: Large language model agents place outputs from external skills into their execution context, allowing attacker-controlled data to influence later priv

Reading the News: Adapting Large Language Models to Swedish Journalism Through Continued Pre-Training

arXiv:2608.30609v1 Announce Type: cross Abstract: Large language models are increasingly capable in general, but their utility can remain modest in niche or understudied areas. One approach to address

Real-Time Deadlines Reveal Fragile Temporal Adaptation in LLM Strategic Dialogues

arXiv:2601.13206v2 Announce Type: replace Abstract: Large Language Models (LLMs) generate text token-by-token in discrete time, yet real-world communication, from therapy sessions to business negotiat

RedLight-VLA: Models for traffic-rule grounding and behavioral emphasis in driving policies

arXiv:2608.28656v1 Announce Type: cross Abstract: Behavior-cloned Vision-Language-Action (VLA) driving policies struggle with rare rule-governed maneuvers at signalized intersections. Braking and laun

ReGraP-LLaVA: Reasoning enabled Graph-based Personalized Large Language and Vision Assistant

arXiv:2505.03654v3 Announce Type: replace-cross Abstract: Multimodal Large Language Models have shown strong performance across multimodal tasks, and recent personalized MLLMs can recognize user-speci

Agents

Repair or Resample? Rethinking Failure Debugging in LLM Multi-Agent Systems

arXiv:2608.25920v2 Announce Type: replace Abstract: As large language model (LLM)-based multi-agent systems (MASs) are increasingly applied to long-horizon complex tasks, their reliability has emerged

agentsarxiv-cs-ai

Responsible Integration of AI in Cancer Genomics: Barriers, Risks, and Pathways to Trustworthy Clinical Translation

arXiv:2608.30912v1 Announce Type: new Abstract: Artificial intelligence (AI) and natural language processing (NLP) are increasingly used to extract, integrate, and interpret biomedical knowledge relev

Review Before Trust: Source-Grounded Integrity Gates for AI-Assisted Personal Health Records

arXiv:2608.29965v1 Announce Type: new Abstract: Large language models can convert medical documents into structured data, but plausible output may still be unsupported by the source. Persisting such o

Robust retinal biometrics for patient identity verification and retrieval across age and imaging devices

arXiv:2608.31094v1 Announce Type: new Abstract: Patient identity errors can compromise longitudinal medical records, research databases, and downstream clinical decisions. We present a retinal biometr

Runtime Safety Filtering for Learned Small UAS Separation Policies under GNSS Degradation

arXiv:2607.10014v2 Announce Type: replace-cross Abstract: Learning-based separation assurance for small Unmanned Aircraft Systems (sUAS) achieves near-zero collision rates in simulation, but assumes a

safetyarxiv-cs-lg

SafeAtlas-VL: Beyond Binary Multimodal Safety with Large-Scale Data and Guard Models

arXiv:2608.29098v1 Announce Type: new Abstract: Multimodal safety moderation requires distinguishing risks arising from visual content, user intent, and assistant behavior. Existing safeguards, howeve

Scale-Plan: Scalable Language-Enabled Task Planning for Heterogeneous Multi-Robot Teams

arXiv:2603.08814v2 Announce Type: replace-cross Abstract: Long-horizon task planning for heterogeneous multi-robot systems is essential for deploying collaborative teams in real-world environments; ye

ScienceArena: Benchmarking LLMs on Latest Scientific Olympiad Competitions

arXiv:2608.30517v1 Announce Type: new Abstract: Benchmark saturation and data contamination increasingly obscure genuine scientific reasoning in frontier LLMs. We introduce extsc{ScienceArena}, an oly

Selective Disclosure of Hidden Directives in Reasoning Models: Behavioral Asymmetry and Steering

model-releasesarxiv-cs-lg

arXiv:2608.29070v1 Announce Type: new Abstract: Chain-of-thought (CoT) reasoning traces are increasingly proposed as a mechanism for AI oversight: a monitor inspecting a model's reasoning can, in prin

Selective Forgetting: A Graph-Based Memory Framework for Long-Term LLM Agents

arXiv:2608.28978v1 Announce Type: new Abstract: Knowledge graphs have been proposed as a structured alternative to flat retrieval-augmented generation for long-term agent memory, on the assumption tha

Self-Aware Active Learning Enables Continual Improvement in Autonomous Driving

arXiv:2608.29772v1 Announce Type: new Abstract: Learning-based autonomous driving (AD) systems can perform reliably in familiar conditions, yet rare distribution shifts and long-tail events remain a m

safetyarxiv-cs-ro

Self-Supervised Pretext Tasks for Infant Cry Analysis: A Controlled Comparison and a Cautionary Result on Donateacry

model-releasesarxiv-cs-lg

arXiv:2608.30456v1 Announce Type: new Abstract: We compare six self-supervised pretext tasks for infant cry analysis under a fixed budget, meaning the same compact encoder of 1.17M parameters, the sam

SeqAlign3DVG: A Sequence-Aligned Benchmark and Voxel Reasoning Framework for 3D Visual Grounding

arXiv:2608.30451v1 Announce Type: new Abstract: Image-based 3D visual grounding is critical for embodied agents, yet existing benchmarks suffer from loose text-observation alignment and neglect tempor

Sequential Trajectories and Simultaneous Blending: Multi-Emotion Modeling for Instruction-Following TTS

arXiv:2608.30325v1 Announce Type: new Abstract: Natural-language instructions enable flexible control of synthesized speech, yet emotional TTS systems primarily model a single utterance-level affect,

safetyarxiv-cs-cl

Applications

SGE: Semantically-Guided Exploration for Unstructured Environments via Image-Space Waypoint Sampling

arXiv:2608.29315v1 Announce Type: cross Abstract: This work introduces Semantically-Guided Exploration (SGE), a modular exploration framework for ground vehicles that integrates pixel-level semantic s

applicationsarxiv-cs-ai

SIR: Self-improving Red-teaming for Compute Use Agents

arXiv:2608.30207v1 Announce Type: cross Abstract: Computer use agents (CUAs) are vision-language models that perceive a screen and act on a real operating system through mouse, keyboard, and terminal,

Small Reward Models via Backward Inference

arXiv:2602.13551v3 Announce Type: replace Abstract: Reward models (RMs) play a central role throughout the language model (LM) pipeline, particularly in non-verifiable domains. However, the dominant L

researcharxiv-cs-cl

Small Updates, Big Doubts: Does Parameter-Efficient Fine-tuning Enhance Hallucination Detection ?

arXiv:2602.11166v2 Announce Type: replace-cross Abstract: Parameter-efficient fine-tuning (PEFT) methods are widely used to adapt large language models (LLMs) to downstream tasks and are often assumed

SnapBench: Benchmarking Snap-and-Ask Multimodal Retrieval for Mobile Interactions

arXiv:2608.29607v1 Announce Type: new Abstract: Mobile AI acts as a visual oracle, empowering users to snap a picture of something and ask for information. Snap-and-ask retrieval is now one of the mos

Agents

Source-Dependent Deference in Medical Imaging Agents Under Falsified Findings: A Pilot Audit

arXiv:2608.29800v1 Announce Type: new Abstract: Tool-using agents are being proposed for medical imaging, and their behaviour when a tool returns a false finding is largely unmeasured. We audit whethe

agentsarxiv-cs-cv

SPADE: A Large Language Model Framework for Soil Moisture Pattern Recognition and Anomaly Detection in Precision Agriculture

arXiv:2509.18123v2 Announce Type: replace Abstract: Accurate interpretation of soil moisture patterns is critical for irrigation scheduling and crop management, yet existing approaches for soil moistu

Spec2Twin-Chain: Orchestrating Bi-Level Optimization with LLMs for Blockchain Digital Twin Construction

arXiv:2608.30050v1 Announce Type: new Abstract: Building a blockchain digital twin largely requires translating domain knowledge and specific system descriptions into a simulator architecture, calibra

Stick to What You Know: A Study of Knowledge-Aligned Supervised Fine-Tuning

arXiv:2608.30987v1 Announce Type: cross Abstract: Supervised fine-tuning (SFT) trains a base language model to imitate target responses, and these targets may require knowledge the base model has not

SUB-PLAY: Adversarial Policies against Partially Observed Multi-Agent Reinforcement Learning Systems

arXiv:2402.03741v4 Announce Type: replace-cross Abstract: Recent advancements in multi-agent reinforcement learning (MARL) have opened up vast application prospects, such as swarm control of drones, c