Search: “evaluation”

ReGraP-LLaVA: Reasoning enabled Graph-based Personalized Large Language and Vision Assistant

arXiv:2505.03654v3 Announce Type: replace-cross Abstract: Multimodal Large Language Models have shown strong performance across multimodal tasks, and recent personalized MLLMs can recognize user-speci

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

Repair or Resample? Rethinking Failure Debugging in LLM Multi-Agent Systems

DGX agent

arXiv:2608.25920v2 Announce Type: replace Abstract: As large language model (LLM)-based multi-agent systems (MASs) are increasingly applied to long-horizon complex tasks, their reliability has emerged

agentsarxiv-cs-ai

1 Sept 2026

Responsible Integration of AI in Cancer Genomics: Barriers, Risks, and Pathways to Trustworthy Clinical Translation

arXiv:2608.30912v1 Announce Type: new Abstract: Artificial intelligence (AI) and natural language processing (NLP) are increasingly used to extract, integrate, and interpret biomedical knowledge relev

Review Before Trust: Source-Grounded Integrity Gates for AI-Assisted Personal Health Records

arXiv:2608.29965v1 Announce Type: new Abstract: Large language models can convert medical documents into structured data, but plausible output may still be unsupported by the source. Persisting such o

Robust retinal biometrics for patient identity verification and retrieval across age and imaging devices

arXiv:2608.31094v1 Announce Type: new Abstract: Patient identity errors can compromise longitudinal medical records, research databases, and downstream clinical decisions. We present a retinal biometr

researcharxiv-cs-cv

Runtime Safety Filtering for Learned Small UAS Separation Policies under GNSS Degradation

arXiv:2607.10014v2 Announce Type: replace-cross Abstract: Learning-based separation assurance for small Unmanned Aircraft Systems (sUAS) achieves near-zero collision rates in simulation, but assumes a

safetyarxiv-cs-lg

SafeAtlas-VL: Beyond Binary Multimodal Safety with Large-Scale Data and Guard Models

arXiv:2608.29098v1 Announce Type: new Abstract: Multimodal safety moderation requires distinguishing risks arising from visual content, user intent, and assistant behavior. Existing safeguards, howeve

Scale-Plan: Scalable Language-Enabled Task Planning for Heterogeneous Multi-Robot Teams

arXiv:2603.08814v2 Announce Type: replace-cross Abstract: Long-horizon task planning for heterogeneous multi-robot systems is essential for deploying collaborative teams in real-world environments; ye

ScienceArena: Benchmarking LLMs on Latest Scientific Olympiad Competitions

arXiv:2608.30517v1 Announce Type: new Abstract: Benchmark saturation and data contamination increasingly obscure genuine scientific reasoning in frontier LLMs. We introduce extsc{ScienceArena}, an oly

Selective Disclosure of Hidden Directives in Reasoning Models: Behavioral Asymmetry and Steering

arXiv:2608.29070v1 Announce Type: new Abstract: Chain-of-thought (CoT) reasoning traces are increasingly proposed as a mechanism for AI oversight: a monitor inspecting a model's reasoning can, in prin

Selective Forgetting: A Graph-Based Memory Framework for Long-Term LLM Agents

arXiv:2608.28978v1 Announce Type: new Abstract: Knowledge graphs have been proposed as a structured alternative to flat retrieval-augmented generation for long-term agent memory, on the assumption tha

Self-Aware Active Learning Enables Continual Improvement in Autonomous Driving

arXiv:2608.29772v1 Announce Type: new Abstract: Learning-based autonomous driving (AD) systems can perform reliably in familiar conditions, yet rare distribution shifts and long-tail events remain a m

safetyarxiv-cs-ro

Self-Supervised Pretext Tasks for Infant Cry Analysis: A Controlled Comparison and a Cautionary Result on Donateacry

arXiv:2608.30456v1 Announce Type: new Abstract: We compare six self-supervised pretext tasks for infant cry analysis under a fixed budget, meaning the same compact encoder of 1.17M parameters, the sam

SeqAlign3DVG: A Sequence-Aligned Benchmark and Voxel Reasoning Framework for 3D Visual Grounding

arXiv:2608.30451v1 Announce Type: new Abstract: Image-based 3D visual grounding is critical for embodied agents, yet existing benchmarks suffer from loose text-observation alignment and neglect tempor

Sequential Trajectories and Simultaneous Blending: Multi-Emotion Modeling for Instruction-Following TTS

arXiv:2608.30325v1 Announce Type: new Abstract: Natural-language instructions enable flexible control of synthesized speech, yet emotional TTS systems primarily model a single utterance-level affect,

safetyarxiv-cs-cl

Applications

SGE: Semantically-Guided Exploration for Unstructured Environments via Image-Space Waypoint Sampling

arXiv:2608.29315v1 Announce Type: cross Abstract: This work introduces Semantically-Guided Exploration (SGE), a modular exploration framework for ground vehicles that integrates pixel-level semantic s

applicationsarxiv-cs-ai

SIR: Self-improving Red-teaming for Compute Use Agents

arXiv:2608.30207v1 Announce Type: cross Abstract: Computer use agents (CUAs) are vision-language models that perceive a screen and act on a real operating system through mouse, keyboard, and terminal,

Small Reward Models via Backward Inference

arXiv:2602.13551v3 Announce Type: replace Abstract: Reward models (RMs) play a central role throughout the language model (LM) pipeline, particularly in non-verifiable domains. However, the dominant L

researcharxiv-cs-cl

Small Updates, Big Doubts: Does Parameter-Efficient Fine-tuning Enhance Hallucination Detection ?

arXiv:2602.11166v2 Announce Type: replace-cross Abstract: Parameter-efficient fine-tuning (PEFT) methods are widely used to adapt large language models (LLMs) to downstream tasks and are often assumed

SnapBench: Benchmarking Snap-and-Ask Multimodal Retrieval for Mobile Interactions

arXiv:2608.29607v1 Announce Type: new Abstract: Mobile AI acts as a visual oracle, empowering users to snap a picture of something and ask for information. Snap-and-ask retrieval is now one of the mos

Agents

Source-Dependent Deference in Medical Imaging Agents Under Falsified Findings: A Pilot Audit

arXiv:2608.29800v1 Announce Type: new Abstract: Tool-using agents are being proposed for medical imaging, and their behaviour when a tool returns a false finding is largely unmeasured. We audit whethe

agentsarxiv-cs-cv

SPADE: A Large Language Model Framework for Soil Moisture Pattern Recognition and Anomaly Detection in Precision Agriculture

arXiv:2509.18123v2 Announce Type: replace Abstract: Accurate interpretation of soil moisture patterns is critical for irrigation scheduling and crop management, yet existing approaches for soil moistu

Spec2Twin-Chain: Orchestrating Bi-Level Optimization with LLMs for Blockchain Digital Twin Construction

arXiv:2608.30050v1 Announce Type: new Abstract: Building a blockchain digital twin largely requires translating domain knowledge and specific system descriptions into a simulator architecture, calibra

Stick to What You Know: A Study of Knowledge-Aligned Supervised Fine-Tuning

arXiv:2608.30987v1 Announce Type: cross Abstract: Supervised fine-tuning (SFT) trains a base language model to imitate target responses, and these targets may require knowledge the base model has not

SUB-PLAY: Adversarial Policies against Partially Observed Multi-Agent Reinforcement Learning Systems

arXiv:2402.03741v4 Announce Type: replace-cross Abstract: Recent advancements in multi-agent reinforcement learning (MARL) have opened up vast application prospects, such as swarm control of drones, c

SwarmBench: Can Large Language Models Act as Agent Swarm Orchestrators?

arXiv:2608.30661v1 Announce Type: new Abstract: Large language model-based multi-agent systems are evolving from fixed interaction topologies toward dynamically orchestrated Agent Swarms. However, exi

Tail-Replay: Escaping the Curse of Linear Attention in Prefix Caching for Hybrid LLMs

arXiv:2608.30310v1 Announce Type: cross Abstract: Hybrid large language models interleave full-attention layers with linear-attention layers to reduce the cost of long-context inference. This structur

researcharxiv-cs-ai

The Price of Intelligence: A Quality-Adjusted Price Index for AI Services

arXiv:2608.29843v1 Announce Type: cross Abstract: Posted prices for AI inference have fallen steadily since 2024, yet the measured speed of that fall depends almost entirely on the method of measureme

Toward Postural State Classification in Immersive VR with Multimodal Data and Explainability Analysis

arXiv:2608.28844v1 Announce Type: cross Abstract: Ensuring a safe virtual reality (VR) experience requires systems that can predict and respond when users lose their balance. Although prior work has e

Local Ai

Toward Trustworthy Robot-Assisted Sliding Palpation for Shallow Vessel Localisation with a Calibrated Digital Twin

arXiv:2608.29396v1 Announce Type: new Abstract: Reliable localisation of shallow subsurface vessels is important for safe robot-assisted venous access and vessel-aware manipulation, but collecting div

local-aiarxiv-cs-ro

Towards Continual Test-Time Adaptation of Vision-Language Models in Open-Vocabulary Semantic Segmentation

arXiv:2608.29923v1 Announce Type: new Abstract: Open-vocabulary semantic segmentation (OVSS) relies on vision-language alignment to recognize arbitrary text-defined categories, yet this alignment is f

safetyarxiv-cs-cv

Tracing the Latent Threads: A Mechanistic Study of How LLMs Represent and Operationalize Race and Ethnicity Cues

arXiv:2601.12868v2 Announce Type: replace Abstract: Large language models (LLMs) increasingly operate in high-stakes settings where demographic attributes such as race and ethnicity may be explicitly

safetyarxiv-cs-cl

Training and Agentic Inference Strategies for LLM-based Manim Animation Generation

arXiv:2604.18364v2 Announce Type: replace Abstract: Generating programmatic animation using libraries such as Manim presents unique challenges for Large Language Models (LLMs), requiring spatial reaso

UFPR-PEs: A Brazilian Face Recognition Benchmark with Self-Declared Race/Color Labels

arXiv:2608.30688v1 Announce Type: new Abstract: While face recognition systems are widely deployed, ensuring their demographic reliability and robustness under uncontrolled visual conditions remains a

UltraVoice: Scaling Fine-Grained Style-Controlled Speech Conversations for Spoken Dialogue Models

arXiv:2510.22588v2 Announce Type: replace-cross Abstract: Spoken dialogue models currently lack the ability for fine-grained speech style control, a critical capability for human-like interaction that

Understanding Temporal Semantic Stability in Open-Vocabulary UAV Perception through Metric 3D Fusion

arXiv:2608.28665v1 Announce Type: new Abstract: Recent open-vocabulary segmentation models have advanced semantic perception for UAVs, but predictions from moving aerial platforms can remain temporall

researcharxiv-cs-cv

VFR-Audit: Verdict-Level Reliability for Fairness Audits in Hospital Length-of-Stay Prediction

arXiv:2608.30846v1 Announce Type: new Abstract: Fairness audits in clinical Artificial Intelligence convert continuous fairness metrics into binary pass-or-fail verdicts against operational thresholds

Local Ai

When Errors Become Memories: Causal Pathway Tracing in Multi-Turn Memory-Augmented LLMs

arXiv:2608.30198v1 Announce Type: new Abstract: Long-term memory enables large language models (LLMs) to preserve and reuse information across interactions, but it can also turn localized errors into

local-aiarxiv-cs-cl

When Patients Cut In: Extending Clinical Conversational AI Safety to Interruptions

arXiv:2608.29241v1 Announce Type: new Abstract: Clinical voice agents are now deployed in routine care, where real patients do not wait their turn: they interrupt. These systems typically use a cascad

Local Ai

Where Identity Lives: Localized, Retain-Free Identity Unlearning in Multimodal Large Language Models

arXiv:2608.30649v1 Announce Type: new Abstract: Removing a specific individual's information from multimodal large language models (MLLMs) is often needed after deployment, but existing methods rely o

local-aiarxiv-cs-cl

Where Induction Runs Out: Description-Length Difficulty and the Memorisation Gap in Integer-Sequence Benchmarks

arXiv:2608.29411v1 Announce Type: new Abstract: Integer sequences from the On-Line Encyclopedia of Integer Sequences (OEIS) are increasingly used to benchmark mathematical reasoning in language models

WiT: Waypoint Diffusion Transformers for Alleviating Trajectory Conflict in Pixel-Space Image Generation

arXiv:2603.15132v3 Announce Type: replace Abstract: While recent Flow Matching models avoid the reconstruction bottlenecks of latent autoencoders by operating directly in pixel space, the raw pixel ma

You Know What I Mean: A Benchmark for Agentic Conversational Reference Grounding

arXiv:2608.29834v1 Announce Type: new Abstract: Collaborative conversations frequently contain references whose targets are indirect rather than named: resolving 'this looks like the fix discussed yes

Applications

BanglaMed-QA: A Question Answering System for Healthcare Support in Bangla

arXiv:2608.28329v1 Announce Type: new Abstract: Medical question answering (QA) systems have become crucial tools for providing reliable health information. But they remain very unexplored for low-res

applicationsarxiv-cs-cl

BEACON: Behavior-Anchored Cross-Source Knowledge Graph Construction for Cyber Threat Intelligence

arXiv:2608.28394v1 Announce Type: cross Abstract: Cyber threat intelligence (CTI) is foundational to modern cyber defense, yet much of it resides in unstructured reports whose volume and heterogeneity

Blind Men and the Elephant: Probing the Epistemic Myopia of LLMs under Long-Tail Divergent Knowledge

arXiv:2608.28478v1 Announce Type: new Abstract: Factual question answering (QA) typically assumes a single canonical answer, obscuring whether large language models (LLMs) retain divergent accounts of

Cloud CISO Perspectives: Tips on securing the water sector in the AI era

Welcome to the second Cloud CISO Perspectives for August 2026. Today, Chris Sistrunk and Stephanie Kiel detail the critical issues facing the water sector, and actionable steps that OT operators can t

safetygoogle-cloud-ai

CoCoBench: A Cooperative Coordination Benchmark for Embodied Multi-Agent Task Planning

model-releasesarxiv-cs-ro

arXiv:2608.28266v1 Announce Type: new Abstract: Agent systems powered by multimodal large language models (MLLMs) have advanced rapidly in recent years, yet existing embodied-agent benchmarks still la