Search: “evaluation”

SwarmBench: Can Large Language Models Act as Agent Swarm Orchestrators?

arXiv:2608.30661v1 Announce Type: new Abstract: Large language model-based multi-agent systems are evolving from fixed interaction topologies toward dynamically orchestrated Agent Swarms. However, exi

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Tail-Replay: Escaping the Curse of Linear Attention in Prefix Caching for Hybrid LLMs

DGX agent

arXiv:2608.30310v1 Announce Type: cross Abstract: Hybrid large language models interleave full-attention layers with linear-attention layers to reduce the cost of long-context inference. This structur

researcharxiv-cs-ai

1 Sept 2026

The Price of Intelligence: A Quality-Adjusted Price Index for AI Services

arXiv:2608.29843v1 Announce Type: cross Abstract: Posted prices for AI inference have fallen steadily since 2024, yet the measured speed of that fall depends almost entirely on the method of measureme

Toward Postural State Classification in Immersive VR with Multimodal Data and Explainability Analysis

arXiv:2608.28844v1 Announce Type: cross Abstract: Ensuring a safe virtual reality (VR) experience requires systems that can predict and respond when users lose their balance. Although prior work has e

safetyarxiv-cs-ai

Toward Trustworthy Robot-Assisted Sliding Palpation for Shallow Vessel Localisation with a Calibrated Digital Twin

arXiv:2608.29396v1 Announce Type: new Abstract: Reliable localisation of shallow subsurface vessels is important for safe robot-assisted venous access and vessel-aware manipulation, but collecting div

local-aiarxiv-cs-ro

Towards Continual Test-Time Adaptation of Vision-Language Models in Open-Vocabulary Semantic Segmentation

arXiv:2608.29923v1 Announce Type: new Abstract: Open-vocabulary semantic segmentation (OVSS) relies on vision-language alignment to recognize arbitrary text-defined categories, yet this alignment is f

safetyarxiv-cs-cv

Tracing the Latent Threads: A Mechanistic Study of How LLMs Represent and Operationalize Race and Ethnicity Cues

arXiv:2601.12868v2 Announce Type: replace Abstract: Large language models (LLMs) increasingly operate in high-stakes settings where demographic attributes such as race and ethnicity may be explicitly

safetyarxiv-cs-cl

Training and Agentic Inference Strategies for LLM-based Manim Animation Generation

model-releasesarxiv-cs-ai

arXiv:2604.18364v2 Announce Type: replace Abstract: Generating programmatic animation using libraries such as Manim presents unique challenges for Large Language Models (LLMs), requiring spatial reaso

UFPR-PEs: A Brazilian Face Recognition Benchmark with Self-Declared Race/Color Labels

arXiv:2608.30688v1 Announce Type: new Abstract: While face recognition systems are widely deployed, ensuring their demographic reliability and robustness under uncontrolled visual conditions remains a

UltraVoice: Scaling Fine-Grained Style-Controlled Speech Conversations for Spoken Dialogue Models

arXiv:2510.22588v2 Announce Type: replace-cross Abstract: Spoken dialogue models currently lack the ability for fine-grained speech style control, a critical capability for human-like interaction that

Understanding Temporal Semantic Stability in Open-Vocabulary UAV Perception through Metric 3D Fusion

arXiv:2608.28665v1 Announce Type: new Abstract: Recent open-vocabulary segmentation models have advanced semantic perception for UAVs, but predictions from moving aerial platforms can remain temporall

researcharxiv-cs-cv

VFR-Audit: Verdict-Level Reliability for Fairness Audits in Hospital Length-of-Stay Prediction

arXiv:2608.30846v1 Announce Type: new Abstract: Fairness audits in clinical Artificial Intelligence convert continuous fairness metrics into binary pass-or-fail verdicts against operational thresholds

safetyarxiv-cs-ai

When Errors Become Memories: Causal Pathway Tracing in Multi-Turn Memory-Augmented LLMs

arXiv:2608.30198v1 Announce Type: new Abstract: Long-term memory enables large language models (LLMs) to preserve and reuse information across interactions, but it can also turn localized errors into

local-aiarxiv-cs-cl

When Patients Cut In: Extending Clinical Conversational AI Safety to Interruptions

arXiv:2608.29241v1 Announce Type: new Abstract: Clinical voice agents are now deployed in routine care, where real patients do not wait their turn: they interrupt. These systems typically use a cascad

Where Identity Lives: Localized, Retain-Free Identity Unlearning in Multimodal Large Language Models

arXiv:2608.30649v1 Announce Type: new Abstract: Removing a specific individual's information from multimodal large language models (MLLMs) is often needed after deployment, but existing methods rely o

local-aiarxiv-cs-cl

Where Induction Runs Out: Description-Length Difficulty and the Memorisation Gap in Integer-Sequence Benchmarks

arXiv:2608.29411v1 Announce Type: new Abstract: Integer sequences from the On-Line Encyclopedia of Integer Sequences (OEIS) are increasingly used to benchmark mathematical reasoning in language models

WiT: Waypoint Diffusion Transformers for Alleviating Trajectory Conflict in Pixel-Space Image Generation

arXiv:2603.15132v3 Announce Type: replace Abstract: While recent Flow Matching models avoid the reconstruction bottlenecks of latent autoencoders by operating directly in pixel space, the raw pixel ma

You Know What I Mean: A Benchmark for Agentic Conversational Reference Grounding

arXiv:2608.29834v1 Announce Type: new Abstract: Collaborative conversations frequently contain references whose targets are indirect rather than named: resolving 'this looks like the fix discussed yes

Applications

BanglaMed-QA: A Question Answering System for Healthcare Support in Bangla

arXiv:2608.28329v1 Announce Type: new Abstract: Medical question answering (QA) systems have become crucial tools for providing reliable health information. But they remain very unexplored for low-res

applicationsarxiv-cs-cl

BEACON: Behavior-Anchored Cross-Source Knowledge Graph Construction for Cyber Threat Intelligence

arXiv:2608.28394v1 Announce Type: cross Abstract: Cyber threat intelligence (CTI) is foundational to modern cyber defense, yet much of it resides in unstructured reports whose volume and heterogeneity

Blind Men and the Elephant: Probing the Epistemic Myopia of LLMs under Long-Tail Divergent Knowledge

arXiv:2608.28478v1 Announce Type: new Abstract: Factual question answering (QA) typically assumes a single canonical answer, obscuring whether large language models (LLMs) retain divergent accounts of

CoCoBench: A Cooperative Coordination Benchmark for Embodied Multi-Agent Task Planning

model-releasesarxiv-cs-ro

arXiv:2608.28266v1 Announce Type: new Abstract: Agent systems powered by multimodal large language models (MLLMs) have advanced rapidly in recent years, yet existing embodied-agent benchmarks still la

CommerceVibe: Learning to Design E-Commerce Creatives as Executable Visual Code via Dual-Feedback Reinforcement Learning

arXiv:2608.27893v1 Announce Type: new Abstract: High-quality e-commerce creatives are essential for presenting products and conveying marketing messages. Recent diffusion models enable scalable creati

Cross-Spectral Dense Correspondence for Multimodal Spectral Medical Imaging

arXiv:2608.28341v1 Announce Type: new Abstract: Precise dense correspondence is a fundamental prerequisite for multimodal spectral imaging systems that fuse disparate wavelength ranges for subsequent

Diverging Transformer Predictions for Human Sentence Processing: A Comprehensive Analysis of Agreement Attraction Effects

arXiv:2603.16574v2 Announce Type: replace Abstract: Transformers underlie almost all state-of-the-art language models in computational linguistics, yet their cognitive adequacy as models of human sent

Tutorials

Euclidean Fourier Neural Operators

arXiv:2608.28425v1 Announce Type: new Abstract: Fourier neural operators (FNOs) provide an efficient framework for learning mappings between function spaces as they are, by construction, independent o

tutorialsarxiv-cs-lg

Fidelity Is Not Enough: Dispatch-Level Instrumentation for Agentic Datasheet Extraction

arXiv:2608.28439v1 Announce Type: new Abstract: One model passed our fidelity check without ever opening the datasheet. We found it while qualifying models for an internal extraction service: a struct

FUSED: Forensic-Semantic Mixture-of-Experts for AI Inpainting Detection and Localization

arXiv:2608.28302v1 Announce Type: new Abstract: Diffusion-based inpainting models modify only a localized part of an image, while many AI-image detectors rely on global artifacts and do not localize.

Generalized Gibbs Ensemble Weighting for Forecast Combination

arXiv:2608.28116v1 Announce Type: new Abstract: Forecast combination is a reliable way to improve predictive performance when several forecasting models are available. Simple aggregation rules such as

Is Prosody Lost in Translation? Fine-Grained Cross-Lingual Prosody Similarity Across Languages

arXiv:2608.27848v1 Announce Type: cross Abstract: Prosody plays an important role in speech translation, conveying information such as emphasis, emotion, and intent beyond lexical content. However, de

safetyarxiv-cs-cl

Agents

LandingAgent: A Reference-Annotated Dataset and Agentic Generation Framework for Landing Pages

arXiv:2608.27902v1 Announce Type: new Abstract: Landing pages are goal-oriented web interfaces that must communicate a target-specific value proposition while organizing information flow, visual hiera

agentsarxiv-cs-cl

Layered LLM Defenses as an Ensemble: Access Tiers, Inference Cost, and the Measured Failure Correlation Between Defense Layers

arXiv:2608.28327v1 Announce Type: cross Abstract: Practitioners defend large language models (LLMs) by stacking defenses, assuming the layers compound. A stack is an ensemble, and ensembles compound o

Lexically conditioned realization ambiguity in Korean predicate morphology

arXiv:2608.27966v1 Announce Type: new Abstract: This paper examines Korean surface realization as distinct from morphological analysis. It asks whether a sequence of canonical morphemes and grammatica

Long Story Short: Story-level Video Understanding from 20K Short Films

arXiv:2406.10221v3 Announce Type: replace-cross Abstract: Recent developments in vision-language models have significantly advanced video understanding. Existing datasets and tasks, however, have nota

Agents

LUCID: An Agentic AI Framework on Digital-Twin in the Loop for QoS-Guaranteeing Robotic Control

arXiv:2608.28437v1 Announce Type: cross Abstract: Cloud robotics relies on the timely uplink of high-volume sensing streams, yet dynamic environments continually shift the feasible combinations of tra

agentsarxiv-cs-ro

Memorization Is Not Extraction: Tight Differential-Privacy Bounds and Audit Blind Spots

arXiv:2608.27782v1 Announce Type: cross Abstract: Memorization in large language models is measured through a zoo of definitions whose formal relations are unknown, and differential privacy (DP) is tr

NL2AGBench: Benchmarking LLM Auto-Formalization for AlphaGeometry

arXiv:2608.28481v1 Announce Type: new Abstract: Recent advances in large language models (LLMs) have demonstrated strong capabilities in natural language understanding and mathematical reasoning. Howe

OceanGym: A Benchmark Environment for Underwater Embodied Agents

arXiv:2509.26536v3 Announce Type: replace Abstract: We introduce OceanGym, the first comprehensive benchmark for ocean underwater embodied agents, designed to advance AI in one of the most demanding r

Physics-informed learning for the inverse problem in resonant ultrasound spectroscopy

arXiv:2608.27590v1 Announce Type: cross Abstract: Inferring elastic constants from resonant ultrasound spectra is a nonlinear and typically overdetermined inverse problem based on finite spectral data

Quantifying Affective Bias in Low-Resource Media: Large-Scale Emotion Profiling of Bengali Headlines

arXiv:2510.17252v2 Announce Type: replace Abstract: News media can influence readers not only through the events they report but also through the emotional tone used to present them. This issue is esp

Scientific Graphics Program Synthesis via Dual Self-Consistency Reinforcement Learning

arXiv:2604.06079v2 Announce Type: replace Abstract: Graphics Program Synthesis is pivotal for interpreting and editing visual data, effectively facilitating the reverse-engineering of static visuals i

SimpCue: Cue-Based Prompting for Multilingual Text Simplification

arXiv:2608.28042v1 Announce Type: new Abstract: Text simplification aims to make complex texts easier to understand while preserving their original meaning. Recent large language models can perform si

SIMPNet: Spatial-Informed Motion Planning Network

arXiv:2408.12831v2 Announce Type: replace Abstract: Current robotic manipulators require fast and efficient motion-planning algorithms to operate in cluttered environments. State-of-the-art sampling-b

researcharxiv-cs-ro

Stranger, Fan, or Peer? A Systematic Study on the Role of Interlocutor in Persona-Based Dialogue Generation

arXiv:2608.28467v1 Announce Type: new Abstract: Persona-based dialogue systems are usually conditioned on speaker biography, but dialogues involve at least two participants, and who has access to whos

Agents

Synthetic Linguistic Agency: How an Embodied Mortal Agent Learns Linguistic Affordances through Consequential Social Experience

arXiv:2608.27843v1 Announce Type: new Abstract: Contemporary language models can converse fluently and influence human decisions, yet their exchanges do not enter a continuing, vulnerable life of thei

agentsarxiv-cs-cl

Talk in Pieces, See in Whole: Disentangled and Hierarchical Representation Learning in Language-based Object Detection

arXiv:2509.24192v2 Announce Type: replace Abstract: Vision-language models (VLMs) have advanced multimodal perception, demonstrated by open-vocabulary object detection with simple language queries. St

Tensor-Accelerated Eager Multi-Resolution Grids for Evolving Large-Scale Substrates

arXiv:2608.27612v1 Announce Type: cross Abstract: In neuroevolution, indirect encoding generates neural network connectivity from a compact genome rather than specifying each connection. ES-HyperNEAT

local-aiarxiv-cs-lg

Applications

Text Restoration of Ancient Documents with Language Models

arXiv:2608.28170v1 Announce Type: new Abstract: Purpose - This study investigates the feasibility of restoring missing text caused by physical lacunae in damaged ancient manuscripts using language mod

applicationsarxiv-cs-cl