Search: “evaluation”

Optimizing PyTorch Inference with LLM-Based Multi-Agent Systems

arXiv:2511.16964v2 Announce Type: replace-cross Abstract: Maximizing performance on available GPU hardware is an ongoing challenge for modern AI inference systems. Traditional approaches include writi

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

PALMS: A Computational Implementation for Pavlovian Associative Learning Models' Simulation

DGX agent

arXiv:2602.07519v3 Announce Type: replace Abstract: In contrast to static formalisms, computational definitions describe the operational mechanisms of a model. Simulations are an essential part of the

researcharxiv-cs-lg

15 May 2026

Paraphrasing Attack Resilience of Various AI-Generated Text Detection Methods

arXiv:2605.14240v1 Announce Type: new Abstract: The recent large-scale emergence of LLMs has left an open space for dealing with their consequences, such as plagiarism or the spread of false informati

Persian MusicGen: A Large-Scale Dataset and Culturally-Aware Generative Model for Persian Music

arXiv:2605.14765v1 Announce Type: cross Abstract: Persian music, with its unique tonalities, modal systems (Dastgah), and rhythmic structures, presents significant challenges for music generation mode

safetyarxiv-cs-cl

Polaris: A Godel Agent Framework for Small Language Models through Experience-Abstracted Policy Repair

model-releasesarxiv-cs-lg

arXiv:2603.23129v2 Announce Type: replace Abstract: Godel agent realize recursive self-improvement: an agent inspects its own policy and traces and then modifies that policy in a tested loop. We intro

Position: Behavioural Assurance Cannot Verify the Safety Claims Governance Now Demands

arXiv:2605.15164v1 Announce Type: cross Abstract: This position paper argues that behavioural assurance, even when carefully designed, is being asked to carry safety claims it cannot verify. AI govern

Precise Verification of Transformers through ReLU-Catalyzed Abstraction Refinement

arXiv:2605.14294v1 Announce Type: new Abstract: Formal verification of transformers has become increasingly important due to their widespread deployment in safety-critical applications. Compared to cl

PreFT: Prefill-only finetuning for efficient inference

arXiv:2605.14217v1 Announce Type: cross Abstract: Large language models can now be personalised efficiently at scale using parameter efficient finetuning methods (PEFTs), but serving user-specific PEF

Pro-DG: Procedural Diffusion Guidance for Architectural Facade Generation

arXiv:2504.01571v2 Announce Type: replace-cross Abstract: We use hierarchical procedural rules for the generation of control maps within the stable diffusion framework to produce photo-realistic archi

PROCESS-2: A Benchmark Speech Corpus for Early Cognitive Impairment Detection

model-releasesarxiv-cs-lg

arXiv:2605.14888v1 Announce Type: cross Abstract: Speech-based analysis offers a scalable and non-invasive approach for detecting cognitive decline, yet progress has been constrained by the limited av

Progent: Securing AI Agents with Privilege Control

arXiv:2504.11703v3 Announce Type: replace-cross Abstract: AI agents interact with external environments through tool calls, exposing them to attacks like indirect prompt injection that can trigger una

Tutorials

Prompt Segmentation and Annotation Optimisation: Controlling LLM Behaviour via Optimised Segment-Level Annotations

arXiv:2605.14561v1 Announce Type: new Abstract: Prompt engineering is crucial for effective interaction with generative artificial intelligence systems, yet existing optimisation methods often operate

tutorialsarxiv-cs-ai

Proposal and study of statistical features for string similarity computation and classification

arXiv:2605.15110v1 Announce Type: cross Abstract: Adaptations of features commonly applied in the field of visual computing, co-occurrence matrix (COM) and run-length matrix (RLM), are proposed for th

researcharxiv-cs-cl

Agents

ProtoMedAgent: Multimodal Clinical Interpretability via Privacy-Aware Agentic Workflows

arXiv:2605.14113v1 Announce Type: cross Abstract: While interpretable prototype networks offer compelling case-based reasoning for clinical diagnostics, their raw continuous outputs lack the semantic

agentsarxiv-cs-ai

RAVEN: Real-time Autoregressive Video Extrapolation with Consistency-model GRPO

arXiv:2605.15190v1 Announce Type: new Abstract: Causal autoregressive video diffusion models support real-time streaming generation by extrapolating future chunks from previously generated content. Di

safetyarxiv-cs-cv

Applications

ReasonCache: Accelerating Large Reasoning Model Serving through KV Cache Sharing

arXiv:2507.21433v3 Announce Type: replace-cross Abstract: Large Reasoning Models (LRMs) are becoming integral to many AI inference systems, enhancing their capabilities with advanced reasoning. Howeve

applicationsarxiv-cs-ai

Reinforcement Learning for Diffusion LLMs with Entropy-Guided Step Selection and Stepwise Advantages

arXiv:2603.12554v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) has been effective for post-training autoregressive (AR) language models, but extending these methods to diffusion

Reinforcement Learning for Tool-Calling Agents in Fast Healthcare Interoperability Resources (FHIR)

arXiv:2605.14126v1 Announce Type: cross Abstract: Fast Healthcare Interoperability Resources (FHIR) is the dominant standard for interoperable exchange of healthcare data. In FHIR, electronic health r

Reinforcement Learning with Semantic Rewards Enables Low-Resource Language Expansion without Alignment Tax

arXiv:2605.14366v1 Announce Type: new Abstract: Extending large language models (LLMs) to low-resource languages often incurs an 'alignment tax': improvements in the target language come at the cost o

safetyarxiv-cs-cl

Reliability-Gated Source Anchoring for Continual Test-Time Adaptation

arXiv:2605.14063v1 Announce Type: new Abstract: Continual test-time adaptation (CTTA) updates a pretrained model online on an unlabeled, non-stationary stream while anchoring it to a frozen source che

Agents

Remember Your Trace: Memory-Guided Long-Horizon Agentic Framework for Consistent and Hierarchical Repository-Level Code Documentation

arXiv:2605.14563v1 Announce Type: cross Abstract: Automated code documentation is essential for modern software development, providing the contextual grounding that both human developers and coding ag

agentsarxiv-cs-cl

Local Ai

Robometer: Scaling General-Purpose Robotic Reward Models via Trajectory Comparisons

arXiv:2603.02115v2 Announce Type: replace-cross Abstract: General-purpose robot reward models are typically trained to predict absolute task progress from expert demonstrations, providing only local,

local-aiarxiv-cs-ai

Scalable Solution of the Stochastic Multi-path Traveling Salesman Problem via Neural Networks

arXiv:2605.14662v1 Announce Type: cross Abstract: The multi-path Traveling Salesman Problem with stochastic travel costs arises in hybrid vehicle routing applications designed for Smart City and City

SceneForge: Structured World Supervision from 3D Interventions

arXiv:2605.14399v1 Announce Type: new Abstract: Many multimodal learning tasks require supervision that remains consistent across edits, viewpoints, and scene-level interventions. However, such superv

researcharxiv-cs-cv

Applications

SCRWKV: Ultra-Compact Structure-Calibrated Vision-RWKV for Topological Crack Segmentation

arXiv:2605.14926v1 Announce Type: new Abstract: Achieving pixel-level accurate segmentation of structural cracks across diverse scenarios remains a formidable challenge. Existing methods face signific

applicationsarxiv-cs-cv

Semantic Feature Segmentation for Interpretable Predictive Maintenance in Complex Systems

arXiv:2605.14318v1 Announce Type: new Abstract: Predictive maintenance in complex systems is often complicated by the heterogeneity and redundancy of monitored variables,which can obscure fault-releva

researcharxiv-cs-ai

SemaTune: Semantic-Aware Online OS Tuning with Large Language Models

arXiv:2605.15026v1 Announce Type: cross Abstract: Online OS tuning can improve long-running services, but existing controllers are poorly matched to live hosts. They treat scheduler, power, memory, an

Agents

Sequential Resource Trading Using Comparison-Based Gradient Estimation

arXiv:2408.11186v4 Announce Type: replace-cross Abstract: We study sequential multi-issue trading between two greedily rational agents who exchange resources from a finite set of categories. Each agen

agentsarxiv-cs-ai

Sheaf-Theoretic Transport and Obstruction for Detecting Scientific Theory Shift in AI Agents

arXiv:2605.14033v1 Announce Type: new Abstract: Scientific theory shift in AI agents requires more than fitting equations to data. An artificial scientific agent must detect whether an existing repres

SimPersona: Learning Discrete Buyer Personas from Raw Clickstreams for Grounded E-Commerce Agents

arXiv:2605.14205v1 Announce Type: new Abstract: LLM-based web agents can navigate live storefronts, yet they often collapse to a single 'average buyer' policy, failing to capture the heterogeneous and

SOCC-ICP: Semantics-Assisted Odometry based on Occupancy Grids and ICP

arXiv:2605.15074v1 Announce Type: new Abstract: Reliable pose estimation in previously unseen environments is a fundamental capability of autonomous systems. Existing LiDAR odometry methods typically

safetyarxiv-cs-ro

SPIN: Structural LLM Planning via Iterative Navigation for Industrial Tasks

arXiv:2605.14051v1 Announce Type: new Abstract: Industrial LLM agent systems often separate planning from execution, yet LLM planners frequently produce structurally invalid or unnecessarily long work

SToRe3D: Sparse Token Relevance in ViTs for Efficient Multi-View 3D Object Detection

model-releasesarxiv-cs-cv

arXiv:2605.14110v1 Announce Type: new Abstract: Vision Transformers (ViTs) enable strong multi-view 3D detection but are limited by high inference latency from dense token and query processing across

StyleTextGen: Style-Conditioned Multilingual Scene Text Generation

model-releasesarxiv-cs-cv

arXiv:2605.14708v1 Announce Type: new Abstract: Style-conditioned scene text generation faces unique challenges in extracting precise text styles from complex backgrounds and maintaining fine-grained

Hardware

SurgicalMamba: Dual-Path SSD with State Regramming for Online Surgical Phase Recognition

arXiv:2605.14889v1 Announce Type: cross Abstract: Online surgical phase recognition (SPR) underpins context-aware operating-room systems and requires committing to a prediction at every frame from pas

hardwarearxiv-cs-ai

SWE-Chain: Benchmarking Coding Agents on Chained Release-Level Package Upgrades

arXiv:2605.14415v1 Announce Type: cross Abstract: Coding agents powered by large language models are increasingly expected to perform realistic software maintenance tasks beyond isolated issue resolut

Systematic Discovery of Semantic Attacks in Online Map Construction through Conditional Diffusion

arXiv:2605.14396v1 Announce Type: new Abstract: Autonomous vehicles depend on online HD map construction to perceive lane boundaries, dividers, and pedestrian crossings -- safety-critical road element

safetyarxiv-cs-cv

TERRA-CD: Multi-Temporal Framework for Multi-class and Semantic Change Detection

model-releasesarxiv-cs-cv

arXiv:2605.14651v1 Announce Type: new Abstract: Urban vegetation monitoring plays a vital role in understanding environmental changes, yet comprehensive datasets for this purpose remain limited. To ad

TFGN: Task-Free, Replay-Free Continual Pre-Training Without Catastrophic Forgetting at LLM Scale

arXiv:2605.15053v1 Announce Type: cross Abstract: Continually pre-training a large language model on heterogeneous text domains, without replay or task labels, has remained an unsolved architectural p

The Pitfalls of KV Cache Compression

arXiv:2510.00231v2 Announce Type: replace-cross Abstract: KV cache compression promises increased throughput and efficiency with negligible loss in performance. While the gains in throughput are indis

The Scientific Contribution Graph: Automated Literature-based Technological Roadmapping at Scale

arXiv:2605.15011v1 Announce Type: new Abstract: Scientific contributions rarely develop in isolation, but instead build upon prior discoveries. We formulate the task of automated technological roadmap

researcharxiv-cs-cl

The Spheres Dataset: Multitrack Orchestral Recordings for Music Source Separation and Information Retrieval

arXiv:2511.21247v2 Announce Type: replace-cross Abstract: This paper introduces The Spheres dataset, multitrack orchestral recordings designed to advance machine learning research in music source sepa

TILBench: A Systematic Benchmark for Tabular Imbalanced Learning Across Data Regimes

model-releasesarxiv-cs-lg

arXiv:2605.14915v1 Announce Type: new Abstract: Imbalanced learning remains a fundamental challenge in tabular data applications. Despite decades of research and numerous proposed algorithms, a system

Tutorials

To See is Not to Learn: Protecting Multimodal Data from Unauthorized Fine-Tuning of Large Vision-Language Model

arXiv:2605.14291v1 Announce Type: cross Abstract: The rapid advancement of Large Vision-Language Models (LVLMs) is increasingly accompanied by unauthorized scraping and training on multimodal web data

tutorialsarxiv-cs-ai

Towards Continuous Sign Language Conversation from Isolated Signs

arXiv:2605.14705v1 Announce Type: new Abstract: Sign language is the primary language for many Deaf and Hard-of-Hearing (DHH) signers, yet most conversational AI systems still mediate interaction thro

safetyarxiv-cs-cv

Local Ai

Towards Real-Time Autonomous Navigation: Transformer-Based Catheter Tip Tracking in Fluoroscopy

arXiv:2605.14253v1 Announce Type: new Abstract: Purpose: Mechanical thrombectomy (MT) improves stroke outcomes, but is limited by a lack of local treatment access. Widespread distribution of reinforce

local-aiarxiv-cs-cv

Hardware

Towards Resource-Efficient LLMs: End-to-End Energy Accounting of Distillation Pipelines

arXiv:2605.13981v1 Announce Type: cross Abstract: The rise in deployment of large language models has driven a surge in GPU demand and datacenter scaling, raising concerns about electricity use, grid

hardwarearxiv-cs-ai

Towards the Next Frontier of LLMs, Training on Private Data: A Cross-Domain Benchmark for Federated Fine-Tuning

arXiv:2605.13936v1 Announce Type: cross Abstract: The recent success of large language models (LLMs) has been largely driven by vast public datasets. However, the next frontier for LLM development lie