PLASMA: A Layout-Aware Benchmark Reveals Memory Layout Matters for Graph-based ANNS on GPU

arXiv:2508.15436v2 Announce Type: replace-cross Abstract: We propose a extbf{P}latform for extbf{L}ayout-extbf{A}ware extbf{S}earch and extbf{M}emory extbf{A}rrangement (extbf{PLASMA}), a unified evaluation framework for graph-based Approximate Nearest Neighbor Search (ANNS) on GPU that isolates the effects of graph index topology and memory layout. Graph-based ANNS is essential in modern AI applications such as RAG, and GPU utilization is attracting attention for datasets of millions or more vectors. Our framework extracts the topology of arbitrary graph-based indices and enables execution under a unified, GPU-optimized search algorithm, specifying the correspondence between vertex IDs and positions on memory to allow arbitrary vertex orderings. Through comprehensive experiments, we demonstrate that vertex reordering yields up to 80% (typically 10-30%) QPS improvement while preserving search accuracy.

Source: arXiv cs.CV | 2026-08-20