FlexServe: A Fast and Secure LLM Serving System for Mobile Devices with Flexible Resource Isolation
DGX agentarXiv:2606.23370v1 Announce Type: cross Abstract: Device-side Large Language Models (LLMs) have grown explosively, offering stronger privacy and higher availability than their cloud-side counterparts.