Spexis: Speculative Lookahead Scheduling for LLM Inference
arXiv:2609.34370v1 Announce Type: new Abstract: Spexis is a multi-GPU LLM inference framework that improves the efficiency of pipeline and tensor parallelism through speculative parallelism. Rather th