JevSoup: System-One Routing for Training-Free LoRA Composition

arXiv:2609.30922v1 Announce Type: new Abstract: Building adaptable AI systems requires effective coordination of specialized capabilities across diverse tasks. Low-rank adaptation (LoRA) enables modular expertise, but existing routing approaches may require auxiliary data, additional training, or autoregressive decoding. We propose JevSoup, a training-free framework separating System One expert routing from System Two execution. Using only the input and expert descriptions, Jev selects two experts through structured probabilities. JevSoup retains the leading expert's update, projects the second onto the orthogonal complement of the first update's row space, and combines them with equal weights. Across 14 PorTAL tasks and three Qwen3 scales, JepSoup achieves absolute gains of up to 1.19% in task-macro and 1.21% in sample-micro accuracy over the strongest evaluated external baselines. Our code is available at https://github.com/Leowang980/JevSoup.

Related

• Breaking the Structural Identity: Personalized Federated LoRA Fine-tuning under Rank Heterogeneity
• FedPA-LoRA: Product-Aligned Framework for Mitigating Aggregation and Initialization Errors in Heterogeneous Federated LoRA
• Foundation-Preserving Adaptation via Generalized Rayleigh-Quotient Optimization
• FraQ: Efficient Coordinate-Space Recompression for Federated Low-Rank Adaptation

Source: arXiv cs.AI | 2026-09-28