InfiFPO: Implicit Model Fusion via Preference Optimization in Large Language Models
arXiv:2505.13878v3 Announce Type: replace-cross Abstract: Model fusion combines multiple Large Language Models (LLMs) with different strengths into a more powerful, integrated model through lightweigh