Enhancing Zero-shot Personalized Image Aesthetics Assessment with Profile-aware Multimodal LLM

arXiv:2604.17233v1 Announce Type: new Abstract: Personalized image aesthetics assessment (PIAA) aims to predict an individual user's subjective rating of an image, which requires modeling user-specific aesthetic preferences. Existing methods rely on historical user ratings for this modeling and therefore struggle when such data are unavailable. We address this zero-shot setting by using user profiles as contextual signals for personalization and adopting a profile-based personalization paradigm. We introduce P-MLLM, a profile-aware multimodal LLM that augments a frozen LLM with selective fusion modules for controlled visual integration. These modules selectively integrate visual information into the model's evolving hidden states during profile-conditioned reasoning, allowing visual information to be incorporated in a profile-aware manner. Experiments on recent PIAA benchmarks show that P-MLLM achieves competitive zero-shot performance and remains effective even with coarse profile information, highlighting the potential of profile-based personalization for zero-shot PIAA.

Related

• Comparison Drives Preference: Reference-Aware Modeling for AI-Generated Video Quality Assessment
• ZSG-IAD: A Multimodal Framework for Zero-Shot Grounded Industrial Anomaly Detection
• Scaling Up AI-Generated Image Detection with Generator-Aware Prototypes
• Music Audio-Visual Question Answering Requires Specialized Multimodal Designs

Source: arXiv cs.CV | 2026-04-21