Perceiving Better Moments: Cover Frame Reselection and Enhancement for Live Photos with the Live2K Dataset
Abstract
Modern smartphones capture Live Photos—short video bursts sur-rounding a still image—offering a dynamic and engaging photographic experi-ence. However, the cover photo and video components are generated by two dis-tinct imaging pipelines: the photo stream undergoes full computational photog-raphy processing, while the video stream is constrained by real-time efficiencyand heavy compression. This intrinsic separation produces a substantial qual-ity gap in resolution, color fidelity, and dynamic range between the cover photoand video frames. When users reselect an alternative frame from the video toreplace an imperfect cover, the chosen frame often suffers from severe degrada-tion, making direct replacement visually unsatisfactory. Restoring such framesrequires simultaneous enhancement of spatial detail and color appearance, a taskconsiderably more challenging than ordinary super-resolution or color enhance-ment. To address this, we define the Live Photo Cover Frame Reselection andEnhancement (LPRE) task, which leverages the intrinsic cues available withineach Live Photo: the high-quality cover image as a structural and color reference,the user-reselected low-quality frame as the reconstruction target and several ad-jacent video frames providing temporal cues. Building upon this formulation, weconstruct Live2K, a real-world dataset of 2,042 Live Photos, and develop a unifiedone-stage baseline that integrates multi-frame fusion, guided color enhancementand super-resolution—establishing the first benchmark for Live Photo enhance-ment research.