Unifying PnP and Score-Based Methods: Reusing Diffusion Priors for Imaging
1Computational Imaging Group, Washington University in St.Louis 2Theoretical Division, Los Alamos National Laboratory 3Computer, Computational and Statistical Sciences Division, Los Alamos National Laboratory
Figure 1: Visual comparison of three classical PnP methods for motion deblurring on color images. DPIR, PnP-ADMM, and RED are compared with CNN-based and score-based diffusion model(SBM)-based priors. The figure also includes the results of DiffPIR using the same SBM as the prior. Note how our framework enables the direct comparison of DiffPIR with three classical PnP methods using exactly the same neural network as the prior.
Plug-and-play (PnP) methods are extensively used for solving imaging inverse problems by integrating physical measurement models with pre-trained deep denoisers as priors. Score-based diffusion models (SBMs) have recently emerged as a powerful framework for image generation by training deep denoisers to represent the score of the image prior. While both PnP and SBMs use deep denoisers, the score-based nature of PnP is unexplored in the literature due to its distinct origins rooted in proximal optimization. This letter introduces a novel view of PnP as a score-based method, a perspective that enables the re-use of powerful SBMs within classical PnP algorithms without retraining. We present a set of mathematical relationships for adapting popular SBMs as priors within PnP. We show that this approach enables a direct comparison between PnP and SBM-based reconstruction methods using the same neural network as the prior.
Algorithms: The parameter matching algorithm adapts SBM priors for PnP methods by determining a scaling factor c and the corresponding time-step t for a given noise level σ. This ensures consistency between the noise perturbation used in score training and the PnP algorithm.
Table 1: Quantitative evaluation of image deblurring across four setups for each PnP method. The denoiser types are indicated in parentheses: PnP methods using DnCNN and DRUNet represent classical approaches, while those using SBM denote PnP using a VP diffusion model as the denoiser.