Plug-and-Play Priors as a Score-Based Method

Unifying PnP and Score-Based Methods: Reusing Diffusion Priors for Imaging


Chicago Y. Park1, Yuyang Hu1, Michael T. McCann2,
Cristina Garcia-Cardona3, Brendt Wohlberg3, Ulugbek S. Kamilov1

1Computational Imaging Group, Washington University in St.Louis
2Theoretical Division, Los Alamos National Laboratory
3Computer, Computational and Statistical Sciences Division, Los Alamos National Laboratory

Paper (arxiv) Code
Banner

Figure 1: Visual comparison of three classical PnP methods for motion deblurring on color images. DPIR, PnP-ADMM, and RED are compared with CNN-based and score-based diffusion model(SBM)-based priors. The figure also includes the results of DiffPIR using the same SBM as the prior. Note how our framework enables the direct comparison of DiffPIR with three classical PnP methods using exactly the same neural network as the prior.


Abstract


Plug-and-play (PnP) methods are extensively used for solving imaging inverse problems by integrating physical measurement models with pre-trained deep denoisers as priors. Score-based diffusion models (SBMs) have recently emerged as a powerful framework for image generation by training deep denoisers to represent the score of the image prior. While both PnP and SBMs use deep denoisers, the score-based nature of PnP is unexplored in the literature due to its distinct origins rooted in proximal optimization. This letter introduces a novel view of PnP as a score-based method, a perspective that enables the re-use of powerful SBMs within classical PnP algorithms without retraining. We present a set of mathematical relationships for adapting popular SBMs as priors within PnP. We show that this approach enables a direct comparison between PnP and SBM-based reconstruction methods using the same neural network as the prior.

Score-Based Denoising in Classical PnP Algorithms


Banner

Algorithms: The parameter matching algorithm adapts SBM priors for PnP methods by determining a scaling factor c and the corresponding time-step t for a given noise level σ. This ensures consistency between the noise perturbation used in score training and the PnP algorithm.

Numerical Evaluations


Banner

Table 1: Quantitative evaluation of image deblurring across four setups for each PnP method. The denoiser types are indicated in parentheses: PnP methods using DnCNN and DRUNet represent classical approaches, while those using SBM denote PnP using a VP diffusion model as the denoiser.

Paper


Bibtex


@article{park2024pnpscore, title={Plug-and-Play Priors as a Score-Based Method}, author={Park, Chicago Y. and Hu, Yuyang and McCann, Michael T. and Garcia-Cardona, Cristina and Wohlberg, Brendt and Kamilov, Ulugbek S.}, journal={arXiv preprint arXiv:}, year={2024} }