Built independently by an author, for readers. Read the story and support ChapterPal

keyword

pseudoinverse-guided diffusion models

Pseudoinverse-guided diffusion models are generative frameworks that solve inverse problems by directing a pretrained, problem-agnostic diffusion model toward measurement consistency using a pseudoinverse-based guidance term during the reverse sampling process. Instead of training separate models for specific reconstruction tasks, this approach leverages the unconditional score function of a general diffusion prior and incorporates the generalized or Moore-Penrose pseudoinverse of the forward measurement operator to approximate conditional scores at each denoising step. This enables zero-shot reconstruction across diverse image restoration and signal recovery tasks, accommodating noisy, linear, non-linear, and non-differentiable observation processes without requiring task-specific model retraining.

1 item

Rethinking Diffusion Posterior Sampling: From Conditional Score Estimator to Maximizing a Posterior

Rethinking Diffusion Posterior Sampling: From Conditional Score Estimator to Maximizing a Posterior

Tongda Xu, Xiyan Cai, Xinjie Zhang, Xingtong Ge, Dailan He, Liming Sun, Jingjing Liu, Ya-Qin Zhang, Jian Li, Yan Wang

OrganizationsKuaishou TechnologyNew York UniversitySenseTimeThe Chinese University of Hong KongThe Hong Kong University of Science and TechnologyTsinghua UniversityUniversity of Cambridge

Why you should read this

Demonstrates that Diffusion Posterior Sampling functions as maximum a posteriori optimization rather than true conditional score matching, introducing explicit posterior maximization and an ultra-lightweight estimator trained on just 100 images to improve diffusion-based inverse problem solving.

Recent advancements in diffusion models have been leveraged to address inverse problems without additional training, and Diffusion Posterior Sampling (DPS) (Chung et al., 2022a) is among the most popular approaches. Previous analyses suggest that DPS accomplishes posterior sampling by approximating the conditional score. While in this paper, we demonstrate that the conditional score approximation employed by DPS is not as effective as previously assumed, but rather aligns more closely with the principle of maximizing a posterior (MAP). This assertion is substantiated through an examination of DPS on 512x512 ImageNet images, revealing that: 1) DPS's conditional score estimation significantly diverges from the score of a well-trained conditional diffusion model and is even inferior to the unconditional score; 2) The mean of DPS's conditional score estimation deviates significantly from zero, rendering it an invalid score estimation; 3) DPS generates high-quality samples with significantly lower diversity. In light of the above findings, we posit that DPS more closely resembles MAP than a conditional score estimator, and accordingly propose the following enhancements to DPS: 1) we explicitly maximize the posterior through multi-step gradient ascent and projection; 2) we utilize a light-weighted conditional score estimator trained with only 100 images and 8 GPU hours. Extensive experimental results indicate that these proposed improvements significantly enhance DPS's performance. The source code for these improvements is provided in this https URL.

Added

2026-10-01