← Back to arXiv
arXivProbabilityarXiv:2608.25094

Noising-Denoising by Large Temperature Schr\"{o}dinger Bridges

Diffusion models are a popular class of AI systems that generate images and other data by learning to reverse a noise-adding process. You start with clean data, gradually corrupt it with random noise until it looks like pure static, and then train a neural network to run that process backward, turning noise back into realistic data. These models have become the backbone of tools like image generators, but their theoretical foundations are still being actively worked out.

The Schrodinger bridge problem is a classical mathematical question about finding the most likely way a random process evolves between two known distributions, given some reference process describing typical behavior. The authors show that when you crank up a temperature parameter in this framework to very large values, the Schrodinger bridge problem naturally splits into two halves that mirror the structure of diffusion models. In the first half of the time interval, the optimal process looks like the forward noising procedure that corrupts data. In the second half, it looks like the reverse denoising procedure that recovers clean data. This is a clean and satisfying theoretical result because it roots diffusion models in a well-established mathematical framework without needing to impose that structure by hand.

The practical significance is that this connection provides a principled justification for certain algorithmic approximations that researchers have been using in practice. Specifically, the paper gives a rigorous process-level explanation for an approximation scheme developed in earlier work by Clerc and colleagues, where the score function driving the reverse process is approximated using gradient flow ideas. Establishing this link means practitioners can have more confidence in why those approximations work, and it opens a door for using the rich theory of Schrodinger bridges to further improve or analyze denoising diffusion models going forward.

Read original →