The paper tackles a fundamental challenge in modern statistics and machine learning: how to efficiently represent and approximate complex probability distributions defined over infinite-dimensional spaces, such as spaces of functions or signals. These kinds of distributions appear naturally when you want to infer an unknown function from noisy data (Bayesian inverse problems) or when building generative models for complex data like images or fluid simulations. The core difficulty is that working directly in infinite dimensions is computationally intractable, yet naive finite-dimensional approximations can introduce errors that grow with the resolution of your discretization.
The authors introduce a structured class of distributions that captures a key practical insight: even when a distribution lives in a very high-dimensional space, it often differs from a simple "reference" distribution only along a small number of directions. They build a framework where you only need to learn a low-dimensional transformation to capture the meaningful structure of the distribution, while the remaining directions are handled automatically by the reference distribution. This leads to efficient algorithms where the computational cost scales with the intrinsic complexity of the problem rather than the resolution used to discretize it. They also reveal an important theoretical finding: the classically preferred "optimal transport" approach does not naturally preserve this low-dimensional structure, which has practical implications for algorithm design.
The paper provides rigorous error bounds showing that approximation quality depends on the intrinsic dimension of the problem rather than the ambient discretization size, which is exactly the kind of resolution-independent guarantee you want for reliable scientific computing. The authors validate their framework on several challenging problems, including recovering an unknown field from a small number of nonlinear measurements, deblurring images when the noise has irregular jump-like behavior, and tracking the state of turbulent fluid flows governed by the Navier-Stokes equations. Together, these results suggest a principled and computationally practical path toward scalable probabilistic inference and generative modeling in function spaces.