← Back to arXiv
arXivProbabilityarXiv:2611.03921

R\'enyi mixing bounds for kinetic samplers via $L^2$ hypocoercivity

The paper studies three algorithms used in statistics and machine learning to draw random samples from complex probability distributions: underdamped Langevin dynamics, the bouncy particle sampler, and the Zigzag sampler. These are all "kinetic" or momentum-based methods, meaning they simulate a particle moving through space with velocity, rather than just taking random steps. The central question is: how quickly do these algorithms converge to the desired target distribution, starting from some initial distribution that might be far away from it?

The main technical contribution is a sharper bound on convergence time. The authors measure how far away the algorithm's current distribution is from the target using something called Renyi divergence, which is a way of quantifying the difference between two probability distributions. Previous results suggested the mixing time (how long you need to run the algorithm) scales linearly with the initial "distance" R from the target. The authors show it actually scales like the square root of R times a logarithmic factor, which is a meaningful improvement when R is large. They achieve this by using a logarithmic Sobolev inequality, a functional analytic tool, in a clever way inside a standard convergence argument called hypocoercivity.

The paper also shows these improved bounds are essentially tight, meaning you cannot do much better in general. For the bouncy particle and Zigzag samplers, examples based on Gaussian targets confirm the square-root scaling is the best possible. Perhaps most strikingly, the authors show that strong convexity of the energy function alone is not enough to guarantee a mixing time that is uniform across all starting points, something one might have hoped for. This combination of sharp upper and lower bounds gives a fairly complete picture of how these popular sampling algorithms behave in terms of convergence speed.

Read original →