Prajnanabha Volume 1 Issue 2 · V1I2-A01

Bi-stochastic Versions of Hairer Coupling

A. Chawla\\ REAL Institute, Gurugram
Source PDF: hairerCouplingv6.pdf

Abstract

Coupling methods provide powerful tools for studying long-time behavior of stochastic dynamical systems. Hairer (2001) introduced an influential framework of asymptotic coupling to obtain exponential mixing results for stochastic partial differential equations. In his presentation, the bi-stochastic process arises as a pair of state and noise variables on a single probability space. In this note we propose a bi-stochastic formulation built on two distinct probability spaces, and show how the original Hairer construction is recovered as a special case. We also discuss how asymptotic coupling arguments adapt to this broader framework.

Introduction

Coupling arguments are now central in the analysis of stochastic processes, from Markov chains to stochastic partial differential equations (SPDEs). The underlying idea is to construct two processes on a common probability space in such a way that they eventually meet or contract. This makes it possible to derive mixing rates and uniqueness of invariant measures. The work of Hairer [1] developed an asymptotic coupling method that yields exponential mixing properties for stochastic PDEs, building on earlier coupling methods for Markov chains [2, 3].

In Hairer’s formulation, a toy model is introduced in Section 1.1 of [1] as a stochastic recursion driven by independent and identically distributed noise variables. He then defines a "bi-stochastic process" as the pair consisting of the state and the driving noise, both defined on the same probability space. This construction is perfectly adapted to the ergodic-theoretic perspective, but from the point of view of probability space structure it hides a simplification: the two sources of randomness are forced to coincide at the level of sample space.

This bi-stochastic approach is particularly relevant for modern communication systems, such as 6G networks, where heterogeneous dynamics and feedback loops require flexible coupling methods to ensure reliable data transmission.

This paper is structured as follows. We list the notation next. In Section 2, we discuss bi-stochastic processes with two distinct sample spaces, the key structure introduced herein. In Section 3 we show how to recover Hairer's results and the novelty of our view. In Section 4 we discuss the application to feedback communication. In Section 5 we conclude.

Table of Notation

{|p{3cm}|p{8cm}|p{2cm}|} Symbol & Definition & First Use

$(,{F},{P})$ & First probability space & Section 2

$({K},{G},{Q})$ & Second probability space & Section 2

$$ & Sample point in $$ & Section 2

${K}$ & Sample point in ${K}$ (also used as space name) & Section 2

${P} {Q}$ & Product measure on $ {K}$ & Section 2

$P Q$ & Alternative notation for product measure & Section 3.1.2

$$ & Coupling measure on $ {K}$ & Section 3.1.2

$$ & Unique invariant measure of the original system & Section 3.4

$P^{x_0}$ & Law of the original system started from $x_0$ & Section 3.4

$X(t,)$ & Stochastic process on $$ & Section 2

$Y(t,{K})$ & Stochastic process on ${K}$ & Section 2

$Z(t,,{K})$ & Bi-stochastic process $(X(t,), Y(t,{K}))$ & Section 2

$X_t$ & Alternative notation for $X(t,)$ & Section 3.1.1

$Y_t$ & Alternative notation for $Y(t,{K})$ & Section 3.1.1

$_t$ & Difference process $X_t - Y_t$ & Section 3.1.1

$W^{(1)}_t$ & First Brownian motion & Section 3.1.1

$W^{(2)}_t$ & Second Brownian motion & Section 3.1.1

$b()$ & Drift function & Section 3.1.1

$()$ & Diffusion coefficient function & Section 3.1.1

$()$ & Binding function & Section 3.1.1

$h()$ & Cutoff function in binding function definition & Section 3.1.1

$V()$ & Lyapunov function ${1}{2}||^2$ & Section 3.3

$f$ & Bounded measurable function & Section 3.4

$t$ & Time parameter & Section 2

$T$ & Terminal time & Section 3.1.2

$d$ & Dimension of state space & Section 3.1.1

$$ & Coupling strength parameter & Section 3.1.1

$C$ & Generic positive constant & Section 3.3

$$ & Exponential decay rate & Section 3.3

$$ & Coupling threshold parameter & Section 3.3

$u_s$ & Integrand $(Y_s)^{-1} (X_s - Y_s)$ & Section 3.1.2

${d}{d(P Q)}$ & Radon-Nikodym derivative of coupling measure & Section 3.1.2

$||$ & Euclidean norm & Section 3.1.1

$||^2$ & Squared Euclidean norm & Section 3.1.1

${Tr}[]$ & Matrix trace & Section 3.3

$()^T$ & Matrix transpose & Section 3.3

$x_0$ & Arbitrary initial condition & Section 3.4

$y_0$ & Initial condition drawn from invariant measure & Section 3.4

$\|\|_{{Lip}}$ & Lipschitz norm & Section 3.4

${E}$ & Expectation operator (generic) & Section 3.2

${E}_{P Q}$ & Expectation under product measure & Section 3.2

${E}_$ & Expectation under coupling measure & Section 3.3

${R}^2$ & Two-dimensional real space & Section 2

${R}^d$ & $d$-dimensional real space & Section 3.1.1

$ {K}$ & Product space & Section 2

${F} {G}$ & Product $$-algebra & Section 2

${(, ) : }$ & Diagonal subset of $ $ & Section 3.5

$f_t(,)$ & Encoder function of feedback communication system & Section 4

Bi-stochastic processes with two sample spaces

We propose instead to formulate a bi-stochastic process using two distinct probability spaces. Let $(,{F},{P})$ and $({K},{G},{Q})$ be two measurable probability spaces. On $$ we define a stochastic process $X(t,)$, and on ${K}$ we define another process $Y(t,{K})$. The natural way to synchronize them in time is to consider the product space $( {K}, {F} {G}, {P} {Q})$ and define \[ Z(t,,{K}) = (X(t,), Y(t,{K})) {R}^2. \] This $Z$ is a genuine stochastic process in the plane with common time parameter $t$, but it carries with it the additional structure that each coordinate originates from an independent source of randomness. This structure is richer than Hairer’s original definition, since it allows us to treat the two coordinate processes as truly independent subsystems until we impose a coupling through a suitable joint law.

The Hairer construction corresponds precisely to the special case $ = {K}$ and ${P} = {Q}$, where both processes are built from the same underlying noise sequence. In that situation, the joint law of the pair is concentrated on the diagonal of the product space, and the distinction between the two sources of randomness disappears.

Recovery of Hairer-style Results in the Bi-stochastic Framework

Having established our bi-stochastic framework with two distinct probability spaces, we now demonstrate that all essential results from Hairer's asymptotic coupling method can be recovered within this setting. The key technical steps—binding functions, Girsanov changes of measure, and exponential contraction analysis—translate directly, while the two-space structure provides additional clarity about the coupling construction.

Implementation of Binding and Measure Change

Within our two-space framework, the coupling is implemented by defining a new probability measure $$ on $ K$ that preserves the marginals while introducing dependence between the noise processes.

Binding Function Construction

Let $: {R}^d {R}^d$ be a binding function that depends on the state difference $_t = X_t - Y_t$. Under the coupling measure $$, the process $Y_t$ evolves according to:

$$ dY_t = \left[b(Y_t) + \Phi(\Delta_t)\right] dt + \sigma(Y_t) dW^{(2)}_t $$

while $X_t$ follows its original dynamics:

$$ dX_t = b(X_t) dt + \sigma(X_t) dW^{(1)}_t $$

The binding function is typically chosen to provide contraction when $|_t|$ is large, for example:

$$ \Phi(\Delta) = \alpha \Delta \cdot h(|\Delta|) $$

where $ > 0$ controls the coupling strength and $h$ is a cutoff function that vanishes for small $||$.

Measure Change via Radon-Nikodym Derivative

The coupling measure $$ is defined through its Radon-Nikodym derivative with respect to the product measure:

$$ \frac{d\mu}{d(P \otimes Q)} = \exp\left(\int_0^T u_s \cdot dW^{(2)}_s - \frac{1}{2}\int_0^T |u_s|^2 ds\right) $$

where the integrand is:

$$ u_s = \sigma(Y_s)^{-1} \Phi(X_s - Y_s) $$

This is precisely the exponential martingale form that appears in Hairer's original construction, but now the probabilistic structure is explicit: we are changing measure on the $K$ component of the product space while leaving the $$ component unchanged.

Verification of Absolute Continuity

For the measure change to be well-defined, Novikov's condition must hold:

$$ \mathbb{E}_{P \otimes Q}\left[\exp\left(\frac{1}{2}\int_0^T |u_s|^2 ds\right)\right] < \infty $$

In the two-space framework, this condition takes the form:

$$ \mathbb{E}_{P \otimes Q}\left[\exp\left(\frac{1}{2}\int_0^T \left|\sigma(Y_s)^{-1} \Phi(X_s - Y_s)\right|^2 ds\right)\right] < \infty $$

The verification typically relies on:

The two-space structure makes the independence assumptions explicit, facilitating the application of concentration inequalities and moment bounds for the individual processes.

Exponential Contraction in the Coupled System

Under the coupling measure $$, the difference process $_t = X_t - Y_t$ satisfies:

$$ d\Delta_t = [b(X_t) - b(Y_t) - \Phi(\Delta_t)] dt + \sigma(X_t)dW^{(1)}_t - \sigma(Y_t)dW^{(2)}_t $$

The analysis of exponential contraction proceeds through Lyapunov methods. Consider $V() = {1}{2}||^2$ and apply Itô's formula:

$$ \begin{align} dV(\Delta_t) &= \Delta_t \cdot [b(X_t) - b(Y_t) - \Phi(\Delta_t)] dt &\quad + \Delta_t \cdot [\sigma(X_t)dW^{(1)}_t - \sigma(Y_t)dW^{(2)}_t] &\quad + \frac{1}{2}\text{Tr}[(\sigma(X_t) - \sigma(Y_t))(\sigma(X_t) - \sigma(Y_t))^T] dt \end{align} $$

The key observation is that the drift term provides contraction when the binding function is appropriately chosen. Under standard Lipschitz conditions on $b$ and suitable choice of $$, one establishes:

$$ \mathbb{E}_\mu[V(\Delta_t)] \leq C e^{-\lambda t} V(\Delta_0) + C\varepsilon^2 $$

for constants $C, > 0$ and coupling threshold $$.

The two-space formulation clarifies that this contraction occurs under the joint law $$ while each marginal process retains its original law. This separation is crucial for transferring the contraction property to mixing results for the original system.

Transfer of Mixing Properties

The exponential contraction established under the coupling measure $$ directly implies exponential mixing for the original system. The argument proceeds by coupling an arbitrary initial condition with a trajectory started from the invariant distribution.

Let $$ denote the unique invariant measure of the original system, and consider initial conditions $x_0$ (arbitrary) and $y_0 $. Under the coupling measure $$:

For any bounded measurable function $f$, this yields:

$$ \begin{align} |\mathbb{E}[f(X_t)] - \pi(f)| &= |\mathbb{E}_\mu[f(X_t)] - \mathbb{E}_\mu[f(Y_t)]| &\leq \mathbb{E}_\mu[|f(X_t) - f(Y_t)|] &\leq \|f\|_{\text{Lip}} \mathbb{E}_\mu[|X_t - Y_t|] &\leq C\|f\|_{\text{Lip}} e^{-\lambda t/2} \end{align} $$

The key insight made transparent by the two-space formulation is that we are using the coupling measure $$ for the contraction analysis while simultaneously preserving the marginal distributions required for the mixing argument.

Equivalence with Original Hairer Framework

The construction presented above recovers Hairer's results as a special case when $ = K$ and $P = Q$. In this degenerate situation:

Under these identifications, both processes $X_t()$ and $Y_t()$ are driven by correlated noise derived from the same underlying Brownian motion, which matches Hairer's original construction exactly. The exponential mixing results follow with identical constants and rates.

However, the two-space formulation provides additional structure that can be exploited in extensions:

  1. Heterogeneous systems: When coupling processes with different state spaces or dynamics

  2. Multi-scale analysis: When different components evolve on different time scales

  3. Partial coupling: When only certain modes or degrees of freedom are coupled

In each case, the freedom to choose distinct probability spaces $(, P)$ and $(K, Q)$ allows for more flexible and transparent constructions than forcing both processes onto a single sample space.

Use Case: Application to Continuous-Time Feedback Systems

The bi-stochastic formulation of Hairer coupling proves particularly valuable in analyzing continuous-time additive white Gaussian noise (AWGN) channels with perfect feedback [4]. In such systems, the encoder function $f_t(, Y_{[0,t)})$ depends causally on channel output observations, creating a feedback loop that complicates traditional reliability analysis. The two-space construction allows us to decouple the forward channel dynamics from the feedback mechanism by placing the transmitted signal process $X_t$ on probability space $(, {F}, P)$ while the received signal process $Y_t$ evolves on $(K, {G}, Q)$. Under the coupling measure $$, the binding function $(_t)$ can be designed to account for the encoder's response to feedback, where $_t = X_t - Y_t$ represents the instantaneous transmission error. This framework enables rigorous analysis of the expected decoding time bounds while maintaining the causal structure essential to feedback communication. The exponential contraction properties established under $$ may directly translate to lower bounds on communication reliability, as the Lyapunov analysis of $V(_t) = {1}{2}|_t|^2$ captures both the channel noise effects and the encoder's adaptive behavior.

Conclusion

The bi-stochastic reformulation clarifies the probabilistic structure underlying Hairer’s coupling method. By starting from two distinct sample spaces and considering their product, we gain a transparent view of the independence of the two noise sources, and can then recover Hairer’s asymptotic coupling by imposing a special joint law. This perspective may be particularly valuable when one wishes to analyze couplings between heterogeneous systems or when dealing with multi-scale stochastic models, since it makes explicit the freedom to choose joint distributions beyond the diagonal case.

Acknowledgements

This work was produced with the assistance of a language model.

References

  1. [1]

    Doeblin, W. (1938). Exposé de la théorie des chaînes simples constantes de Markov à un nombre fini d’états. Rev. Math. Union Interbalcanique, 2, 77–105.

  2. [2]

    Kolmogorov, A. N. (1933). Grundbegriffe der Wahrscheinlichkeitsrechnung. Springer.

  3. [3]

    Feller, W. (1950). An Introduction to Probability Theory and Its Applications, Vol. I. Wiley.

  4. [4]

    Doob, J. L. (1953). Stochastic Processes. Wiley.

  5. [5]

    Skorokhod, A. V. (1956). Limit theorems for stochastic processes. Theory Probab. Appl., 1, 261–290.

  6. [6]

    Itô, K. (1951). On stochastic differential equations. Mem. Amer. Math. Soc., 4, 1–51.

  7. [7]

    Harris, T. E. (1956). The existence of stationary measures for certain Markov processes. Proc. Third Berkeley Symp. Math. Statist. Prob., 2, 113–124.

  8. [8]

    Fortet, R. and Mourier, E. (1953). Les fonctions aléatoires du type Markov associées à certaines équations linéaires aux dérivées partielles. Ann. Sci. École Norm. Sup., 70, 267–284.

  9. [9]

    Doeblin, W. and Fortet, R. (1937). Sur les chaînes à liaisons complètes. Bull. Soc. Math. France, 65, 132–148.

  10. [10]

    Lindvall, T. (1992). Lectures on the Coupling Method. Wiley.

  11. [11]

    Thorisson, H. (2000). Coupling, Stationarity, and Regeneration. Springer.

  12. [12]

    Hairer, M. (2001). Exponential mixing properties of stochastic PDEs through asymptotic coupling. Probab. Theory Relat. Fields, 124, 345–380.

  13. [13]

    Meyn, S. P. and Tweedie, R. L. (1993). Markov Chains and Stochastic Stability. Springer.

  14. [14]

    Kifer, Y. (1986). Ergodic Theory of Random Transformations. Birkhäuser.

  15. [15]

    Arnold, L. (1998). Random Dynamical Systems. Springer.

  16. [16]

    Revuz, D. and Yor, M. (1991). Continuous Martingales and Brownian Motion. Springer.

  17. [17]

    Ethier, S. N. and Kurtz, T. G. (1986). Markov Processes: Characterization and Convergence. Wiley.

  18. [18]

    Stroock, D. W. and Varadhan, S. R. S. (1979). Multidimensional Diffusion Processes. Springer.

  19. [19]

    Khasminskii, R. Z. (1960). Ergodic properties of recurrent diffusion processes and stabilization of the solution of the Cauchy problem for parabolic equations. Theory Probab. Appl., 5, 179–196.

  20. [20]

    Has’minskii, R. Z. (1980). Stochastic Stability of Differential Equations. Sijthoff & Noordhoff.

  21. [21]

    Dobrushin, R. L. (1956). Central limit theorem for non-stationary Markov chains. I. Theory Probab. Appl., 1, 65–80.

  22. [22]

    Dobrushin, R. L. (1970). Prescribing a system of random variables by conditional distributions. Theory Probab. Appl., 15, 458–486.

  23. [23]

    Villani, C. (2009). Optimal Transport: Old and New. Springer.

  24. [24]

    Kantorovich, L. V. (1942). On the translocation of masses. C. R. (Doklady) Acad. Sci. URSS, 37, 199–201.

  25. [25]

    Marton, K. (1996). Bounding ${d}$-distance by informational divergence: a method to prove measure concentration. Ann. Probab., 24, 857–866.

  26. [26]

    Dobrushin, R. L. (1971). Definition of random variables through conditional distributions. Theory Probab. Appl., 16, 458–486.

  27. [27]

    Kipnis, C. and Varadhan, S. R. S. (1986). Central limit theorem for additive functionals of reversible Markov processes. Commun. Math. Phys., 104, 1–19.

  28. [28]

    Liggett, T. M. (1985). Interacting Particle Systems. Springer.

  29. [29]

    Holley, R. and Stroock, D. (1987). Logarithmic Sobolev inequalities and stochastic Ising models. J. Stat. Phys., 46, 1159–1194.

  30. [30]

    Bakry, D. and Émery, M. (1985). Diffusions hypercontractives. Séminaire de probabilités XIX, 177–206.

  31. [31]

    Girsanov, I. V. (1960). On transforming a certain class of stochastic processes by absolutely continuous substitution of measures. Theory Probab. Appl., 5, 285–301.

  32. [32]

    Rosenblatt, M. (1956). A central limit theorem and a strong mixing condition. Proc. Natl. Acad. Sci. USA, 42, 43–47.

  33. [33]

    Ionescu Tulcea, C. T. and Marinescu, G. (1950). Théorie ergodique pour des classes d’opérations non complètement continues. Annals of Math., 52(1), 140–147.

  34. [34]

    A. Chawla and S. D. Morgera, "On the continuous time additive Gaussian noise channel in the presence of perfect feedback," in Proc. 2020 IEEE Information Theory Workshop (ITW), pp. 1–5, IEEE, 2021.