Steady-state probabilities for Markov jump processes in terms of powers of the transition rate matrix.

ABSTRACT

Several types of dynamics at stationarity can be described in terms of a Markov jump process among a finite number N of representative sites. Before dealing with the dynamical aspects, one basic problem consists in expressing the a priori steady-state occupation probabilities of the sites. In particular, one wishes to go beyond the mere black-box computational tools and find expressions in which the jump rate constants appear explicitly, therefore allowing for a potential design/control of the network. For strongly connected networks admitting a unique stationary state with all sites populated, here we express the occupation probabilities in terms of a formula that involves powers of the transition rate matrix up to order N - 1. We also provide an expression of the derivatives with respect to the jump rate constants, possibly useful in sensitivity analysis frameworks. Although we refer to dynamics in (bio)chemical networks at thermal equilibrium or under nonequilibrium steady-state conditions, the results are valid for any Markov jump process under the same assumptions.