Markov analysis is a method used to forecast the value of a variable whose future value is influenced only by its current position or state.

This paper is concerned with the analysis of Markov decision processes in which a natural form of termination ensures that the expected future costs are bounded, at least under some policies. Whereas ...