Markov property The transition probability of a process only depends on the previous state P(St+1∣St,St−1,⋯)=P(St+1∣St) References