Abstract
Stochastic processes have many useful
applications and are taught in several university programmers. In this paper we are using stochastic process with complex concept on Markov chains which uses a transition matrix to plot a transition diagram and there are several examples which explains various type of transition diagram. The concept behind this topic is simple and easy to understand.