Markov processes form a fundamental class of stochastic models in which the evolution of a system is delineated by the memoryless property. In such processes, the future state depends solely on the ...

Brief review of conditional probability and expectation followed by a study of Markov chains, both discrete and continuous time. Queuing theory, terminology, and single queue systems are studied with ...

It is shown that sequences of generalized semi-Markov processes converge in the sense of weak convergence of random functions if associated sequences of defining elements (initial distributions, ...

In this paper, we obtain a Lamperti type representation for real-valued self-similar Markov processes, killed at their hitting time of zero. Namely, we represent real-valued self-similar Markov ...