• Open Daily: 10am - 10pm
    Alley-side Pickup: 10am - 7pm

    3038 Hennepin Ave Minneapolis, MN
    612-822-4611

Open Daily: 10am - 10pm | Alley-side Pickup: 10am - 7pm
3038 Hennepin Ave Minneapolis, MN
612-822-4611
Solved problems on Markov chains

Solved problems on Markov chains

Paperback

Probability & Statistics

ISBN10: 6206843807
ISBN13: 9786206843801
Publisher: LAP Lambert Academic Publishing
Published: Jul 1 2025
Pages: 128
Weight: 0.40
Height: 0.30 Width: 6.00 Depth: 9.00
Language: English
Markov chains have many applications, ranging from modeling communication networks to analyzing stock prices, Markov chains can be used in market research studies, they can model the probabilities of claims for insurance, they are used in the fields of public health and medicine, also they are used in ranking of websites in web searches. In general, Markov chains are particularly useful in modeling systems that have a finite number of states and transitions between those states and can be used to analyze and predict the long-term behavior of such systems.Most books on Markov chains are dedicated to reviewing theoretical concepts. The objective of this work is to make available to students and teachers a collection of solved problems on discrete-time Markov chains. In this sense, the work consists of solving 74 problems of different types. In them are obtained the transition probabilities and the transition matrix, the state spaces and the classes of those states, the n-step transition probabilities, the recurrence and transience, the invariant distributions, the mean return time and the convergence to equilibrium.

Also from

Corbacho Sánchez, Alicia

Also in

Probability & Statistics