SCCI Digital Library and Forum
Menu
Home
About Us
Video Library
eBooks
SCCI Forum
Home
»
Applied Sciences
»
Engineering
»
Electrical Engineering and Computer Science (M-I-T)
»
Introduction to Probability (Spring 2018) (M-I-T)
»
Part III: Random Processes (M-I-T)
»
Lecture 25: Steady–State Behavior of Markov Chains (M-I-T)
»
L25.3 Markov Chain Review (M-I-T)
L25.3 Markov Chain Review (M-I-T)
Course:
Lecture 25: Steady–State Behavior of Markov Chains (M-I-T)
Discipline:
Applied Sciences
Institute:
MIT
Instructor(s):
Prof. John Tsitsiklis, Prof. Patrick Jaillet
Level:
Graduate
Lecture 25: Steady–State Behavior of Markov Chains (M-I-T)
L25.10 Birth-Death Processes — Part I (M-I-T)
L25.11 Birth-Death Processes — Part II (M-I-T)
L25.1 Brief Introduction (M-I-T)
L25.2 Lecture Overview (M-I-T)
L25.3 Markov Chain Review (M-I-T)
L25.4 The Probability of a Path (M-I-T)
L25.5 Recurrent and Transient States: Review (M-I-T)
L25.6 Periodic States (M-I-T)
L25.7 Steady-State Probabilities and Convergence (M-I-T)
L25.8 A Numerical Example — Part II (M-I-T)
L25.9 Visit Frequency Interpretation of Steady-State Probabilities (M-I-T)