SCCI Digital Library and Forum

Lecture 25: Steady–State Behavior of Markov Chains (M-I-T)

S# Lecture Course Institute Instructor Discipline
1
L25.10 Birth-Death Processes — Part I (M-I-T)
Lecture 25: Steady–State Behavior of Markov Chains (M-I-T) MIT Prof. John Tsitsiklis, Prof. Patrick Jaillet Applied Sciences
2
L25.11 Birth-Death Processes — Part II (M-I-T)
Lecture 25: Steady–State Behavior of Markov Chains (M-I-T) MIT Prof. John Tsitsiklis, Prof. Patrick Jaillet Applied Sciences
3
L25.1 Brief Introduction (M-I-T)
Lecture 25: Steady–State Behavior of Markov Chains (M-I-T) MIT Prof. John Tsitsiklis, Prof. Patrick Jaillet Applied Sciences
4
L25.2 Lecture Overview (M-I-T)
Lecture 25: Steady–State Behavior of Markov Chains (M-I-T) MIT Prof. John Tsitsiklis, Prof. Patrick Jaillet Applied Sciences
5
L25.3 Markov Chain Review (M-I-T)
Lecture 25: Steady–State Behavior of Markov Chains (M-I-T) MIT Prof. John Tsitsiklis, Prof. Patrick Jaillet Applied Sciences
6
L25.4 The Probability of a Path (M-I-T)
Lecture 25: Steady–State Behavior of Markov Chains (M-I-T) MIT Prof. John Tsitsiklis, Prof. Patrick Jaillet Applied Sciences
7
L25.5 Recurrent and Transient States: Review (M-I-T)
Lecture 25: Steady–State Behavior of Markov Chains (M-I-T) MIT Prof. John Tsitsiklis, Prof. Patrick Jaillet Applied Sciences
8
L25.6 Periodic States (M-I-T)
Lecture 25: Steady–State Behavior of Markov Chains (M-I-T) MIT Prof. John Tsitsiklis, Prof. Patrick Jaillet Applied Sciences
9
L25.7 Steady-State Probabilities and Convergence (M-I-T)
Lecture 25: Steady–State Behavior of Markov Chains (M-I-T) MIT Prof. John Tsitsiklis, Prof. Patrick Jaillet Applied Sciences
10
L25.8 A Numerical Example — Part II (M-I-T)
Lecture 25: Steady–State Behavior of Markov Chains (M-I-T) MIT Prof. John Tsitsiklis, Prof. Patrick Jaillet Applied Sciences
11
L25.9 Visit Frequency Interpretation of Steady-State Probabilities (M-I-T)
Lecture 25: Steady–State Behavior of Markov Chains (M-I-T) MIT Prof. John Tsitsiklis, Prof. Patrick Jaillet Applied Sciences