Discrete-time Markov Chains and Poisson Processes (English)

   Sunday, April 07, 2024   

Starting a new Lecture Notes Series on Discrete-time Markov Chains and Poisson Processes

Youtube Lecture Playlist Credits 

Channel Name: NPTEL IIT Guwahati

So Let Us Start to This Journey of Learning 

Discrete-time Markov Chains and Poisson Processes By Lecture Notes together!

Lecture 1: Discrete-time Markov Chains and Poisson Processes

Lecture 2: Lec 1: Review of Basic Probability I

Lecture 3: Lec 2: Review of Basic Probability II

Lecture 4: Lec 3: Review of Basic Probability III

Lecture 5: Lec 4: Stochastic Processes

Lecture 6: Lec 5: Definition of Markov Chain and Transition Probabilities

Lecture 7: Lec 6: Markov Property and Chapman-Kolmogorov Equations

Lecture 8: Lec 7: Chapman-Kolmogorov Equations: Examples

Lecture 9: Lec 8: Accessibility and Communication of States

Lecture 10: Lec 9: Hitting Time I

Lecture 11: Lec 10: Hitting Time II

Lecture 12: Lec 11: Hitting Time III

Lecture 13: Lec 12: Strong Markov Property

Lecture 14: Lec 13: Passage Time and Excursion

Lecture 15: Lec 14: Number of Visits

Lecture 16: Lec 15: Class Property

Lecture 17: Lec 16: Transience and Recurrence of Random Walks

Lecture 18: Lec 17: Stationary Distribution I

Lecture 19: Lec 18: Stationary Distribution II

Lecture 20: Lec 19: Stationary Distribution III

Lecture 21: Lec 20: Limit Theorems I

Lecture 22: Lec 21: Limit Theorems II

Lecture 23: Lec 22: Some Problems I

Lecture 24: Lec 23: Some Problems II

Lecture 25: Lec 24: Time Reversibility

Lecture 26: Lec 25: Properties of Exponential Distribution

Lecture 27: Lec 26: Some Problems

Lecture 28: Lec 27: Order Statistics

Lecture 29: Lec 28: Poisson Processes

Lecture 30: Lec 29: Poisson Thinning I

Lecture 31: Lec 30: Poisson Thinning II

Lecture 32: Lec 31: Conditional Arrival Times

Lecture 33: Lec 32: Independent Poisson Processes

Lecture 34: Lec 33: Some Problems

Lecture 35: Lec 34: Compound Poisson Processes