EE 512: Stochastic Processes

Course Info

Schedule

Lecture Content Reference
Lecture 1 Probability theory
Lecture 2 Probability theory
Lecture 3 Limit theorems
Lecture 4 Poisson processes
Lecture 5 Properties of Poisson processes
Lecture 6 Introduction to renewal theory
Lecture 7 Renewal theory limit theorems
Lecture 8 RankWald's identity, Key renewal theorem
Lecture 9 Markov chain examples
Lecture 10 Markov chain decomposition
Lecture 11 Markov chain limit theorems
Lecture 12 Reversible chains, mixing time
Lecture 13 Markov jump processes
Lecture 14 CTMC limiting behavior
Lecture 15 Martingales and Azuma's inequality
Lecture 16 Martingale stopping
Lecture 17 Martingale wrapup
Lecture 18 Brownian motion
Lecture 19 Brownian motion
Lecture 20 Ornstein-Uhlenbeck process
Lecture 21 Notes on finance
Lecture 22 Stochastic calculus
Lecture 23 Ito's formula
Lecture 24 Stochastic differential equations
Lecture 25 SDE weak solutions & simulations
Lecture 26 Black-Schole's, Importance sampling
Lecture 27 Review