 | Use this page to maintain syllabus information, learning objectives, required materials, and technical requirements for the course. |
| MA 43200 - Elementary Stochastic Processes |
|---|
|
Associated Term:
Spring 2023
Learning Outcomes: 1. Identify a verbal description of a stochastic process, identify the process as a Markov process and compute the transition matrix for the Markov process. 2. Compute the stationary distribution of a Markov process and use this to draw conclusions on the long-term asymptotic behavior of the stochastic process using appropriate limit theorems for Markov processes. 3. Understand what conditions are necessary to be able to apply the main limit theorems for Markov chains; also, students should be able to give examples of Markov chains where these limit theorems do not hold because the assumptions of the theorems are violated. 4. Calculate hitting probabilities or expected hitting times of a Markov chain by solving a system of linear equations. 5. Know how to use mathematics software (e.g. Matlab) to perform computations for Markov chains on large state spaces. 6. Understand the thinning and superposition properties of Poisson processes and how to use these properties in computations. Required Materials: Technical Requirements: |
| Return to Previous | New Search |
 |