Go to Main Content

Purdue Self-Service



Detailed Course Information


Spring 2023
May 26, 2024
Transparent Image
Information Select the desired Level or Schedule Type to find available classes for the course.

MA 43200 - Elementary Stochastic Processes
Credit Hours: 3.00. An introduction to some classes of stochastic processes that arise in probabilistic models of time-dependent random processes. The main stochastic processes studied will be discrete time Markov chains and Poisson processes. Other possible topics covered may include continuous time Markov chains, renewal processes, queueing networks, and martingales.
3.000 Credit hours

Syllabus Available
Levels: Undergraduate, Graduate, Professional
Schedule Types: Distance Learning, Lecture

Offered By: College of Science
Department: Mathematics

Course Attributes:
Upper Division

May be offered at any of the following campuses:     
      West Lafayette

Learning Outcomes: 1. Identify a verbal description of a stochastic process, identify the process as a Markov process and compute the transition matrix for the Markov process. 2. Compute the stationary distribution of a Markov process and use this to draw conclusions on the long-term asymptotic behavior of the stochastic process using appropriate limit theorems for Markov processes. 3. Understand what conditions are necessary to be able to apply the main limit theorems for Markov chains; also, students should be able to give examples of Markov chains where these limit theorems do not hold because the assumptions of the theorems are violated. 4. Calculate hitting probabilities or expected hitting times of a Markov chain by solving a system of linear equations. 5. Know how to use mathematics software (e.g. Matlab) to perform computations for Markov chains on large state spaces. 6. Understand the thinning and superposition properties of Poisson processes and how to use these properties in computations.

(Undergraduate level MA 26500 Minimum Grade of C- or Undergraduate level MA 35100 Minimum Grade of C-) and (Undergraduate level MA 41600 Minimum Grade of C- or Undergraduate level STAT 41600 Minimum Grade of C-)

Return to Previous New Search
Transparent Image
Skip to top of page