Course Schedule - Fall Semester 2025

     

Meeting location information can now be found on student schedules in ESTHER (for students) or on the Course Roster in ESTHER (for faculty and instructors).
Additional information available here.

BUSI 571 001 (CRN: 15304)

MARKOV DEC PROCESSES OPS MGMT

Long Title: MARKOV DECISION PROCESSES IN OPERATIONS MANAGEMENT
Department: Business
Instructor: Secomandi, Nicola
Meeting: 2:30PM - 5:30PM W (25-AUG-2025 - 5-DEC-2025) 
Part of Term: Full Term
Grade Mode: Standard Letter
Course Type: Lecture
Language of Instruction: Taught in English
Method of Instruction: Face to Face
Credit Hours: 3
Course Syllabus:
Course Materials: Rice Campus Store
 
Restrictions:
Must be enrolled in one of the following Program(s):
Doctor of Philosophy Business
Must be enrolled in one of the following Level(s):
Graduate
Section Max Enrollment: 15
Section Enrolled: 1
Enrollment data as of: 20-APR-2025 8:18AM
 
Additional Fees: None
 
Final Exam: GR Course-Dept Schedules Exam
 
Description: This course introduces students to Markov Decision Processes, which are models of decision making under uncertainty that play a foundational role in operations management. Topics comprise the optimality conditions (Bellman equations), algorithms to obtain optimal policies, including dynamic programming, and both reinforcement learning approximations and bounding approaches to deal with intractable models.