Description: Artificial intelligence is driving growing demand for computation, pushing computer architecture in new directions. Graphics processing units have become the dominant hardware platform for AI, while purpose-built accelerators are emerging to deliver greater performance and efficiency. At the same time, rapidly evolving AI workloads, such as large language models and agentic AI, continue to expose new bottlenecks and inspire new hardware designs. This course explores the computer architecture principles behind modern AI hardware and provides the foundation to reason about why today’s AI accelerators are designed the way they are and how future architectures might evolve.
This course will begin with how AI workloads present data parallelism opportunities and how conventional processors exploit data-level parallelism. We then study GPU architecture in depth, examining its parallelism, memory hierarchy, and recent innovations for AI workloads. Next, we will explore domain-specific accelerators, especially those where computations are mapped across spatial arrays of processing elements, and their broad design space. This course will equip students with a working knowledge of architecture principles for AI hardware, and we will be applying these principles to analyze recent advances in the field and conduct hands-on projects. Cross-list: COMP 537. Recommended Prerequisite(s): COMP 326 - Digital Logic Design, Introductory machine learning and/or artificial intelligence course Mutually Exclusive: Cannot register for COMP 437 if student has credit for COMP 537.