CS 758 Advanced Topics in Computer Architecture Fall 2019 Section 1
Instructor Matthew D. Sinclair
URL: http://www.cs.wisc.edu/~sinclair/courses/cs758/fall2019/

This is a rough schedule and will change with little notice as the semester progresses. Please check regularly.

You may need to be on campus (or use VPN) to access the PDFs on the ACM and IEEE websites. I will also post the PDFs on Canvas. Finally, if you are interested in additional readings on GPUs, you may consider this webpage (still in progress) where I am constructing a list of top GPU papers on various topics.

Date Topic Content
Thurs 9/5 Introduction & the Rise of Heterogeneous Computing Read: Hameed 2010
Unit 1 slides
Tues 9/10 Dark Silicon Office Hours Poll Due (vote on Doodle, see details on Piazza)
Review: Esmaeilzadeh 2011
Reference: Keckler 2011
Unit 2 slides
Thurs 9/12 GPU Programming HW0 Assigned
Read General-Purpose Graphics Processor Architectures (GPGPA): Chapters 1-2
Reference: (NVIDIA) CUDA Programming Guide
Reference: (NVIDIA) PTX ISA
Reference: (AMD) HIP Programming Guide
Reference: (AMD) GCN3 ISA
Unit 3 slides
Tues 9/17 GPU Programming, ISAs, & Simulation Review: Gutierrez 2018
Read: Khairy 2018
Reference: Lew 2018
Reference: Bakhoda 2009
Unit 4 slides
AMD GPU Tutorial
Thurs 9/19 GPU Microarchitecture HW0 Due
Read: Rogers 2015
Read: GPGPA Chapter 3
Unit 5A slides
Fri 9/20 HW1 Assigned
Tues 9/24 GPU Register Files & Thread Scheduling Review: Gebhardt 2011 (ISCA)
Reference: Gebhardt 2011 (MICRO)
Reference: Narasiman 2011
Unit 5B slides
Thurs 9/26 GPU Register Files & Thread Scheduling (Continued) Unit 6A slides
Unit 6B slides
Tues 10/1 GPU Coalescing, TLBs, & DRAM Review: Pichai 2014
Read: GPGPA Chapter 4
Skim: Chaterjee 2017
Reference: GPGPA Chapter 5
Reference: Rogers 2012
Reference: Agarwal 2015
Unit 7 slides
Unit 7B slides
Thurs 10/3 GPU Coherence & Consistency Read: Hower 2014
Skim: Sinclair 2015
Reference: Orr 2016
Unit 8 slides
Fri 10/4 HW1 Due
Tues 10/8 Exam Review Midterm Exam I 715-915 PM, 1325 CS
Thurs 10/10 No Class
Tues 10/15 GPU/Accelerator Security Project Preliminary Ideas Due 9AM
Review Naghibijouybari 2017
Read Olson 2015
Unit 9 slides
Thurs 10/17 Using CHTC to Improve Research Throughput: Guest Lecture by Brian Bockelman HW2 Assigned
Read: Thain 1995
Reference: Condor Manual
CHTC slides
Tues 10/22 Multi GPU/Chiplets Project Proposal Due 9AM
Review: Arunkumar 2017
Read: Milic 2017
Reference: Vijayaraghavan 2017
Arunkumar slides
Unit 10 slides
Thurs 10/24 Intro to DNNs Review: Sze 2017 (first 20 pages)
Reference: watch Dean 2018
Unit 11 slides
Tues 10/29 MLP, GEMM, Conv Read: Sze 2017 (last 15 pages)
Reference: watch Dally 2018
Unit 12 slides
Thurs 10/31 ML: Systolic Arrays Read: Jouppi 2017
Reference: Volta V100
Reference: Williams 2008
Unit 13 slides
Fri 11/1 HW2 Due
Tues 11/5 ML: Data Reuse Review: Chen 2014
Read: Du 2015
Unit 14 slides
Thurs 11/7 ML: Reuse/Sparsity & Pruning Review: Han 2016
Read: Zhang 2016
Unit 15 slides
Tues 11/12 ML: Sparsity & Pruning 2 Project Progress Report Due 9AM
Unit 15 slides
Thurs 11/14 ML: Memory Read: Rhu 2018
Reference: Siu 2018
Unit 16 slides
CDMA slides
Tues 11/19 ML: RNNs Review: Fowers 2018
Read: Diamos 2016
Unit 17 slides
Thurs 11/21 Accelerator Wall Review: Fuchs 2019
Read: Hestness 2019
Unit 18 slides
Tues 11/26 Exam Review Midterm Exam II 715-915 PM, 1325 CS
Thurs 11/28 No Class: Thanksgiving Break
Tues 12/3 No Class Project Lightning Talk Due at 9AM
Thurs 12/5 No Class
Tues 12/10 Project Talks: 9AM - 1PM, 4310 CS
Tues 12/17 Final Project Reports due, upload to Canvas by 5PM

 
Computer Sciences | UW Home