Introduction to Foundation Models

CS 639, Spring 2026
Department of Computer Sciences
University of Wisconsin–Madison


Important Notes

Meets: Tuesdays & Thursdays. First day: Tue. Jan. 20, 2026. Last day: Thu. Apr. 30, 2026.

This schedule is tentative and subject to change. Please check back often. In particular, the deadlines for the homework sets/project may change.

Tentative Schedule

Date Lecture Readings Homework Release Homework Due
Tuesday Jan. 20 Lecture 1: Class Overview and What Is an FM?
Thursday Jan. 22 Lecture 2: Machine Learning: Review
Tuesday Jan. 27 Lecture 3: Deep Learning: A Quick Intro I
Thursday Jan. 29 Lecture 4: Deep Learning: A Quick Intro II
Tuesday Feb. 3 Lecture 5: Self-Supervised Learning
Thursday Feb. 5 Lecture 6: Nick Roberts: The Science of Foundation Models
  • (TBD)
Tuesday Feb. 10 Lecture 7: Transformers and Attention
Thursday Feb. 12 Lecture 8: Transformers and Attention II
Tuesday Feb. 17 Lecture 9: Architectures I
Thursday Feb. 19 Lecture 10: Encoder-Decoder and Decoder-Only Models
Tuesday Feb. 24 Lecture 11: Attention Variants
Thursday Feb. 26 Lecture 12: Multimodal Architectures I
Tuesday Mar. 3 Lecture 13: Multimodal Architectures II
Thursday Mar. 5 Lecture 14: Prompting, ICL, and Others
Tuesday Mar. 10 Lecture 15: Specialization: Fine-Tuning & Adaptation I
Thursday Mar. 12 Lecture 16: Specialization: Fine-Tuning & Adaptation II
Tuesday Mar. 17 Lecture 17: Alignment I
Thursday Mar. 19 Lecture 18: Alignment II
Tuesday Mar. 24 Lecture 19: Reasoning I: CoT
Thursday Mar. 26 Lecture 20: Reasoning II: RLVR and Otbers
Tuesday Mar. 31 No class — Spring Break
Thursday Apr. 2 No class — Spring Break
Tuesday Apr. 7 Lecture 21: Evaluation I: Metrics and Benchmarks
Thursday Apr. 9 Lecture 22: Evaluation II
Tuesday Apr. 14 Lecture 23: Scaling I: Laws, MoEs and More
Thursday Apr. 16 Lecture 24: Scaling II: Test-time Scaling
Tuesday Apr. 21 Lecture 25: Agents I
Thursday Apr. 23 Lecture 26: Agents II
Tuesday Apr. 28 Lecture 27: Applications: FMs for Science & Medicine
Thursday Apr. 30 Lecture 28: Future Areas