Many of the following slides are modified from the excellent class notes of similar courses offered in other schools by Prof Yung-Yu Chung, Frédo Durand, Alexei Efros, William Freeman, Srinivasa Narasimhan, Steve Seitz, and Dr Richard Szeliski. The instructor is extremely thankful to the researchers for making their notes available online. Please feel free to use and modify any of the slides but acknowledge the original sources where appropriate.

The following tentative syllabus is inheritted from last Fall; it is subject to change (but not much) and update.

Lecture Dates

Topics Materials
1 Sept 3 Th Introduction and Overview
PPT, PDF
2 Sept 8 Tu Cameras and Image Formation
PPT, PDF

Readings: Forsyth and Ponce, Chapter 1

Diffraction and Photography Tutorial

3 Sept 10 Th Eyes and HDR
PPT, PDF

Readings: Nishino and Nayar, IJCV 2006, Corneal Imaging System: Environment from Eyes

4 Sept 15 Tu HDR(2)

Readings: Debevec, SIGGRAPH 1997, Recovering High Dynamic Range Radiance Maps from Photographs

Readings: Forsyth and Ponce, Chapter 7 and 8 on filtering and edge detection.

Project 1 assigned

5 Sept 17 Th Image Processing Basics

PPT, PDF

Readings (Optional): Fergus et al, Removing camera shake from a single image, SIGGRAPH 2006.

6 Sept 22 Tu Image Transformation
PPT, PDF
7 Sept 24 Th Camera Projection and Calibration
PPT, PDF

Readings: Forsyth and Ponce, Chapter 2 on geometric camera models.

8 Sept 29 Tu Image Mosaics
PPT, PDF

Readings: Forsyth and Ponce, Chapter 3 on geometric camera calibration.

Project 1 due on Sept 29

9
10 Oct 1 Th Matching Features

Readings:
1. R. Szeliski and H.-Y. Shum. Creating full view panoramic image mosaics and texture-mapped models, SIGGRAPH 1997, pp251-258.
2. M. Brown, D. G. Lowe, Recognising Panoramas, ICCV 2003.
Project 2 assigned

PPT, PDF

Readings:
Lowe, IJCV 2004, Distinctive image features from scale-invariant keypoints
Brown et al, CVPR 2005, Multi-image matching using multi-scale oriented patches
Brown and Lowe, ICCV 2003, Recognizing Panorama

11 Oct 6 Tu Single View Modeling

PPT, PDF

Readings:
Horry et al, SIGGRAPH 1997, Tour into the picture
Criminisi et al, IJCV 2000, Single View Metrology

12 Oct 8 Th Shading and Illumination

PPT, PDF

Readings:
Woodham, Optical Engineering, 1980, Photometric Stereo

13 Oct 13 Tu Shading and Illumination (2)

Readings:
Hertzmann and Seitz, PAMI 2005, Example-based Pphotometric Stereo
Nayar et al, SIGGRAPH 2007, Fast Seperaton of Direct and Global Illumination

Project 2 due on Oct 15

14 Oct 15 Th Stereo

PPT, PDF

Readings:
Forsyth and Ponce, Computer Vision, 2003, Chapter 11 Stereopsis
Scharstein and Szeliski, IJCV 2002, A taxonomy and evaluation of dense two-frame stereo correspondence algorithms

15 Oct 20 Tu Stereo (2)

Readings:
(Optional) Zhang et al, SIGGRAPH, 2004, Spacetime Faces

Project 3 assigned

16 Oct 22 Th Structure from Motion
 

PPT, PDF

Readings:
Hartley and Zisserman, Multiple View Geometry, 2003, Chapter 9 Epipolar Geometry and the Fundamental Matrix (course reserve in Wendt Library)
Marc Pollefeys' online tutorial on SfM
Snavely et al, SIGGRAPH 2006, 3D Photo Tourism

17 Oct 27 Tu Structure from Motion (2)

Readings:
Kanade and Morris, Philosophical Transactions of the Royal Society of London, Series A, Vol. 356, No. 1740, 1998, Factorization Methods for Structure From Motion
Bill Triggs, et al, Vision Algorithms: Theory and Practice, 2000, Bundle Adjustment -- A Modern Synthesis

Final Project Out

18 Oct 29 Th Multiview Stereo

PPT, PDF

Readings:
Kutukakos and Seitz, IJCV 2000, A Theory of Shape by Space Carving
Faugeras and Keriven, ECCV 1998, Complete Dense Stereovision using Level Set Methods


19 Nov 3 Tu Plenotpic Function, Lightfields, and Sensing

PPT, PDF

Readings:
Levoy and Hanrahan, SIGGRAPH 1996, Light Field Rendering
Isaksen, et al, SIGGRAPH 2000, Dynamically Reparameterized Light Fields
Ng et al, Stanford CS Tech Report 2005-02, Hand-Held Plenoptic Camera
Levoy, IEEE Computer 2006, Light Fields and Computational Imaging

Project 3 due on Nov 3

 

20 Nov 5 Th Face Detection and Recognition

PPT, PDF

Readings:
Forsyth and Ponce, Chapter 22, pp 495-511
Turk and Pentland, J of Cognitive Neuroscience 3(1), Eigenfaces for recognition
Viola and Jonce, IJCV 2004, Robust Realtime Face Detection

21 Nov 10 Tu

Segmentation

Final Project proposal due on Nov 10

Readings:
Comaniciu and Meer, ICCV 1999, Mean shift analysis and applications.
Shi and Malik. PAMI 2000. Normalized Cuts and Image Segmentation.
Rother, Kolmogorov, and Blake. SIGGRAPH 2004. GrabCut: Interactive Foreground Extraction using Iterated Graph Cuts.
Li, Sun, Tang, and Shum. SIGGRAPH 2004. Lazy Snapping

Presenters: Nayan, Bhaswati, Yizhen

22 Nov 12 Th More on Feature Detection and Descriptors

Readings:
Ke and Sukthankar, CVPR 2004, PCA-SIFT.
Mikolajczyk and Schmid, PAMI 2005, A performance evaluation of local descriptors (GLOH).
Tola, Lepetit, and Fua, CVPR 2008, DAISY.
Winder, Gang, Brown, CVPR 2009, Picking the best DAISY.

Presenters: Kamiya, Maxwell, Mark

23 Nov 17 Tu

Shape and Matching

Readings:
Belongie, et al, PAMI 2002, Shape matching and object recognition using shape contexts
Shechtman and Irani, CVPR 2007, Matching Local Self-Similarities across Images and Videos
Grausman and Darrell, ICCV 2005, Pyramid Matching Kernel
Lazebnik et al, CVPR 2006, Beyond Bags of Features

Presenters: Faisal, Varghese, Taushar

24 Nov 19 Th Indexing and Retrieval

Readings:
Sivic and Zisserman, CVPR 2003, Video Google
Nister and Stewenius, CVPR 2006, Scalable Recognition with a Vocabulary Tree
Schindler, Brown, and Szeliski, CVPR 2007, City-Scale Location Recognition

Presenters: Junming, Lizhu, Zhiting

25 Nov 24 Tu

More on 3D Reconstruction

Final Project progress report due on Nov 24

Readings:
Goesele, Snavely, Curless, Hopppe, and Seitz, ICCV 2007, Multi-View Stereo for Community Photo Collections
Agarwal, Snavely, Simon, Setiz, and Sezliski, ICCV 2009, Building Rome in a Day
Furukawa, Curless, Seitz, and Szeliski, ICCV 2009, Reconstructing Building Interiors from Images

Presenters: Chaman, Mon-Ju, Joel

  Nov 26 Th Thanksgiving
26 Dec 1 Tu

Labeling Images for Fun

Readings:
Ahn, CHI 2004, Labeling Images with a Computer Game (game website)
Ahn, et al, Peekaboom: A Game for Locating Objects in Images (game website)
Russel et al, MIT AI LAB Memo, AIM-2005-025, Label Me (tool website)
Torralba et al. Tiny Images.

Presenters: Finn, Kendrick, Navdeep

27 Dec 3 Th Computational Cameras

Readings:
Levin, Fergus, Durand, and Freeman, SIGGRAPH 2007, Image and Depth from a Conventional Camera with a Coded Aperture
Levin, Sand, Cho, Durand, and Freeman, SIGGRAPH 2008, Motion-Invariant Photography
Nagahara, Kuthirummal, Zhou, and Nayar, ECCV 2008, Flexible Depth of Field Photography

Presenters: Adrian, David, Yoram

28 Dec 8 Tu Final project presentation I

Presenters:

29 Dec 10 Th Final project presentation II Presenters: