Syllabus

For all "Materials and Assignments", follow the deadlines listed on this page, not on Coursera! Assignments are due every Tuesday by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted.

Announcements

  • The course website for Fall offering of 2024 is still in the process of updating. Please keep in mind that changes will be made up until 9/23 so please refer to the website for the most up-to-date information on the first day of the quarter.
  • Please join Ed during the first week. This is where the majority of course announcements will be found.
  • Video cameras located in the back of the room will capture the instructor presentations in this course. For your convenience, you can access these recordings by logging into the course Canvas site. These recordings might be reused in other Stanford courses, viewed by other Stanford students, faculty, or staff, or used for other education and research purposes. Note that while the cameras are positioned with the intention of recording only the instructor, occasionally a part of your image or voice might be incidentally captured. If you have questions, please contact a member of the teaching team.
  • Since the exam will be in-person, SCPD/CGOE students will need to nominate exam monitors for both exams and coordinate the exam process with the SCPD exams team. Please refer to this link for more information on the process. For any additional questions, please reach out to the SCPD exams team at scpd-exams@stanford.edu.
  • If you would like to audit the course, please fill out the following request form.

Syllabus

  • Modules are equivalent to “Weeks” in the Coursera courses. For example, C1M1 refers to C1 Week 1.
  • Note that the in-class lecture topics are subject to change as the quarter progresses.
Event Date In-class lecture Online modules to complete Materials and Assignments
Lecture 1 9/24 Topics: (slides)
  • Class introduction
  • Examples of deep learning projects
  • Course details
 No online modules. If you are enrolled in CS230, you will receive an email to join Course 1 ("Neural Networks and Deep Learning") on Coursera with your Stanford email. No assignments.
Neural Networks and Deep Learning (Course 1)
Lecture 2 10/01 Topics: Full-cycle of a Deep Learning Project (no slides) Completed modules:
  • C1M1: Introduction to deep learning (slides)
    • due by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted
  • C1M2: Neural Network Basics (slides)
Optional Video
  • Batch Normalization videos from C2M3 will be useful for the in-class lecture.
 Quizzes (due by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted):
  • Introduction to deep learning
  • Neural Networks Basics
Programming Assignments (due by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted)
  • Python Basics with Numpy (Optional)
  • Logistic Regression with a neural network mindset
Lecture 3 10/08 Topics: Deep Learning Strategy (no slides)

Optional Reading: A guide to convolution arithmetic for deep learning, Is the deconvolution layer the same as a convolutional layer?, Visualizing and Understanding Convolutional Networks, Deep Inside Convolutional Networks: Visualizing Image Classification Models and Saliency Maps, Understanding Neural Networks Through Deep Visualization, Learning Deep Features for Discriminative Localization 		Completed modules: Quizzes (due by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted):
  • Shallow Neural Networks
  • Key concepts on Deep Neural Networks
Programming Assignments (due by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted):
  • Planar data classification with a hidden layer
  • Building your Deep Neural Network: step by step
  • Deep Neural Network - Application
Project Meeting #1 10/08 Tuesday 11:59 PM Instructions Meet with any TA between 9/24 and 10/08 to discuss your proposal.
Project Proposal Due 10/08 Tuesday 11:59 PM Instructions
Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization (Course 2)
Lecture 4 10/15 Topics: Deep Learning Intuition (slides) Completed modules:
  • C2M1: Practical aspects of deep learning (slides)
  • C2M2: Optimization algorithms (slides)
 Quizzes (due by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted):
  • Practical aspects of deep learning
  • Optimization Algorithms
Programming Assignments (due by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted):
  • Initialization
  • Regularization
  • Gradient Checking
  • Optimization
Structuring Machine Learning Projects (Course 3)
Lecture 5 10/22 Topics: Adversarial examples / GANs / Stable Diffusion (slides)
  • Attacking neural networks with Adversarial Examples and Generative Adversarial Networks
Optional Readings: Explaining and Harnessing Adversarial Examples, Generative Adversarial Nets, Conditional GAN, Super-Resolution GAN, CycleGAN 		Completed modules:
  • C2M3: Hyperparameter Tuning, Batch Normalization (slides)
  • C3M1: ML Strategy (1) (slides)
  • C3M2: ML Strategy (2) (slides)
 Quizzes (due by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted):
  • Hyperparameter tuning, Batch Normalization, Programming Frameworks
  • Bird recognition in the city of Peacetopia (case study)
  • Autonomous driving (case study)
Programming Assignments (due by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted):
  • Tensorflow
Convolutional Neural Networks (Course 4)
Lecture 6 10/29 Topics: (slides) Optional Reading Completed modules:
  • C4M1: Foundations of Convolutional Neural Network (slides)
  • C4M2: Deep Convolutional Models (slides)
 Quizzes (due by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted):
  • The basics of ConvNets
  • Deep convolutional models
Programming Assignments (due by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted):
  • Convolutional Model: step by step
  • Convolutional Model: application
  • Residual Networks
  • Transfer Learning with MobileNet
Lecture 7 11/05 Democracy day: NO CLASS Completed modules:
  • C4M3: ConvNets Applications (1) (slides)
  • C4M4: ConvNets Applications (2) (slides)
 Quizzes (due by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted):
  • Detection Algorithms
  • Special Applications: Face Recognition & Neural Style Transfer
Programming Assignments (due by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted):
  • Car Detection with YOLO
  • Art Generation with Neural Style Transfer
  • Face Recognition
Midterm Review TBD
Midterm 11/06 Midterm will be from 6 pm to 9 pm. More information will be provided later in the quarter.
Lecture 8 11/12 Topics: Deep Reinforcement Learning Optional Reading: Completed modules:
  • C5M1: Recurrent Neural Networks (slides)
 Quizzes (due by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted):
  • Recurrent Neural Networks
Programming Assignments (due by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted):
  • Building a Recurrent Neural Network - Step by Step
  • Dinosaur Land -- Character-level Language Modeling
  • Jazz improvisation with LSTM
Project Meeting #2 11/15 Friday 11:59 PM Instructions Meet with your assigned TA between 10/08 and 11/15 to discuss your milestone report.
Project Milestone Due 11/15 Friday 11:59 PM Instructions
Sequence Models (Course 5)
Lecture 9 11/19 Topics:
Completed modules:
  • C5M2: Natural Language Processing and Word Embeddings (slides)
  • C5M3: Sequence-to-Sequence Models (slides)
 Quizzes (due by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted):
  • Natural Language Processing and Word Embeddings
  • Sequence Models and Attention Mechanism
Programming Assignments (due by 11:00 a.m. PST, 30 minutes prior to the start of lecture time, unless otherwise noted):
  • Operations on Word Vectors - Debiasing
  • Emojify!
  • Neural Machine Translation with Attention
  • Trigger Word Detection
Lecture 10 12/03 Topics: (slides)
  • Class wrap-up
  • Closing speech
  • AI on-the-job
 Optional:
  • If you’re interested in testing your ML/DL skills or preparing for job interviews in AI, you can take the Workera assessment
Project Meeting #3 12/03 Tuesday 11:59 PM Instructions Meet with your assigned TA between 11/15 and 12/03 (before class) to discuss your final project report.
Project Final Report Due 12/03 Tuesday 11:59 PM Instructions Please read over the final project guidelines here for information on the rubric and late submissions.
Project Poster Session 12/13 Friday 11:30 AM - 3:00 PM Location: AOERC Basketball courts. Note that the poster and video submission is due on gradescope on 12/11.