18.S096 | January IAP 2023 | Undergraduate

Matrix Calculus for Machine Learning and Beyond

Lecture 8 Part 2: Automatic Differentiation on Computational Graphs

Description: Complicated computational processes can be expressed as “graphs” of computational steps that flow from inputs to outputs. Forward- and reverse-mode automatic differentiation (AD) traverse in opposite directions, giving very different algorithms.

Instructors: Alan Edelman, Steven G. Johnson

Course Info

Departments
As Taught In
January IAP 2023
Learning Resource Types
Lecture Videos
Lecture Notes
Readings
Instructor Insights
Editable Files
Problem Sets
Problem Set Solutions