OPTIMIZATION TECHNIQUES FOR MACHINE LEARNING AND DEEP LEARNING





LECTURE 0. Introduction and course logistics  slides              

       LECTURE 1. The single input derivative and numerical differentiation  slides  notes

   LECTURE 2. Derivatives at a point and the numerical differentiator  slides  notes

LECTURE 3. Derivative equations and automatic differentiation  slides  notes  

   LECTURE 4. Automatic Differentiation  slides  notes            

LECTURE 5. The anatomy of a hyperplane  slides  notes          

LECTURE 6. Derivatives of multi-input functions  slides  notes        

LECTURE 7. Unconstrained optimality conditions  slides  notes       

LECTURE 8. Principal Component Analysis (PCA)  slides  notes