achine learning+
TutorialsPricingTestimonialsDS Career Path
Sign inStart free

The roadmap, in 8 stages

  1. 01Programming for AI/ML9 courses
  2. 02Statistics and ML Algorithms11 courses
  3. 03MLOps12 courses
  4. 04Deep Learning6 courses
  5. 05Agentic AI10 courses
  6. 06Time Series Forecasting9 courses
  7. 07Industry DS Projects15 courses
  8. 08Special Topics13 courses

Start free

  • Foundations of Data Science
  • Core Python Programming

All-Access membership

All 85 courses, one membership

See plans and prices

Browse all coursesSee the map
achine learning+

Courses, in 8 stages

  1. 01Programming for AI/ML9 courses
  2. 02Statistics and ML Algorithms11 courses
  3. 03MLOps12 courses
  4. 04Deep Learning6 courses
  5. 05Agentic AI10 courses
  6. 06Time Series Forecasting9 courses
  7. 07Industry DS Projects15 courses
  8. 08Special Topics13 courses
  • Dashboard
  • Tutorials
  • Pricing
  • Testimonials
  • DS Career Path
Start freeSign in
  1. Courses
  2. Foundations of Deep Learning in Python
  3. Building Blocks: Optimization

Gradient Descent Optimization

Video · 8 min · Lesson 16 of 20

This lesson is part of All-Access

One membership opens all 85 courses. Members learn on our course site, edu.machinelearningplus.com, for now: sign in there with the same email.

See the plansContinue on our course siteWatch a free lesson
PreviousIntroduction to Deep NeuralNext lessonGradient Descent Update Rule
Deep LearningFoundations of Deep Learning in Python

    1. What is Deep LearningFree2 min
    2. Download Resources1 min
    3. Why Deep LearningFree4 min
    4. History of Deep LearningFree3 min
    5. Applications of Deep LearningFree2 min
    6. Overview of Deep LearningFree4 min
    1. Weighted Sum OperationFree2 min
    2. Mathemetic Representation3 min
    3. Course Review1 min
    1. Introduction to Activation Function2 min
    2. Threshold Step Funtion1 min
    3. Logistic Sigmoid Function3 min
    4. Rectified Linear Unit Function2 min
    5. Hyperbolic Tangent Functon1 min
    1. Introduction to Deep Neural1 min
    2. Gradient Descent Optimization8 min
    3. Gradient Descent Update Rule7 min
    4. Varients of Gradient Descent8 min
    1. Backpropagation Intuition2 min
    2. Getting Metrix Dimensions Right10 min

Get new articles, videos and live session news

Join 57,000+ fine folks. Stay as long as you’d like. Unsubscribe anytime.

achine learning+

Learn and master AI and data science.

We accept

Visa, PayPal, American Express, Mastercard and bank transfer

Roadmap

  • The complete roadmap
  • Programming for DS
  • ML algorithms
  • MLOps
  • Deep learning
  • Generative AI
  • Time series
  • DS industry projects
  • Supplementary courses

Offerings

  • All courses
  • All-Access membership
  • Course map
  • Tutorials
  • YouTube
  • 30-day DS interview prep
  • Task list for DS projects
  • Jobs

Company

  • About us
  • Testimonials
  • Contact us
  • Drop a query
  • Newsletter

© 2026 Machine Learning Plus. All rights reserved.

  • Privacy policy
  • Terms of service
  • Terms and conditions
  • Refund policy
  • Imprint