achine learning+
TutorialsPricingTestimonialsDS Career Path
Sign inStart free

The roadmap, in 8 stages

  1. 01Programming for AI/ML9 courses
  2. 02Statistics and ML Algorithms11 courses
  3. 03MLOps12 courses
  4. 04Deep Learning6 courses
  5. 05Agentic AI10 courses
  6. 06Time Series Forecasting9 courses
  7. 07Industry DS Projects15 courses
  8. 08Special Topics13 courses

Start free

  • Foundations of Data Science
  • Core Python Programming

All-Access membership

All 85 courses, one membership

See plans and prices

Browse all coursesSee the map
achine learning+

Courses, in 8 stages

  1. 01Programming for AI/ML9 courses
  2. 02Statistics and ML Algorithms11 courses
  3. 03MLOps12 courses
  4. 04Deep Learning6 courses
  5. 05Agentic AI10 courses
  6. 06Time Series Forecasting9 courses
  7. 07Industry DS Projects15 courses
  8. 08Special Topics13 courses
  • Dashboard
  • Tutorials
  • Pricing
  • Testimonials
  • DS Career Path
Start freeSign in
  1. Courses
  2. PySpark for Data Science - IV: Machine Learning
  3. Linear Regression

Why Pyspark for ML when we have scikit-learn?

Video · 11 min · Lesson 1 of 27

Next lessonDownload Resources

Discussion

Sign in to read the discussion and ask a question.

MLOps and DeploymentPySpark for Data Science - IV: Machine Learning

    1. Why Pyspark for ML when we have scikit-learn?Free11 min
    2. Download Resources1 min
    3. Import libraries and init SparkSession2 min
    4. Using VectorAssembler to prepare data9 min
    5. Build the linear regression model7 min
    6. Model Summary3 min
    7. Make predictions and evaluate the model2 min
    8. Analyze feature importance6 min
    9. Improve the model (optional)1 min
    10. Save and load the model (optional)1 min
    11. Course Review1 min
    1. Setup and Load Dataset3 min
    2. Prepare the data5 min
    3. Building the Logistic Regression model7 min
    4. Evaluating the model on test data3 min
    1. Setup and Load1 min
    2. Prepare the data2 min
    3. Creating a Ridge Regression model8 min
    4. Hyperparameter tuning2 min
    5. Inspect the model coefficients and intercept2 min
    6. Evaluating the model1 min
    1. Import required libraries and initialize SparkSession1 min
    2. Prepare the data1 min
    3. Build Lasso Regression Model1 min
    4. Hyperparameter tuning1 min
    5. Inspect the model coefficients and intercept1 min
    6. Evaluating the model1 min

Get new articles, videos and live session news

Join 57,000+ fine folks. Stay as long as you’d like. Unsubscribe anytime.

achine learning+

Learn and master AI and data science.

We accept

Visa, PayPal, American Express, Mastercard and bank transfer

Roadmap

  • The complete roadmap
  • Programming for DS
  • ML algorithms
  • MLOps
  • Deep learning
  • Generative AI
  • Time series
  • DS industry projects
  • Supplementary courses

Offerings

  • All courses
  • All-Access membership
  • Course map
  • Tutorials
  • YouTube
  • 30-day DS interview prep
  • Task list for DS projects
  • Jobs

Company

  • About us
  • Testimonials
  • Contact us
  • Drop a query
  • Newsletter

© 2026 Machine Learning Plus. All rights reserved.

  • Privacy policy
  • Terms of service
  • Terms and conditions
  • Refund policy
  • Imprint