Project: Text Generation using Language Models with LSTM

Build a text generation deep learning model to predict the next word in sentence using language models with LSTM.

Prabhakaran SPrincipal Data Scientist

Included in All-Access, one membership for every course.

Lessons
17, in 3 chapters
Video
31 min
Free to watch
6 lessons
Certificate
On completion

What you'll be able to do

  • What is Language modelling?
  • How are transformed based language models different from RNN language models?
  • Step by step implementation of text generation models.
  • How to evaluate the text generation model?
  • How to optimise various parameters of language models?

Course content

3 chapters · 17 lessons · 31 min · 6 free to preview

  1. 01Introduction to Language Modelling4 lessons · 11 min
    1. IntroductionPreview2:43
    2. Download Resources1:00
    3. Simple RNN Language ModelPreview4:55
    4. Training an RNN Language ModelPreview2:36
  2. 02State-Of-The-Art Models3 lessons · 6 min
    1. Transformer-based Language ModelsPreview3:19
    2. Example Application: Google's LaMDAPreview1:21
    3. Course Review1:00
  3. 03Text Generation using Language Models with LSTM (Code Demo)10 lessons · 16 min
    1. Setup Environment and Import DataPreview0:39
    2. Helper Function for Creating Corpus4:10
    3. Set Device Configuration0:12
    4. Define Architecture and Hyperparameters1:25
    5. Load Dataset0:47
    6. Initialize Model2:09
    7. Define loss and optimizer0:23
    8. Train Model3:25
    9. Examine Output1:24
    10. Save Model1:18

What you need

  • Basics of Python
  • Foundational knowledge of Data Science
  • High school maths

Who this course is for

  • Data Science Aspirants
  • Data Science Professionals
  • Software/Data engineers interested in quantitative analysis
  • Professionals working with large datasets
  • Data analysts, economists, researchers

Your instructor

Prabhakaran S

Prabhakaran S

Principal Data Scientist

My name is Selva, and I am super excited to mentor you on this course!

I head the Data Science team for a global Fortune 500 company and over the last 10 years of my data science experience I've deployed 20+ global products. I'm also the Founder and Chief Author of Machine Learning Plus, which has over 4M annual readers.

I specialize in covering the in-depth intuition and maths of any concept or algorithm. And based on my existing student requests, I've put up the series of courses and projects with detailed explanations, just like on-the-job experience. Hope you love it!

from 3,965 ratings
4.92
learners
57K+
courses
85

Questions

How do I get this course?

It is part of All-Access: one membership that opens all 85 courses. The plans and prices are on our course site. You can watch the free preview lessons before you join.

Can I get a refund?

Yes. If the membership is not right for you, ask for a refund within 30 days of your first payment.

Can I learn on my phone?

Yes. Lessons play in the browser on any phone, tablet or computer, and your place is saved for the next device.

I am already a member. Where are my courses?

On our course site, edu.machinelearningplus.com. Sign in there with the email you joined with. The courses move to this site later, with your access, and you will not pay again.

Contact us