Brilliant step by step tutorial! You earned a subscriber and a fan. Looking forward to more.

Your knowledge and delivery is unmatched, subscribed after one video!

Yes we want next part. It would be a perfect portfolio project and to learn alot of stuff. Thank you

This is amazing! Can it work in real-time? Not only on existing videos?

I just discovered your channel and 1 video made me fall in love with your style of sharing! Simple and easy to understand! One project that I think will be interesting is automatic assessment with deep learning esp in computer vision field! (as i saw many people are doing this these days hehe) Keep up the good work & cant wait for a new video!

Amazing! Nick's videos are phenomenal.

Hello Nick. Thanks for always uploading such insightful tutorials. If my model training starts with loss=inf (i followed your tutorial throughout), will it get better or their is something else wrong with my code/model? please guide

This is really cool 😎😎😎....Would love to watch tutorials like these in future. Keep up the good work

You are the best! thanks Nic for these super quality videos!

Thank you, Nich! Building the App will be very helpful.

Hey Nick, great video as always. I was wondering why the input is normalized, but the tokens representing each character in the output are not.

It was awesome deep learning learning experience. Its a fantastic tutorial and the results are TP. its a ...BOOOM.....BOOOM...BOOOM situation after completing this tutorial. Thank you so much Nicks.

This project is f***ing awesome.Can you make a video on finding accuracy for LipNet

Awesome, your way of explaining is incredible

duuuuuuuude i've been looking for such a channel like this since forever your amazing thanks for sharing all your awesome project for free

most awaited video ....thanks mate !!!

Do words need to appear in the training to ever be predicted, or can they be built up of letter predictions? The dataset would be more useful if the number was a numeral, rather than spelled out, since that part of the alphabet never gets used. I would love to see this built out, maybe even have a "Lip Reading Keyboard" to type with your camera rather than a mouse or microphone, as it would have many accessibility applications, especially in the workplace. Great channel, I have been watching many of your previous shows, and was so happy to see a new episode!

Great effort man.

Absolutely awesome, mate!

Brooo, you made my day! Thank you so much!

I was wondering where you went man!! Welcome back! :D

Pioneering in data science and machine learning! love the video

Awesome 🤯🔥 thanks alot nick

Thank you so much!! This is absolutely phenomenal 🔥🔥👏🏾

amazing tutorial , helped me a lot quick question though, how can I use f1_score metric or accuracy metric for example with this network ??

Hey Nick! How were you able to find out the exact co ordinates of the lip region in the frame to extract them? Thanks for helping.

Damn ,That crazy ! Thank Nick for an other fantastic video ! Ur the best 🙏🏻🙏🏻

What kind of data collecting are we talking about if we want to generalise to like, the 1000 most used English words? Could we build the model so that it can recognise phonemes from the preprocessed videos? Then the model associates the most likely phoneme separation to convert to the output string.

This f***ing awesome!!! 🔥🔥🔥

That looks neat!

This is why I am a subscriber, for amazing content like this.

Real cool calculating

Hi. This is great. How do i load a custom video and try to perform lipreading on that?

Dude! Amazing!!!

Thank you so much!!

Next Tutorial please Nicholas !!! Loved your content... Subscribing for greater cause....

That's awesome! Do you think it would be possible for it to, instead of sentences, I train it to detect individual phonemes? That should actually work even better, since there are only 44 phonemes in the English language.

we gave you a follow since you are doing good things for the whole

Why did you choose fps=10 specifically for imageio statement? How to determine what fps value we have to put in?

Thank you so much for this.

This is so awesome

Thanks for the content, I'm learning a lot from your videos sir... but I need help with translating the models into Tflite, with labels.

We really need the app! 🤯

Could u make a tutorial on how to use TPUs from google colab to run reinforcment learning for example on solving like cartpole or some other envieemnet more complicated i guess. Thanks a lot!! Keep up the excelent work !! i share all ur vids in my team group in university! = )

that's one of the awesome tutorials

Hi. can you please (if possible) introduce any natured-inspired optimizer in this code? like GWO so that we can use less epochs and achieve good accuracy.

Bro, awesome💥🔥

hey Nick, this was a very helpful video. Just a small suggestion, if you create a requirements.txt file listing all the version of the packages you used it will be very helpful, even years to come we can install the specific version that yu have used otherwise it keeps creating dependencies issues.😃

Nick you are legend man.

Hey Nick, can you do a video on implementing the model with custom dataset?? Please

Hi @NicholasRenotte !...Beginner In ML here, I have a doubt in the last dense layer: model.add(Dense(char_to_num.vocabulary_size()+1, kernel_initializer='he_normal', activation='softmax')) we doing : char_to_num.vocabulary_size()+1, why are we adding '+1'...... char_to_num.vocabulary_size() includes the oov token implicitly

Hey Nick can you tell me. how they video can be annotated?Which tool are they using?

That was fantastic....fabulous brooo.......u are a real geniusthe god father of Machine Learning, deep learning

This is amazing!! Would it be possible to do live predictions using a camera?

Thanks for the help you are giving with the videos Nick anyway I'm studying to make Lip Reading work in real time, a bit like seen for sign recognition For now I will try to retrain the model with the other samples from the grid dataset and in real time i tried to build the prediction on the lips every 75 frames but it still doesn't work very well the predictions obtained by me are currently unusable I will continue to study waiting for more of your videos.. Let's see what will happen

Thank you so so much 👊🏾

THANKS !!!

really liked the video, thanks for the tutorial, make a streamlit app too.

Hello Nicholas, first of all thank u so much for ur work. i have discovered deep learning for myself thanks to u. already built and trained some models and im totally into it :D Only sad thing is that i do training on an kinda old cpu of my laptop cuz i have no gpu with cuda compatibility :( So i decided to upgrade my pc a bit and i rly have no clue what gpu i should choose. Im currently wavering between rtx 3080 and rtx 4070 ti (although im not sure if the 4070 ti got the cuda compatibility, couldnt find this model on the nvidia cuda website). Do you have any suggestions on gpu's for machine learning? Id be very thankful about an advice! :) greetings from germany and pls keep doing with ur videos, ure a blessing for the deep learning community!

You're the most enjoyable software developer youtuber to watch. Not only you are doing amazing job, but you also share it with community. Because of guys like you I'm gaining back my trust to humanity. Thanks a lot!

Helo sir may I known which dataset is used in this project...

This is such an important application of ai. I subscribed right away and can see it being one of the most important advances to enery one.

Can you please do a tutorial on training on our own dataset/ videos..

Hi @Nicholas, Is LipNet free to use?

It would be great if you could create a tutorial on creating a custom data set.

Hi Nick , I have just started learning about machine learning and dp. What mathematical skills are essential for me to have a solid understanding in this field?

Imagine that in all KZfaq this is the only video detailed at how to make this project lipnet lip reading. Just shows how this topics are not easy to found

Thankyou Nic. i want to work on this project , can you please guide me how can i use my native language in dataset for lipreading? please guide me im newbie please

i wanted to know t how can i make my own training data and also how predict from real time output?

I have a small question, what is the differences between the DNN model you use above and RNN ? I'm doing a college project, hope you can answer me soon, thank you very much.

How to get the dataset?

Bro i am trying to make my own model but when I try to load the dataset it shows me permission denied error. What should I do?

We want that tutorial with custom dataset. Please please please sir...... Also, great tutorial again. You are a great teacher.

Hey, could you please do a video of this model working on a custom dataset?

At 43:00 what if I want to test this on a new custom video, that is of not that shape.. (75,46,140,1) I am getting a shape mismatch error, as my frame shape is 99,46,140,1 I tried changing the temporal dim i.e 99 with 75 like yours but it didn't work Pleasssssseee help

how are you not at a million subscribers yet🤯

@Nicholas Rennotte. Can you please do a full tutorial on YAMNet

hey nick where can i download the data set for this? can some one let me know?

What does that numbers in alignments represent ?

This project is making me go insane, and iam very much happy too by its results again, its facinating, its even hard for me to undertand all those words that guy says in the videos. And whats crazy is it learns from the lips movements. Its just crazy, but i think if we want to make it be able to work with any video, to first be able to detect the mouth in the video we give it then be able to read the lips movement. ❤ Project and crazy ideas like this makes me fall in love with neural network more and more, thank you for this wonderful projext, have a nice day nicknacknock

from where i can get the dataset used in this video?

Yassssss we back!

How to make this work on any random video from internet or any other source, for example video store in our own PC, please help and can you please make a tutorial for that

what is the accuracy of your this model sir please reply someone please reply

Hey! I got some doubts in the project. Adding to that, the code you provided also has errors in it. Would you please share updated code?

Hey nick i am getting an error if InvalidArgumentError: ((function node wrapped Transpose device_/job:localhost/replica:0/task:0/device:CPU:0)) transpose expects a vector of size 5. But input (1) is a vector of size 3 [Op: Transpose]

Superb..

How do I get to the ide 😭 I’m only familiar with vs code

Do you have any AI modules will create text to animated videos ?

data.as_numpy_iterator error: For the people who are using colab, I used tensorflow version 2.10.1 In load_data(), use file_name = path.split('/')[-1].split('.')[0] For mappable_function, use this code: from typing import Tuple def mappable_function(path:str) ->Tuple[tf.Tensor, tf.Tensor]: result = tf.py_function(load_data, [path], (tf.float32, tf.int64)) return result (The tf.py_function call returns a tuple of two tensors (tf.float32 and tf.int64), not a list of strings.)

Can you make short video covering jupyter notebooks tricks and extensions to easily use notebooks like execution speed time and other etc

hi thank you for this great idea, i had this error "OpenCV: Couldn't read video stream from file "data/s1/.mpg"

Thx🔥

Hi NIck. can you make videos on MLOPS (series for begineers or as per your convience).?

Hey nick can you make a tutorial on how methods are used

Hi Nick! I would love to purchase the tutorial but the link is broken and I can't seem to find it on your site?

Can it be used to read lips in other languages?

Can you privide the real time integration??

another bomb from you 🔥

Hey Nicholas can I try this pipeline to my custom dataset?