Rather than creating a class for each step, another much easier approach is to make use of sklearn's FunctionTransformer. This basically allows you to write a custom function and turn it into a transformer object, which can then be fed through a pipeline as per normal

For those who noticed that the encoder seems to sort the values alphabetically and messes up the job column names, instead of manually typing column names you can do: matrix = encoder.fit_transform(X[['Job']]).toarray() column_names = sorted([i for i in df['Job'].unique()]) This will also work if there are more /new jobs and values added and makes a column for each unique value while keeping the order. Good tutorial in any case!

Nice. For this example I might use the ColumnTransformer class, its perfect for dropping columns and integrating imputers and scalers on select features.

Hey man, great channel! Love the topic based tutorials ❤️ Video Suggestion: Can I suggest you attempt making a video on: Using Python and the Tree Algorithm to make an autocomplete Python CLI program. Haven’t seen this anywhere and I guess it’s a great way to understand why the Tree algorithm might be the best solution for an autocomplete program. Thanks! Sure we all appreciate what you do for the community ♥️ 🌻

This was awesome and very informative. Many thanks from a machine learning novice!

I find using FunctionTransformer much easier. It turns each of your custom functions into a transformer and you don't need to write a class, but just a function.

I remember when I took courses from udemy in ML and took more time from this video, keeps to continue creating more videos from the same subject.

This video is pure gold. Thank you so much!

Fantastic video, always wondered the reasoning behind using classes in ml, thank you!!!

I have a big one question: What is the difference of build a Machine Learning application with Pipeline and to build a machine learning application with a OOP technique? I see that it is the same.

16:42 I think it's wrong to use fit_transform in transform method, because it will cause to memory leakage, after you divide data into two parts train/test - where transform on the test dataset will recalculate imputer.

wow this technique is amazing. thanks for sharing us with brilliant knowledge

I would really like to find a tutorial on how to pass arguments to an pipeline function you created yourself, like the namedropper. So i can use the gridsearch to try out dropping different features.

Sick video bro! 😎

With an eye towards the love that programming has gotten from the ml community lately, it occurs to me that perhaps ml could also be used more in the data preprocessing role. For example: Choosing encoding types, handling missing values, flattening, etc could all be automated. Just a thought. 2nd random thought. I know random noise has been added to features in an attempt to get the models to generalize better but did not fare well. However I have not seen that anyone has tried simply using noise generators (normal, gaussian, etc) as individual features and allowing the model itself to choose when and where noise might be effective.

That was really helpful, thanks!

Thank you. This is very helpful.

bro great video!!

I think your feature encoder has some faulty logic for the "Job" column. The df2 for example shows 1 x writer, 3 x programmer and 1 x teacher, but afterwards there isn't even a "teacher" column. And if you were to recreate the single columns using 1 or 0 from the features you created you wouldn't get the same dataframe.

Thank you, this was informative 😁

Thank you, sir!

really useful, thank you very much

Thank you!

Could you use the get_dummies pandas method for the One Hot Encoding?

Thank you so much nicely explained with what you showed i created pipeline and dumped it as pikle file but when i tryinng to load that model and using it. i have been facing an error : AttributeError: Can't get attribute 'NullEncoder' on

Very usefull! Thx!

What is the opening song of this videos name?

Thanks Sir

Great!

Awesome

Are you swedish? 😮

where do you work #admin

1st