Scikit-Learn Model Pipeline Tutorial

No video

Scikit-Learn Model Pipeline Tutorial

Рет қаралды 26,018

2 жыл бұрын

Thank you for watching the video!
Learn Python, SQL, & Data Science for free at mlnow.ai/ :)
Subscribe if you enjoyed the video!
Best Courses for Analytics:
---------------------------------------------------------------------------------------------------------
+ IBM Data Science (Python): bit.ly/3Rn00ZA
+ Google Analytics (R): bit.ly/3cPikLQ
+ SQL Basics: bit.ly/3Bd9nFu
Best Courses for Programming:
---------------------------------------------------------------------------------------------------------
+ Data Science in R: bit.ly/3RhvfFp
+ Python for Everybody: bit.ly/3ARQ1Ei
+ Data Structures & Algorithms: bit.ly/3CYR6wR
Best Courses for Machine Learning:
---------------------------------------------------------------------------------------------------------
+ Math Prerequisites: bit.ly/3ASUtTi
+ Machine Learning: bit.ly/3d1QATT
+ Deep Learning: bit.ly/3KPfint
+ ML Ops: bit.ly/3AWRrxE
Best Courses for Statistics:
---------------------------------------------------------------------------------------------------------
+ Introduction to Statistics: bit.ly/3QkEgvM
+ Statistics with Python: bit.ly/3BfwejF
+ Statistics with R: bit.ly/3QkicBJ
Best Courses for Big Data:
---------------------------------------------------------------------------------------------------------
+ Google Cloud Data Engineering: bit.ly/3RjHJw6
+ AWS Data Science: bit.ly/3TKnoBS
+ Big Data Specialization: bit.ly/3ANqSut
More Courses:
---------------------------------------------------------------------------------------------------------
+ Tableau: bit.ly/3q966AN
+ Excel: bit.ly/3RBxind
+ Computer Vision: bit.ly/3esxVS5
+ Natural Language Processing: bit.ly/3edXAgW
+ IBM Dev Ops: bit.ly/3RlVKt2
+ IBM Full Stack Cloud: bit.ly/3x0pOm6
+ Object Oriented Programming (Java): bit.ly/3Bfjn0K
+ TensorFlow Advanced Techniques: bit.ly/3BePQV2
+ TensorFlow Data and Deployment: bit.ly/3BbC5Xb
+ Generative Adversarial Networks / GANs (PyTorch): bit.ly/3RHQiRj

Пікірлер: 49

@GregHogg Жыл бұрын

Take my courses at mlnow.ai/!

@TheCsePower Жыл бұрын

Thanks Greg. This made me realise how non-standard my code is. I learnt: - Use copy or deepcopy and not assignment. - Always perform preprocessing on the train and test separately. - sklearn pipelines have nothing to do with ETL pipelines from Data Engineering. - sklearn transfers have nothing to do with NLP Transformers. - sk elarn estimators have nothing to do with Statistics estimators.

@GregHogg Жыл бұрын

Super glad you got some useful pointers!!

@crepantherx 2 жыл бұрын

Keep Posting Greg, I am Data Analyst by profession and your video certainly helps a lot

@GregHogg 2 жыл бұрын

That's awesome! Thank you 😄

@kyleGrealis 20 күн бұрын

thanks, Greg. really good explanation and structured example. this makes it easy to create a template for easy reuse!

@hansenmarc Жыл бұрын

Great stuff! I’m curious why you used FunctionTransformer instead of ColumnTransformer, which could run the two scalers in parallel? Also, since FunctionTransformer is stateless, the documentation says that fit just checks the input rather than actually fitting the scaling parameters. Doesn’t that lead to data leakage since applying transform to test data won’t use parameters learned from fitting on the training data?

@AmitabhSuman Жыл бұрын

A very practical video, that I came across on Pipelines. Thank you for this video!

@GregHogg Жыл бұрын

Awesome that's great to hear. You're very welcome ☺️☺️

@JJGhostHunters 2 жыл бұрын

Great tutorial! I use the MinMaxScaler with the option to scale from -1 to 1 instead of 0 to 1 when I am dealing with values that can be positive and negative. Seems to be fine, but I may need to reconsider going forward. I have never noticed any issues though.

@ilanyutsis9653 21 күн бұрын

When you do the StandardScaler().fit on the dataframe, what is the meaning of this operation? what is happening?

@alexrook5604 Жыл бұрын

I undstand what you are doing here but I have two questions that I think would be helpful and would make it easier to follow along and replicate you steps. 1) Where did you get the data. I can't the california_housing dataset that is already in the train/test form. 2) Why not use scikit-learn tooling rather than doing it yourself? Like you could have used train/test split or pipelines (or column transformer... or similar stuff). That just has me confused.

@JJGhostHunters 2 жыл бұрын

I would love to see a tutorial that covers using pipelines with multilayer perceptron models (MLPs), CNNs and LSTMS.

@lythien390 2 жыл бұрын

Thank you Greg! It's a great video!

@GregHogg 2 жыл бұрын

Glad to hear it!

@rahiiqbal1294 6 ай бұрын

This was very helpful, thank you :)

@brandonn8166 Жыл бұрын

Just out of curiosity, is there a reason you don't use train_test_split to get X and y values?

@user-dh6wx3fe6y 9 ай бұрын

yes, why he uses X_train for train_predictions instead of another dataset X_valid

@marcofogale9719 6 ай бұрын

Perfect explanation. Thanks a lot

@GregHogg 6 ай бұрын

Very welcome 😁

@allanmachado2011 4 ай бұрын

Thank you!

@Nadia-db6nb Жыл бұрын

Thanks for the great tutorial. Can you make a video on how to combine multiple feature selection methods and feature extraction using python?

@nabanitadasgupta 8 ай бұрын

Thank you for the video!

@00SeijiHan00 8 ай бұрын

TYSM bro really appreciate this

@GregHogg 8 ай бұрын

Very welcome!!

@krzysztofzaucha3592 4 ай бұрын

nice video Greg

@GregHogg 4 ай бұрын

Thanks so much!!

@junaidlatif2881 Жыл бұрын

How to transform y variable and then fit model. And after how to reverse transform for the scatter plotting

@TheFrankyguitar 9 ай бұрын

Thanks for this amazing video! Would that work also with a statsmodels model?

@GregHogg 8 ай бұрын

Thanks so much!! And I'm not sure, haven't tried :)

@adriandiaz5688 Жыл бұрын

Great Video!

@GregHogg Жыл бұрын

Thank you Adrian!

@talyb7383 Жыл бұрын

Thanks for the great tutorial! what do I need to change to create a pipeline for an image classification model? like the cifar10 model?

@GregHogg Жыл бұрын

Well, everything. You probably won't be using scikit for that. And you're very welcome!

@talyb7383 Жыл бұрын

@@GregHogg I didnt explained myself clearly... I want to create a pipeline that receives a trained cifar10 model an also make preprocessing on the e data set ? so I cant use your way?