No video
Use OrdinalEncoder instead of OneHotEncoder with tree-based models
Рет қаралды 4,237
Күн бұрынWith a tree-based model, try OrdinalEncoder instead of OneHotEncoder even for nominal (unordered) features.
Accuracy will often be similar, but OrdinalEncoder will be much faster!
👉 New tips every TUESDAY and THURSDAY! 👈
🎥 Watch all tips: • scikit-learn tips
🗒️ Code for all tips: github.com/jus...
💌 Get tips via email: scikit-learn.tips
=== WANT TO GET BETTER AT MACHINE LEARNING? ===
1) LEARN THE FUNDAMENTALS in my intro course (free!): courses.datasc...
2) BUILD YOUR ML CONFIDENCE in my intermediate course: courses.datasc...
3) LET'S CONNECT!
- Newsletter: www.dataschool...
- Twitter: / justmarkham
- Facebook: / datascienceschool
- LinkedIn: / justmarkham
@dataschool 2 жыл бұрын
Have you tried OrdinalEncoder with your tree-based model? Let me know how it compares to OneHotEncoder!
@sophiazhou9119 Жыл бұрын
I tried with randomforest and tree classifier, but the problem with ordinalEncoder is that the tree might treat it as a real number and break it down into a decimal number when spitting. How do you deal with that?
@dhirajkumarsahu999 2 жыл бұрын
Yes, this makes sense to me. Models like linear regression gives importance to features based on the weights. Hence using one hot encoding in case of unordered categories is important in case of linear regression. Please correct me if I am wrong.
@dataschool 2 жыл бұрын
Right!
@dhirajkumarsahu999 2 жыл бұрын
@@dataschool thanks for the reply ❤️
@grzegorzzawadzki8718 2 жыл бұрын
Thanks! That was very helpful.
@dataschool 2 жыл бұрын
Great to hear!
@elmoreglidingclub3030 Жыл бұрын
Very interesting. I’d like to work with this a bit; what is the data set you used? I have an interesting data set (~2,300 rows, 13 features) that can give some bizarre accuracy results using a single classification tree but performs much, much better with a random forest. I’ll try ordinal encoding on it and let you know how it performs. Good stuff! Again, please, what is this data set?
@dataschool Жыл бұрын
See here: nbviewer.org/github/justmarkham/scikit-learn-tips/blob/master/notebooks/43_ordinal_encoding_for_trees.ipynb
@Dara-lj8rk 2 жыл бұрын
Good one thanks
@dataschool 2 жыл бұрын
You're very welcome!
@alfathterry7215 2 жыл бұрын
interesting...
@dataschool 2 жыл бұрын
Thanks!
@anandvyavahare2031 2 жыл бұрын
Who on earth even tried it to find it? 😂😂