Statistics 101: Linear Regression, Fit and Coefficient of Determination

Рет қаралды 416,084

Күн бұрын

This Statistics 101 video is the next in our series about Simple Linear Regression. In our last three videos, we talked about the very basics of regression and introduced other fundamental concepts like the algebra of lines, general patterns to look for on a scatter plot, and the least-squares method.
In this video, we are going to learn to evaluate how well a regression line fits the data it models. It is important to note that a regression model is unique to the data it represents. Adding or changing data points will most certainly change the regression model. The model is also only valid for the range of data points under analysis. It is not proper to extrapolate above or below the data being evaluated.
So if you are new to Regression or are still trying to figure out exactly what it even IS...this video is for you. So sit back, relax, and let's go ahead and get to work.
My playlist table of contents, Video Companion Guide PDF documents, and file downloads can be found on my website: www.bcfoltz.com
#statistics #regression #machinelearning

Пікірлер: 525

@Yu-Xiao-2028 3 жыл бұрын

I don't skip your intro because I needed that positivity in my life right now

@rohitekka2674 3 жыл бұрын

More than 7 years later, and your videos still continue to bring wonders. Thank you!

@antoniogiuseppefaietalasar6849 3 ай бұрын

This is the gold standard for statistic teaching. Indispensable.

@wbspangie 8 жыл бұрын

Stared at the book for hours yesterday and understood nothing. Watched this videos and 20 minutes later it all makes sense! Your are amazing! Thank you!

@MegaApostolicMan 8 жыл бұрын

I had the same experience. Looking at the book, and the Professor video. I just could not make sense of it, until I see these videos.

@pushkarmahajan9294 2 жыл бұрын

SAMEEEEEEEEE ;_;

@RoboticComplexity 4 жыл бұрын

I used to get so frustrated I would cry trying to read my textbook. I passed Linear Regression I with a B because I watched your videos. Now on to LR II and I'm refreshing my memory. Thanks.

@jackeroo75 3 жыл бұрын

Keep it up and be positive in yourself and you will get better and better!

@ireneborgen8035 4 жыл бұрын

I finally understood what SSE and SSR are... and what "fit the data" is... amazing!

@Pankajkumar-dw1fu 5 жыл бұрын

I always like the motivation you give at the start of every lecture.

@sunra7712 7 жыл бұрын

best teacher since Sal Khan

@BrandonFoltz 7 жыл бұрын

Very kind of you to say. Sal is a HUGE hero of mine bringing education to everyone.

@Qornv 4 жыл бұрын

@@BrandonFoltz While Sal is doing an incredible job, and has helped me as well several times, in my opinion you explain topics better, maybe because you're focusing on mainly statistics while Sal tries to cover as much as possible

@juliusbenkoe5373 3 жыл бұрын

Imho on par with Sal. Thanks a lot for lifting the fog!!!

@courtneywilkerson6131 3 жыл бұрын

This channel the best in my opinion.

@juliusbenkoe5373 3 жыл бұрын

@@courtneywilkerson6131 that's absolutely true!

@annatsukiya 8 жыл бұрын

now i know what's the use of SSE, SST and SSR.. during my studies, lecturers just tells us to memorize it without explain the why we use those in steps of making regression table.. Thanks Brandon, i'm looking forward to learn Multiple Regression next..

@tubeymoto 6 жыл бұрын

same here.... hahaha

@shela3081 3 жыл бұрын

same !

@gatr12isthebest 7 жыл бұрын

I got more knowledge in intervals of 20 mins with you, than in a university level class of 1hour of which I have to pay for. Says a lot about my country's education system. Great job.

@samanthapierre8884 3 жыл бұрын

I've learned more in this 30 minutes video than my 2 hour lecture at school!!! I really appreciate the time and effort you put into these videos! Thank you so so so so so much!

@LRZ2628 2 жыл бұрын

Thank you so much for this! After 7 years away from Master's-level statistics, I'm earning my PhD and totally stuck on the path of regression, exploratory and confirmatory factor analysis. Your videos are an absolute life-saver!

@markzhang8742 10 жыл бұрын

Best regression class I have ever had!

@goldiekaur928 9 жыл бұрын

hey Brandon. thanks a lot for posting such brilliant videos..I salute you for teaching in such depth and clarity that too free of cost..people like you make this world a better living place.

@naageshk1256 9 ай бұрын

Agreed :)

@shivakumarkeshavan5171 5 жыл бұрын

Brandon - I have gone through a few videos of regression and I love the way you have simplified things + a beautiful pattern of beginning with a wonderful quote, pictorial representation and ending by wishing everyone the best - Thank you!

@JoshFlorii 7 жыл бұрын

Amazing series. 8 years after going over this in highschool I finally understand it.

@omarflores527 8 жыл бұрын

Hi Brandon, You are doing an awesome job man. Thanks for taking it slow on these concepts and providing a well thought out presentation with applicable examples. Trying to pass research comp exams for my Ph.D. in education and this is incredibly helpful! Thanks again, keep up the great work...

@ol7668 5 жыл бұрын

Such a great lecture series that I've ever had on KZfaq. Watching all ads for my tuition.

@edwardmoor6538 9 жыл бұрын

Your a great teacher. Made regression so much easier for me. I really appreciate the time you took to upload these!

@Elethia441 8 жыл бұрын

OMG, my textbook writers must be sadists! This makes so much more sense!

@dijonstreak 4 жыл бұрын

Man no kidding

@fwlanger 8 жыл бұрын

Brilliant videos! I've just finished watching all your linear regression lessions, and I can certainly tell you are making my Biostats studies much easier and pleasant! Huge thanks from Brazil!

@sumanthgoje6864 4 жыл бұрын

Brandon ...you deserve standing ovation ...thanks much ...

@santoshpandey23 9 жыл бұрын

I actually clapped at the end the 4th video...Thanks a lot Brandon Foltz..going back to basic was so exciting...

@eternity3061 7 жыл бұрын

The fourth and the last video, and I know the basics of linear regression. The best part is that even if I watch the videos over 4-5 days, I don't feel any disconnect. The short review/references to the previous videos are really helpful. Thanks Brandon for all the hard work.

@ilikedetectives 6 жыл бұрын

Thank you so much Brandon. I'm taking a grad-level stat course without any basic stat knowledge and your videos have been life-savers!

@sketchstudios05 7 жыл бұрын

"Thank you " word is not enough to express how much thankful I am to you. BIG THANKS, your video explain LR in very simple way.

@fysiologieee 8 жыл бұрын

we need more people like you that do these good things for free ;)

@eszterarato1490 7 жыл бұрын

All Simple Linear Regression videos are excellent learning materials. It feels so great to be confident about this topic, finally. I am really grateful.

@mks07866 8 жыл бұрын

This is one of the best training videos I have ever seen. I am taking a applied analytics frameworks course at Columbia University and this course really helped me to understand the concepts before I jump into more advanced topics. Brandon, can't thank you enough!!

@donharris8846 Жыл бұрын

This video should be required for ALL basic stats courses. From elementary to grad school this is, hands down, the best explanation to help people gain an intuitive sense of what a regression truly is. Very well done.

@redserpent 5 жыл бұрын

Amazing series. I had tried for several years to understand and fit together both the notation and the concept. Well done and thank you. Clearly a share URL.

@bruschetta3089 6 жыл бұрын

And five years later you are still the person who explain the best!!

@PrachiR 8 жыл бұрын

thank you so much! you are doing a great job!! - you explain so well.

@renewmasonry8176 7 жыл бұрын

brandon, At 56 years old, I have decided to return to school...I'm taking elementary statistics, starting on 30 days, but have been pre studying to get a jump on things. I haven't done any math in 30 years. I enjoy your teaching style, and what shines through is that you truly care. You're a great coach!!

@manjuk8363 6 жыл бұрын

These are the ideal set of videos for even a layman to understand stat in and out! Thank you very much for the videos

@25lobo 9 жыл бұрын

This serie of tutorials is the best thing I have ever seen about linear regression! Show!

@darcimartindale4861 8 жыл бұрын

You're actually saving my life! Thank you so much for explaining in one video what my prof couldn't do in 3 weeks!

@PinkFloydTheDarkSide 7 жыл бұрын

I paid $5k for stats class in my program and studying it for a year and today by this video I understood what R square actually means and how does it explain the variance. Thank you from the core of my heart.

@abundant_AF 3 жыл бұрын

You are a fabulous teacher! Wow. I am so impressed with your patience, your positivity and your clarity in explaining these concepts. I am taking stats this term and these videos have been an invaluable supplement to my course materials. I am so grateful to you! Thank you for everything.

@biswashgauchan5644 10 жыл бұрын

Brandon, the video is just too good. I have benefited a lot in understanding the basics of regression. Excellent work and great service to education

@ozlevy4057 7 жыл бұрын

Thank you Brandon ! very straight forward and clear. Please keep on making these videos to help those who need it.

@zoebeary 10 жыл бұрын

Can't thank you enough! Having to challenge an old stats course exam in preparation for my Master's! Your approach and genuine love for teaching is getting me through!!!! Fingers crossed!

@BaldwinThamaga 10 жыл бұрын

It's not often that one can scroll down a list of comments on KZfaq without bumping into a single negative one. Goes to show how helpful your videos Brandon. Thank you.

@varunbhargava15 7 жыл бұрын

The best tutor I have came so far for statistics, you make things look so simple to understand. Thanks a ton for simplifying the things for us.

@maryhabashy8663 4 жыл бұрын

FABULOUS!!! This was a great visual representation of Simple Linear Regression! As a visual learner, this made this concepts much more approachable. Thank you Brandon.

@jelenamiokovic5658 7 жыл бұрын

I have never seen a better teacher in my life!! you are AMAZING!!! keep it up!

@emilyconley4967 8 жыл бұрын

Another exemplary video. Thanks, Mr. Foltz, you are a wonderful teacher!

@mohammedalswailem3868 7 жыл бұрын

Thank you for sharing your knowledge with the world. You are making the world a better place with each video you make and each view you receive. I had a rough time catching up to the lectures and you made it easy. I wish I have found your channel earlier in the semester not two days before the final. Thank you again

@cccspwn 4 жыл бұрын

Phenomenal, a good teacher is worth his or her weight in gold, you are worth your weight in platinum!

@rtong12 10 жыл бұрын

You are a very gifted teacher. Love the slides that you built. I've heard this topic explained so many times and I think this is the first time I truly understand how R square is calculated. Thank you!

@ritchiebrowne4629 3 жыл бұрын

This is brilliant Brandon, just watched all videos on Linear Regression and you explained more in 2 hours than my college lecturer did over 3 weeks

@jinghua7561 4 жыл бұрын

It is the best online course I have ever watched. Thank you!

@MuhammadAli-yq7sd 10 ай бұрын

After nine years, your videos are much valuable than ever. Who knows who knows who will take advantage of them after another years. You can't imagine how young I was.

@taraplachowski9774 6 жыл бұрын

This truly makes linear regression logical and understandable, rather than memorizing steps in SPSS. I now understand interpretation of social science statistics in a way I have not after 4 stats classes in my doctoral degree. Thank you! I will be sharing these videos with all my fellow doc students! Looking forward to MR!

@tracygundy4038 9 жыл бұрын

Thank you really much Brandon! I am an international student doing a master program and this videos are very useful for me. You make difficult concepts easy to understand (even for a native-spanish speaker with a not so advanced English), and that's what makes a teacher outstanding. Thanks.

@sunkyongkim2886 4 жыл бұрын

I cannot even find proper words to express my gratefulness to thank you sir. Thank you for the clear explanation. It feels like you throw a rope for me to escape from a lonely and dark underworld hole of statistics.

@iidamakikallio8599 7 жыл бұрын

You sir are eliminating so much stress from the planet. You deserve a public health honor of somesort. Thank you SO MUCH. Absolutely fantastic pedagogical skills. You rock. Biggest of thanks.

@sarehpanjeh724 5 жыл бұрын

Thank you, Brandon Foltz. You are the best teacher I 've ever seen.

@fridaysilomba8444 3 жыл бұрын

I have done this from my undergraduate, I started it in my First Stage at Masters and Never knew what really goes on until after Watching your videos from The basics.. I wish you could see how Fast I answered The Class Tutorial Question.. Thanks and Many Thanks.. You are simply the Best

@sarojsasmal 5 жыл бұрын

I love your presentation, the way you begin your tutotial, especially the first few lines in the very beginnning really keeps me motivated. Thanks a lot.

@thaddaeuscarr9886 4 жыл бұрын

These lessons will always be relevant! Thank you for these breakdowns!

@Elizmss 5 жыл бұрын

GOD BLESS YOU SIR I LOVE YOU I WILL PASS THAT TEST BECAUSE OF YOU

@leannewong6296 7 жыл бұрын

After watching all your videos on simple regression , i am definitely more comfortable with the concepts now and can start working on quantitative methodology for my thesis. Thanks so much! You've done a great job at breaking things down such that it's so easy to follow. Subscribed :)

@KirillBezzubkine 4 жыл бұрын

With every new video i watch i worship your tut abilities and effort

@akankshat3395 5 жыл бұрын

I liked and subscribed immediately when it said "ITS A TALE OF TWO LINES"!! Great Explaination

@davidgl1988peru 4 жыл бұрын

You are INCREDIBLE Brandon Foltz. Thank you so much!

@fuhad.erised 5 жыл бұрын

Sir you should make more videos, you are one of a kind! Since the demand for data analytics are becoming more extensive, it would be a blessing to have such a great teacher like you to guide us :')

@somashekharhottin6091 4 жыл бұрын

This is the place to learn Statistics stuff in very short and sweet time. thank you very much

@empaulstube6947 4 жыл бұрын

Thank you Sir Brandon!!! I have encountered this Regression topic many times in my teaching and studying career. But this is the only time I learned.

@ranjithpals 4 жыл бұрын

Great job Brandon! You are the best I have come across explaining the math behind the algorithm.

@arturoolvera2604 10 жыл бұрын

WOW! I was amazed to finally understand why we use linear regression! Thank you!

@ilhamhamza10 9 жыл бұрын

Without a doubt the best presentation I have ever seen on Linear Regression! This video sums up the whole theory behind the topic and completely puts my professors to shame!! Well done Good Sir!

@mirimar69 9 жыл бұрын

Thanking you for all your effort Brandon. Clear and succinct presentations. As a mature learner I was putting off this seemingly dry topic but no more! I will continue persevering Thank you and season greetings from down under.

@BrandonFoltz 9 жыл бұрын

mirimar69 Awesome! Thanks for very nice comment and I am glad you found the fire to learn what definitely can be a dry topic. Season's Greetings to you as well from the cold North!

@millazilla3811 7 жыл бұрын

you rock!!! I wish all online stats classes were like this. I hope you continue making videos you stats wizard!!

@JohnsonHinneh 9 жыл бұрын

sure this video is so good, it has enlightened me so greatly on how simple regression works. I am now confident in digging deep into statistics.

@MelissaCirtain 8 жыл бұрын

Very happy to find a good overview on simple linear regression. I didn't watch any of your videos outside of these 4 parts, and I am having to go figure out what the SSR, SSE, and SST are all about. I presume those are covered in another series of lectures. That said, this really is a great set of videos, thanks for putting in the time.

@mehrchakraborty6188 4 жыл бұрын

Finally finally finally I understand this! I'd been struggling for YEARS 😭

@lahomahoward4055 10 жыл бұрын

Thanks so much for posting all of these - they are great refreshers in basic statistics when studying for comprehensive exams!

@sienna367 6 жыл бұрын

Thank you!!!!!!!! I'm a fresher in data science! And your videos are *MAGIC*!!!!!!! I've finally understood a lot of topics in regression... thank u!!!

@racheljordan2020 9 жыл бұрын

After searching for two years for good statistics videos I have finally found what I was looking for. Thanks so much for these videos :)

@maliksumit1 9 жыл бұрын

Rachel Jordan I don't want to be rude but in 2 years you could have master statistics itself let alone Regression.You Need to put more effort from your end.Waiting won't help.

@ashfaaqasif8010 9 жыл бұрын

You're a life saver my friend! Thanks!!

@samdavepollard 7 жыл бұрын

This series of 4 videos contain the best explanation of this material that I've ever seen. (And I say that as a Maths graduate and a Maths teacher.) I'm guessing those 10 down votes are Professors, irritated that someone's doing their job way better than they are. :-) Thank You for sharing your knowledge in such an engaging way.

@frederickfinau3628 6 жыл бұрын

Amazing! You're brilliant and you have made statistics more enjoyable for me personally. Your videos give lots of clarification for basic statistical concepts for my further study. Keep it up your good work and am following your posts from now on. Looking forward for more ......

@misnadin6658 10 жыл бұрын

Thank you so much, Brandon! This is an excellent explanation of what linear regression is!

@bibekanandabhattacharjee952 2 жыл бұрын

Very well explained. The pace of the lecture suits us especially to those who are not so fluent in English in accents other than their own. Thanks.

@booyaka316 6 жыл бұрын

I'll stick up with your channel mister! I've only seen the linear regression videos, but you are such an amazing teacher, keep up the good work! Regards from Mexico

@vidyanarayanan3872 6 жыл бұрын

at age of 40, i am trying to understand stats to become a data scientist. These videos are assuring me that i will be able to understand stats easily. thanks a ton brandon!

@peterm9001 8 жыл бұрын

in the last graph you put the estimation of y instead of the mean equals 10. Thank you so much for your work it helps a lot!!

@Miamiheat434 9 жыл бұрын

I am passing my Intro to Stat Analysis class b/c of you and your terrific videos...thank you from the bottom of my heart.. I look forward to seeing your Multiple Linear Regression ones..

@sandeepdesai5378 3 жыл бұрын

Best explanation of what SSE, SST and SSR mean anywhere on Internet!! Thank you. You have a gift of an awakener!

@BrandonFoltz 3 жыл бұрын

Glad it was helpful! If you get those down, all of regression opens up. Keep at it!

@sabinagargosova1951 3 ай бұрын

You just saved one desperate Psychology student, thank you.

@nathanboeger9329 6 жыл бұрын

BTW: I am not new to stats but someone doing research and these videos are great for taking a refresher. They help me analyze these methods and formulas and actually provide some insights...

@sharifahmed45 4 жыл бұрын

Thanks Dr Foltz, this playlist helped immensely my understanding these ss's that confounded me. I will restart stat101 to deepen my understanding. Thanks again, and continue being productive to help struggling student anywhere in the world.

@suahantkulkarni2350 6 жыл бұрын

Thanks Brandon, Iam just getting amazing basic knowledge about simple linear regression. Looking forward for all available tutorials from you. Thank you very much

@meazabahiruheterat8780 7 жыл бұрын

Thanks so much Brandon -you made it lively. if you ask me in twenty year i can still remember it. you are amazing!

@vivayk 7 жыл бұрын

u made me understand regression in 90 mins..awesome work!! and thanks a bunch

@srishtishekhar8789 3 жыл бұрын

these. videos are old but i m referring to these in 2020 because these are the best ones i have found . hope to connect with you! thanks, Brandon!

@EllenHallward 7 жыл бұрын

Thank you so much! These videos are so helpful for me. Now I understand simple regression and I can't even believe it. I'm not native English speaker but everything was clear for me. Thanks a lot! Wish you all the best.

@molan011 5 жыл бұрын

Listening this videos to remind myself of some things learned many years ago...very useful also for us developing models for phd thesis...good job sir

@adelemurphy7681 9 жыл бұрын

Great videos, I'm so grateful I found you after painfully trawling through books and lecture notes. Finally a clear explanation. Actually don't feel overwhelmed by my stats class tomorrow :)