When navigating the Spark UI, something that helped me is "Jobs are full of Stages are full of Tasks" - its a helpful saying I remember when I start to get lost in the weeds haha. thanks for this walkthrough!

Can you do a video explaining how to solve spark issues like OOM error, data spill , data skew and a lot of others using spark UI?

Coming from using legacy systems like T-SQL, ETL tools etc... I agree I am not a big fan of this Delta tables, it is too much of a learning curve from what we are used to !

Great video brother

Thanks for the vid. So you have to read the entire refined table in order to get the last commit version? Is there any more efficient way to get around this?

"Promo SM" 😭

Great tutorial, I would like to see autoloader as the source -> raw and then go through the medallion layers

Good job Obi 👍

Good one Obi

ᑭᖇOᗰOᔕᗰ

Thank you for the video, really appreciate it!

Learned something new. Thank you for sharing!

What are your thoughts on Data engineering Bootcamp from Springboard??

Great video sir , but you kept mentioning only azure and AWS , does that mean GCP isint as good as the cloud tools you mentioned ?

Great video!!!!

Great content chief

Great information!

Check out my blog to get your started training while i drop the other videos plsqlandssisheadaches.blogspot.com/2020/07/become-data-engineer-in-3-months-with.html

I feel encouraged to delve into this field. Much thanks MEZUlity 💪

9ice one Mezu. Keep it up bro 👍

The starting is very good . Your teaching style is full of passion.. you described everything very well. I hope, you will continue the same passion in the next coming videos.