When navigating the Spark UI, something that helped me is "Jobs are full of Stages are full of Tasks" - its a helpful saying I remember when I start to get lost in the weeds haha. thanks for this walkthrough!
@mohitupadhayay14392 ай бұрын
Can you do a video explaining how to solve spark issues like OOM error, data spill , data skew and a lot of others using spark UI?
@artus19810 ай бұрын
Coming from using legacy systems like T-SQL, ETL tools etc... I agree I am not a big fan of this Delta tables, it is too much of a learning curve from what we are used to !
@juanzambrano688 Жыл бұрын
Great video brother
@neek6327 Жыл бұрын
Thanks for the vid. So you have to read the entire refined table in order to get the last commit version? Is there any more efficient way to get around this?
@albeck8523 Жыл бұрын
"Promo SM" 😭
@user-lr3sm3xj8f Жыл бұрын
Great tutorial, I would like to see autoloader as the source -> raw and then go through the medallion layers
@Zafary465 Жыл бұрын
Hello Did you found how to implement it? Any ideas? Thanks
@Bijuthtt Жыл бұрын
Good job Obi 👍
@Bijuthtt Жыл бұрын
Good one Obi
@fidelpeters83222 жыл бұрын
ᑭᖇOᗰOᔕᗰ
@technologicalminds44263 жыл бұрын
Thank you for the video, really appreciate it!
@VibeswithAdaoyibo4 жыл бұрын
Learned something new. Thank you for sharing!
@ak47ava4 жыл бұрын
What are your thoughts on Data engineering Bootcamp from Springboard??
@afroinfotech67054 жыл бұрын
Send me your link so i can review please
@ogbeidenelson88434 жыл бұрын
Great video sir , but you kept mentioning only azure and AWS , does that mean GCP isint as good as the cloud tools you mentioned ?
@afroinfotech67054 жыл бұрын
GCP is good but not yet as popular as AWS and Azure. GCP maybe has 10 to 15 percent market share now so that is why I didn't mention it. feel free to learn the equivalent
@afroinfotech67054 жыл бұрын
Also i am only familiar with US market
@tbird2094 жыл бұрын
Great video!!!!
@harmonyo64474 жыл бұрын
Great content chief
@c.kobieyisi74854 жыл бұрын
Great information!
@afroinfotech67054 жыл бұрын
Check out my blog to get your started training while i drop the other videos plsqlandssisheadaches.blogspot.com/2020/07/become-data-engineer-in-3-months-with.html
@henryulasi89944 жыл бұрын
I feel encouraged to delve into this field. Much thanks MEZUlity 💪
@investorICE4 жыл бұрын
9ice one Mezu. Keep it up bro 👍
@hjhhhhjgg18974 жыл бұрын
The starting is very good . Your teaching style is full of passion.. you described everything very well. I hope, you will continue the same passion in the next coming videos.