Intro to Databricks Lakehouse Platform Architecture and Security

Рет қаралды 112,013

Күн бұрын

This video is designed for everyone who is new to Databricks Lakehouse Platform Architecture and Security.
By the end of this course, you'll be able to:
- Explain the importance of data reliability and performance on platform architecture
- Define Delta Lake and its features
- Describe how Photo improves performance of the Databricks Lakehouse Platform
Earn the Fundamentals of the Databricks Lakehouse Platform Accreditation:
Link for customers only:
Link for partners only: partner-academy.databricks.co...
Link for Microsoft only:
Learn at Databricks Academy
www.databricks.com/learn/cert...
Get insights on how to launch a successful lakehouse architecture in Rise of the Data Lakehouse by Bill Inmon, the father of the data warehouse. Download the ebook: dbricks.co/41EbhKi

Пікірлер: 28

@adeniran8273 8 ай бұрын

PSA - I AM NO EXPERT BUT WORKING TO BECOME ONE. ALL YOU GUYS WANT TO DO IS JUMP ON HANDS ON WITHOUT UNDERSTANDING CONCEPTS. WHATS AN ARCHITECT WITHOUT A BLUEPRINT? Unlike most comment here, You guys did a very good job in breaking down the various differences in datawarehouse, datalake and the new data lakehouse platform. As for people in the comment section that do not understand, try to do research -a.k.a search - on sentence/statement you do not fully grasp. You also have the back -a.k.a replay - button to revisit until you get it. You do not have to watch the video in one sitting. Leave it the next day and come back to it again - its literally new information so reinforce learning is required! Bunch of newbies crying. Talk like you do not know how technology works. Good job you guys gave me a better picture for this stuff! Funny thing is am yet to finish the video on playlist number 3 and minutes 2:30,

@raeferg4595 10 ай бұрын

The first half was a sales pitch full of buzz words, not a tutorial for new users. I recommend just skipping it and starting at 19:35. In this second part of the video, Unity catalog is described much better.

@SaadQureshiOfficial 9 ай бұрын

I agree.

@mohanishsaim6299 10 ай бұрын

Please avoid reading the paragraph. Explain it so that beginners can understand it.

@ravinarang6865 9 ай бұрын

Very Fast, Difficult to Grasp. Unless you know Databricks already, diffcult to follow

@harshitgupta584 9 ай бұрын

😢hardest 28 mins of my life

@choudhurynoor1327 6 ай бұрын

Thanks bro! So it wasn't just me! 😄 Was feeling dumb and started to doubt myself.

@qiyin4011 11 ай бұрын

It is very abstract

@arunavabhattacharya571 5 ай бұрын

Good to know I am not the only one confused with the explanations here. Maybe a short Udemy course out there somewhere would be more intelligible and easier to understand than this official content.

@user-en8pe5ic2i 10 ай бұрын

You mentioned the problems in data lake..But Im able to do all these mentioned problems in AWS s3 For example: ACID - Using Athena able to perform, Schema enforcement - AWS also provides schema registry for this, Data Catalog - AWS provide Glue catalog for this.... Then Whats the advantage on top of these..please someone explain

@dukewellington7050 6 ай бұрын

? I think your confused. S3 is just an object storage platform. Databricks is a combination of object storage (Delta Lake), big data analysis/processing (Apache Spark) and their model management service (MLFlow). It also provides a host of other services like compute resources, workbooks and ci/cd pipelines. The advantage of databricks over S3 is that it combines all of these services under the hood and are pre-configured to work together. If you are just comparing the Delta Lake to S3 then no... there is no real "advantage".

@user-en8pe5ic2i 6 ай бұрын

@@dukewellington7050 Thanks for the reply, With my understanding, if I want to take care all the mentioned activities theres the way in other cloud systems say to use Apache Spark, we have AWS Glue/EMR, and for ML activities Sagemaker..just examples...So if Im right, there's alternatives but certainly with databricks we can perform all these activities in single phase with may be some more benefits.

@aniruddhdeshmukhe6505 10 ай бұрын

Not a good way to explain the things. 90% of the people are beginners and if you explain them in this way then they will definitely quit their learnings.

@visceralcinema 8 ай бұрын

Assumes you have some DB admin experience. Try the Microsoft Azure DB (learn) courses; they nicely explain in detail some of the terms used like transaction logs, master record, etc.

@quynh2183 7 күн бұрын

@@visceralcinemacan you share the link ? I searched on gg but not sure which course?

@michelle4468 Күн бұрын

type in video description: "Describe how Photo improves" Photo --> Photon

@tommy9x 11 ай бұрын

first half is hard to understand

@rich111296 11 ай бұрын

Just a bunch of blablabla

@bibekbhattacharya4890 4 ай бұрын

Like the Databricks presentations but there's an annoying popup showing the next video to watch for the last 30 seconds which blocks the current content in view. There's no way of dismissing this popup by the viewer but apparently can be configured by the content providers. The funny thing is even the recommendation is wrong. It's suggesting me to watch "What is a Data Lakehouse" after watching a "Lakehouse Platform Architecture and Security" video! Don't KZfaq do any user testing on their UX designs?

@neoo754 3 ай бұрын

it is like raining of too much info in just 28 minutes. i would be great if they reduced that and gave more overview on it. really hard to follow for newbies like me