Apache Iceberg Deep Dive | Part 1

Apache Iceberg Deep Dive | Part 1 | Crash Course

Рет қаралды 1,166

Күн бұрын

#Lakehouse #iceberg #Apache_Iceberg #datalake #data
----------------------------------------------------------------------------------------------------------------------
🚀 Alex Merced: / alexmerced
👁️ Iceberg Lakehouse Engineering Video Playlist: bit.ly/am-iceberg-lakehouse-e...
🔧 Iceberg Docker-Compose File: github.com/developer-advocacy...
🔍 Lakehouse on your Laptop Tutorial; bit.ly/am-dremio-lakehouse-la...
📊 Getting Started with Dremio: bit.ly/am-dremio-get-started-...
🚀 Info about Alex: bio.alexmerced.com/data
00:00:00 Introduction
00:01:54 Background
00:03:00 About Alex
00:04:35 What is table format?
00:07:43 How do table formats work?
00:10:00 What is Apache Iceberg?
00:12:30 How Iceberg works?
00:13:52 Iceberg Components
00:20:43 Apache Iceberg Architecture
00:22:44 Benefits of Apache Iceberg
00:35:46 Apache Iceberg Catalogs
00:47:00 Apache Iceberg SQL
00:47:00 Dremio features
----------------------------------------------------------------------------------------------------------------------
This disclaimer informs the audience that the views, thoughts, and opinions presented in the video belong solely to the author and not necessarily to the author's employer, organization, committee or other group or individual.
----------------------------------------------------------------------------------------------------------------------
Follow us:
Twitter: / garageeducation
Facebook: / garageeducationcourses
KZfaq: / garageeducation
Website: gability.com/

Пікірлер: 5

@MahmoudBahnasawy-yk2fj 3 ай бұрын

شكرا يا بشمهندس على الحلقة كم من المعلومات حلو جدا وسهل للمبتدئين

@gihanmahmoud5651 5 күн бұрын

Could we have a follow-up on this now that it was a big offering from both Databricks and Snowflake? From a tech-side. How do the two offerings compare?

@GarageEducation 5 күн бұрын

Nice point. Do you mean comparing features between Databricks and Snowflake in general or with related to Iceberg or delta integration.

@gihanmahmoud5651 4 күн бұрын

@@GarageEducation Yes I mean with relation to iceberg and delta integration. How they two file systems compare? Specific scenarios where one would shine over the other, limitations of both. I think after the summits of both Snowflake and Iceberg there is a focus to be more open in regards to storage/table formats and always working on improving performance.

@SayedElhewihey 4 ай бұрын

Great episode as usual thanks men In addition to Mostafa’s last question about metadata to be stored in JSON files vs RDBMS. I had a case last week where I had to query hive metastore, MySQL DB, to get some metadata like list all tables with their columns and partitions also tables location and more Is this applicable with iceberg catalog where metadata stored as JSON or of their is a high level API that can be used for this type of inquiries? Thanks again