Get Data Into Databricks - Simple ETL Pipeline

Рет қаралды 60,473

Күн бұрын

In this short instructional video, you will learn how to get data from cloud storage and build a simple ETL pipeline
Get started with a Free Trial!
www.databricks.com/try-databr...
Get insights on how to launch a successful lakehouse architecture in Rise of the Data Lakehouse by Bill Inmon, the father of the data warehouse. Download the ebook: dbricks.co/3YaVYpv

Пікірлер: 16

@julius8183 14 күн бұрын

Very clear and quick tutorial. Well done, thanks!

@nicky_rads Жыл бұрын

Solid demo for an intro to data engineering !

@rendorHaevyn Жыл бұрын

Great demo

@user-tp2vb4gh3h 7 ай бұрын

Nice. Is the notebook available to download and try?

@vaddadisanthoshkumar4143 Жыл бұрын

Thank you. 🙏

@omer_f_ist Жыл бұрын

In the video orders/spend information data is exported as csv files. Should source OLTP systems export data? Is it more practical than the other methods(jdbc, etc...) ?

@UntouchedPerspectives 7 ай бұрын

What about on prem data and iot data? Does DBX has ingestion capabilities?

@rabish86 Жыл бұрын

Can u provide us the data file or source for practice shown in this video?

@ongbak6500 Жыл бұрын

Hi, where I can get this code that you are showing here?

@sumantra_sarkar Ай бұрын

Thanks for the demo. Do you all have a link to the slide deck and the data set please?

@dhruvpathi941 Жыл бұрын

where can i find this notebook ?

@TheDataArchitect 4 ай бұрын

You have not append any meta data with the bronze layer, like when it was ingested, which file is the source of it? bronze layer should have all historical data, no? and what should be done next at the silver layer, so that only unprocessed data is processed to the silver table?

@borrarao1525 5 ай бұрын

Good

@7effrey Жыл бұрын

Is this the recommended way of doing ETL with databricks? I thought delta live tables where the recommended approach now

@uditranjan2432 Жыл бұрын

This is one of the ways to build a simple pipeline with Databricks - how one can easily get data from cloud storage and apply some transformations on it. Delta Live Tables (DLT) is the recommended approach for modern ETL/more complex workflows. We will publish an explainer video on DLT soon.