It was an excellent session regarding all these tools. It helps you a lot to understand when to use what.
@saivenkateshtummala55764 ай бұрын
This is really helpful for someone starting new, thank you!
@premanandasahoo2908 ай бұрын
Thanks a lot @lisa. I got a whole lot of clarity. Was always confused about which service to use and why.
@marchelomoratti15 ай бұрын
Thank you so much for the presentation! It was very informative, it gave me a great picture of those tools!
@ranjancse2625 күн бұрын
Wow! Amazing presentation on Azure Data Factory, Azure Databricks, Azure Synapse Analytics. Love it :)
@sajidsidАй бұрын
Thank you for summarization, this is quite helpful
@psvarada8 ай бұрын
very nicely explained. great job!
@kirole73812 ай бұрын
Thank you for the work Lisa !
@leolebron23Ай бұрын
Lisa is amazing! What a cool presentation.
@cloudbaud77943 ай бұрын
Nice info and fun to watch 😊
@valliguduru49634 ай бұрын
Thank you for the video. Excellent analysis and presentation!!! Can you please do a comparision video for Azure Fabric vs Azure Databricks.
@JSinghCode2 ай бұрын
Very helpful for our choice!
@pauloroncarati5 ай бұрын
Great presentation!
@SQLBits5 ай бұрын
Thank you kindly!
@nikjojo11 ай бұрын
Great presentation thank you.
@SQLBits10 ай бұрын
Our pleasure!
@datadataeverywhere69542 ай бұрын
Eye opening
@williamnguyen57713 ай бұрын
HAHAHAHA 20:12 man she’s so hilarious for keeping it real. ADHD here too
@davidlion4482 Жыл бұрын
Azure Data Factory is similar to SSIS and doesn't have a data store to persist the data, but Azure Databricks and Azure Synapse has a database engine to support the storage of data. Azure Data Factory is only an ETL/ELT tool. But for the other two there are ETL/ELT and database. In case this, Azure Data Factory shouldn't be compared to a database.
@devarshsanghvi9315 Жыл бұрын
Its a seperate tool that's true and as many people use ETL with Data Factory they do have doubts about Should I use Azure Synapse / Azure Databricks for my ETL or I should continue using Azure Data Factory. Noting don't know code can leverage UI with little extra cost and who knows code can save little too.
@LisaHoving Жыл бұрын
Migrating to Databricks can offer you a bit more flexibility, but you would have to migrate all the pipelines to code. Alternatively, you could use both tools, and make your new flows in Databricks. Notebooks and packaged code in databricks can easily be kicked off by ADF, making it a cool orchistrator!
@grahamthomas782110 ай бұрын
Agreed that ADF seems like an odd comparison here but the Databricks vs Synapse comparison was really helpful
@rajeshshetty46857 ай бұрын
Why then the speaker is saying that there is no data storage (24:36) in all three:?
@waldchiller46956 ай бұрын
Here still just having on prem projects with SSIS LOL.
@MauriceBierhuizen5 ай бұрын
Very clear. And hilarious when she misspoke sqlbit, and blamed her adhd🤣
@sbudama24211 ай бұрын
I am bit confused, why cant we store data in Databricks. Databricks has Lake house to do so?
@grahamthomas782110 ай бұрын
I guess it's because it's just Azure data lake storage under the hood? So technically the data isn't actually stored in Databricks
@michaszalast60949 ай бұрын
lake house is just the architectural approach. as of my knowledge, every analytical, cloud based solution is built on top of some kind of cloud data storage (adls, blob storage, aws s3 etc.) and this is only a data storage layer
@himondas189 ай бұрын
as per my understanding, databricks and synapse store data in azure blob storage, and give you a database/ datawarehouse like model on top of that, so that you can do easier analytics or other stuffs. Even some projects creates data integration and pipeline in ADF to trigger databricks jobs/notebooks and synapse can do analytics and use BI tools over delta lake in databricks.
@peterpan-yj4rn4 ай бұрын
Why ADF can’t be used for Power BI if the target data model is SQL server?!
@LisaHoving3 ай бұрын
If SQL Server is the target, you can indeed just connect Power BI to SQL Server and do your aggregations/data loading with ADF, no problem! My point was more regarding to connecting ADF to Power BI. In synapse and Databricks you can create tables and use these definitions directly in Power BI by connecting these tools. ADF has no such thing.
@ivanp92229 ай бұрын
What about the Java u highlighted earlier? Or did i missed it 😂
@UNNIE23637 ай бұрын
Yes , you kinda missed it . She mentions go with Databricks if speciality is in Java, as Java lang is supported
What can DataBricks do that Synapse cannot do better?
@danhorus8 ай бұрын
Here's a few off the top of my head: 1. Databricks clusters are more flexible. You can choose the cheaper Compute Optimized VMs for append-only incremental processing, or Storage Optimized VMs to enable caching on the local SSDs, among other VM types. In Synapse, you can only use Memory Optimized and GPU Optimized VMs; 2. Databricks clusters allow you to use Spot VMs for the workers, which are significantly cheaper as well. Synapse does not support Spot VMs; 3. Databricks allows for better cluster sharing, as the same cluster can have multiple Spark sessions active at once. Synapse reserves slots for each Spark session, and those slots will sit idle when the developer is not running any code -- they can't be used by other developers while they are reserved; 4. The notebook file format in Databricks lends itself better to git diffs in Pull Requests, as they are regular code files (e.g., Python code) with some comments for special cells. Synapse notebooks, on the other hand, are saved as JSON files which are much harder to review in a git diff interface; 5. Databricks has exclusive features such as Auto Loader and identity columns, which are really helpful for data engineering and framework development; 6. Databricks is the flagship product of the company founded by the creators of Apache Spark, and as such it will always have an edge in supporting new Spark versions and features. Meanwhile, Synapse is a PaaS offering from Microsoft, and Microsoft is now clearly focusing a lot more in their SaaS offering: Microsoft Fabric. If I had to build a data platform on Azure today, I would use Databricks as my transformation engine. Hope this helps! :)
@tinasheyamaone54357 ай бұрын
WHAT DOES MORE MATURE EVEN MEAN???!!!!
@SQLBits6 ай бұрын
Hi Tinashelyemaone5435, you can get in touch with the speakers directly through LinkedIn and X! They are normally more than happy to help.
@kimstuart79896 ай бұрын
the amount of work the developing community has put into it. Think of it as beta vs stable. Databricks is way more stable, has been developed through iterations to catch bugs and implement fixes already. Synapse Analytics is newer comparatively and is going through that iterative process now, so in time its reliability will catch up to that of Databricks.
@bms46543 ай бұрын
I would say maturity is the level of knowledge and skills an organization has to support these tools. You are not going to give a graphing calculator to a 6 yr old child. You are not going to give databricks to a company that has everything in spreadsheets.