Advancing Fabric - First Look at OneLake

  Рет қаралды 4,798

Advancing Analytics

Advancing Analytics

Жыл бұрын

From the very first Microsoft Fabric announcement there has been a common message - OneLake is the common thread that binds all experiences together. A single Lake used by Lakehouses, Warehouses, RealTime and anything in-between. A single Lake across all workspaces in your Fabric tenant!
In this video, Simon and Craig look at the OneLake, both from the Microsoft Fabric interface, but also via the new OneLake for Windows file browser: A local file browser for your shared Lake data!
For a starter on Fabric's OneLake, see: learn.microsoft.com/en-us/fab...
If you're embarking on a Fabric journey, why not get in touch with Advancing Analytics to guide your journey!

Пікірлер: 15
@tomaskunka2801
@tomaskunka2801 Жыл бұрын
hi there, thanks for the amazing content! when reading data in databricks with abfss path, how did you get authenticated? what sorcery is this? passthrough?
@borninthematrix8006
@borninthematrix8006 Жыл бұрын
Great video, like you keen to under how backup and restores work on all the stuff in onelake. Until there's a disaster recovery plan for the Synapse datawarehouse we can't move our dedicated pools over.
@user-kv7lp8zg5s
@user-kv7lp8zg5s Жыл бұрын
Great video guys 👍 If you import another adls G2 account into your one lake, what does the abfss link look like? How do onelake and the onelake explorer manage permissions & ACLs, particularly in imported adls G2 accounts?
@EngineerNick
@EngineerNick Жыл бұрын
Thanks for the video :) This is just a more convenient version of azure storage explorer. BUT like storage explorer, bet it logs you out every single flipping 8 hours. Our lake consists of pretty small datasets for the most part. Some ad-hoc python on local windows in vscode is often all i need.
@AdvancingAnalytics
@AdvancingAnalytics Жыл бұрын
So far, it's more like OneDrive - just sits there happily logged in with my windows credentials. Haven't had any sync errors...yet...
@brads2041
@brads2041 Жыл бұрын
I'd like to get into an example implementation of a lakehouse with pipelines in fabric. How does a standard Databricks lakehouse implementation look in fabric?
@AdvancingAnalytics
@AdvancingAnalytics Жыл бұрын
It's on our list for vids, don't worry! Will take a few weeks with the Data + AI Summit happening next week!
@tashraf7262
@tashraf7262 Жыл бұрын
Great video guys, keep them coming. Not sure why your confused over the Lake explorer tool etc. Its horses for courses. People might not want to explore Delta files in a Lake explorer tool, but the Lake explorer also shows you the other FILES section, where you can access non delta files (csv, txt, images etc). People might use it to upload/download stuff. Random client data that might need to analysed or processed etc. Or, you might have some desktop tools that you want to connect to the Lake files that cannot use abfss urls, so those tools will see files on the local desktop path that happen to sit in the lake (if the Lake explorer tool appears as a drive in windows?). You questioned the value of seeing the names of delta files behind a table, and why anyone would need that? In SQL Server you can get the name of the mdf/ldf storing all the table data? What can you do with that information? Its just completeness I guess. Seems like the abstraction is where the benefit lies. Tables (SQL), Tables (delta), datasets(powerbi), all underpinned by delta files that you dont need to concern yourself with, it appears. This is a SaaS service designed to work across a multitude of personas, from highly skilled to unskilled. Not sure always critiquing the concept with a data engineers view will always be valuable. But thx for getting out this content, really helpful to see it being demonstrated.
@AdvancingAnalytics
@AdvancingAnalytics Жыл бұрын
The ability to see those things isn't the area I'm questioning - from the engineer's standpoint it's always useful to be able to view and analyse the underlying files when performance tuning etc. My concern is for the personas who DON'T want to see those things, or for the people who absolutely SHOULDN'T see those things. As long as we can apply security properly so users can still create new tables (through SQL, Lakehouse, whatever) but can't drop new files or delete files within the formal delta structure, then we're all good! For local IDE/Library use cases, it's super useful, for maintenance and governance it's super useful. I see the value, I'm just old and cynical :) - Simon
@sparktube99
@sparktube99 Жыл бұрын
How is performance compare to PaaS. Is there a way to do detailed comparisons
@JLRocco43
@JLRocco43 Жыл бұрын
delta lake ftw!
@GuillaumeBerthier
@GuillaumeBerthier Жыл бұрын
Don’t you got issue with your Fabric Workspaces named « UK Sales » « EUR Sales » ? Since in Fabric the workspace name is a Gen2 Container it’s doesn’t like too much the UPPER case and space I noticed
@mkrichey1
@mkrichey1 Жыл бұрын
Can’t help but think users would make an unholy mess of this 😂
@AndreasBergstedt
@AndreasBergstedt Жыл бұрын
1st :)
@goldwhispers
@goldwhispers Жыл бұрын
i could feel all the cringe heehee
Advancing Fabric - The Data Engineering Experience
17:51
Advancing Analytics
Рет қаралды 4,4 М.
Advancing Fabric - What is Microsoft Fabric?
19:28
Advancing Analytics
Рет қаралды 29 М.
Increíble final 😱
00:37
Juan De Dios Pantoja 2
Рет қаралды 110 МЛН
Did you believe it was real? #tiktok
00:25
Анастасия Тарасова
Рет қаралды 7 МЛН
когда повзрослела // EVA mash
00:40
EVA mash
Рет қаралды 2,9 МЛН
Behind the Hype - The Medallion Architecture Doesn't Work
21:51
Advancing Analytics
Рет қаралды 24 М.
OneLake - the FIRST thing you need to know about Microsoft Fabric
12:33
Learn Microsoft Fabric with Will
Рет қаралды 2,3 М.
Export Universal Analytics Data Before It's Deleted
12:04
wiredimpact
Рет қаралды 345
Advancing Fabric - Lakehouse vs Warehouse
14:22
Advancing Analytics
Рет қаралды 22 М.
Understanding OneLake within Microsoft Fabric
10:29
Guy in a Cube
Рет қаралды 67 М.
Advancing Fabric - The Data Warehouse Experience
14:05
Advancing Analytics
Рет қаралды 6 М.
Advancing Fabric - Mirroring | #fabcon #microsoftfabric
28:58
Advancing Analytics
Рет қаралды 1 М.
What Is Microsoft OneLake?
22:37
Tamarick Hill's Azure Data Training
Рет қаралды 2,1 М.
What is a Data Lake?
5:18
IBM Technology
Рет қаралды 225 М.