What is Azure Data Share
13:58
10 ай бұрын
What Is Microsoft OneLake?
22:37
Жыл бұрын
Пікірлер
@patsickboy743
@patsickboy743 6 күн бұрын
How to do RLS in Lakehouse?
@DataBar
@DataBar 6 күн бұрын
Have a look at this and it should help you. RLS is only supported on a Lakehouse through the SQL Analytics Endpoint. learn.microsoft.com/en-us/fabric/data-warehouse/tutorial-row-level-security
@benshi1975
@benshi1975 19 күн бұрын
awesome video man!! Ive been looking for this solution the hole day!! since the Manage Roles in my PowerBi Desktop report is blocked, I guess because I connected my Report to the Warehouse semantic model.. this is the solution to RLS my diferent viewers, isnt it? My main table with sales dosnt have a column with the email, if I upload a table and relation it with the main sales table, is it enough¡? thanks bro!!
@DataBar
@DataBar 19 күн бұрын
Thanks. If your semantic model is based on a star schema, you can filter your fact tables and slice based in your dimensions. So yes the relationships are key in the scenario you described.
@user-ky9rv2kl6j
@user-ky9rv2kl6j 23 күн бұрын
It would helpful if you add video on how to load data from Oracle on prem to fabric using Notebook.Thanks
@DataBar
@DataBar 23 күн бұрын
We recently launched a new Oracle connector. You can use this connector in addition to an on-premise gateway to access oracle on prem data. support.fabric.microsoft.com/en-ca/blog/announcing-new-data-factory-connectors-released-in-may-2024?ft=All
@apollobell105
@apollobell105 Ай бұрын
Great info and very informative 💪🏽…I’m currently a production SQL DBA on the road to becoming a Data Engineer so I enjoy your content. You gained a new subscriber 😊💪🏽
@DataBar
@DataBar Ай бұрын
I appreciate it!!! 💪🏽
@aakanshaverma1310
@aakanshaverma1310 2 ай бұрын
can we access SAP data in Microsoft fabric through On Prem Data Gateways ? I dont see any information on the internet that we are the source data that is accessible through MS fabric. If you know pls reply. thanks
@aakanshaverma1310
@aakanshaverma1310 2 ай бұрын
at 5:31 in video , can you tell what is there in "more"
@DataBar
@DataBar 2 ай бұрын
Yes SAP data can be accessed through an on-prem gateway. Check out this link for more details. blog.fabric.microsoft.com/en-us/blog/integrate-your-sap-data-into-microsoft-fabric/
@apramit1
@apramit1 2 ай бұрын
Is the CMK works on auto failover group? if yes, then how key volt will be accessible by secondary database? Please help me to understand. Any documentation will be much appreciated
@DataBar
@DataBar 2 ай бұрын
Just like we provided the primary instance with access to the key vault, we need to provide any secondary instances with that same access to the key vault.
@sarthakkharehcl142
@sarthakkharehcl142 2 ай бұрын
Best and easiest way to explain the Elastic Pool.
@DataBar
@DataBar 2 ай бұрын
Glad it helped!
@escapetothesky
@escapetothesky 2 ай бұрын
Very useful and well paced video
@DataBar
@DataBar 2 ай бұрын
Thank you! Please like and share!
@preyebuowari9129
@preyebuowari9129 3 ай бұрын
Excellent video
@DataBar
@DataBar 3 ай бұрын
Thank you!!
@datasqlai
@datasqlai 3 ай бұрын
whats the latency of moving databases out of latency pool or increasing service tier of it. How to deal with noisy neighbour problem and how to mitigate the risk of kicking out the noisy neighbour from the pool without disruption or latency ?
@DataBar
@DataBar 3 ай бұрын
Increasing a service tier can vary depending on if the current underlying VM has the resources to allocate to your instance, or if it needs to be moved to a different instance. However the downtime is minimal as some of this work involved with potentially moving to a new VM happens in the background while your current instance continues to run, and then we will do, in essence a DNS change, at the end. Moving databases into a new elastic pool is a relatively seamless experience. Within elastic pools, your can limit the amount a vCores that a database can consume from that pool helping to put guardrails around noisy neighbors.
@datasqlai
@datasqlai 3 ай бұрын
@@DataBar my main concern is kicking out the noisy neighbour from the elastic pool to a dedicated azure SQL instance
@DataBar
@DataBar 3 ай бұрын
Understood. That’s why it’s important to set up good monitoring and alerting procedures so you can identify things like that and take appropriate action!
@loucaspapaspyrou5120
@loucaspapaspyrou5120 3 ай бұрын
So you either need to be using a Warehouse in Fabric or a SQL Endpoint. Therefore if I go into the Warehouse as my user I will only see my users information but if I go into a Lakehouse then this filtering will not be applied?
@DataBar
@DataBar 3 ай бұрын
From the Lakehouse you are either using the SQL Endpoint to access data with T-SQL in which the row level security will apply, or you are accessing the data via Spark and hitting the underlying delta parquet files and RLS will not apply in that scenario.
@culpritdesign
@culpritdesign 3 ай бұрын
nvarchar is not a supported data type?
@DataBar
@DataBar 3 ай бұрын
That was at the time of this recording. nvarchar should be supported now as long as it’s not nvarchar(max) as LOB data over 1MB is unsupported.
@lerbous4633
@lerbous4633 4 ай бұрын
just install 1 on prem data gateway in local PC to connect to multiple on prem databases? like oracle/SQL server etc
@DataBar
@DataBar 4 ай бұрын
One gateway can be used to connect to multiple on-prem databases.
@user-ji2si8ic4p
@user-ji2si8ic4p 4 ай бұрын
Great video Tamarick and at a pace I can follow and sufficient clarity through the process. Thanks
@DataBar
@DataBar 4 ай бұрын
Thank you. Glad it was helpful!
@franciscoanalytics
@franciscoanalytics 4 ай бұрын
Hey! Great video! Is it possible to use dynamic data masking for contributor users?
@DataBar
@DataBar 4 ай бұрын
Any user with Admin, Contributor, or Member permissions on the workspace will be able to see unmasked data. If you need it to be masked for a user, either give the Viewer workspace role, or grant more granular SQL permissions using the GRANT statement.
@awadelrahman
@awadelrahman 4 ай бұрын
can you do the other way around, accessing a databricks service (example search index) from an app on azure? What is the difference between Creating service principlal on azure and the one on databricks?
@clvc699
@clvc699 5 ай бұрын
Could I access to SQL Server On premise with Notebook in Fabric?
@DataBar
@DataBar 5 ай бұрын
I am not aware of a way to do this via notebooks. The ideal solution would be to use Fabric Mirroring to mirror your SQL Server database into OneLake. Currently the mirroring feature is in private preview and only supports Azure SQL DB, CosmosDB, and Snowflake, but sql server will be coming soon.
@NeutronStar9
@NeutronStar9 5 ай бұрын
Please add more tutorials
@DataBar
@DataBar 5 ай бұрын
Will do
@user-sm7js3pt3i
@user-sm7js3pt3i 5 ай бұрын
What if more than 1 user need to access the on-prem data? Does every user need to install their own data gateway on the server?
@DataBar
@DataBar 5 ай бұрын
No each user does not need to install their own gateway. The admin of the gateway, usually the person that installs it, can grant additional users permission to use the gateway. See the below doc for more info: learn.microsoft.com/en-us/data-integration/gateway/manage-security-roles
@user-sm7js3pt3i
@user-sm7js3pt3i 5 ай бұрын
What if you want more than 1 user to access the on premise data? Do you have to make a gateway for each user?
@DataBar
@DataBar 5 ай бұрын
No each user does not need to install their own gateway. The admin of the gateway, usually the person that installs it, can grant additional users permission to use the gateway. See the below doc for more info: learn.microsoft.com/en-us/data-integration/gateway/manage-security-roles
@kuto1
@kuto1 5 ай бұрын
Really a great video, helped a lot.
@DataBar
@DataBar 5 ай бұрын
Thanks! Glad it helped!!!
@escapetothesky
@escapetothesky 5 ай бұрын
Easy to follow along. Thank you. Subscribed.
@DataBar
@DataBar 5 ай бұрын
Thank you!
@apurvgaykhe715
@apurvgaykhe715 6 ай бұрын
Very well explained
@DataBar
@DataBar 5 ай бұрын
Glad it was helpful!
@vijaykundanagurthi8585
@vijaykundanagurthi8585 6 ай бұрын
Hey Tamarick, do you have a reference how to configure the credentials as Datarbciks cluster configuration?
@jammuarun
@jammuarun 6 ай бұрын
This video helped me a lot. I struggled for 4 days to mount Datalake on Databricks. This video explained exactly what I need. Thanks a lot for creating this video.
@DataBar
@DataBar 6 ай бұрын
Thank you! Glad it was able to help!!
@rasmusandreasson1548
@rasmusandreasson1548 6 ай бұрын
Would love to have more fabrics content, great job!
@ramonpacheco42
@ramonpacheco42 7 ай бұрын
ok, but can i use on premise on data factory? not in dataflow gen 2? or KQL?
@DataBar
@DataBar 7 ай бұрын
On prem gateways are used to access data on-prem and are currently only supported within Gen2 Dataflows.
@shashipaul6279
@shashipaul6279 8 ай бұрын
That's amazing .... wanted someone to guide it in better way ... Luckily got this video .... Hope you will continue it n explore everything related to data science stuff which can empower data analysts with DS stuff.... 🎉
@DataBar
@DataBar 8 ай бұрын
Glad this was able to help you!!!
@vishwassee
@vishwassee 8 ай бұрын
i am getting this error after i publish error: GatewayCannotAccessSqlError Couldn't refresh the entity because of an internal error any idea how to fix it?
@DataBar
@DataBar 7 ай бұрын
I would need to review it to really understand what’s going on. I recommend you open a support case for assistance.
@efficiencygeek
@efficiencygeek 8 ай бұрын
Well done. Showing a lot of good detail. Thanks much.
@DataBar
@DataBar 8 ай бұрын
Thank you! I appreciate you watching!!
@theministerbo7293
@theministerbo7293 8 ай бұрын
Very good video. I"m learning. Still need hands on but that's coming.
@BudgetBill
@BudgetBill 8 ай бұрын
I agree, I need hands on as well
@DataBar
@DataBar 7 ай бұрын
Best of luck!
@larryarrington9395
@larryarrington9395 8 ай бұрын
East Coast Sr - I plan tio complete all 7 videos in this series. Will have questions so I plan to reach out. Started with your video on Fabrics. Looking to take a deep intio Azure ecosystem. Tks for what you do
@DataBar
@DataBar 8 ай бұрын
Thank you!!!
@larryarrington9395
@larryarrington9395 8 ай бұрын
Just found your site today. Where have I been? 70 yrs old and retired. Now out of retirement to learn new technologies. Starting with Fabric. Will check out your vast collection of Microsoft related videos. Tks for sharing and being so passionate about what you love. It show! I will have questions and plan to reach out. 😅 East Coast Sr.
@DataBar
@DataBar 8 ай бұрын
Thank you for watching sir! I appreciate it!!!
@theministerbo7293
@theministerbo7293 8 ай бұрын
I will keep watching and learning. As I have questions I will reach out Keep doing what you do! I greatly appreciate it! 😊 ❤
@DataBar
@DataBar 8 ай бұрын
Thank you! I appreciate you!
@pawelkostadinow
@pawelkostadinow 8 ай бұрын
This video was very helpful to me as well! Thank you!
@DataBar
@DataBar 8 ай бұрын
Thanks for watching!!
@ayocs2
@ayocs2 9 ай бұрын
is Clustered columnstore index appropriate for real time replication? I saw blogs on why you shouldn't use indexes on columns that gets updated frequently. could you explain in brief please?
@DataBar
@DataBar 3 ай бұрын
Indexes help with data retrieval, but they slow down data writes. In a real-time replication scenario you have lots of write activity taking place. Each time you write new data, any indexes you have will need to be updated, thus impacting performance.
@Southpaw07
@Southpaw07 9 ай бұрын
Since the solution is centered around BC and zone redundancy could you use lb as opposed to traffic manage to reduce cost ?
@DataBar
@DataBar 9 ай бұрын
Azure SQL only allows one replica to serve both read and write workloads so load balancing isn’t really a concept here. You can redirect read-only workloads to a secondary replica. Does this answer your question?
@BudgetBill
@BudgetBill 9 ай бұрын
Great explanation to make decisions
@DataBar
@DataBar 9 ай бұрын
Glad it helped!
@BudgetBill
@BudgetBill 9 ай бұрын
very helpful information
@DataBar
@DataBar 9 ай бұрын
Glad it helped!
@windyearle
@windyearle 10 ай бұрын
The thing is, the replica is still in the same region right? So you're probably better off using GP and creating your own Auto-failover group with a second MI in a second region? That way you've got multi-region HA, which is better than what Business Crit offers.
@DataBar
@DataBar 10 ай бұрын
It just depends on your use case. If your main goal is offloading read-only workloads then using the included replica of the BC tier meets that purpose. The replica is there for high availability purposes and to ensure Microsoft can maintain its SLA’s. But if you are looking for a solution for disaster recover, then, as you stated, auto-failover groups would be the best solution for that use case.
@grimmersnee
@grimmersnee 10 ай бұрын
great explanation
@DataBar
@DataBar 10 ай бұрын
Glad it was helpful!
@CoopmanGreg
@CoopmanGreg 11 ай бұрын
Fantastic Video. Well explained and very detailed. Thanks
@DataBar
@DataBar 11 ай бұрын
Glad it was helpful!
@nickgovorun5384
@nickgovorun5384 11 ай бұрын
Great! But how did you do that: on 1:50 you have win10 inside win 11, that is inside macOS ? Have you 3 VMs ?
@DataBar
@DataBar 11 ай бұрын
MacOS is my host OS. I then have an RDP connection to a Windows 11 VM. At the 1:50 mark I am running the SSMS app connected to a SQL Server 2022 instance hosted on Windows Server 2022.
@andreyjimenez4204
@andreyjimenez4204 11 ай бұрын
Great video! when are they going to add support for more external sources like Google Cloud Storage?
@DataBar
@DataBar 11 ай бұрын
We don’t have a date to announce publicly yet but other providers are in the works.
@nickgovorun5384
@nickgovorun5384 11 ай бұрын
Thnx a lot. You really helped me!
@DataBar
@DataBar 11 ай бұрын
Thanks for watching and glad I could help you!!
@joseronnieranile1712
@joseronnieranile1712 11 ай бұрын
Thanks for the video. I successfully linked my azure sql database to synapse but it's not replicating the table successfully, the status always says 'WaitingForSnaphot'. Can you please help?
@DataBar
@DataBar 11 ай бұрын
It’s kind of hard to troubleshoot without actually understanding and looking into your environment. Have a look at this and perhaps it can help you. learn.microsoft.com/en-us/azure/synapse-analytics/synapse-link/troubleshoot/
@GavinLi-er9eu
@GavinLi-er9eu Жыл бұрын
When I switch to the new TDE key, the existing database encryption_scan_state_desc is still in PROTECTION_CHANGE_IN_PROGRESS. How long does this state have to wait?
@DataBar
@DataBar 10 ай бұрын
We’re you able to resolve this issue?
@GavinLi-er9eu
@GavinLi-er9eu Жыл бұрын
great video! I have some questions, 1. if I want to restore the backup file on my local PC, is the flow is same as in this video? 2. If I have 3 pc want to restore the backup file. Do we need to select Multitenant on the step "create app registration in Azure active directory"? 😁
@DataBar
@DataBar Жыл бұрын
Yes the flow should still be the same for restoring to your local pc. You still must use SQL 2022 and your must go through the process of ensuring your instance can access the CMK stored within the key vault.
@GavinLi-er9eu
@GavinLi-er9eu Жыл бұрын
​@@DataBar thanks. I think there are two scenarios here. The first one is to restore the database to our local location. If I used the Azure default TDE key, I can not do the backup with Azure Blob, because I don't have the master key password. So If we want to back up to the Azure Blob, we should use the custom key. And the custom key should use Azure Key Vault. And then we can restore the database from the Azure blob. The second one is just to ensure that the data is secure. The Azure default enabled the TDE, So we don't need to do anything. I hope I understand correctly, LOL
@DataBar
@DataBar Жыл бұрын
Correct, anytime you want to move a backup outside of Azure you have to use a customer managed keys, and SQL Server 2022 is the only version they currently supports restoring backups from Azure SQL MI. Backups created using a service managed key can only be restored within Azure.
@oswaldoortiz1409
@oswaldoortiz1409 Жыл бұрын
Great insights, thanks for sharing
@DataBar
@DataBar 11 ай бұрын
Thank you for watching!
@peterdolina9124
@peterdolina9124 Жыл бұрын
Excellent! One of the best teaching videos: structured, well organized, clear. Sir, work on more topics and I can assure you as an instructor you would be one of the best!
@DataBar
@DataBar Жыл бұрын
Thank you sir. I appreciate that! More content coming soon!!!
@Ahmad-fz1to
@Ahmad-fz1to Жыл бұрын
Hello can you please make a video on how to restore a TDE protected Azure managed Instance database with Customer managed key azure vault from one tenant to another tenant into different managed instance? cross subscription and cross tenant.
@DataBar
@DataBar 10 ай бұрын
Thanks for the feedback. I may revisit this topic in a future video.