Microsoft Fabric: Import On Premise SQL Server 2022 Data into Microsoft Fabric with Data Pipelines!!

Рет қаралды 710

Күн бұрын

Bradley Ball, aka @SQLBalls, walks us through how to install, setup, and configure a data gateway. Then how to register that data Gateway in Microsoft Fabric. We then use a Data Pipeline to import data from #SQLServer2022 into #MicrosoftFabric!
Chapters
00:00 Importing Data with Microsoft Fabric
01:21 Demo - Our SQL 2022 Data
01:42 Demo Install on-premises data gateway
02:31 Demo Configure SQL Server 2022 Connection
03:36 Demo Super Importaint Configure your ADLS Gen 2 Storage for Staging
03:57 Demo Create Data Pipeline
05:01 Demo Configure Staging
05:45 Demo Validate Data Import
Install an on-premises data gateway
learn.microsoft.com/en-us/dat...
/*******************
/CONNECT WITH US!!
/*******************
Tales from the Field
Twitter: / talesftfield
Linkedin: / 100091910
Blusky: bsky.app/profile/talesfromthe...
Bradley Ball
Twitter: / sqlballs
Linkedin: / sqlballs
Blusky : bsky.app/profile/sqlballs.bsk...
Daniel Taylor
Twitter: / dbabulldog
Linkedin: / danieltaylor3
Blusky: bsky.app/profile/dbabulldog.b...
Neeraj Jhaveri
Twitter: / neeraj_jhaveri
Linkedin: / neerajjhaveri
Blusky: bsky.app/profile/neerajny.bsk...
Josh Luedeman
Twitter: / joshluedeman
Linkedin: / joshluedeman
Blusky: bsky.app/profile/joshluedeman...
Andrés Padilla
Twitter: / nodestreamio
Linkedin: / andrespadillaandrade

Пікірлер: 4

@adilmajeed8439 2 ай бұрын

Thanks for sharing. When you have created the connection in the Fabric service and then you had clicked to see the properties again, after scrolling at the bottom, I can’t see the staging part in my connection which you had showed in the properties dialogue box. Power BI Gateway is already been updated. Any pointers…

@Tales-from-the-Field 2 ай бұрын

Hi @adilmajeed8439 per Bradley, "Hello sir, it's a little hard to troubleshoot this on KZfaq. Could you hit me up on Linkedin and we could DM with screen shots?" www.linkedin.com/in/sqlballs/

@OneNI83 2 ай бұрын

In this method can we bulk import tables (lets say we want tables that are filtered using a query and those tables we need to import) ,what would be the maximum that can export at one go ?

@Tales-from-the-Field 2 ай бұрын

Hi @OneNI83 per Bradley, "Look at this much like Azure Data Factory. Use this for your initial fork lift, based on your comfortability with this and other technologies. If you are a T-SQL Warehouse person, land it in files and do a CTAS to load or load it directly to a warehouse and then use T-SQL to Transform your data. If you are spark person, land it in files and use a notebook to transform and load your data. This is a powerful tool, but there's multiple ways to ingest data after it lands. So super long answer for a short questioni, Yes you can use this to bulk load. Not sure, there's not really a limit and you could scale the parallelism to increase throughput for VLDB workloads."