45. Iterate over excel file sheets dynamically and copy them as a CSV file using Azure Data Factory

No video

45. Iterate over excel file sheets dynamically and copy them as a CSV file using Azure Data Factory

Рет қаралды 17,672

Күн бұрын

In this video, I discussed about Iterating over excel file sheets dynamically using sheet index and copying them as separate CSV files using Azure Data Factory.
Link for PySpark Playlist:
• 1. What is PySpark?
Link for PySpark Real Time Scenarios Playlist:
• 1. Remove double quote...
Link for Azure Synapse Analytics Playlist:
• 1. Introduction to Azu...
Link to Azure Synapse Real Time scenarios Playlist:
• Azure Synapse Analytic...
Link for Azure Data bricks Play list:
• 1. Introduction to Az...
Link for Azure Functions Play list:
• 1. Introduction to Azu...
Link for Azure Basics Play list:
• 1. What is Azure and C...
Link for Azure Data factory Play list:
• 1. Introduction to Azu...
Link for Azure Data Factory Real time Scenarios
• 1. Handle Error Rows i...
Link for Azure Logic Apps playlist
• 1. Introduction to Azu...
#adf #datafactory #azure #azuredatafactory #etl #WafaStudies #maheer

Пікірлер: 29

@rk-ej9ep 9 күн бұрын

Awesome explanation..great efforts..👏👏

@RAAMASHAAMYC 6 ай бұрын

Awesome bro - I got the exact question from one interview where I mentioned the same case with azure functions + fpreach copy but this is more informative but for failed activity part.

@sravankumar1767 Жыл бұрын

Nice explanation bro 👍 👌 👏

@WafaStudies Жыл бұрын

Thank you ☺️

@SantoshKumar-yr2md 6 ай бұрын

great, I also encountered exact question

@PraveenkumarVinukonda 14 күн бұрын

What if there is any other error in copy activity

@dipalipatil-uc7ll Жыл бұрын

nice work done by you

@Sayon____bhattacharjee Жыл бұрын

Sir my humble request please make video on microsoft interview process for azure data engineer role

@arameshkumar5072 Жыл бұрын

Good Effort sir

@WafaStudies Жыл бұрын

Thank you 😊

@saikrishnabudharapu1421 Жыл бұрын

I need all the output CSV files in single sheet one row below other, here the column header is same. could you please give me the solution for this

@chaudhryalisalam3668 Жыл бұрын

Great job mate

@purvajpradhan8841 11 ай бұрын

Hello @WafaStudies: I do have scenario, in which I need to work with Excel of 250MB of size( multiple Sheets in it) Currently, the copy activity takes a lot of time, can you suggest in this case?

@alaknandanadi-yk5pd 9 ай бұрын

Hi..if I want the name of the sheet in the filename.csv then what should I do

@chinmaykshah Жыл бұрын

Hello do we have anyway to create json files for all documents available in cosmos mongo db api? I need to migrate data from cosmos mongo to google postgres any good way to achieve this?

@sanatkumar1497 Жыл бұрын

Is any direct way to convert from azure SQL tablets into Excel sheet.

@anthony281190 Жыл бұрын

Wafa, how can do That with data flow and apply a transformation to any sheet?

@anthony281190 Жыл бұрын

@WafaStudies

@sudarshanthota3369 Жыл бұрын

Hi Anna from Kadapa. Your Videos awesome. How to copy each sheet at scheduled time. Example: I want to copy sheet 2 after 1 hour. Pls let me know if you have answer

@Ravishanker.Muniasmy Жыл бұрын

You can schedule the Trigger accordingly

@const71 Жыл бұрын

what if you want your pipeline to fail when legitimate errors occur?? this is such bad code

@vijaybodkhe8379 Жыл бұрын

Yes Hi Maheer you we may need to find some different logic because if some other error occurs inside until activity you will not able to find or log.Anyway attempt was good and got learn alot all the best thanks for sharing.

@sravankumar1767 Жыл бұрын

Hi bro, I have one doubt is this logic applicable to multiple excel files with multiple sheets to generate a csv file, could u please clarify my doubts

@Sitaram-ek3cc 9 ай бұрын

@sravankumar1767 - Did you get the answer to your question? multiple excel files with multiple sheets to generate a csv file? if so pls share here

@sravankumar1767 9 ай бұрын

@@Sitaram-ek3ccin our we used Metadata configuration in that we have to mention sheet sheetnames in configuration then it will generate each sheet as csv

@CitizenIndia143 Жыл бұрын

Hi Dude, Where I can meet you?

@jamshedsalik8705 Жыл бұрын

Hi sir, I hope you're having a wonderful day. I have csv file with 3 columns ID Name Gender 1 Raja Male 2 Sara Female 3 Aksha Male 4 Ritu Female But i just want to read Female gender record and send to sink location Output: ID Name Gender 2 Sara Female 4 Ritu Female Can we achieve this in using Azure data factory?

@picachu5979 Жыл бұрын

We can use Adf Dataflows filter transformation to filter Female records.