No video

33. ForEach Activity in Azure Data Factory

  Рет қаралды 80,884

WafaStudies

WafaStudies

4 жыл бұрын

In this video, I discussed about ForEach Activity in Azure Data Factory
Link for Azure Functions Play list:
• 1. Introduction to Azu...
Link for Azure Basics Play list:
• 1. What is Azure and C...
Link for Azure Data factory Play list:
• 1. Introduction to Azu...
#Azure #ADF #AzureDataFactory

Пікірлер: 78
@Midnightnoodles
@Midnightnoodles 8 ай бұрын
Keep it up, excellent content
@WafaStudies
@WafaStudies 8 ай бұрын
Thank you 😇
@abhishekhr4724
@abhishekhr4724 3 жыл бұрын
Thanks for the video. one suggestion, Please take one example and run it. this will help us understand what output we are getting.
@dataguys2192
@dataguys2192 2 жыл бұрын
Second that!
@shakthimaan007
@shakthimaan007 2 жыл бұрын
Why not my engineering lectures were like you..!! After 5 hours of going through several videos, I finally managed to make sense of "For each" component using your video. I am able to append today's date to a file which copying from one blob to another. Zillion thanks. Small suggestion is that after showing all these, you might have just ran the pipeline to show what happens and through the process you might have debugged the Array quotes issue
@WafaStudies
@WafaStudies 2 жыл бұрын
Thank you for kind words 🙂. Ya at that time of making these videos I didn't had proper Azure subscription to send some money to execute. Even i was under worry like how much money it take and all. But all videos after intiall few days has everything ran. Sorry for the trouble in intial videos
@patrickbateman7665
@patrickbateman7665 2 жыл бұрын
Hi Maheer, a small correction at 6:10 timeStamp You have passed the list of 3 strings into an array i.e [ output1, output2, output3 ] as a deafult value Since they are list of Strings, They should be passed in Inverted Commas as [ "output1", "output2", "output3" ] Else while validating it will throw warning as "Parameter value should be a valid array " Hope this helps for the rest of Learners fom your channel :)
@WafaStudies
@WafaStudies 2 жыл бұрын
Yes thanks for correcting it.
@ssudipta4
@ssudipta4 4 жыл бұрын
Hi Maheer, Thank you for creating such a good video but one thing I would like to inform, when you are creating parameter like OutputFolders then value should be within the double quote like ["output1","output2","output3"] otherwise it throws a invalid parameter value.
@dataguys2192
@dataguys2192 2 жыл бұрын
I had the same issue. Had to look it up and solved the problem.
@user-jd2jn5qq2k
@user-jd2jn5qq2k 5 ай бұрын
maheer did not run the pipeline he just explain the blueprint waste fellow without run the pipeline how we get know whether its working or not
@prasadsai3776
@prasadsai3776 4 жыл бұрын
I like the way you explain .. Very informative and helpful. Thanks a Bunch!!
@pradeepp5287
@pradeepp5287 3 жыл бұрын
Thanks a ton Maheer. This is one of the most informative playlist I have viewed in KZfaq.
@WafaStudies
@WafaStudies 3 жыл бұрын
Thank you 🙂
@shaikbasha7086
@shaikbasha7086 2 жыл бұрын
Hi Maheer, the way u explaining the concepts understandable.awesome sessions and vr 💯% satisfied, thank you so much
@WafaStudies
@WafaStudies 2 жыл бұрын
Welcome 😊
@vijaybodkhe8379
@vijaybodkhe8379 2 жыл бұрын
Short and Clear videos Thanks Maheer
@WafaStudies
@WafaStudies 2 жыл бұрын
Welcome 🤗
@darkmatter5967
@darkmatter5967 3 жыл бұрын
Your class are reaaly usefull! Just keep making! Thank you a lot!
@sateeesh1000
@sateeesh1000 4 жыл бұрын
I am going through these videos last one week. you are explanation & examples are really very helpful to every one. Thank you @wafastudies
@WafaStudies
@WafaStudies 4 жыл бұрын
Thank you for your kind words 🙂
@satellitepop
@satellitepop 2 жыл бұрын
Many many many thks friend. Great video.
@WafaStudies
@WafaStudies 2 жыл бұрын
Thank you ☺️
@imranimmu1727
@imranimmu1727 4 жыл бұрын
Hi Maheer firstly big thanks to your great efforts, hope your channel should grow exponentially. Can we try nested for each activity in ADF?
@WafaStudies
@WafaStudies 4 жыл бұрын
Thankyou Imran for kind words. No we can't use nested foreach in adf. Currently it's not supported
@ramanareddygarisha7564
@ramanareddygarisha7564 8 ай бұрын
In the pipeline parameter, you have given value as [Output1, Output2, Output3], But it should be in double quotes ["Output1", "Output2", "Output3"] I believe. Correct me if I'm wrong
@samba777ravuri
@samba777ravuri 4 жыл бұрын
Good Explanation...Keep going on
@WafaStudies
@WafaStudies 4 жыл бұрын
Thank you 😊
@RaghbatTV
@RaghbatTV Жыл бұрын
can we use this on 'Copy Data Sink' part that @{item().OutputFolder}.....this output from parameter in pipeline? instead only @item().
@RahulJaiswal-nw1kf
@RahulJaiswal-nw1kf 3 жыл бұрын
thank you sir great work
@WafaStudies
@WafaStudies 3 жыл бұрын
Welcome 🤗
@sonamkori8169
@sonamkori8169 2 жыл бұрын
Thank you Sir
@WafaStudies
@WafaStudies 2 жыл бұрын
Welcome 😊
@biswajitsarkar5538
@biswajitsarkar5538 3 жыл бұрын
Good work...carry on
@WafaStudies
@WafaStudies 3 жыл бұрын
Thank you 😊
@azureadusu1786
@azureadusu1786 4 жыл бұрын
Great Work!!
@learnnrelearn7553
@learnnrelearn7553 3 жыл бұрын
very informative
@WafaStudies
@WafaStudies 3 жыл бұрын
Thank you 🙂
@varunkulkarni7908
@varunkulkarni7908 3 жыл бұрын
Super Video, Great work
@rajabhakshi3333
@rajabhakshi3333 2 жыл бұрын
Good demo
@WafaStudies
@WafaStudies 2 жыл бұрын
Thank you 😊
@dheerajsachdeva5735
@dheerajsachdeva5735 6 ай бұрын
How to handle this: Example: file1.xlsx > (sheet 1).json, (sheet2).json I don’t know how many files are the input folder and I don’t know how many sheets are in each file but the output should be whatever is the sheet name (within the xlsx) with json extn ?
@arishaafini269
@arishaafini269 9 ай бұрын
Hello, how to transform multiple file in single dataflow under the ForEach?
@mr.prasadyadav
@mr.prasadyadav 2 жыл бұрын
Inside continer I'm not getting the container names like output1,output 2 ,output3 Could please execute once your pipeline line activity .we can understand clearly
@avinashpratapsingh3875
@avinashpratapsingh3875 2 жыл бұрын
Hi Maheer, about this topic Foreach can u provide a actual time demo because demo u provide is not properly explanatory.
@letscodewithvivek5191
@letscodewithvivek5191 2 жыл бұрын
Hello, instead of hardcoding array, is it possible to pass folder values dynamically?
@dataguys2192
@dataguys2192 2 жыл бұрын
Is it possible to put all of the files in the same output folder? I tried adding another Parameter in the pipeline outputFolder as a string value, then created another parameter outputFile array type. Instead of creating 3 different files in a single folder, it created 3 separate output folders for each file.
@CoolGuy
@CoolGuy 2 жыл бұрын
Which all playlists by you should be watched for Azure Data Engineer role ? Thanks in advance bro.
@WafaStudies
@WafaStudies 2 жыл бұрын
Adf, synapse, Databricks
@CoolGuy
@CoolGuy 2 жыл бұрын
@@WafaStudies Thanks brother
@Deva21v
@Deva21v 3 жыл бұрын
How do we handle SSIS object type in SSIS
@vamshikrishna9630
@vamshikrishna9630 4 жыл бұрын
parameter should be arry? can be copy this alredy existed folders?
@anujgupta-lc1md
@anujgupta-lc1md 4 жыл бұрын
more video plz upload some on incremental files coming in blob how to store in azure sql viceversa.
@divyar7991
@divyar7991 Жыл бұрын
hi when I did this I got an error message while publish -parameter value should be a valid array,can you help me to sort out?
@WafaStudies
@WafaStudies Жыл бұрын
Array is not correct format i guess. Pls use comment ur format
@divyar7991
@divyar7991 Жыл бұрын
@@WafaStudies thank you for the reply .your videos are great . I got it correct when I go through someone’s comment .
@divyar7991
@divyar7991 Жыл бұрын
[“output1”,”output2”]
@dhanushyadav8879
@dhanushyadav8879 3 жыл бұрын
i dont see the output in my container my debugging happened well whats the problem
@user-jd2jn5qq2k
@user-jd2jn5qq2k 5 ай бұрын
in every video you are just show the flow but you didn't execute pipeline
@shaikraheem0329
@shaikraheem0329 3 жыл бұрын
Parameter value should be a valid array when i validate the pipeline showing above parameter error
@maheshgaddam5729
@maheshgaddam5729 3 жыл бұрын
It should be ["output1","output2","output3"]
@brahmaswetha2325
@brahmaswetha2325 2 жыл бұрын
@@maheshgaddam5729 thanks :) you are right. After changing this, I got the output
@abhilashpande78
@abhilashpande78 4 жыл бұрын
I am getting an error Saying "Parameter should be vaild array" please help me with this
@patrickbateman7665
@patrickbateman7665 2 жыл бұрын
It should be ["output1", "output2", "output3"] since the Folder names are list of Strings
@dineshmadhup8667
@dineshmadhup8667 3 жыл бұрын
Good Work. I wan to copy each record of the table separately. Does this concept work. Would you mind sharing your E-mail for further communication about it?
@prudhviraj3315
@prudhviraj3315 4 жыл бұрын
Tried it but didn't work, after adding value to folder name (@item())its showing invalid
@WafaStudies
@WafaStudies 4 жыл бұрын
To access items in array of for each you need to use @item()
@prudhviraj3315
@prudhviraj3315 4 жыл бұрын
@@WafaStudies I did that and Please check your video it is showing invalid for you too (when u gave the value to folder name it showed invalid ) Thankyou for your videos they r helping me for my carrier
@sateeesh1000
@sateeesh1000 4 жыл бұрын
@@prudhviraj3315 Array parameter you should define like ["output1","output2","output3"] then only it will work. I tried it is working fine. Thank you.
@dhanushyadav8879
@dhanushyadav8879 3 жыл бұрын
@@sateeesh1000 i dont see the output in my container my debugging happened well whats the problem
@chandrasekharthiyagarajan9634
@chandrasekharthiyagarajan9634 2 жыл бұрын
@@sateeesh1000 Thanks Sateesh. You saved my time.
@gaganacreations7464
@gaganacreations7464 Жыл бұрын
Please show me a vedio how to delete less than 50kb files in a blob storage
@WafaStudies
@WafaStudies Жыл бұрын
kindly check below kzfaq.info/get/bejne/nd6hnLWmnt2cdYU.html
@user-jd2jn5qq2k
@user-jd2jn5qq2k 5 ай бұрын
WHY YOU ARE NOT RUN THE PIPELINE IF YOU RUN THE PIPELINE THEN ONLY WE WILL LET YOU KNOW WHETHER ITS WORKING COREECT OR NOT.
@Uda_dunga
@Uda_dunga 9 ай бұрын
Very confusing 😢
@beigepiripitin4923
@beigepiripitin4923 Ай бұрын
No sé entiende NADAAA
@PrakyathJoshPrakki
@PrakyathJoshPrakki 3 жыл бұрын
Thanks for the video. one suggestion, Please take one example and run it. this will help us understand what output we are getting.
34. Get Metadata Activity in Azure Data Factory
12:46
WafaStudies
Рет қаралды 69 М.
42. Lookup Activity in Azure Data Factory
19:17
WafaStudies
Рет қаралды 79 М.
لااا! هذه البرتقالة مزعجة جدًا #قصير
00:15
One More Arabic
Рет қаралды 51 МЛН
Кадр сыртындағы қызықтар | Келінжан
00:16
Azure Data Factory | Copy multiple tables in Bulk with Lookup & ForEach
23:16
Adam Marczak - Azure for Everyone
Рет қаралды 188 М.
17. ForEach Activity in Azure Data Factory | Azure data engineer
11:43
learn by doing it
Рет қаралды 7 М.
29. Lookup activity in azure data factory | Azure data factory
13:50
learn by doing it
Рет қаралды 1,5 М.
32. Filter Activity in Azure Data Factory
6:35
WafaStudies
Рет қаралды 56 М.
Nested forEach activity in Azure Data factory
23:35
Data Engineering Studies
Рет қаралды 355