You should have drawn the nice picture prior to presentation so that you concentrate more on explantion rather thatn drawing this sketch
@amardeepagrawal61884 күн бұрын
could you please give some ref on datasource as sharepoint files as well
@brandoncharles96675 күн бұрын
thx
@rohitshukla70517 күн бұрын
Can you explain how the SQL query is running every two minutes, Have you scheduled it on Synapse, Or the SQL query itself triggers because you mentioned the tumbling window of 2 minutes interval?. Your show and tell video is nice but screen switching is too fast
@rahulverma99239 күн бұрын
great demo
@SoftWizCircle6 күн бұрын
Thanks
@MidhunMuraleedharan-si5yk12 күн бұрын
Thank you so much, very helpful.
@SoftWizCircle6 күн бұрын
Glad it was helpful!
@kingmaker-k5s13 күн бұрын
Hi sir really nice work, Kindly provide the playlist link of azure ai search and please make a detailed video on how the skill-set's are created for all the file types, Please.
@loicdd622518 күн бұрын
Thank you for this clear video. 🔥
@SoftWizCircle13 күн бұрын
Thanks
@swatityagi573119 күн бұрын
can u let me know how to cleanse data?
@swatityagi573119 күн бұрын
helpful video
@SoftWizCircle13 күн бұрын
Thanks
@vedantshirodkar21 күн бұрын
Very informative video. Appreciate all the efforts. Thank you!
@SoftWizCircle13 күн бұрын
Glad it was helpful!
@TheLeads21 күн бұрын
Is it possible to map only one table for indexing. In real life scenario search needs to pick data from multiple tables using joins right? So, AI search cannot help there?
@SoftWizCircle13 күн бұрын
Yes. using Portal we can do simple scenario but for complex scenario we can use API and use from any compute such as Function, synapse, ADF etc.
@rajat42042025 күн бұрын
Pls create a playlist for this
@SoftWizCircle13 күн бұрын
Sure
@rajat42042026 күн бұрын
WHERE is next part
@SoftWizCircle25 күн бұрын
kzfaq.info/get/bejne/ityggNqntZuqpZs.html
@madhanrajmoorthy8843Ай бұрын
Amazing friend. Ground level explanation :)
@SoftWizCircle26 күн бұрын
Glad you liked it!
@cliveyip7172Ай бұрын
great content, easy to follow along
@SoftWizCircle26 күн бұрын
Glad you think so!
@keshavamugulursrinivasiyen5502Ай бұрын
Do you have video on moving data from Cosmos to snowflake
@SoftWizCircle26 күн бұрын
No . you can try to change sink and source from this video and see.
@dominicaleung7329Ай бұрын
This is very good. But you are too fast for me to follow, I wonder whether there is some write up or some website you recommend to me to follow. Since I don't know Azure at all. Thanks
@SoftWizCircleАй бұрын
Microsoft learn will be a good place to start with if you don't know azure
@simple-securityАй бұрын
this method doesn't scale. azure sql allows entra auth via managed identity. use IAM reader role at subscription level to allow all azure sql instances to authenticate to Purview.
@SoftWizCircleАй бұрын
Yes for security and if you are moving code to production then we must use Entra Id with managed Identity. Connection string and other local keys must be used for POC or demo purpose only
@simple-securityАй бұрын
these methods are old. have you created a new video since this was made?
@SoftWizCircleАй бұрын
yes true. this very old video when purview came. i did not get time to make a video on purview from them
@SongulGizemАй бұрын
Comprei 10k de seguidores no AVANCO SOCIAL e chegou certinho recomendo
@kwanyoungoh5578Ай бұрын
very good and very helpful
@SoftWizCircleАй бұрын
Glad it was helpful!
@KkB700Ай бұрын
Is there any other way that we can schedule it outside the timetrigger class. Please help me
@SoftWizCircleАй бұрын
yes you can parameterize it stackoverflow.com/questions/64664294/two-timer-triggers-on-azure-function-with-params
@Gowtham-hm3frАй бұрын
Task: Set up a Basic Data Pipeline in Azure Step 1: Data Ingestion Azure Service: Azure Event Hubs or Azure Blob Storage Steps: 1. Create an Azure Event Hub namespace or Blob Storage account. 2. Set up an Event Hub or Blob Container to receive incoming data. 3. Configure access policies and keys for ingestion. Step 2: Data Transformation Azure Service: Azure Databricks or Azure HDInsight (Spark) Steps: 1. Provision an Azure Databricks workspace or HDInsight cluster. 2. Develop a Py Spark or Spark job to process and transform data. 3. Schedule or manually run the Spark job to process incoming data. Step 3: Data Storage Azure Service: Azure Data Lake Storage Gen2 (ADLS Gen2) or Azure SQL Database Steps: 1. Create an ADLS Gen2 storage account or Azure SQL Database. 2. Define folders or tables to store processed data. 3. Ensure proper access control and data retention policies. Step 4: Orchestration and Monitoring Azure Service: Azure Data Factory Steps: 1. Set up an Azure Data Factory (ADF) instance. 2. Create pipelines to orchestrate data movement from Event Hub/Blob to Databricks/HDInsight to the ADLS Gen2/SQL Database. 3. Configure triggers for pipeline execution and monitoring through ADF. This is my task how to do that? Any specific video having that task please share me
@SoftWizCircleАй бұрын
if you see different video on this channel for azure then you will find video about all resources you have mentioned. you just need to stich it in proper way to achieve your task
@girish46853Ай бұрын
How to disable one step in classic editor
@SoftWizCircleАй бұрын
if you right click then there should be a option to disable
@ericsalesdeandrade9420Ай бұрын
Is there a way to do this without manually creating tables in Snowflake beforehand? (auto create)
@SoftWizCircleАй бұрын
i think we can do via script and run in another activity
@eduardomarinheiroalonso5592Ай бұрын
Very good!!! thanks for share!
@SoftWizCircleАй бұрын
Thank you too
@pigrebantoАй бұрын
thanks. Does this work with Azure Blob Storage or Azure Data Lake?
@SoftWizCircleАй бұрын
yes it does
@devact7707Ай бұрын
Great one 🕶 when I try it in azure , it says "Azure OpenAI Service is currently available to customers via an application form. The selected subscription has not been enabled for use of the service, but you can continue to use other AI services available in this product." how did you manage to proceed with Hotmail account as it is not accepted in approval process ?
@SoftWizCircleАй бұрын
you dont need azure open AI service for azure search. you can search by name.
@rajarajanchandran8486Ай бұрын
Is it possible to use one service principal to multiple subscription?
@SoftWizCircleАй бұрын
Yes as long as all subscription is under same Azure Active directory tenant.
@CraigRicciShaynakАй бұрын
Thanks for the help!
@SoftWizCircleАй бұрын
Happy to help!
@uttamchaturvediАй бұрын
Could you please provide git repo for the code used to generate data seeding
@SoftWizCircleАй бұрын
Sure will upload and let u know
@ramyareddy3047Ай бұрын
Can we use AWS snowflake database to ADLS via ADF?
@SoftWizCircleАй бұрын
Yes but i guess as a source. Not as a Sink. But did not check
@bhushanthoke858Ай бұрын
Thanks for this 🙏 ❤ very informative
@SoftWizCircleАй бұрын
Glad it was helpful!
@2010saumyaАй бұрын
Theoretical....can you also have some hands on season
@AvinashKumar-ww9xzАй бұрын
through this can i connect this in my python project
Hi, I am trying to execute a bash script via Azure batch in ADF. I ma getting the error on pipeline execution "<Error> <Code>PublicAccessNotPermitted</Code> <Message>Public access is not permitted on this storage account. RequestId:7826651d-101e-0022-5ec9-bb8712000000 Time:2024-06-11T06:35:14.0952549Z</Message> </Error>". Please help.
@Sergio-eo6vd2 ай бұрын
SO HELPFUL OMG !!! THX
@SoftWizCircle2 ай бұрын
Glad it helped!
@MySaravan2 ай бұрын
Good explanation
@SoftWizCircle2 ай бұрын
Thanks
@b1trade07122 ай бұрын
is it possible to load data from multiple csv files?
@SoftWizCircle2 ай бұрын
Yes . We need to provide proper pattern in file path
@sundharjieswaran37902 ай бұрын
simple and fantastic content.🎉🎉🎉🎉
@SoftWizCircle2 ай бұрын
Glad you think so!
@Sanjayparmar-dy3dc2 ай бұрын
This is super helpful. Can you please share the bicep template?
@SoftWizCircle2 ай бұрын
Thanks and apologies for template. Traveling due to personal circumstances
@nagan31102 ай бұрын
Hi Team, Iam looking for Purview and Unity catalogue training?
@SoftWizCircle2 ай бұрын
Thanks . Not able to find time due to personal reasons
@bluedhound2 ай бұрын
Great video!! Love the enthusiasm!! :)
@SoftWizCircle2 ай бұрын
Thank you!! 😁
@polascar2 ай бұрын
nice tutorial!
@SoftWizCircle2 ай бұрын
Glad you think so!
@optimusprime2812 ай бұрын
Getting an error : You do not have permission to view this directory or page.
@SoftWizCircle2 ай бұрын
Check web config located
@deepaksenapati35572 ай бұрын
Thank you so much. This video certainly helped me understand how to write a similar code in python for v2 model functions.
@SoftWizCircle2 ай бұрын
Glad it helped!
@prathapn012 ай бұрын
rather than reading you should have explained it in detail..