Polars - Select Query
1:23
Ай бұрын
Polars - SQLContext
1:01
Ай бұрын
What is Streaming data ?
2:09
Жыл бұрын
Top 4 Cloud ETL Tools
5:03
2 жыл бұрын
Macros in dbt(Data Build Tool)
1:06
2 жыл бұрын
Jinja in dbt(Data Build Tool)
1:49
2 жыл бұрын
Hooks in dbt(Data Build Too
1:01
2 жыл бұрын
Seeds in dbt(Data Build Tool)
1:01
2 жыл бұрын
Snapshots in dbt(Data Build Tool)
1:37
Models in dbt(Data Build Tool)
1:02
2 жыл бұрын
What is dbt(Data Build Tool)?
1:43
2 жыл бұрын
IAM Role for AWS Glue
2:44
2 жыл бұрын
Пікірлер
@tataatreya
@tataatreya 14 күн бұрын
How to get classes ?
@rohitkesari229
@rohitkesari229 20 күн бұрын
Can we execute the complex CTE queries in polars. I'm unable to do so, if possible could you provide any example of complex query. for eg: query = """WITH sales_2017 AS ( SELECT SUM(TotalNetAmount) as TotalSales_2017 FROM salesorder WHERE EXTRACT(year FROM CAST(OrderDate AS TIMESTAMP)) = 2017 AND EXTRACT(month FROM CAST(OrderDate AS TIMESTAMP)) BETWEEN 1 AND 3 ), sales_2016 AS ( SELECT SUM(TotalNetAmount) as TotalSales_2016 FROM salesorder WHERE EXTRACT(year FROM CAST(OrderDate AS TIMESTAMP)) = 2016 AND EXTRACT(month FROM CAST(OrderDate AS TIMESTAMP)) BETWEEN 1 AND 3 ) SELECT TotalSales_2017, TotalSales_2016 FROM sales_2017 , sales_2016""" getting error : ColumnNotFoundError: TotalSales_2016
@funwithetl6085
@funwithetl6085 19 күн бұрын
You should have a join condition between you two tables
@pattapukhannaji780
@pattapukhannaji780 4 ай бұрын
Nice explanation bro
@funwithetl6085
@funwithetl6085 4 ай бұрын
Thank you
@manjulavanipayyavula1763
@manjulavanipayyavula1763 5 ай бұрын
very slow and session is sleepy
@arvindsinha1566
@arvindsinha1566 8 ай бұрын
Music is very annoying .. Looks like its DJ
@1992supergamefreak
@1992supergamefreak 8 ай бұрын
I think this process is not valid in todays date. Can anyone suggest a way to transform s3 to RDS in current scenario?
@AnandSharma-yb3cv
@AnandSharma-yb3cv 9 ай бұрын
bhai thoda zor bol le
@tulioaoki5233
@tulioaoki5233 Жыл бұрын
How do we do this with the new interface?
@rishiranjan6830
@rishiranjan6830 Жыл бұрын
How to capture the response in tkafkaoutput whether the messages are published or not?
@RoamerDipakRathod
@RoamerDipakRathod Жыл бұрын
Thoda jor se bolde bhai. Khud ko samjha raha hai ?
@aakashsingh3123
@aakashsingh3123 Жыл бұрын
When I click on the launch matillion etl it displays an error saying timed out. It doesn’t loads the page. What is the solution for it? I stuck at 6.45
@SumitJain92
@SumitJain92 9 күн бұрын
same with me.. Any solution u got?
@umapathins6701
@umapathins6701 Жыл бұрын
Hi Sir kindly advise me whether this course is covered with big queries and how to create models in dbt interfaces
@funwithetl6085
@funwithetl6085 Жыл бұрын
Hello, Yes this course covers all the modules in DBT, instead of big queries, i have used RDS PostgreSql. All the process remains same. You can enroll this course if intrested, www.udemy.com/course/dbt-cloud/?referralCode=2F049047DBF18073DD6C
@umapathins6701
@umapathins6701 Жыл бұрын
I wanted to learn dbt ...is this course covered for dbt and big query as well
@umapathins6701
@umapathins6701 Жыл бұрын
Hi kindly share your email id to get more details of the dbt
@ashutoshmishra5910
@ashutoshmishra5910 Жыл бұрын
irritating background music
@ezzerjuliuz3961
@ezzerjuliuz3961 Жыл бұрын
Hi, need your advice why the messages doesn't appear in tLogRow and tFileOutputDelimeted? What do I need to check?
@udaykumar-tb5kn
@udaykumar-tb5kn Жыл бұрын
Pls speak louder
@troymodel6677
@troymodel6677 Жыл бұрын
get rid of the horrible music. sounds like a bad porno
@dianak4635
@dianak4635 Жыл бұрын
Hi, Can you please explain how to use a while loop in dbt script to use in bigquery?
@funwithetl6085
@funwithetl6085 Жыл бұрын
Hi, You can use Jinja template and loop the data in your query
@NapoLoso
@NapoLoso Жыл бұрын
Thank you for sharing. Great video
@funwithetl6085
@funwithetl6085 Жыл бұрын
My pleasure
@binoypaul4030
@binoypaul4030 Жыл бұрын
This is an advertisement which is 1 min and 5 seconds long. It could be done in 30 seconds but the guy talks slow.
@rainbowdu509
@rainbowdu509 Жыл бұрын
thank you for advertising your course.
@ayushmangupta6986
@ayushmangupta6986 Жыл бұрын
finally, I found that t_assert..👌👌
@miranahmed1926
@miranahmed1926 Жыл бұрын
why music??? :(
@iamlegend5097
@iamlegend5097 Жыл бұрын
aa music endi rayya thala neppi dengutundi.. nuvvu nee lavadaalo music.................
@nunyo7259
@nunyo7259 Жыл бұрын
speak up!!!
@nimesh7430
@nimesh7430 Жыл бұрын
Hey man are you working previously as DJ.. as music is like I am attending any disco.... no need for this background noise... very distracting... keep it simple.
@giasamin6568
@giasamin6568 Жыл бұрын
Music is very very annoying and terribly disturbingly unnecessary. Thanks for the video!!
@rohitbhatnagar7599
@rohitbhatnagar7599 Жыл бұрын
Agreed. Loses the meaning of the training, since you can not hear and understand things. Great video !!
@rohitbhatnagar7599
@rohitbhatnagar7599 Жыл бұрын
It was great - I danced in my room and did AWS - all at the same time🤣
@saurabhpramanick2550
@saurabhpramanick2550 2 жыл бұрын
I am not able to launch the instance. Can you please assist?
@funwithetl6085
@funwithetl6085 2 жыл бұрын
What is the issue you are facing ?
@lakshmikanthan8253
@lakshmikanthan8253 2 жыл бұрын
Hi brother send me your contact number
@johngwheeler
@johngwheeler 2 жыл бұрын
Please get rid of the music - it adds nothing and is extremely distracting.
@funwithetl6085
@funwithetl6085 2 жыл бұрын
Sure, will do that
@RafaelFarias
@RafaelFarias 2 ай бұрын
@@funwithetl6085 You didn't do it. Unwatchable.
@SACHINYED
@SACHINYED 2 жыл бұрын
hello sir
@funwithetl6085
@funwithetl6085 2 жыл бұрын
Hello Akash
@SACHINYED
@SACHINYED 2 жыл бұрын
Sir I need some help can you please share your fb,insta or WhatsApp
@iamdare
@iamdare 2 жыл бұрын
Please how did you create the Oracle instance?
@funwithetl6085
@funwithetl6085 2 жыл бұрын
Hi, This is to create PostgreSql instance. You can follow same process to create Oracle. kzfaq.info/get/bejne/fJ9gadKYlZjJmoE.html
@davidgillis1233
@davidgillis1233 2 жыл бұрын
Love the music! Wish more tutorials had it
@funwithetl6085
@funwithetl6085 2 жыл бұрын
Thank you
@satyendrakumar6667
@satyendrakumar6667 2 жыл бұрын
Good Job !!
@funwithetl6085
@funwithetl6085 2 жыл бұрын
Thank you
@Naru_NNN
@Naru_NNN 2 жыл бұрын
GooD to see this usefull components vedio in your channel
@funwithetl6085
@funwithetl6085 2 жыл бұрын
Thank you
@Naru_NNN
@Naru_NNN 2 жыл бұрын
Good We except more from you bro
@funwithetl6085
@funwithetl6085 2 жыл бұрын
Thank you
@Naru_NNN
@Naru_NNN 2 жыл бұрын
Good bro Take a scenario and explain them It will very usefull for the new learners
@funwithetl6085
@funwithetl6085 2 жыл бұрын
Sure i will do that. Thanks for your kind feedback
@Naru_NNN
@Naru_NNN 2 жыл бұрын
Simple way and easy to understand Beginers Looking for more stuff from you Brother
@funwithetl6085
@funwithetl6085 2 жыл бұрын
Definitely, thanks for your feedback.
@vandanas9158
@vandanas9158 2 жыл бұрын
Can you brief me about what is the need of glue I’m new to data engineering .
@funwithetl6085
@funwithetl6085 2 жыл бұрын
Glue is one of the ETL tool for AWS. Just like Informatica, Talend ,.. Glue is also an ETL tool
@gilbertomanhaes8850
@gilbertomanhaes8850 2 жыл бұрын
Hi, thanks for the tips. Follow the steps shown in the video. However, in my case I need to write to an oracle on premises (external database). I created the jdbc connection (it works), I created the crawler pointing to S3(ok), I created the crawler pointing to oracle(ok). I created the Glue job reading from s3 and targeting oracle. However, when running the job, it generates the following error: Thread-5 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassNotFoundException: org.apache.logging.log4j.core.lookup.JndiLookup at java.net.URLClassLoader.findClass(URLClassLoader.java:382) Thread-5 INFO Log4j appears to be running in a Servlet environment, but there's no log4j-web module available. If you want better web container support, please add the log4j-web JAR to your web archive or server lib directory. how to enable log4j?
@sivasankardiwakar4167
@sivasankardiwakar4167 2 жыл бұрын
Do some more video bro DBT and snowflake
@funwithetl6085
@funwithetl6085 2 жыл бұрын
Sure. I have this Courses created in Udemy and Tutorials point. You can enroll if required. www.udemy.com/course/dbt-cloud/?referralCode=2F049047DBF18073DD6C www.tutorialspoint.com/learn-dbt-data-build-tool/index.asp
@arkadas2415
@arkadas2415 2 жыл бұрын
Jim , I am viewing ur channel now to get some idea on glue
@funwithetl6085
@funwithetl6085 2 жыл бұрын
Thanks Arka, Let me know if you have any doubts
@parantikaghosh4396
@parantikaghosh4396 2 жыл бұрын
please remove the background music
@confounded_feline
@confounded_feline 2 жыл бұрын
In your previous video you had selected the ETL role for the DB permissioning. The explanation in this requested follow-up I would've found most helpful if you demonstrated the creation and setup of the ETL role + policy. In your previous video which was great and generally very comprehensive, this was the only part which I think someone could become stuck on when following along and building this small s3-glue-rds pipeline. This video was good to show what roles where involved but still leaves the setup a mystery. it would be great if you demonstrated this. Thank you for your hard work.
@niranjanjamkhande3773
@niranjanjamkhande3773 2 жыл бұрын
Where you used classifier in crawler?
@funwithetl6085
@funwithetl6085 2 жыл бұрын
You can check the time 2:08, i have demonstrated how to use the classifier. And from 3:08 you check the demonstration of crawlers
@reausreamdays4910
@reausreamdays4910 2 жыл бұрын
very good of work! would u mind if I send questions?
@funwithetl6085
@funwithetl6085 2 жыл бұрын
Thank you. Kindly send out your questions/doubts. Am pleased to help you
@ravikumareddem4705
@ravikumareddem4705 2 жыл бұрын
Nice ..but background music its getting disturbance
@abdullahsiddique7787
@abdullahsiddique7787 2 жыл бұрын
if we learn dbt do we need to still learn other ETL tools like matillion etc
@funwithetl6085
@funwithetl6085 2 жыл бұрын
Yes it is a good approach to learn any ETL tool. DBT performs transformation alone. In case of extract and load, you have to be with good understanding of any etl tool.
@abdullahsiddique7787
@abdullahsiddique7787 2 жыл бұрын
@@funwithetl6085 ok thank u
@abdullahsiddique7787
@abdullahsiddique7787 2 жыл бұрын
@@funwithetl6085 which ETL tool do u recommend is matillion good ?
@funwithetl6085
@funwithetl6085 2 жыл бұрын
@@abdullahsiddique7787 Matillion is a good tool. You can also try talend or informatica which will give you detailed understanding of ETL
@prakashnt7014
@prakashnt7014 2 жыл бұрын
thanks brother great video, can we use same technique to load data from s3 to redshift
@funwithetl6085
@funwithetl6085 2 жыл бұрын
Yes you can load from S3 to RedShift. You go through this documentation. help.talend.com/r/OHwQvD9ynJK6fgSUqgOHKQ/rs4BuEsLqoNyZ32QA6uprQ