Google Cloud Scheduler - Calling Cloud Function

  Рет қаралды 35,854

Cloud Advocate

Cloud Advocate

4 жыл бұрын

In this video, you will learn how to call cloud function from Google cloud scheduler securely using OIDC token. This applies for even app-engine HTTP endpoint.
github.com/cloudadvocate/goog...
----------
- Questions? Thoughts? Disagreements? Tell us here in the comments.
----------
- PLEASE SUBSCRIBE! / @cloudadvocate
Oh and follow me!
Facebook: / multicloudguy
Twitter: / multicloudguy

Пікірлер: 80
@joazes
@joazes 3 жыл бұрын
thank you @Cloud Advocate, It was very util for me!!!
@bbss9295
@bbss9295 2 жыл бұрын
Thanks. You have greatly explained it.
@user-ps5wd1do2s
@user-ps5wd1do2s 5 ай бұрын
Thank you! Really helpful
@samyeung122
@samyeung122 6 ай бұрын
excellent tutorial! many thanks!
@p2p945
@p2p945 Жыл бұрын
thank you so much for saving my day
@bharathkumarreddy2834
@bharathkumarreddy2834 3 жыл бұрын
Great one ...it helped me a lot
@naraharisettysai5059
@naraharisettysai5059 3 жыл бұрын
Superb video ...very informative.
@eltirad0
@eltirad0 3 жыл бұрын
Hi my friend, do you know how to run an existing Cloud Scheduler Job, from Golang or NodeJS ( any client library ), and that the body can be dinamic? so I can send different payload with different params to the Job and the job send the body to the function.
@ChrisRestrepo
@ChrisRestrepo 2 жыл бұрын
Genial gracias bro
@foodyfriends5835
@foodyfriends5835 3 жыл бұрын
Using cloud functions and python I created a file and trying to write it to GCS. The function is ending successful but the file is not created in the bucket. Can you please help?
@chanduyara
@chanduyara 2 жыл бұрын
Hi Pablo..I need help. I have multiple csv file in a gcp bucket and I have to archive this to another folder of same bucket. How I can do this by python in gcp. How I will define all file in blob name. Any help is appreciated.
@aravindhanpoopathy6862
@aravindhanpoopathy6862 3 жыл бұрын
Hi, very informative. how does automating/scheduling the switching ON n OFF process of an instance work?
@CloudAdvocate
@CloudAdvocate 3 жыл бұрын
You have to write the logic in compute and trigger that from scheduler.
@pablogaona7680
@pablogaona7680 3 жыл бұрын
Hi Sir, this is a great video, thanks for the info but i would like to know how could i do the same script but the destination bucket is in another project. Thanks you a lot!
@asimpleton135
@asimpleton135 6 ай бұрын
Is it possible to create a google cloud function using the REST API, without having to manually click through each interface each time you want to create a CRON?
@rajatsudan960
@rajatsudan960 3 жыл бұрын
This is really helpful video but in my scenario the scheduling is done from a frontend application. Basically this is an old application which was using Quartz scheduler and now we are migrating to Cloud, so was thinking of using Cloud scheduler. But the data/ scheduling information is maintained from front end for Quartz, now how do i do that in case of Cloud scheduler ?
@CloudAdvocate
@CloudAdvocate 3 жыл бұрын
Hi Rajat, I am not sure about Quartz, but you might have to migrate the scheduling part to cloud scheduler and re-write each one of them in CF or somewhere in cloud to call as an API. Or you can first write scheduling functions to CF as a first stage and then call via API using Quartz. Again, I am not sure ...pure speculation :D
@mrreddy82
@mrreddy82 4 жыл бұрын
is there a way to perform incremental load (GCP bucket to BQ) using Dataprep and data flow, please help
@CloudAdvocate
@CloudAdvocate 4 жыл бұрын
cloud.google.com/solutions/streaming-data-from-cloud-storage-into-bigquery-using-cloud-functions this should work for you.
@leelagcpg8258
@leelagcpg8258 2 жыл бұрын
Thank you GK, it's Awesome. Do you have any similar demonstration to trigger the Batch Jobs in GCP Data Flow.
@yashdeepkumar2495
@yashdeepkumar2495 Жыл бұрын
Hello @LeelaGCP have you found a solution to your question. I too want to know how to do it
@athirababu2140
@athirababu2140 3 жыл бұрын
I have a doubt. How to implement 2 functions together ? What will be the function name ?
@yashthaker6726
@yashthaker6726 4 жыл бұрын
Please suggest any complete course for GCP Associate Prep
3 жыл бұрын
thank you @Cloud Advocate, one question , what is the trigger for function ? min 3:40 .
@CloudAdvocate
@CloudAdvocate 3 жыл бұрын
HTTP end point.
3 жыл бұрын
@@CloudAdvocate Thanks its working perfect
@cleberfeitosa7954
@cleberfeitosa7954 2 жыл бұрын
Thanks a lot for the video. I'm trying to schedule a colab execution daily, is that possible?
@tejasakadkar4554
@tejasakadkar4554 2 жыл бұрын
How to install python libraries like pandas , google-bigquery etc for cloud function?
@vigneshgnanasekaran5482
@vigneshgnanasekaran5482 3 жыл бұрын
Hi, I tried to deploy the function with the code you have provided but I got error
@atulkumar9593
@atulkumar9593 4 жыл бұрын
How Can I connect with you? I've some sort of queries and doubts. Because I just want to switch my profile. I'm having around 5-year of experience as a developer. So which one I've to choose b/w these step by step.
@CloudAdvocate
@CloudAdvocate 4 жыл бұрын
Hi Atul, You can check my connectivity details on about section of KZfaq channel.
@subrahmanyamchari750
@subrahmanyamchari750 3 жыл бұрын
Hey, Great Video. Could you post a video for the Jenkins CI-Cd pipeline with GCP?
@CloudAdvocate
@CloudAdvocate 3 жыл бұрын
Will do !! thank you.
@sireeshapulipati1179
@sireeshapulipati1179 4 жыл бұрын
Does just having cloud function invoke role is enough? It still doesn't work for me. Which account does the function run as?
@CloudAdvocate
@CloudAdvocate 4 жыл бұрын
What error do you see in logs?
@sireeshapulipati1179
@sireeshapulipati1179 4 жыл бұрын
@@CloudAdvocate UNAUTHENTICATED
@sireeshapulipati1179
@sireeshapulipati1179 4 жыл бұрын
Do the App Engine and Cloud Function need to be in the same region for this to work?
@CloudAdvocate
@CloudAdvocate 4 жыл бұрын
I haven't done anything special besides whah I have shown. Let me try it out again and see if I can reproduce. Meanwhile you can also create a support chat and ask them.
@sireeshapulipati1179
@sireeshapulipati1179 4 жыл бұрын
@@CloudAdvocate oh ok. Can you check if your App Engine region? Also can you tell me which account the cloud function is running under and what permissions it has?
@mindfulshreya
@mindfulshreya 4 жыл бұрын
Please tell the required certifications and languages to switch from software development to cloud engineering.
@CloudAdvocate
@CloudAdvocate 4 жыл бұрын
You don't need certifications to learn cloud. Try to start with basics of cloud computing and then get cloud certification of your choice.
@pingster
@pingster 3 жыл бұрын
slick
@derekmcdonald2168
@derekmcdonald2168 3 жыл бұрын
I’ve been getting that error about permission and could not figure it out! THANK YOU
@feihcsim7045
@feihcsim7045 3 жыл бұрын
i love you
@foodyfriends5835
@foodyfriends5835 4 жыл бұрын
I has some code which uses the google cloud, storage module it gave me error in cloud functions the module was not there. Can you help me with the process the get this in cloud functions to run my code successfully
@CloudAdvocate
@CloudAdvocate 4 жыл бұрын
Make sure you put the module in requirements.txt
@foodyfriends5835
@foodyfriends5835 4 жыл бұрын
@@CloudAdvocate just the module name will do right?
@CloudAdvocate
@CloudAdvocate 4 жыл бұрын
cloud.google.com/functions/docs/writing/specifying-dependencies-python
@Thrissur2022
@Thrissur2022 3 жыл бұрын
Hi brother....ur videos are short n crisp.....still i am having so much of doubts....is it possible i can talk to you .??
@dailyIndiavlogs
@dailyIndiavlogs Жыл бұрын
How can schedule based on success of other jobs?
@rrrfamilyrashriderockers6891
@rrrfamilyrashriderockers6891 Жыл бұрын
Can you please upload cloud function that triggers cloud storage and use cloud schedule for run
@antoniotorres8265
@antoniotorres8265 4 жыл бұрын
Hello, how send POST with Headers in cloud scheduler?? pls help
@CloudAdvocate
@CloudAdvocate 4 жыл бұрын
Very good question Antonio, I found a good article stackoverflow.com/questions/53181297/verify-http-request-from-google-cloud-scheduler
4 жыл бұрын
I have a script in node js, the script get some informations from google api, and then change my channel description for example, every minute. How can I use that on google cloud? I'm rly noob :c
@CloudAdvocate
@CloudAdvocate 4 жыл бұрын
The flow would be similar as what's described in the video. You would create cloud function (node js) and call the gcp api. Schedule it run every min in the scheduler.
4 жыл бұрын
@@CloudAdvocate but how can I import library that I need to run my script if doesn't have a console on cloud functions to install the dependences?
@CloudAdvocate
@CloudAdvocate 4 жыл бұрын
In requirements cloud.google.com/functions/docs/quickstart-nodejs
4 жыл бұрын
@@CloudAdvocate bit other librarys, like Google api, etc, How can I install the repository?
@CloudAdvocate
@CloudAdvocate 4 жыл бұрын
cloud.google.com/functions/docs/writing/specifying-dependencies-nodejs its documented here to install npm modules.
@atanughosh6473
@atanughosh6473 4 жыл бұрын
I am getting the following error while trying to access the google.cloud. ImportError: cannot import name 'storage' from 'google.cloud' (unknown location) Any suggestion on how to load it first?
@CloudAdvocate
@CloudAdvocate 4 жыл бұрын
Are you getting this in cloud function?
@atanughosh6473
@atanughosh6473 4 жыл бұрын
@@CloudAdvocate yes. But i figured out the issue .The Google.cloud module need to go in requirement.txt .One separate question.Is there a way to acess /tmp path in cloud function
@CloudAdvocate
@CloudAdvocate 4 жыл бұрын
I don't think you can. I have never tried though.
@haraldschubert1570
@haraldschubert1570 Жыл бұрын
Awesome video. After I did everything in the video it still gives me an error. It runs the code but it shows error??
@Oh_Rio
@Oh_Rio 3 жыл бұрын
Hi, very informative video. Is it possible to Enable and Disable App Engine using cloud scheduler ? Thanks in advance.
@CloudAdvocate
@CloudAdvocate 3 жыл бұрын
I would use cloud function to do that and schedule using scheduler.
@saravananmaruthanayakam9441
@saravananmaruthanayakam9441 3 жыл бұрын
Good one. How can we expose this http cloud function to public with the authentication?
@CloudAdvocate
@CloudAdvocate 3 жыл бұрын
With Service account credentials or best usng api gateway
@EduardoMartinez-le8me
@EduardoMartinez-le8me 3 жыл бұрын
Hello, thanks for this video, excellent job, but i have a question...what version python you used?
@CloudAdvocate
@CloudAdvocate 3 жыл бұрын
I guess I used python 3.6
@georgesmyth1247
@georgesmyth1247 4 жыл бұрын
I love this company but don't have enough money to invest into it at this point in time my credit cards have going on burned-out soul I have to get back to them sooner or later having problems on the internet as as assets
@CloudAdvocate
@CloudAdvocate 4 жыл бұрын
You get 300$ credits from Google.
@krishnacomplexion194
@krishnacomplexion194 3 жыл бұрын
Hi, Thanks for the video, it's very helpful. I'm getting below error - whilst trying to create the cloud_function - Please help me to debug it Deployment failure: Function failed on loading user code. This is likely due to a bug in the user code. Error message: Code in file main.py can't be loaded. Detailed stack trace: Traceback (most recent call last): File "/env/local/lib/python3.7/site-packages/google/cloud/functions/worker_v2.py", line 359, in check_or_load_user_function _function_handler.load_user_function() File "/env/local/lib/python3.7/site-packages/google/cloud/functions/worker_v2.py", line 236, in load_user_function spec.loader.exec_module(main_module) File "", line 728, in exec_module File "", line 219, in _call_with_frames_removed File "/user_code/main.py", line 2, in from google.cloud import storage ImportError: cannot import name 'storage' from 'google.cloud' (unknown location) Many Thanks !
@CloudAdvocate
@CloudAdvocate 3 жыл бұрын
Did you import the storage library in requirements.txt?
@krishnacomplexion194
@krishnacomplexion194 3 жыл бұрын
@@CloudAdvocate - No, Can you please fetch link here, steps to export . Thanks
@CloudAdvocate
@CloudAdvocate 3 жыл бұрын
Please follow the link cloud.google.com/functions/docs/writing/specifying-dependencies-python
@krishnacomplexion194
@krishnacomplexion194 3 жыл бұрын
@@CloudAdvocate Thanks
@krishnacomplexion194
@krishnacomplexion194 3 жыл бұрын
@@CloudAdvocate - Can I get the comments added in requirments.txt, like you supplied for main.py ? Somehow it's not working for me.
Google Cloud Scheduler - Calling Pub/Sub
6:16
Cloud Advocate
Рет қаралды 14 М.
Cloud Functions vs. Cloud Run
20:37
Google Cloud Tech
Рет қаралды 47 М.
ЧУТЬ НЕ УТОНУЛ #shorts
00:27
Паша Осадчий
Рет қаралды 10 МЛН
No empty
00:35
Mamasoboliha
Рет қаралды 10 МЛН
Useful gadget for styling hair 🤩💖 #gadgets #hairstyle
00:20
FLIP FLOP Hacks
Рет қаралды 10 МЛН
Introduction to Google Batch
9:51
Google Cloud Tech
Рет қаралды 15 М.
Cloud Scheduler - Time Triggers for Cloud Functions
4:53
Fireship
Рет қаралды 62 М.
5 Traits that Transform DevOps Engineers into Heroes! 🦸‍♂️💻
10:37
Google Cloud Functions - Serverless in GCP
17:52
Cloud Advocate
Рет қаралды 22 М.
Google Cloud infrastructure Manager - Managed Terraform Service
16:00
Cloud Advocate
Рет қаралды 1,7 М.
Why The Windows Phone Failed
24:08
Apple Explained
Рет қаралды 242 М.
What is IAM Policy?
4:36
Google Cloud Tech
Рет қаралды 8 М.
Это - iPhone 16!
16:29
Rozetked
Рет қаралды 419 М.
Это iPhone 16
0:52
Wylsacom
Рет қаралды 786 М.
#samsung #retrophone #nostalgia #x100
0:14
mobijunk
Рет қаралды 14 МЛН