Model Serving using MLFlow Model Registry | MLFlow 2.0.1 | Live Demo | Part 2 | Ashutosh Tripathi

  Рет қаралды 11,023

Ashutosh Tripathi

Ashutosh Tripathi

Жыл бұрын

Model Serving using MLFlow Model Registry | MLFlow 2.0.1 | Live Demo | Part 2 | Ashutosh Tripathi
Topics Covered:
1. Experiment Tracking Recap
2. Different methods to register ML model in MLFlow Model Registry
3. Transition Model stage : None(default), Staging, Production or Archived
4. Load Model from MLflow Registry and do Prediction
5. Model Serving - Serving an ML Model from MLFlow Model Registry by creating REST end points
If you find this video helpful, don't forget to like share and subscribe.
Part 1: Experiment Tracking using MLFlow
• Experiment Tracking Us...
Notebook link: github.com/TripathiAshutosh/m...
Connect with me:
LinkedIn: / ashutoshtripathiai
Instagram: / ashutoshtripathi_ai
Twitter: / ashutosh_ai
Website: ashutoshtripathi.com
If you want to message me directly, then connect with me on LinkedIn and send a DM.
#machinelearning #modelserving

Пікірлер: 53
@sawanrawat5489
@sawanrawat5489 5 ай бұрын
thankyou thankyou , thankyou very much dear ashutosh , i have wasted literally 1 year just to finding a good online course to learn about mlops , i have seen your playlist as a suggestion mannier time in past months but ignored beacuse of less number of views , but the end when i was frustated i dont know how i opened your playlist , and from that day im gladdd!!!! , thankyou brother
@AshutoshTripathi_AI
@AshutoshTripathi_AI 5 ай бұрын
Glad to hear that you liked the content.
@ishanmodi3583
@ishanmodi3583 10 ай бұрын
very well planned content ashutosh, really appreciate your efforts 👍
@hEmZoRz
@hEmZoRz Жыл бұрын
This was a fantastic tutorial! Thanks for taking the time to make such high-quality content.
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
Thank you.
@deepaksingh9318
@deepaksingh9318 10 ай бұрын
Very well explained.. please upload more to the series.. :)
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
Part 1: experiment tracking using MLFlow: kzfaq.info/get/bejne/qJaUopR8u6uroYE.html
@niteshsharma4128
@niteshsharma4128 Жыл бұрын
Awesome
@AdandKidda
@AdandKidda Жыл бұрын
ashutosh, u created well organized content, really helpful for complete understanding of mlflow. ultimate explanation. thanks :). keep it up.
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
Thank you @chaloghumne8632
@BIZSURESH
@BIZSURESH Жыл бұрын
Excellent Ashutosh....very detail presentation makes easy to understand the mlflow.....thanks for the detail explanation ashutosh....🙌🙌🙌🙌🙌🙏🙏🙏🙏
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
Glad to hear 🙏
@user-cy3dg4ev6i
@user-cy3dg4ev6i 5 ай бұрын
very excellent explanation Bro,i got some good knowledge after watching your videos' Thx a lot for your efforts
@AshutoshTripathi_AI
@AshutoshTripathi_AI 5 ай бұрын
Thank you Dost 🙏
@aditya_01
@aditya_01 Жыл бұрын
great video and playlist pls keep uploading
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
Thanks.
@yannawutkimnaruk7189
@yannawutkimnaruk7189 Жыл бұрын
Great tutorial. Thank you for sharing.
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
You are welcome
@mastersandy9
@mastersandy9 Жыл бұрын
Super tutorials on ML Flow...keep it up buddy on these topics
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
Thank you Sandeep.
@kumji1922
@kumji1922 Жыл бұрын
excellent material for beginners
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
Thanks
@chiragchauhan8429
@chiragchauhan8429 Жыл бұрын
After going through so many tutorials I found your tutorial to be clear and on point. Amazing tutorial. Can you make a video on docker and mlflow?
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
Actually docker and MLFlow solve two different purposes. Could you please let me know what exactly u would be interested to see in the video.
@vishalwaghmare3130
@vishalwaghmare3130 Жыл бұрын
This is so amazing Channel ❣️🙌🙌
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
Thanks Man.
@atulanand4824
@atulanand4824 9 ай бұрын
Fantastic tutorial, just one more request, can you please make a playlist for PySpark for Data Science, much needed sir
@AshutoshTripathi_AI
@AshutoshTripathi_AI 9 ай бұрын
Sure.
@overmarc86
@overmarc86 Жыл бұрын
Very nice video and I appreciate your effort. One thing happened with me while trying to serve an LSTM model using TensorFlow. There is always an error because of the data shape and data type?
@geetatripathi9335
@geetatripathi9335 Жыл бұрын
Good
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
🙏🙏
@sokhibtukhtaev9693
@sokhibtukhtaev9693 3 ай бұрын
at 30:12, you get the Run ID from an already exisitng source. I'm doing the same but having an error: RestException: INVALID_PARAMETER_VALUE: Invalid model version source: '67fd8db1a7be49fd9badace4b3a0a6e8\artifacts\model'. To use a local path as a model version source, the run_id request parameter has to be specified and the local path has to be contained within the artifact directory of the run specified by the run_id.
@basi6621
@basi6621 Жыл бұрын
thanks.. it's helpful.. in 40:11 you activated the serve the model to production. but what if you want to change the version? should you stop the serving or change anything or just update the model version by using this py? thank you
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
When we are serving then either we are serving a particular version of the model or the model with a particular stage that is staging or production. And see while serving we either define model url with modelname/version or modelname/stage so in case of version change you have to restart the serving. However if you opt CI/CD then this can be achieved automatically with little to negligible downtime. But I would suggest to try out these things by changing version, stages and see if you need to restart the serving or it works as it is. Then it will be more clear. Thank you
@basi6621
@basi6621 Жыл бұрын
@@AshutoshTripathi_AI thank you for explain it well.! hope the best for you
@stevenpais5174
@stevenpais5174 Жыл бұрын
Hi Ashutosh - Can you please share Model serving notebook. Your videos are very helpful. Please do upload code to github and share link soon.
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
Hi Steven, Glad you liked it. please find below the link to notebook: github.com/TripathiAshutosh/mlflow/blob/main/MLFlow%20Model%20Serving%20Live%20Demo.ipynb
@mehul4mak
@mehul4mak Жыл бұрын
How come you are getting string as prediction and model do not throws any error for ordinal encoding?
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
do you mean string classes as model prediction output? This is normal behavior isn't it? may be I am not understanding your query, could you please explain what is your doubt.
@sairamadithya9650
@sairamadithya9650 Жыл бұрын
hi ashuthosh. Great videos, by the way whats the main purpose of serving a model?
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
Model serving APIs prediction output could be consumed within third party applications.
@sairamadithya9650
@sairamadithya9650 Жыл бұрын
@@AshutoshTripathi_AI so can i combine mlflow with streamlit...because i have worked on web app development using streamlit
@harishs-dm8mm
@harishs-dm8mm Жыл бұрын
could u make a video on docker w.r.t Machine learning
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
Sure. You will get one video on this soon. Just hit the bell 🔔 icon to get notified.
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
Hi Harish, this video is uploaded. You can watch it. ML model deployment using docker container: kzfaq.info/get/bejne/htRnZsx80qqXc6s.html
@Sandesh.Deshmukh
@Sandesh.Deshmukh 7 ай бұрын
Hi Ashutosh, As we are using sqlite as Database, Can you please explain it in detail? How can we do that?
@AshutoshTripathi_AI
@AshutoshTripathi_AI 7 ай бұрын
I think I have already explained this. Please let me know what is your question specifically
@Sandesh.Deshmukh
@Sandesh.Deshmukh 7 ай бұрын
@@AshutoshTripathi_AI How to setup sqlite for this?
@saikiran-mi3jc
@saikiran-mi3jc 6 ай бұрын
may i know how to do model serving for multiple models please thanks in advance
@AshutoshTripathi_AI
@AshutoshTripathi_AI 6 ай бұрын
You can register each model individually on mlflow and then create a serving url for each of the models. Later can consume that url in any of the third party applications.
@saikiran-mi3jc
@saikiran-mi3jc 6 ай бұрын
Okay thanks @AshutoshTripathi_AI
@s.seducation3888
@s.seducation3888 Жыл бұрын
Can you show the same thing which is model serving part for CNN, Image classification import requests import numpy as np import mlflow,os, cv2 IMAGE_SIZE=120 new_prediction, img_data=[],[] NEW_TEST_DIRECTORY= 'new_prediction_data' #it has cat and dog mixed images for predictions for img in os.listdir(NEW_TEST_DIRECTORY): img_path=os.path.join(NEW_TEST_DIRECTORY,img) img_data.append(img) img_arr=cv2.imread(img_path) img_arr=cv2.resize(img_arr,(IMAGE_SIZE, IMAGE_SIZE)) new_prediction.append(img_arr) new_prediction=np.array(new_prediction) new_prediction=new_prediction/255 # Prepare inference request inference_request = { "data": new_prediction.tolist() } endpoint = "localhost:1234/invocations" response = requests.post(endpoint,data=inference_request,headers={"Content-Type": "application/json"}) predictions=np.argmax(np.array(response.json()),axis=1) print(predictions) for me its showing error can you fix this then it will be great help
Data Cleaning in Pandas | Python Pandas Tutorials
38:37
Alex The Analyst
Рет қаралды 267 М.
How Many Balloons Does It Take To Fly?
00:18
MrBeast
Рет қаралды 142 МЛН
I Can't Believe We Did This...
00:38
Stokes Twins
Рет қаралды 110 МЛН
Дарю Самокат Скейтеру !
00:42
Vlad Samokatchik
Рет қаралды 7 МЛН
MlOps MLflow: How to install  a Mlflow Tracking Server in docker containers
54:32
The Machine Learning Engineer
Рет қаралды 130
MLOps on Databricks: A How-To Guide
1:27:43
Databricks
Рет қаралды 54 М.
MLFlow Tutorial | Hands-on | ML Tracking and Serving
13:48
Harsh Kumar
Рет қаралды 6 М.
How Many Balloons Does It Take To Fly?
00:18
MrBeast
Рет қаралды 142 МЛН