No video

Feast as Feature Store in Machine Learning | Feast Live Demo | MLOps | Ashutosh Tripathi

  Рет қаралды 8,509

Ashutosh Tripathi

Ashutosh Tripathi

Күн бұрын

Feast as Feature Store in Machine Learning
How to use feast as feature store in Machine Learning?
End to end code explanation in python
Video Content:
1. Prepare Data set
2. Create a feature repo (feast init)
3. Define feature definitions
4. register and deploy the features (Feast apply)
5. Generate training data set
6. Model training
7. Prepare online feature store
8. Feature serving to model in production
notebook used: github.com/Tri...
What is Feature Store Concept Overview: • What is Feature Store ...
Connect with me:
LinkedIn: / ashutoshtripathiai
Instagram: / ashutoshtripathi_ai
Twitter: / ashutosh_ai
Website: ashutoshtripat...
If you want to message me directly, then connect with me on LinkedIn and send a direct message.
#featurestore #feast #machinelearning #mlops

Пікірлер: 49
@AshutoshTripathi_AI
@AshutoshTripathi_AI 2 жыл бұрын
Quick Introduction to Experiment Tracking in Machine Learning: kzfaq.info/get/bejne/eM-FddSnlreyf3U.html
@vishnuvardhan-sp5nd
@vishnuvardhan-sp5nd 2 жыл бұрын
Thank you Ashutosh really it will help to learn Python
@AshutoshTripathi_AI
@AshutoshTripathi_AI 2 жыл бұрын
🙏
@user-lp5ev1hf1q
@user-lp5ev1hf1q 11 ай бұрын
Very informative video. Thanks you
@sivanagarajuboyina4617
@sivanagarajuboyina4617 Жыл бұрын
very thankful sir
@geetatripathi9335
@geetatripathi9335 2 жыл бұрын
veri good
@geetatripathi9335
@geetatripathi9335 2 жыл бұрын
very good
@vashudevsingh
@vashudevsingh 2 жыл бұрын
Good Bro Keep it up
@AshutoshTripathi_AI
@AshutoshTripathi_AI 2 жыл бұрын
Thanks bro 😁
@TanankiRohit
@TanankiRohit 2 ай бұрын
Few more vedios end to end with feast . Like building recommendation system
@arunr2265
@arunr2265 Жыл бұрын
one question Ashutosh. What will happen if the data is not in the feature store. new data comes from prediction , how will it work. Btw excellent explanation
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
Hi Arun, even if data is coming from another prediction model then also it has to pass through the feature store. In that way it will be ensured that new data is in sync with training data else you have to write separate functions to validate it. So the thing is there are various ways to achieve things depends what fits to us. Also feature store serve data with low latency so if your old prediction model is deployed in other server and target model is deployed elsewhere then latency will be high and in that case you can utilise feature store online serving functionality. I am not saying it is a must but yes if you have a feature store then it comes with a lot of advantages which I have mentioned however you can read it in their official documents itself. Hope it is clear. If not please don't hesitate to ask again. Thanks
@arunr2265
@arunr2265 Жыл бұрын
Thanks Ashutosh. i have one more question. For example while serving a model, we receive an inference request with some details (an id ) which is not available in the feature store, how will it be handled. So feature store can be only used for usecases where the features are available for both training and serving.
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
@@arunr2265 so in that case feature store will return empty record now it is upto us like how we handle this. We can apply a no record found check just before serving api. Ideally the ID is created only after record is generated and then it will be pushed to feature store and then served to api. So no point of ID doesnt exist. But I agree due to human error or other reasons if record does not exist then we have write this check explicitly as for as I know.
@arunr2265
@arunr2265 Жыл бұрын
Thanks Ashutosh, so there might be scenarios where feature store can be used only for training?
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
@@arunr2265 it does not make much sense to use it only for training. Because one of the main reasons to use a feature store is to have sync between training and serving data. Just read the advantages of the feature store then it will be clear.
@erenyeager41
@erenyeager41 Жыл бұрын
Thanks for an amazing video Ashutosh! Now that the feature store is made, how do I connect this to a MLops platform like Kubeflow?
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
We already talked regarding this.
@sohildoshi2655
@sohildoshi2655 6 ай бұрын
i ran pip install feast it got installed but when Im trying to check it using feast version command it is giving error of No module named fcntl, and pip install fcntl is not working i tried everything available on google still not able to run feast commands on windows
@chravi511
@chravi511 Жыл бұрын
Hi Ashutosh, During the execution of get_historical_features to generate training data, I've come across an error : Feast_entity_df _..... does not exist (basically it searches for runtime generated entity dataframe in the offline storage configured in yml file )
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
Just run the command `feast feature-views list` and see if feature view exist and in feature definition py file check if you have created the entity df or not. This seems error in your feature def py file.
@sodiqrafiu9072
@sodiqrafiu9072 Жыл бұрын
Can we get more end-to-end finance and marketing business problems solved, please?
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
If you are looking for any specific one, then please mention I will try to cover that in upcoming videos. Thanks
@sodiqrafiu9072
@sodiqrafiu9072 Жыл бұрын
@@AshutoshTripathi_AI Credit card fraud and customer lifetime values cluster
@erenyeager41
@erenyeager41 Жыл бұрын
Could you create a video to show us how to Deploy a feast store on Kubeflow both with an online and an offline store
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
It requires a good amount of work from some devops engineer. Because along with integrating a feast with kubeflow you have to setup backend offline and online databases. You can refer kubeflow documents where they have mentioned how to integrate third party tools like feast. But if you just want to test out certain things you simply open notebook from kubeflow and do pip install feast. It will install within notebook env. Then run feast init. This will initialize a repository with default configuration which will have file as a offline db. And there only you can configure connection string if you want to use the redis as online store. After that you can follow my video to use feast as feature store.
@erenyeager41
@erenyeager41 Жыл бұрын
@@AshutoshTripathi_AI I have sent you an email via your website can we please get in touch. Any sort of help from you would be greatly appreciated. I'm actually trying to implement this for my company
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
@@erenyeager41 replied to your email.
@13Keerthana
@13Keerthana Жыл бұрын
Hi Ashutosh, I am getting the below error while registering the features(feast apply) File "C:\Users\abcd\Documents\feast\Feast Live Demo\feature_repo\feature_repo\feature_definition.py", line 11, in democlient = Entity(name = "demo_id",value_type = ValueType.Int64,description = "ID") File "C:\Users\abcd\Anaconda3\lib\enum.py", line 429, in __getattr__ raise AttributeError(name) from None AttributeError: Int64 I have been debugging it for long, didn't get a solution for this. Can you pls help
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
Could you please share your feature def python file. It seems some problem there. You can share directly in LinkedIn msg.
@13Keerthana
@13Keerthana Жыл бұрын
@@AshutoshTripathi_AI i am not able to reply through linkdin as i dont have premium subscription
@13Keerthana
@13Keerthana Жыл бұрын
@@AshutoshTripathi_AI Do you have any alternate contact(email id) through which I can send
@lenovak3note366
@lenovak3note366 Жыл бұрын
Can you make a video how to install feast in anaconda promt
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
Ok. Will create one.
@user-sg6bx3sc2l
@user-sg6bx3sc2l Жыл бұрын
Hello Ashutosh, I have a issue while retrieving the data, after running "feature_ref=feature_store.get_historical_features(features=feature_service, entity_df= entity_df ).to_df()" the execution fails and I get an the output as "Killed" on my terminal. My RAM (20 GB) was getting consumed to the fullest and the execution was getting failed. Can you please help me with this issue?
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
What is the size of data you are trying to load using feature store?
@user-sg6bx3sc2l
@user-sg6bx3sc2l Жыл бұрын
@@AshutoshTripathi_AI The size of the data is less than 5 mb, but I resolved it. It did not pass the entity_df correctly.
@user-sg6bx3sc2l
@user-sg6bx3sc2l Жыл бұрын
But now I have another problem the dataframe which is retrieved using the .to_df() method is empty. Any support on this.
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
@@user-sg6bx3sc2l is this happening after materialize. It means there is no data present in ur online store. Just increase the TTL entry or increase the duration of start and end date during materialize
@user-sg6bx3sc2l
@user-sg6bx3sc2l Жыл бұрын
@@AshutoshTripathi_AI Is it compulsory to materialize even if I am using a offline feature store?
@arpitsingh8721
@arpitsingh8721 Жыл бұрын
How to deploy this model as api which is using feature store
@AshutoshTripathi_AI
@AshutoshTripathi_AI Жыл бұрын
For that you need to utilise feast api for data serving. For example get data from online store and during this time your online store should be active means deployed pod should be up.
娜美这是在浪费食物 #路飞#海贼王
00:20
路飞与唐舞桐
Рет қаралды 6 МЛН
ML System Design: Feature Store
31:36
Applied AI Course
Рет қаралды 31 М.
Rethinking Feature Stores
27:14
Databricks
Рет қаралды 11 М.