Using AI to build a Pokédex for Food

Рет қаралды 9,142

Күн бұрын

Nutrify allows you to take a photo of food and learn about it. Consider it a Pokédex for food or Shazam for food.
Download Nutrify on the App Store - apple.co/4ahM7Wc
Nutrify website - www.nutrify.app
Nutrify Instagram - / nutrifyfoodapp
Questions? - support@nutrify.app
Other links:
Learn AI/ML (beginner-friendly course) - dbourke.link/ZTMMLcourse
Learn TensorFlow - dbourke.link/ZTMTFcourse
Learn PyTorch - dbourke.link/ZTMPyTorch
AI/ML courses/books I recommend - www.mrdbourke.com/ml-resources/
Read my novel Charlie Walks - www.charliewalks.com
Connect elsewhere:
Web - dbourke.link/web
Twitter - / mrdbourke
Twitch - / mrdbourke
ArXiv channel (past streams) - dbourke.link/archive-channel
Get email updates on my work - dbourke.link/newsletter
Timestamps:
0:00 - Intro
0:37 - How it started
2:34 - How it's going
3:09 - Nutrify philosophy
4:08 - Create a visual food diary
4:42 - Fill out the Nutridex
6:20 - Get stats over time
6:52 - Where it's going
8:13 - Outro
#nutrify #nutrition #machinelearning #ai

Пікірлер: 103

@mrdbourke 5 ай бұрын

What foods would you like to see in Nutrify?! Let us know in the comments! Also, if you have any questions feel free to ask and Josh and I will answer as best we can!

@vizualyse 5 ай бұрын

This is the working "See Food" app from the TV Show, Silicon Valley! Awesome work fellas!

@mrdbourke 5 ай бұрын

Hahahah yes yes yes, it sure is! It even does Hot Dogs too! 🌭📸

@abhishekshandilya5644 5 ай бұрын

Makes me so happy, daniel. You’ve always been so helpful & my go-to guy for ML stuff (my first starred repo of gh was pytorch for deep learning). This demo was amazing. Nutrify’s been such a central part of your work for so long. Finally it’s here. Going to go try it right now! Congratulations! Love you, man

@ranieratemoni 5 ай бұрын

Congratulations Daniel and Josh! It's so great to see the "fruits" of your labour! I have enjoyed following your journey and wishing you great success.

@mrdbourke 5 ай бұрын

Thank you thank you! We really appreciate it!

@vaibhavrana 5 ай бұрын

Congrats Daniel! Been learning through your bootcamp and Pytorch courses and it's so cool to see this finally come out!

@mrdbourke 5 ай бұрын

Thank you! It's finally out!! Keep machine learning legend!

@Zoe-eu7si 5 ай бұрын

How awesome it is to see this come to life. Poured your heart and soul into this and it’s so damn good. Proud of you both!!! 👌🏼🍍

@mrdbourke 5 ай бұрын

Thank you thank you thank you!

@ibrahimadiallo7444 5 ай бұрын

😂😂 Daniel, this is awesome!! Congratulations to you and your brother. I've been watching your journey for nearly 4 years now. I'm ecstatic about Nutrify. Well done!

@mrdbourke 5 ай бұрын

Thank you so much for the support brother! We really appreciate it!

@shi_503 Ай бұрын

Exciting to seeing more people work in this space! Can't wait to check it out.

@manifestasisanubari 5 ай бұрын

Great work! Been following you since Learn PyTorch in a day video and waiting for this app progress. Bananas to both of you!!! 💖

@mrdbourke 5 ай бұрын

Thank you legend! Bananas and pineapples to you to! 🍍🍌

@levelup2014 5 ай бұрын

Wow you really built it I remember talking to you about your project on Twitter during its early days, love to see the follow through will definitely check it out!

@mrdbourke 5 ай бұрын

The follow through took a little while! But it's here!

@petea3471 Ай бұрын

Fantastic work lads! This is a great journey well documented!

@misterzurg7874 5 ай бұрын

Hey Daniel, congrats! 🎉🎉🎉 You've done an awesome job! Still grinding your pure gold, ml & tf & pytorch couses! Thank u!🗿

@mrdbourke 5 ай бұрын

Thank you! Glad to hear you're enjoying the ML/TF/PyTorch courses!

@mailoisback 5 ай бұрын

Great job! Congrats for releasing the app.

@mrdbourke 5 ай бұрын

Thank you!

@yogeshhasabe4931 5 ай бұрын

And yes The Nutrify Launch Day presentation was awesome 🔥

@TheBerkaay 5 ай бұрын

Congratulations Daniel! Great work

@mrdbourke 5 ай бұрын

Thank you!

@deusML 5 ай бұрын

I am currently enrolled to your deep learning course with tensorflow, but this is really inspiring work

@joaoalexdesabugelli7890 4 ай бұрын

This is one of the best demos, pitches, and product journeys I have ever seen. Nutrify seems to be a great idea, and the implementation you have done to turn this into a product was perfect. I'm looking forward to trying it out (I use Android 😅). Great job. A hug from Brazil! Keep learning, keep creating P.S.: This product has potential for Y Combinator. Are you applying for?

@dipamvasani8727 5 ай бұрын

Great job :) you are inspiring. This app along with Yuka will be really useful

@mrdbourke 5 ай бұрын

Thank you thank you! You're right! We think the same! Yuka is a phenomenal app and they do a great job of scanning different food and cosmetic products with barcodes. We fill in the gap with whole foods!

@maruthikonjeti4572 5 ай бұрын

Congratulations 👏🏻 I have been following since the idea of nurtify. It's really amazing watching you growww

@mrdbourke 5 ай бұрын

Woohooo!!! Thank you for the support brother! I really appreciate it!

@peter102 5 ай бұрын

congrats guys. really awesome product and creative idea. wishing you all the best

@mrdbourke 5 ай бұрын

Thank you so much Peter! Really appreciate it! 🍍

@AAMATE 5 ай бұрын

Mate, I'm so proud of you guys. I'm now at the point you were at in 2017, Collecting ideas and learning machine learning. wish me luck :)

@mrdbourke 5 ай бұрын

Thank you so much! And welcome to the world of machine learning my friend! It's a wild one!

@DamirbekSydykov 5 ай бұрын

Awsome, guys! Very inspiring! 🎉

@mrdbourke 5 ай бұрын

Thank you!

@Khaled_ML 5 ай бұрын

Happy to see you again bro after a long time without a video; I have been replicating your Learning Intelligence Journey;

@kevinmccallister7647 5 ай бұрын

I love the pokedex way this is being done, helping discover new foods

@yogeshhasabe4931 5 ай бұрын

Well... it was a ride full of Nostalgic moments of learning & creating 🙌 Truly loved the Nutrify App! Well done Daniel & Josh 👏 Keep Learning ~ Keep Creating has now been on a different level 😄 💯

@mrdbourke 5 ай бұрын

Thank you for the ongoing support Yogesh! You've been there since the start! Really really really appreciate it!

@yogeshhasabe4931 5 ай бұрын

@@mrdbourke 🙌🙌

@reazuldipto7338 Ай бұрын

Loving your journey

@tikkydore6973 5 ай бұрын

Congrats on your wonderful work!! I would like to know the reason why you don’t choose a Mac to train your model?

@mrdbourke 5 ай бұрын

Thank you thank you! As for Mac vs Deep Learning PC, the dedicated GPU (NVIDIA TITAN RTX) is just much faster for any kind of larger scale deep learning work.

@sohamshah1806 5 ай бұрын

What exactly is the usecase for this app tho? People wanting to log whatever they ate? Cant you do the same thing in other apps

@mrdbourke 5 ай бұрын

Yes, that's one potential use case. Another is if you wanted to teach your kids about different foods, you can encourage them to learn about foods by taking a photo of them (my friend has been teaching his 5 year old about different fruits and vegetables at the store with it). Another is to discover foods you've never tried before. Another is to see how you eat over time (other apps do this yes, however, they focus more on calories rather than specific whole foods). And more will come! But yes you're right, other apps do this and our use case is not 100% new, just a different way of approaching it - a fun way!

@SaschaRobitzki 5 ай бұрын

Downloading now!

@mrdbourke 5 ай бұрын

Woohooo!!! 🍍📸

@developerjosh 5 ай бұрын

Gosh did I have some shocking hair cuts during the development of Nutrify. 🤣

@mrdbourke 5 ай бұрын

Bring back the mullet! 🎣

@Zoe-eu7si 5 ай бұрын

I love that it’s now out for the world to see 😂

@tarandeep6861 Ай бұрын

great app we all have many good ideas but only few execute them congrats

@exvynai 5 ай бұрын

meanwhile: Jian Yang casually adds Nutrify to his whiteboard

@williambrace6885 3 күн бұрын

How does this approach compare to using an LLM with multi modal capabilities to identify the foods?

@mrdbourke Күн бұрын

Our models are much much smaller and run on-device (no inference cost/time delay when making predictions). However, they don’t have the wide range of foods as a big multi-modal LLM. But we’re working on it! We can use the combination of on-device models (small + fast + free) and multi-modal LLMs in the future.

@mohamadhasanzeinali3674 5 ай бұрын

wow, good lock bro. There is no version for android device? I see the application in google play but that was not related to you. Is that right?

@mrdbourke 5 ай бұрын

Thank you! And yes, no version for Android just yet. We're a small team (2x developers) so we had to focus on one platform for now. But we'll be looking to expand Nutrify to Android in the near future!

@mailoisback 5 ай бұрын

Btw, is it going to be available for Android?

@mrdbourke 5 ай бұрын

Yes! Eventually it will be. However, since we're 2 person developer team (for now), we chose to focus on iOS.

@Sohail30 5 ай бұрын

Woooooo🥳🥳🥳🥳 let's goooooo🔥🔥🔥

@mrdbourke 5 ай бұрын

Thank you! 🔥

@krishnakaushik4294 5 ай бұрын

Great congratulations 🎉

@mrdbourke 5 ай бұрын

Thank you!

@davepunk2077 5 ай бұрын

It"s working Daniel, I scan my mom cook green bean the apps detect "Green Bean", I scan my dog the apps detect "No Food Detected"... Niceeee😅👍

@mrdbourke 5 ай бұрын

Woohoo!!!! Glad to hear it's working in the wild!

@kingthame 5 ай бұрын

Just realized this whole app can actually catapault people into communities. Food communities.

@MadeInJack Ай бұрын

Why not just hook up GPT-4o ?

@aliyahsulaiman4695 5 ай бұрын

What you guys got against android

@mrdbourke 5 ай бұрын

Nothing against Android, just had to focus on one platform to begin with. Of course, we'd love to bring it to Android sometime soon!

@aliyahsulaiman4695 5 ай бұрын

Thanks. We android users are all waiting😁😁😁😁

@mouniaelkoraichi2502 5 ай бұрын

Android users are like 😢😢😢😢😢

@mrdbourke 5 ай бұрын

We would love to bring Nutrify to Android! With a small team we had to focus on one to begin (iOS) but it will be on Android one day!

@hemanthchowdaryd 5 ай бұрын

App is soo goooood

@mrdbourke 5 ай бұрын

Thank you thank you!

@AlexanderWinter0 5 ай бұрын

Good app.

@mrdbourke 5 ай бұрын

Thank you! We agree!

@ActiveArtify 5 ай бұрын

@mrdbourke 5 ай бұрын

Oh no! What error are you getting?

@ActiveArtify 5 ай бұрын

If I try to Sign in with Apple, I just get the checkmark but nothing is happening after and then I’m still not signed in ^^

@CreativeAiArtistry 5 ай бұрын

❤❤❤❤wow.

@vankram1552 5 ай бұрын

API when?

@mrdbourke 5 ай бұрын

good question! once we improve our models a bit more, an API could be on the cards!

@RR-et6zp 5 ай бұрын

just do kinobody

@mrdbourke 5 ай бұрын

Sensational idea!

@zhwarhiwa 5 ай бұрын

Hello Daniel , iam Zhwar I am happy that you serve human beings with artificial intelligence. I am the first level of this work. I would like to reach a high level of service to everyone with artificial intelligence. I really want to be better than you because I really like artificial intelligence and I don't want anyone who is better than me، I'm from Kurdistan the people of Kurdistan are in bad financial straits and I'm not deprived of that bad. So I want to make it my livelihood. I want to serve myself and everyone thank you very much.

@gtaonline3542 5 ай бұрын

Bring it to android

@mrdbourke 5 ай бұрын

We will!

@vankram1552 5 ай бұрын

Ok but is it a hotdog?

@mrdbourke 5 ай бұрын

hahaha, the app will tell you!

@krishnakaushik4294 5 ай бұрын

Waiting for android

@mrdbourke 5 ай бұрын

Soon!

@SnipeSniperNEW 5 ай бұрын

are you looking to hire more ML engineers ? I can work for 2.5 bananas a day

@mrdbourke 5 ай бұрын

How about 2 bananas and 1 pineapple a day??

@SnipeSniperNEW 5 ай бұрын

@@mrdbourke I'll consider it with my dietitian

@Bozo--- 25 күн бұрын

Awesome app but not on android, what a shame, who buys an iphone in 2024 ??!!

@solidname9085 5 ай бұрын

Useless app, because google lens does it better . And still not a day to day app, a very rare use app....

@mrdbourke 5 ай бұрын

You're so right! Google Lens does do a fair few more foods than Nutrify, however, I'd argue our vision models are better for every day usage of foods. Plus, I personally use Nutrify every day. So not rare use for some ;)

@solidname9085 5 ай бұрын

@@mrdbourke then it is ok,👍🏻

@marcorossi2268 Ай бұрын

I am sorry to be so direct but your app is totally trash. It fails to identify basic food. It doesnt allow the users to submit new foods. It lacks of any useful feature apart from food image recognition

@mrdbourke Ай бұрын

Which "basic food" does it fail to identify? And it does allow submission of new foods. But you're right this could be better. We'll work on that. If you have any more useful criticism, happy to hear it.