How to Run LLaMA 70B on Your LOCAL PC with Petals
Рет қаралды 8,421
Күн бұрынUnlock the power of AI on your local PC 💻 with LLaMA 70B V2 and Petals - your ticket to democratized AI research! 🚀🤖
Notebook: colab.research.google.com/dri...
🚀Custom AI Solutions: www.vrsen.ai/
🤝Need help with your next AI project? calendly.com/vrsen/ai-project...
🐦Twitter: / __vrsen__
Intro 00:00
Petals: The Torrent of AI Research 01:06
Tutorial: Running LLaMA 70b Locally 02:51
Conclusion 04:36
About: Learn how to run LLaMA 70B V2 on your local PC using Petals, a platform that democratizes AI research by utilizing a distributed system. This video provides a detailed tutorial on how to reduce the memory consumption of your GPU, and make use of AI advancements without needing high-end computational resources. Understand the underlying concepts, security aspects, and potential future of Petals and AI research. A must-watch for AI enthusiasts, researchers, and developers with limited resources.
@nanukaskhilaze7885 9 ай бұрын
Great content! Keep up the amazing work - you're making learning a delightful journey for all of us! 👏🎉
@Infosnapz_ 10 ай бұрын
First Here, Nice One Vrsen
@vrsen 10 ай бұрын
Thank you🙏
@yolamontalvan9502 10 ай бұрын
My report I was writing had a lot mistakes. LLAMA 2 fixed it. LLAMA 2 rocks. I hope it is free forever. Thanks.
@MasterBrain182 10 ай бұрын
Astonishing content Arsenii 💯💯💯 Thanks to share your knowledge with us. Thumbs Up from Brazil! 👍👍👍 Plus +1 subs.
@vrsen 10 ай бұрын
Thanks bro!
@JohnDoe-ji1zv 6 ай бұрын
Fine tuning video would be really really great. Looking forward to it 👍🏻👍🏻👍🏻 amazing video and thank you
@animecharacter5866 10 ай бұрын
Amazing content, keep it up!
@vincentnestler4619 10 ай бұрын
Thanks for sharing. Unfortunately your notebook steps are not working when trying to run on windows locally. First, in the video you say to create a conda environment, but in your notebook your steps use a python environment. That is fine. When I run the pip install, the error I get is... RuntimeError: uvloop does not support Windows at the moment [end of output]. Did you get it to work in windows or did you copy the steps and modify it as it should work on windows? I tried it in a WSL and that did not work either. I would greatly appreciate any help on getting this up and running. Curious if there is a way to get this working with oobabooga. Maybe an extension. Thanks again!
@oldguy3525 9 ай бұрын
keep the videos coming!
@educationforeveryone214 10 ай бұрын
Great , Bro.
@vrsen 10 ай бұрын
Thanks man
@benjnp3 9 ай бұрын
Thanks for this video. Is this Petals an open source project where other companies can create their own version of torrent-style AI framework? Or is the only open-source part the library only for using it as an API?
@zenonvandeventer5229 6 ай бұрын
Any company or individual can create their own private swarm!
@anujagrawal1875 8 ай бұрын
Love you❤
@user-kv1ie9nq8b 10 ай бұрын
make a tutorial on how to use petals with langchain please
@vrsen 10 ай бұрын
Great idea!
@caseyhoward8261 9 ай бұрын
Can we use Pedals for commercial use?
@onlineinformation5320 Ай бұрын
can I deploy my finetuned model on petals
@AfnanQasim-wk8nq 15 күн бұрын
can you make a video how to make private swarm using google colab
@emileharel4595 6 ай бұрын
My local machine keeps downloading, it does not actually give me a url. Any advice?
@sjtrader1363 10 ай бұрын
Rapper turned tech enthusiast
@vrsen 10 ай бұрын
Why is it too fast?
@sjtrader1363 10 ай бұрын
@@vrsen No your body language. Content was awesome.
@truckfinanceaustralia1335 10 ай бұрын
Great vid! Do you have a community?
@vrsen 10 ай бұрын
Hey, no but I answer all comments here if you want to chat
@truckfinanceaustralia1335 10 ай бұрын
@@vrsen I appreciate it bro, I have been trying to create a persistent vector db chatbot. Your vids have been amazing 👌
@manojramesh4598 9 ай бұрын
@@vrsencan 7b model run properly on local system?
@caseyhoward8261 9 ай бұрын
Can we use Petals within software for commercial use? I'm thinking no! Lol I've yet to really brain storm the idea.
@zenonvandeventer5229 6 ай бұрын
Yes you can. It's open sources as in do whatever you like with it as long as you give credit.
@gokulraja1580 10 ай бұрын
we want how to fine tune llama 2 on google colab
@vrsen 10 ай бұрын
Got it
@gokulraja1580 10 ай бұрын
@@vrsen Arsenii we want llama 2 fine tuned on chat dataset, for my college project.thank you for amazing visualising content.
@vrsen 10 ай бұрын
@@gokulraja1580 ok, bro, I will try to fit this in. Wish I had homework like this in college haha
@carlgodfrey4482 4 ай бұрын
I got it but i think i didn't fully understand it
@RyanSmith-rb1ch 10 ай бұрын
Your instructions to run locally have left me confused. You never say how to start the server.
@RyanSmith-rb1ch 10 ай бұрын
The glossing over Conda also left me unimpressed.
@vrsen 10 ай бұрын
Check the notebook please, it has all the commands in there with descriptions
@user-pi3em2ke2l 4 ай бұрын
Ю понимейшен по руссейшен?
@vintagegenious 10 ай бұрын
What about Kobold Horde ?
@vrsen 10 ай бұрын
I am not sure if you can select a model there
@vintagegenious 10 ай бұрын
@@vrsen I'll try then tell you
@cartelion 19 күн бұрын
Skynet
Oddly Satisfying
Рет қаралды 140 МЛН
Oscar's Funny World
Рет қаралды 231 МЛН
AI Jason
Рет қаралды 190 М.
Telefonchi uz
Рет қаралды 1,9 МЛН
YUKI
Рет қаралды 8 МЛН