Create Custom AI Characters Easily 🎭 How To Fine-Tune LLMs For AI Role Play

  Рет қаралды 44,848

Matthew Berman

Matthew Berman

8 ай бұрын

Thanks to Gradient for sponsoring this video: grdt.ai/mberman
In this video, I show you how to fine-tune an open-source LLM to behave like any character from movies, TV shows, comics...even yourself from text messages!
Enjoy :)
Join My Newsletter for Regular AI Updates 👇🏼
www.matthewberman.com
Need AI Consulting? ✅
forwardfuture.ai/
Rent a GPU (MassedCompute) 🚀
bit.ly/matthew-berman-youtube
USE CODE "MatthewBerman" for 50% discount
My Links 🔗
👉🏻 Subscribe: / @matthew_berman
👉🏻 Twitter: / matthewberman
👉🏻 Discord: / discord
👉🏻 Patreon: / matthewberman
Media/Sponsorship Inquiries 📈
bit.ly/44TC45V
Links:
colab.research.google.com/dri...

Пікірлер: 161
@matthew_berman
@matthew_berman 8 ай бұрын
Should I clone myself with AI and try to fool my family?
@AD-tw1do
@AD-tw1do 8 ай бұрын
I would definitely love to see that!
@Ziggurat1
@Ziggurat1 8 ай бұрын
Yes, check if mum is catching on
@marilynlucas5128
@marilynlucas5128 8 ай бұрын
Hi @ mathew_berman , In your autogen courses, you've never used open interpreter. I wonder why
@matthew_berman
@matthew_berman 8 ай бұрын
@@marilynlucas5128 I have an entire video of open interpreter :)
@jamesdrummond187
@jamesdrummond187 8 ай бұрын
Yep.
@JasonEllingsworth
@JasonEllingsworth 8 ай бұрын
Finally! I can automate my friendships, have the AI give me the highlights/details of any important information, and get back to living as a hermit.
@christianmeza4941
@christianmeza4941 4 ай бұрын
🤣
@marcfruchtman9473
@marcfruchtman9473 8 ай бұрын
Very cool! This is really another step into creating our own content... I love the last line where he is going to use the portal gun to go back in time and stop the portal gun from being invented! hilarious.
@elwoodfanwwod
@elwoodfanwwod 8 ай бұрын
Love your channel man! It's always the first thing I watch when it pops up. I have been playing around with famous characters using character sheets and Oobabooga. I've found that with only a few hundred tokens I can create a scary good interaction because (model dependent) everything is already baked in and all you need to do is point out who you want to talk to. I'm willing to bet that Rick and Morty script was part of your models training data set already. That said, AS ALWAYS, your video has filled my head with day dreams. The idea of training a whole model for a single character is so cool. My challenge to you and anyone that reads this is how small of a model can you train into being a coherent and usable roll play bot.
@unc_matteth
@unc_matteth 8 ай бұрын
honestly dude i feel like you specifically know what i'm doing and are making videos to help me. you keep giving me exactly what i need. i need ai agents to set up ai agents for me. smh. great video again! i'm saving this one
@Uterr
@Uterr 8 ай бұрын
I see a problem here: how do we know, that model responses "kinda" like Rick not because model knew of this character before finetuning? Any model can do what you did in this video right now, without finetuning.
@spencerfunk6697
@spencerfunk6697 8 ай бұрын
The man himself is back. I been looking forward to your uploads you always got so much dope information
@adrianfiedler3520
@adrianfiedler3520 8 ай бұрын
Yes! Today I was researching how to fine tune Mistral 7B on my dataset and now you post this video! ❤ Would be great to also get a tutorial how to fine tune with HuggingFace AutoTrain. This way it could be uploaded to HuggingFace and used from Text-Generation-Webui.
@robertbyer8189
@robertbyer8189 8 ай бұрын
THANK YOU!!! I was just getting ready to go down this exact rabbit hole when you posted this. I WOULD LOVE to see a video of this BUT but using all open source/local llms/software.
@tsentenari4353
@tsentenari4353 8 ай бұрын
I support this notion
@prakharsaxena763
@prakharsaxena763 4 ай бұрын
This should be very easy! I want to build a youtube social media audience, should I start my first video with that? Or a blog would be better?
@stickmanland
@stickmanland 8 ай бұрын
What about an open-source tutorial. NO THIRD PARTY poo poos (I mean gradient is great and all, but come on!)
@Link-channel
@Link-channel 2 ай бұрын
He does not seem to understand that using a product is not what "learning" means 🙁
@taeyangoh7305
@taeyangoh7305 8 ай бұрын
amazing! looking forward to have another video for this subject !!💙
@kenknudsen7478
@kenknudsen7478 8 ай бұрын
Very well done! Looking forward to the future fine tuning videos
@Josh-Casey
@Josh-Casey 8 ай бұрын
Nice! Thanks Matt! Looking forward to this one. Introducing the real, the one, the only, Skippy The Magnificent!
@hypnokitten6450
@hypnokitten6450 29 күн бұрын
This is fascinating - all of your videos that I've seen so far are! Thank you so much for having a good fine-tuning video. I am very curious about two things that I am not seeing covered much... (1) The topic you mentioned - creating good prompts.. particularly from large bodies of unrefined data. For example 'all the works of Shakespeare' or 'the Guttenberg project'. Especially where those works have both dialog and non-dialog 'things' that happen as part of the writing style. (2) How to work entirely locally, assuming you have the memory / GPU for it - such as if you are working with a large body of local data and you don't want to keep trying to move it into the cloud during training, or you just want to use your own resources.
@johnzacharakis1404
@johnzacharakis1404 8 ай бұрын
Yeah! Do it!!! The clone-yourself video! 🙌
@DeianGiNet
@DeianGiNet 8 ай бұрын
YES we want that video! :)
@TechUbus
@TechUbus 8 ай бұрын
Yes do the clone and video keep up the good work you do I enjoy all your videos 🎉
@antonpictures
@antonpictures 8 ай бұрын
00:00 🎭 You can create a custom AI roleplay bot for characters from TV shows, movies, comics, and even yourself using fine-tuning techniques. 00:27 📊 Data for fine-tuning can be obtained from sources like Kaggle for scripts, which are available in CSV format, or other websites for various dialogues. 01:50 📄 You can also fine-tune a model based on your own text messages, DM history, or telegram messages by converting them into CSV format. 03:02 📂 Google Colab is used to prepare data for fine-tuning, and Gradient AI makes fine-tuning models easy and efficient. 05:36 ⚙ Fine-tuning is performed using NAOUS Hermes 2, and you can adjust the fine-tuning process as needed. 07:01 🗨 The model's responses are generated by providing a query, and you can customize the system message and instructions for roleplay. 08:50 🤖 You can deploy the AI roleplay bot for any character, and the process is versatile, allowing you to mimic various personalities.
@OutlawMantis
@OutlawMantis 8 ай бұрын
Know what I'd really like to see? A guide on an open-source installation of multiple roleplay chatbots that can exist on a Discord server as Discord bots with the ability to communicate with each other and humans. That's my dream chatbot project, my server would love it.
@kallamamran
@kallamamran 8 ай бұрын
You're incredibly helpful :D
@terbospeed
@terbospeed 8 ай бұрын
I used to do this with markov chains way back, and had an IRC channel full of different characters that would discuss social media posts. One plus of markov chains was they could learn, but couldn't get that big, I wonder if llama index can replace the need for training.
@LongTheRevolution
@LongTheRevolution 8 ай бұрын
yes i would love to see a video of you cloning yourself and tricking your family. Great work as always boss. so awesome..
@rafael.gildin
@rafael.gildin 8 ай бұрын
Great video 👏
@arnaudlelong2342
@arnaudlelong2342 8 ай бұрын
Cool see ya in the next one. Bravo!
@darren1833
@darren1833 8 ай бұрын
love your channel. please bring back the AI News videos!
@titusfx
@titusfx 8 ай бұрын
Yes to both videos
@marilynlucas5128
@marilynlucas5128 8 ай бұрын
This is great!
@NakedSageAstrology
@NakedSageAstrology 8 ай бұрын
I use this through CHATGPT custom instructions and voice chat while I make dinner or work on code. I have Rick Sanchez roast me on everything like a Jerry! 🤣
@redneq
@redneq 8 ай бұрын
I was waiting for you to ask how to pronounce PENALTY. 😂Great video again.
@UVishnuVardhan
@UVishnuVardhan 8 ай бұрын
yeah! we need self clone with AI video. Eagerly waiting for your video sir
@py_man
@py_man 8 ай бұрын
Thanks matt❤
@TheReferrer72
@TheReferrer72 8 ай бұрын
Your videos have risen in quality and sophistication. Brilliant.
@matthew_berman
@matthew_berman 8 ай бұрын
Thank you
@dolevmp
@dolevmp 8 ай бұрын
Amazing thank you! 1. How much data did you use there? How much is needed? 2. Why did you choose that base model?
@gradientllm
@gradientllm 8 ай бұрын
nous Hermes is an unlocked Llama2 13B model - it’s more performant and also a little spicier
@aldoyh
@aldoyh 8 ай бұрын
Yes definitely interested in chatting with a Mathew AI .. just don't trick your family members! 😂
@avidrucker
@avidrucker 8 ай бұрын
I agree on both accounts
@kritikusi-666
@kritikusi-666 8 ай бұрын
Great stuff. Make a version to do this locally.
@andy111007
@andy111007 8 ай бұрын
Thanks Matt for another great video, is the data accessible. How did you copy data from fandom and added in the file?. I would really appreciate if you can share that information.
@rolandrodriguez
@rolandrodriguez 8 ай бұрын
…You had me at Rick Sanchez. Subbed. 👍🏽
@keithprice3369
@keithprice3369 8 ай бұрын
Can you share how you got to rick & morty wiki from Fandom? I search on rick & morty and got a ton of stuff that wasn't you showed in the video. Would also love to see a how to use Fandom for finding dialog from other movies & tv shows. I spent about 5 minutes (not a lot, I know) and really didn't find anything I thought I could use for fine tuning.
@Mr.Laffin
@Mr.Laffin 8 ай бұрын
Could you please Do more videos on autogen specifically how to get autogen running with mem GPT and llm and maybe what are you using for if you're using it at all
@maxiria
@maxiria 8 ай бұрын
Yes!! Would love to see you cloning urself
@CronoBJS
@CronoBJS 8 ай бұрын
DeepSeek Coder 6.7b Instruct is the only Open Source LLM that I was able to get to generate SNAKE!!!!! It works so well! And I tried the 33b version on their chatbot webpage and it also did it even better. I hope you make a video soon!
@glumpfi
@glumpfi 3 ай бұрын
That's exactly what i wanted to try out, thanks! :) I would love to see if you can trick your family
@dabdab10
@dabdab10 8 ай бұрын
Can you clone yourself and ask the model questions that you have answered before and compare the accuracy?
@to-mi1949
@to-mi1949 2 күн бұрын
Could you do some kind of tutorial of how to make a realtime voice conversation chatbot? So kinda like this where you train it to be the character you want, then add a speech-to-text and text-to-speech chat? Maybe something where you can add your own custom voices.
@DeianGiNet
@DeianGiNet 8 ай бұрын
YES and if you can make it work off a local llm that would be great
@wrOngplan3t
@wrOngplan3t 7 ай бұрын
That's Rick Sanchez alright 🤣Cool stuff!
@bardaiart
@bardaiart 8 ай бұрын
Noob question: how to get the fine-tuned model? Does GradientAI allow downloading the model/lora? or do we need to use its API to interact with the model?
@ernesto.iglesias
@ernesto.iglesias 8 ай бұрын
Good question
@edifox86
@edifox86 8 ай бұрын
How long did it take roughly to complete the fine tune?
@SlickSonicTitan
@SlickSonicTitan 2 ай бұрын
Did you ever do a video on unstructured data for finetuning in the end?
@jtjames79
@jtjames79 8 ай бұрын
As a weaponized autistic, the world is going to regret this tutorial.
@mexicanameric4n
@mexicanameric4n 8 ай бұрын
You win the internet today i'm fkn dead, LOL
@trackerprince6773
@trackerprince6773 7 ай бұрын
is is possible to take fine tuned model from gradient to runpod? or can i fine tune in runpod?
@antigravityinc
@antigravityinc 8 ай бұрын
Thanks. Not really sure about any use case implementations. I think you mentioned using this anywhere, but there’s no context. Maybe you’re assuming most subscribers already have this knowledge?
@Mind_ConTroll
@Mind_ConTroll 8 ай бұрын
Does this only work for character behavior and personality or would it work with information if you loaded a database of writings, like, could it think like a person based on a dataset like that, so like talking to Einstein for instance?
@auriocus
@auriocus 8 ай бұрын
In principle, yes - this is roughly how chatGPT and stuff were built. However it takes a ridiculous amount of data and compute power to actually change some more fundamental capabilities, that's why truly models with improved coding, better reasoning, better math etc. come out at a much slower pace then models with role playing this and that. The foundational models were trained with just a gigantic corpus of natural language and therefore they are extremely good at writing and translating between languages, but not that much with other stuff like science and the behaviour of the physical world.
@Mind_ConTroll
@Mind_ConTroll 8 ай бұрын
@@auriocus I have seen where they are trying to make something where you can talk historical figures, but I think it is more novel than actually functional. I am really waiting for a way to have a Jarvis, like, an avatar on my pc, a head, or body, doesn't matter, but I can talk to it and have it open programs and perform tasks within those programs like 2 people working together on a project, but with knowledge to help me through problems that I may have. I don't see how this is that far off, internet access, speech capabilities, both talking and listening, and a memory system... I think we are close, like a true AI assistant.
@yagoa
@yagoa 8 ай бұрын
Imitation episode would be awesome
@CherryGarcia77
@CherryGarcia77 8 ай бұрын
Thanks for the vid - curious about the cost for this one...
@Paulina-ds5bg
@Paulina-ds5bg 8 ай бұрын
From where the model takes the informations besides the input .csv? And why the model making up responses if it dont know the answers? For what the input csv is, if I can chat with thant model with only the system message that inform it who he is?
@JimmyTheGreek2121
@JimmyTheGreek2121 8 ай бұрын
Cloning yourself I think would be really cool. Would it be possible that instead of csv 2 columns to use audio files? Might be able to feed it an audio memoir or autobiography and make it more real and nuanced
@MrBademy
@MrBademy 8 ай бұрын
do it, i think thats the next step, life tuning on your personality and create an alter ego bot of yourself, that would be epic
@flethacker
@flethacker 8 ай бұрын
so how much did that all cost, and how do you download the new model?
@jasonsalgado4917
@jasonsalgado4917 Ай бұрын
if i finetune model in gradient and then later decide to no longer use gradient, do i iose access to those models?
@infini_ryu9461
@infini_ryu9461 6 ай бұрын
>fine-tune my AI on my own data >find them super annoying and hate their guts >"Oh god, is that what I sound like?"
@pafnutiytheartist
@pafnutiytheartist 8 ай бұрын
Two problems with the video: 1. You haven't compared the fine-tuned model with the original. Nous-hermes can roleplay at about this level with character prompt and no fine tuning so we don't really know if you did anything at all by fine-tuning the model. 2. The process for doing this locally for free has significant differences to what you shown, so it's not really useful as a tutorial. You wouldn't want to use collab for local training and you probably would use different libraries. Only data collection and preprocessing would be similar.
@casperd2100
@casperd2100 8 ай бұрын
Rick would actually do that lmao... He would go back in time to prevent the portal gun from being invented. But he would know he can't
@RZRRR1337
@RZRRR1337 8 ай бұрын
I love this! Do you know any way to do clone voices as well? Goal: Generate a Rick Sanchez Voice using some GPT-generated text
@JJBoi8708
@JJBoi8708 8 ай бұрын
Can I use this to fine tune my model that is not for AI roleplay?
@TheAbrahamHD
@TheAbrahamHD 6 ай бұрын
I wonder if it would be possible to do this with video/audio of myself...
@prestonmolloy808
@prestonmolloy808 5 ай бұрын
I don't see anyone mentioning this so: Here is a case where if you don't know something, the AI will confidently tell you something wrong. Rick doesn't believe in time travel... He would never postulate using a portal gun to "go back in time", but it sure sounded good to everyone who doesn't know that about Rick. Anyone who knows, would know this was an imposter Rick.
@RandomButBeautiful
@RandomButBeautiful 8 ай бұрын
Missed opportunity, you should have asked Rick "What is my purpose?" :)
@alefalfa
@alefalfa 8 ай бұрын
I absolutely want you to finetune a model, clone your voice with elevenlabs and trick your family member in a phone call
@Piotr_Sikora
@Piotr_Sikora 8 ай бұрын
BTW… there is a way to fine-tune model to use other language than English?
@NourEldin_z3r0
@NourEldin_z3r0 7 ай бұрын
my question is, now if i did this, how i use it as an api to incorporate it in my apps?
@riggitywrckd4325
@riggitywrckd4325 8 ай бұрын
Id like to see if you could get a good enough model to trick people you know for sure lol
@ezzye
@ezzye 8 ай бұрын
Do it!
@tomski2671
@tomski2671 8 ай бұрын
Here an idea for for anybody willing to do it: Fine tune a GPT model to help users install/configure Autogen locally, connect to various LLMs (including local ones) and thereafter quickly generate autogen code of various structures/configurations/tools - I would pay to use that model. Just unsuccesfully spent several hours trying to get local Autogen going.
@nufh
@nufh 8 ай бұрын
I want to have a chat interface. I mean like a What'sApp chat with voice. That Chainlit thingy is still hard for me.
@Malito2010
@Malito2010 8 ай бұрын
It is really good but can you give it his voice and run it on his own ecosystem some thing like a raspberry pi with mic speaker....
@conradjulian5409
@conradjulian5409 8 ай бұрын
Yes plz
@TrekGravityou81
@TrekGravityou81 8 ай бұрын
Bring on the clones ❤😂
@shaw-krowdashsabe2302
@shaw-krowdashsabe2302 8 ай бұрын
ive been trying all of your videos i cant get a single one of them to work AHHHHHHH
@jeremietisby2206
@jeremietisby2206 8 ай бұрын
Who wouldn't! I mean, strictly for yuks of course, **and that point has to be emphasized with a disclaimer.** The subject would have to be selected carefully (the more sense of humor they have the better; not too young or old). Maybe do multiple friends/relatives and select the best one. The subject would have to be debriefed afterward, possibly on video. But given all this I think it would be a great video.
@samsonthomas6797
@samsonthomas6797 8 ай бұрын
Trick them, I want to see how they'll react,, Create the clone of you
@buggbear
@buggbear 8 ай бұрын
Can this tell me how to make concentrated dark matter?
@hectornonayurbusiness2631
@hectornonayurbusiness2631 8 ай бұрын
Okay what about this AutoGen + memGPT + open interpreter?
@monnef
@monnef 8 ай бұрын
Okay demonstration, though I would strongly prefer seeing local approach.
@Paulina-ds5bg
@Paulina-ds5bg 8 ай бұрын
Can I fine tune in other language than english?
@remsee1608
@remsee1608 8 ай бұрын
Hello can anyone help me create an Alan Watts bot
@fabriai
@fabriai 8 ай бұрын
I love the idea of cloning oneself, but is tricking someone into thinking they’re talking to a human when they’re not an unethical version of the Turing’s experiment?
@Septimius
@Septimius 8 ай бұрын
if "Rick == row["name"]? Sir, Yoda conditions do not have a reason to exist
@tomski2671
@tomski2671 8 ай бұрын
There are going to be breaking charges in the world of AI for the next several years as we all figure out exactly how to best use this AI thing.
@pandoraeeris7860
@pandoraeeris7860 8 ай бұрын
I'm RickGPT!
@erikvogt8500
@erikvogt8500 8 ай бұрын
Make the vid!
@anshrathod
@anshrathod 8 ай бұрын
how to do it without gradient?
@user-nj8mx5kq8n
@user-nj8mx5kq8n 7 ай бұрын
Nice video @matthew_berman , Do you know how can we implement this on structural data with multiple csv files tables in it and star schema.
@edmundkudzayi7571
@edmundkudzayi7571 8 ай бұрын
slow down! i'm one week behind
@ThaiNeuralNerd
@ThaiNeuralNerd 8 ай бұрын
Clone yourself 🎉
@ScottzPlaylists
@ScottzPlaylists 8 ай бұрын
👎 You have to contact them for pricing.. Not my cup of tea. How much would it have cost to train your example if it wasn't sponsored.❓ Can you do an fully open source free version of the same task? ❓
@Breakopen
@Breakopen 3 ай бұрын
How does this handle foreign language?
@thomasschon
@thomasschon 8 ай бұрын
Yes, trick your family.
@moon8013
@moon8013 8 ай бұрын
make the video to trick your family....
@ewhorlow
@ewhorlow Күн бұрын
This is interesting and clever but it's pointless asking questions about its plan about anything. There's no permanence. It's just learning words and phrases and then outputs those to questions asked. The AI doesn't have missions and goals, likes or dislikes or any moral's, at least none that are permanently instilled in it. Not yet anyway.
ОСКАР vs БАДАБУМЧИК БОЙ!  УВЕЗЛИ на СКОРОЙ!
13:45
Бадабумчик
Рет қаралды 4,7 МЛН
3M❤️ #thankyou #shorts
00:16
ウエスP -Mr Uekusa- Wes-P
Рет қаралды 14 МЛН
MEGA BOXES ARE BACK!!!
08:53
Brawl Stars
Рет қаралды 36 МЛН
QLoRA-How to Fine-tune an LLM on a Single GPU (w/ Python Code)
36:58
I've paid $24 to AI Anthropic Claude 3.5 to write React code. Results are amazing
2:24
Do It In Public | Startups & Marketing
Рет қаралды 8 М.
This New AI Tool Does Consistent Characters (For Real)
13:36
Theoretically Media
Рет қаралды 215 М.
AI Pioneer Shows The Power of AI AGENTS - "The Future Is Agentic"
23:47
All You Need To Know About Running LLMs Locally
10:30
bycloud
Рет қаралды 124 М.
Run your own AI (but private)
22:13
NetworkChuck
Рет қаралды 1,2 МЛН
"okay, but I want Llama 3 for my specific use case" - Here's how
24:20
Don’t Build AI Products The Way Everyone Else Is Doing It
12:52
Steve (Builder.io)
Рет қаралды 340 М.
iPhone 15 Pro в реальной жизни
24:07
HUDAKOV
Рет қаралды 189 М.
Самый дорогой кабель Apple
0:37
Romancev768
Рет қаралды 335 М.
КРУТОЙ ТЕЛЕФОН
0:16
KINO KAIF
Рет қаралды 4,9 МЛН
YOTAPHONE 2 - СПУСТЯ 10 ЛЕТ
15:13
ЗЕ МАККЕРС
Рет қаралды 187 М.
Tag her 🤭💞 #miniphone #smartphone #iphone #samsung #fyp
0:11
Pockify™
Рет қаралды 36 МЛН