I use the web ui and I feel it's much easier to manage the modelfiles and the obvious history tracking oc the chat etc etc.
@renierdelacruz46525 ай бұрын
Great Video, Thanks very much.
@PromptEngineer485 ай бұрын
You are welcome!
@JavierCamacho4 ай бұрын
Stupid question. Does this creates a new model file or it just creates a instruction file for the base model to follow instructions?
@PromptEngineer484 ай бұрын
New Model File
@JavierCamacho4 ай бұрын
@PromptEngineer48 so the size on driver gets duplicated...? I mean 4gb of llama3 plus an extra 4gb for whatever copy we make?
@PromptEngineer484 ай бұрын
@@JavierCamacho No the old is not used. just the new one
@JavierCamacho4 ай бұрын
@@PromptEngineer48 thanks
@user-ms2ss4kg3m3 ай бұрын
great thanks
@PromptEngineer483 ай бұрын
You are welcome!
@fkxfkx5 ай бұрын
Great 👍
@PromptEngineer485 ай бұрын
Thank you! Cheers!
@enesnesnese2 ай бұрын
Thanks for the clear explanation. But can we also do this for the llama3 model built on the ollama image in Docker? I assume that containers do not have access to our local files
@PromptEngineer482 ай бұрын
Yes, you can
@enesnesnese2 ай бұрын
@@PromptEngineer48 how? Should I create a file named Modelfile in container? Or should I create in my local? I am confused
@PromptEngineer482 ай бұрын
@@enesnesnese you should create the modelfile in local and you could run the model created from this modelfile in container
@enesnesnese2 ай бұрын
@@PromptEngineer48 got it. Thanks
@saramirabi1485Ай бұрын
Have a question is it possible to fine-tune the llama-3 in Ollama?
@khalidkifayat5 ай бұрын
nice one, questions was how to use mistral_prompt for production purposes OR sending to client ??
@PromptEngineer485 ай бұрын
Yes. U can push this to your Ollama login under your models. Then anyone will be able to pull the model by saying like Ollama pull promptengineer48/mistral_prompt . I will show the process in the next video on Ollama for sure.
@khalidkifayat5 ай бұрын
@@PromptEngineer48appreciated mate
@autoboto5 ай бұрын
This is great info. One thing I have wanted to do is migrate all my local models to another drive. With Win11 I was using wsl2 with Linux ollama then I installed windows ollama and lost the reference to the local models. I rather not download the models again. In addition would be nice to be able to migrate models to another SSD and have ollama reference the alternate model path. OLLAMA_MODELS in windows works but only for downloading new models. When I copied models from the original wsl2 location to new location ollama would not recognize the models in the list command Curious if anyone has needed to relocate the high number models to new location and have ollama able to refence this new model location
@PromptEngineer485 ай бұрын
Got it
@michaelroberts11204 ай бұрын
What exactly does this do that koboldcpp or sillytavern does not already do in a much simpler way?
@PromptEngineer484 ай бұрын
basically if i can get the models running on ollama, we open another door of integration.
@user-wr4yl7tx3w4 ай бұрын
do you have a video showing how to use crewai and ollama together?
@PromptEngineer484 ай бұрын
kzfaq.info/get/bejne/fbGiaLiDr9yydIU.html
@UTubeGuyJK5 ай бұрын
How does modelfile not have a file extension? This keeps me up at night not understanding how that works :)
@PromptEngineer485 ай бұрын
I will find the reason and give you a night's sleep.
@robertranjan4 ай бұрын
❯ ollama run mistral >>> does a computer filename must have a extension? A computer file name does not strictly have to have an extension, but it is a common convention in many computing systems, including popular operating systems like Windows and macOS. An extension provides additional information about the type or format of the data contained within the file. For instance, a file named "example.txt" with no extension would still be considered a valid file, but the system might not recognize it as a text file and may not open it with the default text editor. In contrast, if the same file is saved with the ".txt" extension, the system is more likely to open it using the appropriate text editor. One popular file like `Modelfile` without an extension is `Dockerfile`. I think, developers named it like that one...
@romanmed90353 ай бұрын
how do I find out when the model is actually updated? when was it filled with data and how outdated are they?
@PromptEngineer483 ай бұрын
U will have to put a different name for the model...
@romanmed90353 ай бұрын
@@PromptEngineer48 Thank you. but I asked how to find out the date of relevance when I download someone else's model and not make my own.
@PromptEngineer483 ай бұрын
if you ollama list command in cmd, you will see all the list of models in your own system
@EngineerAAJ5 ай бұрын
Is it possible to prepare a model with RAG and then save it as a new model?
@PromptEngineer485 ай бұрын
To prepare a model for RAG, we would need to do finetune the model separately using other tools, get the .bin file or gguf file, then convert to Ollama intergration mode.
@EngineerAAJ5 ай бұрын
@@PromptEngineer48Thanks, I will try to take a deeper look into that, but something says that I won't have enough memory for that :(