Unlock Ollama's Modelfile | How to Upgrade your Model's Brain using the Modelfile

No video

Unlock Ollama's Modelfile | How to Upgrade your Model's Brain using the Modelfile

Рет қаралды 19,308

Prompt Engineer

Күн бұрын

Пікірлер: 41

@drmetroyt 5 ай бұрын

Thanks for taking up the request ... 😊

@PromptEngineer48 5 ай бұрын

🤗 Welcome

@TokyoNeko8 5 ай бұрын

I use the web ui and I feel it's much easier to manage the modelfiles and the obvious history tracking oc the chat etc etc.

@renierdelacruz4652 5 ай бұрын

Great Video, Thanks very much.

@PromptEngineer48 5 ай бұрын

You are welcome!

@JavierCamacho 4 ай бұрын

Stupid question. Does this creates a new model file or it just creates a instruction file for the base model to follow instructions?

@PromptEngineer48 4 ай бұрын

New Model File

@JavierCamacho 4 ай бұрын

@PromptEngineer48 so the size on driver gets duplicated...? I mean 4gb of llama3 plus an extra 4gb for whatever copy we make?

@PromptEngineer48 4 ай бұрын

@@JavierCamacho No the old is not used. just the new one

@JavierCamacho 4 ай бұрын

@@PromptEngineer48 thanks

@user-ms2ss4kg3m 3 ай бұрын

great thanks

@PromptEngineer48 3 ай бұрын

You are welcome!

@fkxfkx 5 ай бұрын

Great 👍

@PromptEngineer48 5 ай бұрын

Thank you! Cheers!

@enesnesnese 2 ай бұрын

Thanks for the clear explanation. But can we also do this for the llama3 model built on the ollama image in Docker? I assume that containers do not have access to our local files

@PromptEngineer48 2 ай бұрын

Yes, you can

@enesnesnese 2 ай бұрын

@@PromptEngineer48 how? Should I create a file named Modelfile in container? Or should I create in my local? I am confused

@PromptEngineer48 2 ай бұрын

@@enesnesnese you should create the modelfile in local and you could run the model created from this modelfile in container

@enesnesnese 2 ай бұрын

@@PromptEngineer48 got it. Thanks

@saramirabi1485 Ай бұрын

Have a question is it possible to fine-tune the llama-3 in Ollama?

@khalidkifayat 5 ай бұрын

nice one, questions was how to use mistral_prompt for production purposes OR sending to client ??

@PromptEngineer48 5 ай бұрын

Yes. U can push this to your Ollama login under your models. Then anyone will be able to pull the model by saying like Ollama pull promptengineer48/mistral_prompt . I will show the process in the next video on Ollama for sure.

@khalidkifayat 5 ай бұрын

@@PromptEngineer48appreciated mate

@autoboto 5 ай бұрын

This is great info. One thing I have wanted to do is migrate all my local models to another drive. With Win11 I was using wsl2 with Linux ollama then I installed windows ollama and lost the reference to the local models. I rather not download the models again. In addition would be nice to be able to migrate models to another SSD and have ollama reference the alternate model path. OLLAMA_MODELS in windows works but only for downloading new models. When I copied models from the original wsl2 location to new location ollama would not recognize the models in the list command Curious if anyone has needed to relocate the high number models to new location and have ollama able to refence this new model location

@PromptEngineer48 5 ай бұрын

Got it

@michaelroberts1120 4 ай бұрын

What exactly does this do that koboldcpp or sillytavern does not already do in a much simpler way?

@PromptEngineer48 4 ай бұрын

basically if i can get the models running on ollama, we open another door of integration.

@user-wr4yl7tx3w 4 ай бұрын

do you have a video showing how to use crewai and ollama together?

@PromptEngineer48 4 ай бұрын

kzfaq.info/get/bejne/fbGiaLiDr9yydIU.html

@UTubeGuyJK 5 ай бұрын

How does modelfile not have a file extension? This keeps me up at night not understanding how that works :)

@PromptEngineer48 5 ай бұрын

I will find the reason and give you a night's sleep.

@robertranjan 4 ай бұрын

❯ ollama run mistral >>> does a computer filename must have a extension? A computer file name does not strictly have to have an extension, but it is a common convention in many computing systems, including popular operating systems like Windows and macOS. An extension provides additional information about the type or format of the data contained within the file. For instance, a file named "example.txt" with no extension would still be considered a valid file, but the system might not recognize it as a text file and may not open it with the default text editor. In contrast, if the same file is saved with the ".txt" extension, the system is more likely to open it using the appropriate text editor. One popular file like `Modelfile` without an extension is `Dockerfile`. I think, developers named it like that one...

@romanmed9035 3 ай бұрын

how do I find out when the model is actually updated? when was it filled with data and how outdated are they?

@PromptEngineer48 3 ай бұрын

U will have to put a different name for the model...

@romanmed9035 3 ай бұрын

@@PromptEngineer48 Thank you. but I asked how to find out the date of relevance when I download someone else's model and not make my own.

@PromptEngineer48 3 ай бұрын

if you ollama list command in cmd, you will see all the list of models in your own system

@EngineerAAJ 5 ай бұрын

Is it possible to prepare a model with RAG and then save it as a new model?

@PromptEngineer48 5 ай бұрын

To prepare a model for RAG, we would need to do finetune the model separately using other tools, get the .bin file or gguf file, then convert to Ollama intergration mode.

@EngineerAAJ 5 ай бұрын

@@PromptEngineer48Thanks, I will try to take a deeper look into that, but something says that I won't have enough memory for that :(

@PromptEngineer48 5 ай бұрын

Try on runpods