Get Started with Mistral 7B Locally in 6 Minutes

Рет қаралды 51,904

7 ай бұрын

In this video I show you how to quickly get started with Mistral as well as models such as Llama 13B locally, I will show you how to get set up with Node.js/Bun as well with Langchain. Finally I will show you how to get started with an online implementation of Mistral!
Link:
mistral.ai/
mistral.ai/news/announcing-mi...
ollama.ai/download
ollama.ai/library/mistral
huggingface.co/mistralai/Mist...
js.langchain.com/docs/modules...
labs.perplexity.ai/
Patreon:
/ developersdigest
/ dev__digest

Пікірлер: 39

@DevelopersDigest Ай бұрын

Check out my latest project where you can use Ollama + Mistral + Llama 3! git.new/answr ⭐(LLM Answer Engine)

@prodigiart 7 ай бұрын

I had a few failed attempts trying to get these cool language models up and running on my Mac. I was happy to finally get clear instructions on how to get started. I found your video very helpful - thank you!

@DevelopersDigest 7 ай бұрын

I love to hear that! Thank you for watching

@trackerscr4100 7 ай бұрын

Excellent video friend, I was searching for this exactly like you did. Thanks😊

@DevelopersDigest 7 ай бұрын

Thank you! Glad I could help 😃

@sitrakaforler8696 7 ай бұрын

Ollama is life ! Thank you for your awesome video man !!!!

@DevelopersDigest 7 ай бұрын

Thank you for watching!

@Taskade 26 күн бұрын

Excited to see Mistral in action in Taskade's next Multi-Agent update! 🌈

@ronan815 3 ай бұрын

Super great tutorial, thank you so much. Which tutorial would you recommend next in order to start using Mistral AI locally to be used with langchain?

@diptampaul7595 4 ай бұрын

can we custom train Mistral using Ollama?

@AIEntusiast_ 2 ай бұрын

would love to see this on a live server step by step guide and also implemented with the tokens, seconds and information it shows when running them from mistral site

@Andrea-Giachetto 7 ай бұрын

Great content!

@DevelopersDigest 7 ай бұрын

Thank you Andrea 🙏!

@mrquicky 7 ай бұрын

I have this gut feeling that ollama is being used in open-interpreter based on the chunks streaming reply code.

@DevelopersDigest 7 ай бұрын

You might find this interesting: github.com/KillianLucas/open-interpreter/pull/124 Cheers! I

@nasiksami2351 7 ай бұрын

Can we train these models on our own custom data? Will it be free in that case?

@DevelopersDigest 7 ай бұрын

You can absolutely fine tune llama models as well as mistral. I would check their license if you plan to use fine tune versions within production (can check most open source models permissions on huggingface). If you are looking to try and fine tune locally, I would check out: github.com/cckuailong/SuperAdapters Cheers!

@nasiksami2351 7 ай бұрын

Thank you so much! I'm definitely gonna check this out! @@DevelopersDigest

@masterac7344 7 ай бұрын

can you do a video for windows ?

@DevelopersDigest 7 ай бұрын

I unfortunately don’t have a PC right now!

@masterac7344 7 ай бұрын

@@DevelopersDigest i will be waiting with anticipation

@padthaizilla9165 5 ай бұрын

i can't find the ollama for windows i think is not even out yet

@alivecoding4995 7 ай бұрын

What is the difference of ollama compared to gpt4all?

@DevelopersDigest 7 ай бұрын

Similar in some regards, I haven’t personally done a deep dive into gpt4all yet. Cheers 🥂

@mubasharwarriach7216 7 ай бұрын

Can we do embedding with this?

@DevelopersDigest 7 ай бұрын

Mistral doesn’t have a open source embedding model yet and ollama has embeddings that can now be accessed as well, here is the langchain documentation! js.langchain.com/docs/modules/data_connection/text_embedding/integrations/ollama

@mubasharwarriach7216 7 ай бұрын

@@DevelopersDigestcan you make a video about some free embeddings llms alternatives to openai embedding. We would appreciate it. Love your channel. Love the fact that you are straight to the point.

@user-tp6dr9zj8m 3 ай бұрын

Now its available in windows, you could add a pinend comment for that.

@BudoReflex 2 ай бұрын

For the algorithm.

@memegene69 7 ай бұрын

While I appreciate this video, I wish you had mentioned at the start that this wouldn't work with windows.

@DevelopersDigest 7 ай бұрын

That is very fair feedback, and helpful to point out. I’ll point that out in future videos!

@EatDrimBmerry 5 ай бұрын

Lm studio solves this. ❤

@bigpickles 5 ай бұрын

It's mentioned within the first 2 minutes 😊

@krzysztofzabolotny4802 Ай бұрын

Take a look how to dowlmnload docker, and you can run it there.

@ceciliadisanti371 29 күн бұрын

@@DevelopersDigestWow, I appreciate the video😊 I have to learn to prompt in Mistral in the shortest time possible, could you help me understandig how I I can get it? I'm new in the Prompting Engineering and I'm not a developer.