Can I generate an installable app to deploy it in own infra? Which code language use it behind? Can I have access to code generated to custom behaviour?

Hey Matt, I was really excited for this video, then only to realize theres no mention of Ollama in it!?!? I have a project on the go where I'm trying to build a multi container app using docker-compose where the containers are backend- fastAPI, frontend- Nextjs and llmServer- Ollama. I'm running into problems having the backend connect to the Ollama server ... I get the dreaded [Errno 111] Connection refused

Any tutorial on model creating from custom data,like pdf s? Like for companies?

Please share the link of the video for reducing the model size for specific tasks, example, only weather, is wouldn't need the hole context for this

1973

Man. I love it. I already subscribe to it. Something I really will be crazy to know is how to story my ollama local models in an external hard drive in Mac. As you know macs doesn't have much space. So, i bought a special hard drive that runs at 40G/sec to have models and other stuff and I will love to have the models in there than in my internal hard drive. Thanks for the great content and explanations.

Matt, I do not see COBOL (of any flavor) especially for PCs; e.g., MicroCOBOL and or GnuCOBOL 😢😢😢 Which Ai Code Assistant can GnuCOBOL? Is LaTeX not considered a programming language? Or is LaTeX considered native to all Ai entities?

Wonderful video, Matt. Thanks so much for sharing this.

I love your videos! Your explanations are amazing, thank you!

Thank you!

🙏🙏🙏Please how to add vision model MiniCPM-V 2.6 to ollama? openbmb/MiniCPM-V-2_6-gguf

I'm really enjoying this series. Thanks.

what location to run that download hugging face model command? and where does it download to? same location as the others wheres that?

any1 wana swap code for tokens?

I am very interested in FABRIC, and I will probably get into a serious use of it. I think it would be very useful if you create a video taking one or two of the patterns that may not be configured to your exact use case and demonstrate how you would modify them for your use case. This type of use case from an experienced Generative AI Aficionado can be very helpful for more novice users. Thanks for all your videos. I watched a lot of them and I will watch a lot more.

is there a way i can fetch the whole response in a single response object

"If, for example, I have more than one model downloaded, and one is chat, another is multimodal, and another generates images, can I make it so that Ollama chooses which model to use based on a prompt, or does it by default use the one you've chosen with the `ollama run` command?"

Hey Matt! Off topic comment but I guess I'm feeding the ol' KZfaq algorithm anyway! I haven't watched your entire backlog so apologies if you've already covered this, but I'd love to see some content / videos on the following topics: 1. How can you use ollama in a production environment. Topics around infrastructure, reasonable techniques (e.g. handing off processing to async jobs when possible), cost, etc. I'm not sure how common this use case is but I am evaluating using something like llama 3.1 to help summarize some potentially very large text files and weighing cost differences between using something turnkey like openai's APIs vs figuring out hosting myself (well my company. There seems to be a lot less on production hardening some of these open source models (or I just haven't been paying attention!) 2. A "state of the union" high level overview of the options available to software developer new to using AI. This you have covered in a lot more detail in various forms, but an overview of what tools are actually at a persons disposal in terms of trying to use AI to solve some problem. When I first started looking at this stuff I thought the only options I had were buying a bunch of super computers to train models and learning a lot about doing matrix multiplication. But we have RAG, we have "fine tuning", we have modifying system prompts... a sort of high level overview of what a layperson can do, and perhaps where reasonable off-ramps for more advance use cases are would be super helpful (i.e. when do I need to brunch up on my linear algebra? :)) Thanks for your work!

Outstanding video. As a complete newbie this was intriguing, well explained and engaging. New subber and bell set

Excellent content Matt! Congrats! Keep on going.

I love the way you explain. Thanks

Hi Matt, thank you for another amazing content. I'm working with ollama and other tools available from community to develop some solutions for my company. I need some help from a professional consultant for this job. Could you work with me, or, maybe, recommend a person who can help me to do it?

I wouldn’t recommend creating models the legacy Q4_0 quant types, they’re depreciated and are worse quality than K quants (or IQ if you’re running with CUDA)

More cool stuff please!

ah... the ollsma serve... LOL i was wasted a week until i realized it was user issue in Linux, i felt so stupid having duplicate models, and things... this is really good video any one new to ollama should watch this if i watch this before i wouldn't waste a week just to realized how stupid i am the simple user issue...

Removing models is the most annoying part because you have to name it exact. Wish they made it easier to just select and delete via GUI or list and select to remove by a number

Love this, I think we’ve all been doing just-in-time learning to run and keep up to date with what’s happening every couple of weeks. Great to tear it back to the foundations Matt

I use the Voice Recorder on Google Pixel which does on-device live transcription with punctuation, and keeps track of different people speaking. I always assumed something like that would be built in on Apple devices

this is amazing, super clear, thank you!

Very nice! Thank you.

Thank you for this awesome course, I‘m enjoying it!

Awesome, thoughtful video, Matt! And you have an amazing voice--you should license it to ElevenLabs. 😁

I was confused about function calling as I could not figure out how the model was calling a function. The model was just returning json formatted data. Thanks for the clear and concise explanation.

Using this information, while interesting, with all of the caveats mentioned in getting this to work there's nothing easy about it.

I've been waiting on the CrewAI waitlist since April (it's August).

Loved the hints to choose the best model for the problem you want to solve

Thanks Matt! Very helpful!

How can i download a model in .gguf format locally,my reason is am transferring the model to a computer being used remotely in a health facility with no phone or internet network.

Great ❤

thank you. if human inteligence is an ai in some sense i am definetly an insane model :D :D

i am not good in programming ,but this video help me start my local RAG easliy

Matt, thanks for your content. Is there an Ollama model that you can use to check for plagiarism? I am creating short articles using ChatGPT. Another question. Is there a command that can interrupt llama3.1 while it’s outputting an answer? /bye doesn’t work.

Another great video! Thanks

Thanks for the content. Can't wait to put them to use.

Such a calm, yet punctual voice. Like ASMR + tutorials. And the content is easy to follow and understand. Great Channel!

1:30 it's a similar problem with LateX(latechi). But, in linguistics you cannot use different alphabets to write the same word. So I pronounce latex as the material.

Naming things is hard 😂

Awesome video! By the way, in general your format, pacing, conciseness and the cool but also utilitarian "code floating above your speaking" is a nice touch! I know making these videos takes a lot so just want to give kudos where it's clearly deserved! There's so many "faceless", auto-gen'd content or just click-baity low-content videos so this was a welcomed break from that!

Hi @Matt Williams if time permits, can you create a video showing how to deploy Dify to a cloud service like Render?

It's not pronounced "en-gin-ex", it's pronounced "en-gin-chi".