Spring AI - Run Meta's LLaMA 2 Locally with Ollama 🦙

Spring AI - Run Meta's LLaMA 2 Locally with Ollama 🦙 | Hands-on Guide |

Рет қаралды 8,090

18 күн бұрын

#JavaTechie #SpringAI #Ollama #LLaMA2
👉 In this tutorial I will walk you through the steps to understand how to run LLM locally using ollama & spring ai , We will also work on a hands-on project with the popular LLM, Llama2
What You Will Learn:
👉 What is Spring AI?
👉 What is Ollama?
👉 What is LLaMA 2 ?
👉 hands-on project with the popular LLM, Llama2
Spring documentation : docs.spring.io/spring-ai/refe...
🧨 Hurry-up & Register today itself!🧨
Devops for Developers course (Live class ) 🔥🔥:
javatechie.ongraphy.com/cours...
COUPON CODE : NEW24
Spring boot microservice Premium course lunched with 70% off 🚀 🚀
COURSE LINK : Spring boot microservice course link :
javatechie.ongraphy.com/cours...
PROMO CODE : SPRING50
GitHub:
github.com/Java-Techie-jt/spr...
Blogs:
/ javatechie4u
Facebook:
/ javatechie
Join this channel to get access to perks:
kzfaq.infojoin
🔔 Guys, if you like this video, please do subscribe now and press the bell icon to not miss any update from Java Techie.
Disclaimer/Policy:
📄 Note: All uploaded content in this channel is mine and it's not copied from any community, you are free to use source code from the above-mentioned GitHub account.

Пікірлер: 45

@_vku 6 күн бұрын

Thanks Basant sir, as a developer i like ur video to watch, whenever new leaning required i follow ur video.

@SouravDalal1981 11 күн бұрын

Great job. Will look forward for Vector database with AI integration

@TheMrtest123 14 күн бұрын

Thanks for starting a series on AI. This is the need of the hour. Thanks for accepting our request for AI demos

@dmode1535 16 күн бұрын

Thanks for posting this sir, I have learn a lot from you. Developers should be the highest paid group of any field because we do more learning than any field. We never stop learning, there is always something new to learn.

@itdev7097 13 күн бұрын

"Developers should be highest paid group in any field".... exactly the opposite should happen.

@gopisambasivarao5282 8 күн бұрын

Thanks Basant. Appreciate your efforts. God bless you!

@grrlgd3835 15 күн бұрын

thanks for this JT. another great video. I'm going to take a look at the ETL framework for Data Engineering. look forward to more content

@abdus_samad890 15 күн бұрын

Loved it... Yes you can create more.

@rajasekharkarampudi2669 15 күн бұрын

Great start to the Java AI world bro, Will be Waiting for the demos in this playlist on RAG applications using Vector DB, and Function calling, Take your time and plan a video on E2E real world projects, deploying it on a server.

@satyendrabhagbole3746 8 күн бұрын

Brilliant explanation

@rabiulbiswas5908 15 күн бұрын

Thanks for the video. I hope more will come on Spring AI soon.

@SrkSalman416 15 күн бұрын

Very Good Video On Spring-AI. Your content(Videos) like Java Magnet, Its attract very fast.

@mayankkumarshaw635 16 күн бұрын

Very nice ❤❤

@psudhakarreddy6548 15 күн бұрын

Thank you

@ChandraSekhar-jm3sr 13 күн бұрын

Please share different model videos...they are very helpful

@muralikrishna-qh6vg 14 күн бұрын

Thank you Basanth, can you please take us to Spring ai with google cloud (like vertexAiGemini) also vertextai with java

@petersabraham7423 14 күн бұрын

Great video. Thank you for always making effort to update us with the latest technologies. I have one issue though, after implementing the generate rest api, my response takes too long, sometimes it takes up to 7minutes and i also noticed that you used GET request while llama "/api/chat" expects a POST request. Is there a particular reason you used a GET request? 2. Is it possible to train the llama model to recognize and provide responses based on the trained data?

@kappaj01 15 күн бұрын

Great video. Can you do a RAG solution using the Weaviate Vector DB? I had one with AI 0.8 running, but it has changed so muched to 1.0...

@Javatechie 15 күн бұрын

Sure I will give a try as currently I am learning it 😊

@driveDoses 15 күн бұрын

Great start in AI world. I had question If I have an spring boot application and I want ans related to my application data only. how we can achieve that

@Javatechie 15 күн бұрын

I am not sure will check and update you

@2RAJ21 5 күн бұрын

I got below issue verifying sha256 digest writing manifest removing any unused layers success Error: model requires more system memory (8.4 GiB) than is available (2.9 GiB) after running -> docker exec -it ollama ollama run llama2 how to solve this ?? please help me..

@koseavase 6 күн бұрын

Here comes Spring boot to challenge Python

@liqwis9598 15 күн бұрын

Hey basant nice video , can you please teach us how to use RAG functionality in locally running llms

@Javatechie 15 күн бұрын

I will do this

@liqwis9598 15 күн бұрын

@@Javatechie thank you as always 🙂

@moinakdasgupta3341 15 күн бұрын

Hi JT, I am running both ollama and my spring boot app using docker compose, but app is getting 500 response when hitting ollama api. This is fixed only when I manually run ollama run llama2 or ollama pull llama2 in the ollama container. Is there any way to automatically pull the model while starting from docker compose? I tried command: ["ollama", "pull", "llama2"] in docker compose file with no luck :(

@Javatechie 15 күн бұрын

not sure buddy, I will check and update you

@MrSumeetshetty 15 күн бұрын

Thanks bro.. You are a good motivation for all developers to keep learning ❤

@flutterdevfarm 15 күн бұрын

Sir, are you launching any latest course spring boot & microservices? The course which is listed on your site, is it Live?

@attrayadas8067 15 күн бұрын

It's pre-recorded!

@Javatechie 15 күн бұрын

It was recorded session of past live class currently I don't have any plan for new batch but If I have any plan in future then definitely I will update first in my KZfaq channel for my audience 😀