Spring Tips: Spring AI

No video

Spring Tips: Spring AI

Рет қаралды 61,835

Күн бұрын

Hi, Spring fans! In this installment we'll look at the new Spring AI project, which provides convenient integrations with LLMs (like the one behind ChatGPT) and tools to support the RAG (retrieval augmented generation) pipeline.
the code is available here: github.com/spr...
#ai #springboot #artificialintelligence #java #graalvm #cloud #java21 #postgresql

Пікірлер: 83

@petervangeenhoven6991 7 ай бұрын

If all KZfaq content was as informative and to the point as this... Job well done, and much appreciated!

@user-hp6gf7lu8c 7 ай бұрын

Spring is becoming the most advanced backend framework of all kinds of backend frameworks of all languages.

@Lykkos29 7 ай бұрын

absolutely!!! it's getting better and joyful to work with

@h2o2m3n 7 ай бұрын

java is shit. fucking old, slow, high resource consuming, heavy.

@h2o2m3n 7 ай бұрын

@@Lykkos29 you prolly havent seen other framework.

@Lykkos29 7 ай бұрын

@@h2o2m3n axum from rust, not even close to surpass spring 😎

@hobaca1465 6 ай бұрын

Nope. Quite the opposite. In my env, a large financial org, people are combining multiple Spring projects to form a complex monolithic stack, difficult to debug. Pile on Spring Integration AWS on top of Spring Cloud AWS on top of Spring Session JDBC on top of Spring Security.

@coldstone87 6 ай бұрын

Awesome. Indeed a great time to be a java developer

@pedrolopes7813 4 ай бұрын

Very fun and informative demo Josh! Thanks. I'll definitely use this soon on few personal projects

@luiscarbonel1991 6 ай бұрын

I was testing the integration with Pinecone vector database and is amazing. I built the frontend with nextjs and backend with spring boot. Thanks ✌️

@dibangshuwaddar1009 4 ай бұрын

It was an awesome and very impressive demo of the new feature.

@lowabstractionlevel3910 7 ай бұрын

Josh Long thinks and types code so fast that his videos are the only ones I need to slow down on youtube instead of speed up

@petervangeenhoven6991 7 ай бұрын

Was thinking the same thing: finally a video you do not have to speed up!

@compiled9787 7 ай бұрын

This will be revolutionary!

@DorBenDov 3 ай бұрын

Very good and simple explanations. i tried and it works great, changed to my samples, also worked very good and very fast.

@tuliomop 5 ай бұрын

Thank you for all your professional job

@ashishkarn9283 6 ай бұрын

the ocean of knowledge.

@DinMamma002 6 ай бұрын

Thanks Josh! You should be a speaker at JFocus in Stockholm next year.

@davidgg8462 7 ай бұрын

Always great man !

6 ай бұрын

Great Job

@channyeintun6411 7 ай бұрын

It's awesome!

@DuongTran-zh6td 6 ай бұрын

world need spring AI

@Girichippada 4 ай бұрын

Hello Josh, Great job in explaining in detail. This really helps and gives a glimpse of Spring in the AI world. The world really needs Spring AI. Btw, could you please share the pdf file you have used in this demo or uploading to GitHub would be really helpful to try the same on our own? Thanks a bunk in advance

@dev11223311 6 ай бұрын

Fantastic!

@danielsundersingh1 6 ай бұрын

Where is the Open AI API configuration done?

@pranayreddy5824 6 ай бұрын

Nice ❤

@hdsystem 17 күн бұрын

Dude, where can I get that Spring t-shirt?

@kwarnkham3836 6 ай бұрын

There's nothing easy with spring. Documentations are meant for robot. The code is super verbose. Even the example in documentation isn't working.

@ansismaleckis1296 6 ай бұрын

Thanks for the tutorial! I managed to run this "on my machine". What I discovered is that the pdf document is just split into pages and fed into pgVector. Similarity search then returns top4 results (the 4 best pages) by default which are then sent to chatGpt. It is possible to configure similarity search to return more/less results (pages). Similarity search is quite slow on my computer, it takes a couple of seconds (I have a "normal" consumer laptop with i5). I suppose if there were 100 or 1000 pages not 10 then the similarity search would really get slow. Too bad the call to openAi was performed with blocking .call()🤭 Spring AI and openAI support reactive calls (returning streams/Flux) so why not use them?

@lbognini 5 ай бұрын

Listen carefully at 18:44 and 21:50

@jesusemersonpachecoalanya5680 4 ай бұрын

has anyone tried spring AI coin springboot 3.0.0? i have tried and the application won't launch.

@mohammedsardar3779 5 ай бұрын

Any idea why I'm getting this err even before developing the application discussed here. I did not make atleast 10 requests to open ai, but openai says my quota over? Should I upgrade for learning phase too? Err Received: 429 - ResponseError[error=Error[message=You exceeded your current quota, please check your plan and billing details. For more information on this error, read the docs:

@marcoantoniobarrosohormiga7665 4 ай бұрын

Hi, that happened to me too. If it's not a new account, you don't have 5$ free trial, so you have to buy tokens.

@hasankagalwala7110 6 ай бұрын

I think you should probably have explained the configuration a bit more, I couldn't grasp anything in one watch.

@erniea5843 6 ай бұрын

Anyone get this to work? The spring documentation examples don’t work.

@davidhsv2 6 ай бұрын

Are you going to support the openai assistant API?

@kamakshaiahmukku5708 5 ай бұрын

where can i find the git hub project for this example

@mohammedsardar3779 5 ай бұрын

Why we need to make OpenAI request for every time for any questions that we ask in the pdf? Would be great if that's explained or the right resources attached. We read the PDF and store in the vector and ask question from the vector_store. What is the role openAI rest call plays here? Why we need subscription? Any response must help.

@lbognini 5 ай бұрын

The LMM behind the OpenAI API is the one that actually answers the question. The Vector Store just converts the corpus of all documents (pages of documents in this case) into 1536-dimension vectors of numbers and stores them in the database, along with the textual page content. When a question (user message) comes in, the similaritySearch method will convert it into a vector of same size and use some similarity function (like dot product) to compare it to the vectors in the database. The text content corresponding to the most similar vectors is then retrieved and injected in the template of the prompt. The result (system message) along with the question (user message) are used to call the OpenAPI model to get the response to the question. So Vector Store is just used here to find out the relevent contextual text to add to the question in order to give the model additionnal information it must take into account when generating its response. Vector Store by itself can not answer the question. The API calls require a subscription with OpenAI. It's not free.

@mohammedsardar3779 5 ай бұрын

Thanks a lot for your time. Do you say the user message get converted to a dimension number to the question in the pdf already and then the numbers are compared to get the answer? Dimension means here the dimension of pages in the pdf? And those dimensions are stored and compared by AI to respond to the user? Is my understanding right?

@novinjaiswal 6 ай бұрын

How can I use where i have 10K transactions I want to build AI-based recommendations by feeding these transactions so our system can give personalized recommendations how can i achieve it with spring

@nagkumar 6 ай бұрын

could you pl. share github url of the code used..

@el8338 6 ай бұрын

Hi! Could you kindly provide a link to github project or something? Thanks!

@pankaj3746 6 ай бұрын

Why Postgres? Can we use some other DB?

@lbognini 5 ай бұрын

09:05 There are many vector stores you can choose from.

@arkosarkar343 6 ай бұрын

Which IDE is that?

@6060797 6 ай бұрын

which ide used in the video?

@davidxcode 6 ай бұрын

IntelliJ Idea, I think Ultimate version.

@Buy_YouTube_Views_a091 7 ай бұрын

Love the effort!

@besooab8810 6 ай бұрын

can you share the repo ?

@avalagum7957 6 ай бұрын

Your Java app is not smart enough to understand the response from AI. It just printed out that response for a human being to parse. How do you unit test it? Given: a particular pdf file When: I feed that file to AI and ask AI this question "blah blah blah" Then: AI will response this "another blah blah" Are you sure that AI will response with that "another blah blah" every time you ask it "blah blah blah"?

@lbognini 5 ай бұрын

What you want to do is integration test. Not unit test. You are trying to test OpenAI, not your App.

@avalagum7957 5 ай бұрын

@@lbognini Yes, integration test is a more correct word. How to write that kind of test when we don't know what the output is for a given input?

@petmik5022 6 ай бұрын

dude make something with your audio in all videos you sound like echo, not pleasure to ears listen, its pity

@lhxperimental 6 ай бұрын

This is cool. However I still have mixed feelings about using a strongly typed language for AI. AI is on the opposite end of the spectrum. All that strong typing looks pointless when your inputs and outputs are blunt strings and borderline non-deterministic. Doing AI in Java feels like going the beach in a tuxedo. That aside I do see that Java can still be useful in the sense that all the bluntness / non-determinism in your application is a function of the external AI model and rest of your application is completely robust and deterministic.

@hobaca1465 7 ай бұрын

Maven? Why the regression... thought Spring is fully in the Gradle world.

@CheeseStickzZ 7 ай бұрын

Gradle sucks. Maven all the way

@konstantingromov6485 7 ай бұрын

Gradle is better if only you need to put some custom logic with tasks into projects. Otherwise (especially for tutorials) maven is way better and stable - once declare then it's needed only to update libs/plugins versions. And btw maven also consumes less resources. IMO

@lhxperimental 6 ай бұрын

The things gradle allows you to do, you should probably not be doing them.Stopped using gradle 5 years ago.

@hobaca1465 6 ай бұрын

@@CheeseStickzZ reason for stating such a strong opinion?

@hobaca1465 6 ай бұрын

@@lhxperimental could you share some of those things?

@ticler 7 ай бұрын

Spring OS when?

@mohamedalmasry7577 6 ай бұрын

Marketing crab .. basic API calls to open AI nothing special about it ..

@shandilyacodes 5 ай бұрын

Meanwhile Dmitri after finding about Spring AI : kzfaq.info/get/bejne/jdt8Z7F8qdHHaIE.html&ab_channel=ShandilyaCodes

@juanbp97 4 ай бұрын

Spring sucks...

@andrews4379 6 ай бұрын

Java DEAD

@mqtrade5743 6 ай бұрын

Since when

@andrews4379 6 ай бұрын

@@mqtrade5743 since overpriced language

@mqtrade5743 6 ай бұрын

@@andrews4379 overpriced language? How can language be overpriced?

@poojapatole3573 6 ай бұрын

When did this happen?😂

@huseyinaydin1002 7 ай бұрын

Hello, please reply to my message. How can I access the samples made on this channel? I need the examples made in this channel. Is there a GitHub link? Please.

@hamiltonmbrito 7 ай бұрын

this information is showed at 07:15

@huseyinaydin1002 7 ай бұрын

Thank you brother. ❤ 😂@@hamiltonmbrito

@DuongTran-zh6td 6 ай бұрын

world need spring AI

@DuongTran-zh6td 6 ай бұрын

world need spring AI