How to build a Llama 2 chatbot

Рет қаралды 85,255

Жыл бұрын

In this video, ‪@DataProfessor‬ shows you how to build a Llama 2 chatbot in Python using the Streamlit framework for the frontend, while the LLM backend is handled through API calls to the Llama 2 model hosted on Replicate.
⭐️ Watch this simplified video on using Llama 2 in Python • How to use the Llama 2...
🕹️ Demo app llama2.streamlit.app/
🕹️ Demo app (Pro) llama2-pro.streamlit.app/
🐙 GitHub repo github.com/dataprofessor/llama2/
🛠️ Tutorial blog on building the Llama 2 chatbot blog.streamlit.io/how-to-buil...
🔗 Llama release ai.meta.com/llama/
🔗 a16z chatbot github.com/a16z-infra/llama2-...
🔗 Replicate replicate.com/
☁️ Deploy your own Streamlit app streamlit.io/cloud
#streamlit #llama2 #chatgpt #chatbot #python

Пікірлер: 30

@mohammedismail6872 10 ай бұрын

the flow chart at 1:50 is sooo cool bro, how did you make it ?

@simon-ski 7 ай бұрын

Awesome explanation and tutorial! Thank you. By the way: It is "What questions did I ask?". The word 'did' is already past tense, so 'ask' shouldn't be past tense as well - it's gramatically incorrect.

@NexTechNuggets 10 ай бұрын

Can you make it read pdfs from folder and than chat with them? I am looking for something that can chat with documents but all needs to be locally tun and free.

@learningneverends6674 11 ай бұрын

Replicate api is cost since using cloud. Can we do it in local??

@TJTHEFOOTBALLPROPHET 11 ай бұрын

A few days ago you produced a video called "how to make an app in seconds" that was Steve Jobs level of brilliant marketing!!!!

@GeigenAkademie 8 ай бұрын

When I type in the textfield, my input gets red marked/underlined (spellcheck?). I don't see it in your video. How can I prevent it?

@Nyanda_Jr 11 ай бұрын

Hello I thought llam2 is open source but you discussed about replicate kind of paying? I would like to know more about that. Sounds like am missing a point.

@iamvalenci4 11 ай бұрын

is paying if you decide to run llama2 in the cloud (wich consume gpu), you can run in your local computer which also consume gpu but is free, llama2 is somthing that you can deploy to use with your app, other way you need to keep your local computer on 24/7, that is the reason deploying your llama2 model in the cloud need to be paid. like an API.

@gabrielhbueno1 9 ай бұрын

Thanks for that!

@roigazit8165 11 ай бұрын

Thanks! Can I build a saas chatbot based on llama 2 that knows read pdf and schedule treatments? How can I do that? Thanks again!

@moniamasti 5 ай бұрын

did you manage to build a bot that raeds pdf ?

@uynguyen746 3 ай бұрын

Hey, I tried to create a chatbot based on this vid, but can you tell me more about the purpose ipynb file?

@macharlasaimahesh18 11 ай бұрын

Can I Prepare a Query as output to user by using Snowflake Streamlit based on the Prompt that user sends?

@streamlitofficial 11 ай бұрын

Hi, yes certainly. Check out this GitHub repo that performs what you're looking for github.com/Snowflake-Labs/sfguide-frosty-llm-chatbot-on-streamlit-snowflake

@Piotr_Sikora 10 ай бұрын

Can we save session?

@mihaelacostea5783 3 ай бұрын

Can you trai Llama2 with your own data?

@kbhange90 5 ай бұрын

🎈

@Nyanda_Jr 11 ай бұрын

Can I build Mental Health AI chatbot with my custom dataset finetuning with Llama2 ?

@iamvalenci4 11 ай бұрын

yes you can, but you need frontend and a backend, your backend consume third services one of them is llama2, but to use llama2 you need to deploy to the cloud and from the backend call your llama2 model AI

@Nyanda_Jr 11 ай бұрын

Can I get your Email Address brother?

@bourbe 11 ай бұрын

kzfaq.info/get/bejne/ob6le9t6msDHd2Q.html

@bourbe 11 ай бұрын

kzfaq.info/get/bejne/osh2oMaW1JqoZXk.html

@LGseeker 5 ай бұрын

Streamlit sucks now, if you deploy on the community cloud you will have to give streamlit access to all your git repos including private ones. I am guessing they want you use your work to train their models.