FAST Local Live LLM Preview Window - Phi-2 / Mistral 7B Uncensored

  Рет қаралды 8,505

All About AI

All About AI

Күн бұрын

FAST Local Live LLM Preview Window - Phi-2 / Mistral 7B Uncensored
👊 Become a member and get access to GitHub:
/ allaboutai
🤖 AI Engineer Course:
scrimba.com/?ref=allabtai
Get a FREE 45+ ChatGPT Prompts PDF here:
📧 Join the newsletter:
www.allabtai.com/newsletter/
🌐 My website:
www.allabtai.com
In this video i create a project where we get a real time live preview of the llm output, running on local models like uncensored Phi-2 and Mistral 7B. Very fun and simple project.
00:00 Local Live LLM Preview Window Intro
00:20 Flowchart
01:32 Python Code
04:01 Live LLM Preview Test 1
04:57 Live LLM Preview Test 2
05:22 Live LLM Preview Test 3

Пікірлер: 23
@mikew2883
@mikew2883 3 ай бұрын
I think that should officially replace "Hello World" from now on. 😆👍
@PriceActionTradesbyJosh
@PriceActionTradesbyJosh 3 ай бұрын
😂 the first email was hilarious!!
@BoldStatement
@BoldStatement 3 ай бұрын
🎯 Key Takeaways for quick navigation: 00:27 🐍 *Developed a local real-time LLM (Language Model) preview using Python and threading.* 01:23 🔄 *Parallel function allows capturing and processing keyboard inputs without interruption.* 01:49 📝 *Python code includes M7B function for local LM Studio, update preview function, and capture input function.* 03:27 🗣️ *System prompts for the Mistral 7B model include examples for a 4chan Reddit style and a more explicit chatbot style.* 04:09 🖥️ *Demonstrates the local real-time preview in action with user input and model responses.* 05:32 🔄 *Switches the model to Open Hermis Mistral 7P, adjusts settings, and changes the system prompt for a different tone.* 06:28 📧 *Tests the modified model by writing a short, humorous, and explicit email using keyboard input.* 08:31 💻 *Encourages support through channel membership for access to scripts and the community GitHub and Discord.*
@milkywaydev593
@milkywaydev593 2 ай бұрын
Beautiful
@micbab-vg2mu
@micbab-vg2mu 3 ай бұрын
Graet - thank you:)
@MattJonesYT
@MattJonesYT 2 ай бұрын
I've had great results with the beagle models! Even the 3 bit version does better than some of the big models for things like evaluating RAG results.
@Tripp111
@Tripp111 3 ай бұрын
Great content. I'm LMFAO.
@MetaphoricMinds
@MetaphoricMinds 2 ай бұрын
How does it feel to be a demigod? Thank you for sharing your spells!
@thetagang6854
@thetagang6854 21 күн бұрын
hiliarious concept
@Edward_ZS
@Edward_ZS 3 ай бұрын
Can we do a real-time llm that works with ollama STT then Ollama then TTS in the terminal. Ollama is the most optimized llm solution.
@goodchoice4410
@goodchoice4410 3 ай бұрын
check out twinny
@Canna_Science_and_Technology
@Canna_Science_and_Technology 3 ай бұрын
Just use the ollama end point. All done
@Edward_ZS
@Edward_ZS 3 ай бұрын
@Canna_Science_and_Technology with ollama, don't you need additional headers? For model and pre-prompt
@Edward_ZS
@Edward_ZS 3 ай бұрын
@Canna_Science_and_Technology curl localhost:11434/api/generate -d '{ "model": "tinydolphin", "prompt": "As a friendly and informative assistant, provide detailed explanations. This is a test. Output:", "options": { "stop": ["Instruct:", "Output:"] }, "raw": true, "stream": true }'
@Canna_Science_and_Technology
@Canna_Science_and_Technology 3 ай бұрын
@@Edward_ZS yes, host.docker.internal:11434/api
@nvleo4what
@nvleo4what 2 ай бұрын
Where do I find dolphin phi 2 q5 k m
@avi7278
@avi7278 3 ай бұрын
you obviously need a debounce on that input
@futurizerush
@futurizerush 2 ай бұрын
really love the web troll lol
@emmanuelgoldstein3682
@emmanuelgoldstein3682 3 ай бұрын
I feel like this would have been much better in streamlit
All You Need To Know About Running LLMs Locally
10:30
bycloud
Рет қаралды 81 М.
I Analyzed My Finance With Local LLMs
17:51
Thu Vu data analytics
Рет қаралды 359 М.
Which one will take more 😉
00:27
Polar
Рет қаралды 55 МЛН
ВИРУСНЫЕ ВИДЕО / Мусорка 😂
00:34
Светлый Voice
Рет қаралды 9 МЛН
AutoGen Studio 2.0 Full Course - NO CODE AI Agent Builder
21:00
Local RAG using Ollama and Anything LLM
15:07
GovBotics
Рет қаралды 8 М.
How I Made AI Assistants Do My Work For Me: CrewAI
19:21
Maya Akim
Рет қаралды 631 М.
Using Llama Coder As Your AI Assistant
9:18
Matt Williams
Рет қаралды 58 М.
Creating J.A.R.V.I.S. powered by GROQ and Python
14:47
AI FOR DEVS
Рет қаралды 87 М.
Mistral 7B 🖖 Beats LLaMA2 13b AND Can Run On Your Phone??
13:11
Matthew Berman
Рет қаралды 50 М.
I Tried Every AI Coding Assistant
24:50
Conner Ardman
Рет қаралды 631 М.
Local - ON DEVICE LLMs are the future, but NOT yet - Here’s why
19:37
Samsung or iPhone
0:19
rishton_vines😇
Рет қаралды 591 М.
Why spend $10.000 on a flashlight when these are $200🗿
0:12
NIGHTOPERATOR
Рет қаралды 16 МЛН
Такого вы точно не видели #SonyEricsson #MPF10 #K700
0:19
BenJi Mobile Channel
Рет қаралды 2,6 МЛН
How Neuralink Works 🧠
0:28
Zack D. Films
Рет қаралды 22 МЛН
Самый маленький игровой ПК
0:46
ITMania - Сборка ПК
Рет қаралды 581 М.