Using Llama 3 to Control Home Assistant

Using Llama 3 to Control Home Assistant | Local AI

Рет қаралды 6,316

Күн бұрын

Llama 3 was just released a month ago, and it’s a massive improvement over Llama 2, but, can we use it to control home assistant?
Check out this video if you want to find out!
FixtSE Web: fixtse.com/blog/llama-3-home-...
PCBWay: pcbway.com/
PCBWay Discord: / discord
- 00:00 Does it deliver?
- 02:32 Prerequisites
- 02:43 Hardware Requirements
- 03:37 Install Llama 3 in Ollama
- 03:45 Llama Conversation Integration
- 03:48 Install Integration
- 03:52 Configuration
- 07:00 My Prompt Template
- 07:37 Configure Assistant
- 09:46 Conclusions
- 10:37 Limit the amount of devices exposed to Assist
If you like my work, please consider becoming a member on Ko-fi! ☕🎉: ko-fi.com/fixtse
or Patreon: / fixtse
You can find me on:
Web: fixtse.com/
Instagram: / fixtse
Hope this was useful and if you have any questions, write me a comment below
Thank you for watching (～￣▽￣)～

Пікірлер: 29

@user-yh5ej1qy8o Ай бұрын

Great video as usual, Cant wait to try this out. Let's go!

@markshaz8691 Ай бұрын

Good video again thanks

@gacekk87 Ай бұрын

FYI. I am working on incorporating Polish as a language. Training data has already been prepared 😊

@fixtse. Ай бұрын

That Sounds great!!! 🙌🙌🙌

@cyberdevil657 Ай бұрын

Hi i can't believe that i did not find you before. I'm doing a personal specific project to create a voice assistant that handles as a ADHD assistant and this looks really promising. Well explained i have not tested it yet & i got to say that i broke my brain because my plan was to use a Alexa with API from amazon that is not available anymore. My original plan was it was done in a week, but it's almost 3 months of failing & (i think) i am closer then ever of finding the ultimate solution! I'm gonna try it tomorrow thanks for the high quality the effort to explain it well, if this works i will sub to you 100%

@MsOmgnowai2 13 күн бұрын

Can you share more about your ADHD assistant idea? I’m sure I could use something like this

@hesham1216 Ай бұрын

Thank you for amazing informative video as usual! You have one of the best and neat dashboards I see on home assistant! @8:30 Can you please let us know integrations you use and also the dashboard, including the adguard integration. And how to tell if someone in some room? I see this on many youtubers home assistant tutorials but few says how it is made? is it possible without apple watch and bluetooth connections? Thank you

@fixtse. Ай бұрын

Hey, thanks for that, I actually have videos about everything you just asked, specially for the dashboard, the code is on my website so you can adapt it to your needs and I have a series on presence detection, but short answer yes, you need some kind of bluetooth device to be able to have in room presence detection. It works great, but I would say it's an adition, not a replacement for other presence detection methods. Go to my website and on the blog, look for the lovelave, presence detection and integrations tags.

@hesham1216 Ай бұрын

@@fixtse. Thank you! I will read more on your website and your youtube channel as well, and also I will activate the bell not to miss any of new videos! Thank you

@minemuffin Ай бұрын

I currently have about six entities exposed to the Assistant, but I sometimes get the error message: Failed to parse call from '{"to_say": "The weather is partly cloudy with a temperature of 17°C, humidity of 64%, and a rain probability of 8.3%.", "service": "", "target_device": ""}' Even though the correct answer is in there. Is that just a misconfiguration on my side, or does this happen when I ask more of the model than just turning stuff on and off?

@fixtse. Ай бұрын

Yes, this could be fixed by improving the examples or the prompt to instruct the LLM to ignore the execution part if there is no specific service that matches the list of available services provided.

@gacekk87 Ай бұрын

Does it work for languages other than English?

@dalekronk1320 11 күн бұрын

I am getting a "Unexpected Error during intent recognition" error when i ask the assistant anything any help would be appreciated

@kjcsg 9 күн бұрын

Hey, I found the problem causing that error for me to be the 'Multi-Turn Tool Use' option. Disable that and the error should go away.

@dalekronk1320 8 күн бұрын

@@kjcsg That didn't make a difference any other suggestions or where can i see logs to tell me what is happening

@bamspay 26 күн бұрын

YOur links don't work. Error This integration does not support configuration via the UI. If you followed this link from the Home Assistant website, make sure you run the latest version of Home Assistant.

@fixtse. 21 күн бұрын

Hi, I just checked again and they are working, witch one are you refering exactly?

@neilos2085 Ай бұрын

You thought about doing something local with a jetson and HA?

@baudneo Ай бұрын

Jetson is NOT the platform you want to use for LLMs. Just get a home server setup and aim for a 3080ti, it gives you some wiggle room and at least a decent experience. 12GB VRAM would be recommended minimum. Yes it's relatively expensive but, the GPU can be repurposed if LLMs become small enough for smaller hardware requirements. A Jetson is not useful for LLMs and has limited reuse / resale options.

@neilos2085 Ай бұрын

@@baudneo sounds like a whole video in its self

@fixtse. Ай бұрын

It really is a valid point, and one to consider before investing in new hardware. I'm talking about a different thing here, but tech is a fast-paced and merciless industry, and when it comes to hardware, companies will murder any product line that is not longer profitable, sometimes even if it is, so you want to invest in something commercial enough that is not going to fall out of grace soon, and most importantly, something that can be repurposed easily. Now to answer your question, I haven't, I don't know much about the jetson platform yet, but, my question would be, is it easy to get them in a configuration with 48GB of ram? Since RAM is a big requirement for modern LLMs, I think that an AI platform should offer easy access to it, since consumer grade GPUs currently aren't.

@neilos2085 Ай бұрын

@@fixtse. yep very valid points to take in here. Did you ever share what setup you had to run this?

@ChrisS-oo6fl Ай бұрын

⁠@@baudneo Jetson is actually working with Paulus and the HA team. They working on seamlessly integrating local models with HA using their hardware. I guess it’s extremely promising. But agin if your running local control models on any hardware why run a censored and over aligned model. Unless your creating a Disney land theme park.

@ChrisS-oo6fl Ай бұрын

Only interested in Uncensored or unaligned models. I know someone has released one for Lama3 but why run a model with someone else’s constraints. Especially with a personal assistant….It’s just foolish.

@fixtse. Ай бұрын

does dolphin counts?