Create Custom Wake Word For AIY Projects Kit | Voice Activate Google Assitant on Raspberry Pi

Рет қаралды 17,639

7 жыл бұрын

Using Snowboy, create custom wakeword for AIY projects kit.
Link to Snowboy AI: snowboy.kitt.ai
Command for Atlas installation: sudo apt-get install libatlas-base-dev
Apologies for exposure and audio issues

Пікірлер: 102

@danithomas9781 6 жыл бұрын

I have done similar work to this for version two of the aiy voice kit software. I've managed to integrate snowboy to use the voice hat recorder rather than a separate pyaudio and sox. If anyone is interested the details are at danicymru.wordpress.com/2017/12/21/aiy-voice-kit-voice-vad-or-hotword-activation/

@swannschilling474 7 жыл бұрын

Thanks for the info on the waiting list...and also for the tutorial!! Excellent work!! :D

@Clingclongclay 6 жыл бұрын

I don't have voice-recognizer-raspi... is it because I am using the latest AIY image? there is also no action.py.

@ltrale1031 6 жыл бұрын

Do you know how to make a kit response by voice (and light up the button) when we say a wake word? example: when we say 'OK, Google', the kit will response with voice 'OK' or 'Yes' and light up the button as well. in Alexa with Pi project, the kit response with voice 'Yes' when we say a wake word 'Alexa'

@SnakeOilDev 6 жыл бұрын

Work like a charm. Thank!

@clearwavepro100 7 жыл бұрын

Thank you for sharing this video!! :)

@andreyuvarovhome 5 жыл бұрын

how to use voice hat mic as default mic in raspberry pi? like usb mic?

@Wichurd 6 жыл бұрын

Do you know if there is a way to customize the voice? I know you can change between male/female. But I’m looking for something a little more interesting

@saurabhrahatekar7173 7 жыл бұрын

hey there, is ther any way to change the voice of google assistant?

@karankungwani3810 6 жыл бұрын

Can I use the same procedure for Amazon Alexa also?

@Tracks777 7 жыл бұрын

Good video! Keep it up!

@bruceammerman7320 7 жыл бұрын

I just finished building my Voice Kit (it works! amazing!) and I would like to try your modification, but I'm wondering if you have a transcript (or written directions) you could share -- otherwise this will take quite a while going screen by screen by screen and hearing the instructions over and over again....because it looks a lot more complicated to me than it does to you!

@SidsEClassroom 7 жыл бұрын

Unfortunately, i never prepare scripts for my videos. But I can always help you out here.

@hernandezmaurice 6 жыл бұрын

I cannot find the voice-recognizer-raspi in my /home/pi/

@swannschilling474 6 жыл бұрын

I had the same problem thanks @Lauren Rodrigues

@LimitlessScience20 6 жыл бұрын

I can't get that voice recogniser directory....

@joeynuggetz 6 жыл бұрын

Hi I dont know all the terminology yet but I want to know how I can using voice triggers to turn of LEDs/GPIO pins. I have the Magpi kit but there is no example that allows you to use voice triggers to control lights. Only example is using button. Is there a simple way for this?

@SidsEClassroom 6 жыл бұрын

Follow this project kzfaq.info/get/bejne/ntWmnd2F3ajQcXk.html github.com/shivasiddharth/GassistPi

@kamlesh2mail 6 жыл бұрын

thanks dani will try

@IngeniousProjects-tu5cf 4 ай бұрын

Seems like Snowboy is no longer in use, kindly let me know any alternative method to make the custom wake word

@Chriswheelies 6 жыл бұрын

I don't have the voice recognizer folder after downloading all the required folders. What should I do?

@PranshuTople 6 жыл бұрын

Au Memes hey. Have u fixed the issue?

@AlsHackShack 7 жыл бұрын

Hello, I was wondering if you could help me. I get as far as 09:47 where it says "connection to server failed" which is fine, and the voice activation works, then you just jump to it working, what step did you do after the "sudo python trigger" step? Did you just run main.py again? I tried that, and although the button no longer works, there doesn't appear to be any voice recognition. have I missed a step? I followed all the config file changes etc. why is it now pin 17, what is on there?

@SidsEClassroom 7 жыл бұрын

Hi, You need to change the default GPIO trigger pin in main.py and then the main.py must be started again. You can use any GPIO pin i chose 17 at random. Basically what we are doing here is pulling the GPIO low using snowboy to simulate the button press.

@AlsHackShack 7 жыл бұрын

Thanks Sid, makes sense about the pin number. I changed the pin from 23 to like you said, but I guess I need to know how to make the new trigger we created override it? So the trigger.py we created works perfectly, but how do I use that in my main.py program? sorry if I'm missing something, it's not clear to me.

@SidsEClassroom 7 жыл бұрын

Ok, let me put it this way... Normally the pushbutton is connected to GPIO 25 and when you push that the assistant is activated. Nowif you use the same GPIO in the trigger.py instead of now physically pushing the button we are simulating a press using the snowboy. When the wakeword is detected, the snowboy simulates a debounce effect on the mentioned GPIO mush like physically pressing the button. All you need to do is match the GPIO numbers in trigger.py and the GPIO trigger in main.py

@alexhalfpenny9034 6 жыл бұрын

Thank you so much for your help Sid and for your patience with my stupid questions haha! :) I totally understand the principle I just was missing the part where we replaced the physical trigger with the snowboy trigger in the code. That is the part that was not clear to me. I'll see if getting the GPIO numbers to match in the two files (sorry, files is probably the wrong word) will solve it. One question, how do you run the "trigger.py" and "Main.py" at the same time? or does "main.py" just call on "trigger.py" automatically when needed? Is it maybe my files are not in the same /correct place? Keep up the great work!

@sairahul1998 6 жыл бұрын

Al's Hack Shack hi I'm not getting what to do after 9:47 please reply with command

@sairahul1998 6 жыл бұрын

Will it work with raspberry pi 3 with googleassistant sdk?? Should I download any file

@iWorld17 7 жыл бұрын

I really don't know why you need to change the value of blink and sleep time to 0.05 & 0.5. Any specific reasons?

@SidsEClassroom 7 жыл бұрын

To create a debounce effect on the GPIO

@hashir 7 жыл бұрын

Is there a way to use both the button and the wake word at the same time?

@powsniffer0110 7 жыл бұрын

Hash Milhan what do you mean

@kamlesh2mail 6 жыл бұрын

not found voice recogniser folder at AIY KIT OS

@PranshuTople 6 жыл бұрын

Same problem. Have anyone fixed it?

@vijrohit 6 жыл бұрын

Great Video! (Just a little confusing)

3 жыл бұрын

hello quick question, does the AIY have wake word like Hey Google by default or do you need to press the button?

@SidsEClassroom 3 жыл бұрын

It depends on the board you are using. Pi Zero does not have Ok Google and all boards starting from Pi 2 have OK Google Wakeword.

3 жыл бұрын

@@SidsEClassroom thanks... do you think support can be added with snowboy?

@SidsEClassroom 3 жыл бұрын

@ Check my project github.com/shivasiddharth/GassistPi it has more than you may even need

3 жыл бұрын

@@SidsEClassroom thanks man!

@AndrewWallEdTech 7 жыл бұрын

Thank you for this! My only question is, can I make it run the wake word automatically when it boots? (I'm not so great with Pi yet)

@SidsEClassroom 7 жыл бұрын

Hi ! The SDK has been updated and the new SDK comes with wake word recognition built in. But updating the SDK, is breaking the existing AIY project. So once the bugs have been fixed, will post an update here. Until then, you can use this as a stop gap arrangement. Auto starting the wake word is a bit cumbersome process.. you can enable SSH and start the wake word service manually.

@AndrewWallEdTech 7 жыл бұрын

Could the button be programmed to run Snowboy on startup?

@SidsEClassroom 7 жыл бұрын

Can do ! But i never had the time to test that !

@SidsEClassroom 7 жыл бұрын

I have posted an updated video check that out.

@needfullthing 6 жыл бұрын

good video but how can you connect to one mic with to applications?

@SidsEClassroom 6 жыл бұрын

You need to use dsnoop plugin. You can find some sample scripts here. github.com/shivasiddharth/GassistPi/tree/master/audio-drivers

@mastermind5814 7 жыл бұрын

after rebooting, do you have to run src/main.py before runing the snowboy script, or just run the snowboy script. after rebooting i run the snowboy script but google assistant did not work with my wake word. i tried runing src/main.py before the snowboy script but i got an error after runing the snowboy script. please help ps. I am not using the voice hat, i editted the config files to run with usb microphone and 3.5mm jack as speaker

@SidsEClassroom 7 жыл бұрын

You are using the same files of the AIY projects kit, but have just edited the config.txt and asound.conf files? And are you using the momentary push button as trigger ?

@mastermind5814 7 жыл бұрын

yes, i edited the config.txt and asound.conf files. with that done i was able to get it to work with the momentary push button as a trigger. the problem is triggering it with the wake-word

@SidsEClassroom 7 жыл бұрын

Within the snowboy folder, you should have a file called demo.py and snowboy.umdl open a terminal and move into the snowboy directory and run the following command. python demo.py snowboy.pmdl for this you should hear a ding sound. Kindly get back to me with the results of this test.

@mastermind5814 7 жыл бұрын

python demo.py snowboy.umdl works

@SidsEClassroom 7 жыл бұрын

sudo systemctl enable voice-recognizer run this command in the "Start dev terminal" on the Desktop. This will auto start your google assistant.

@akshatshah3717 7 жыл бұрын

When I type sudo python trigger.py OK Google.pmdl it says "python: can't open file 'trigger.py': [Errno 2] No such file or directory" can you please help me?

@SidsEClassroom 7 жыл бұрын

you need to run that command when inside the directory in which you have the trigger.py

@akshatshah3717 7 жыл бұрын

Sid's E Classroom Sorry, I'm new to the raspberry pi and coding but can you please explain to me what that means?

@SidsEClassroom 7 жыл бұрын

In the terminal type cd "path to the directory that has the trigger.py" without quotes.. Just like windows. change directory to the folder that has the trigger.py

@sandeep-ul4oq 7 жыл бұрын

can i control the rpi pins with this google assistant?

@SidsEClassroom 7 жыл бұрын

Yes !

@sandeep-ul4oq 7 жыл бұрын

can you please provide me link to that information/documentation. thanks 4 replying.

@SidsEClassroom 7 жыл бұрын

aiyprojects.withgoogle.com/voice/

@sandeep-ul4oq 7 жыл бұрын

Sid's E Classroom thankyou sir 💜

@085-vaibhavgusain9 7 жыл бұрын

can I add custom wake up word on Amazon Alexa

@SidsEClassroom 7 жыл бұрын

You mean the Alexa on Raspberry Pi ? Yes you can. but the process is different.

@085-vaibhavgusain9 7 жыл бұрын

can you plz make a video how to do that plz🙏

@mksenterprise2388 7 жыл бұрын

can u Do video on how to get music to play on the aiy project plz

@KevinVerberk 7 жыл бұрын

@Max If you're using the AIY kit, I recommend having a look at this: github.com/Tom-Archer/gmusicaiy It's also worth noting that Casting music does work, so, better than nothing.

@nareshmurthy9685 7 жыл бұрын

This video is great!!!, currently I don't have the AIY kit, but I have setup Google assistant on raspbian pixel, is it possible to create custom wake word without the AIY kit

@SidsEClassroom 7 жыл бұрын

Which Pi are you using? If it is Pi3, i have already posted a video for that.

@nareshmurthy9685 7 жыл бұрын

I am using pi2 model B, I have watched your video on headless voice activation on pi3, but i think in that video you didn't add custom wake word using snowboy

@SidsEClassroom 7 жыл бұрын

Pi zero cannot make use of google assistant's built-in hotwording due to incompatibility. Stay tuned. I will be posting a video for running voice activated assistant on pi zero and other devices.

@nareshmurthy9685 7 жыл бұрын

I am able use hot word "ok Google" on pi2 and it works fine, but not able to create a custom wake word instead of "ok Google" Any way thanks a lot for your videos

@SidsEClassroom 7 жыл бұрын

The process for creating custom wakeword will be the same for all the Pi. So you can follow the same steps that i wiil be showing in the pi zero video.

@asutoshpatel3588 7 жыл бұрын

where do get the kit?

@SidsEClassroom 7 жыл бұрын

Signup here and join the waiting list...docs.google.com/forms/d/e/1FAIpQLSev7IQBFUaDlv5tx1Decxd5Ya5AqYSEvD72hJySeaRDogaqAw/viewform?c=0&w=1

@whatsnext3034 7 жыл бұрын

Thanks

@murshedaziz3742 6 жыл бұрын

how could i run both main.py and trigger.py at the same time.... please help... And a ton of thanks to you... your tuts helps a lot...

@SidsEClassroom 6 жыл бұрын

you mean running trigger.py as a service?

@murshedaziz3742 6 жыл бұрын

yes.. And i am using AIY image with usb microphone and 3.5 mm jack .. One more question sir , which is better for custom actions AIY image or Goole assistant SDK ?

@murshedaziz3742 6 жыл бұрын

waiting for your instructions.... :) :)

@SidsEClassroom 6 жыл бұрын

Creating a service for the trigger.py is tricky, if you do it wrong, you will crash your AIY setup. For manually running both at the same time, you need to use a dsnoop plugin. Change the asoundrc and asound.conf like how it is given in this link.. github.com/shivasiddharth/GassistPi/blob/master/audio-drivers/USB-MIC-JACK/scripts/asound.conf SDK's audio quality is better than old AIY. New AIY and SDK are almost same..AIY is a community project so there are so many people working on it. But for modifying SDK, right now i am the only person doing it...

@murshedaziz3742 6 жыл бұрын

It's working .... again a lot lot more thanks to you .... :) :)

@paulmatz1004 7 жыл бұрын

Great Video. My first thought after putting my AIY kit together was how to make it work with a wake word. Thank you. I've used Snowboy before to control a GoPiGoRobot (kzfaq.info/get/bejne/eaeGodd1zs2tkWQ.html), but didn't know how to make it interact with the Google AI. You can also edit the trigger.py file to contain the name of the pmdl file, so you don't have to re-enter it every time you start the program. Just change the line: model = sys.argv[1] to: model = ["File_path/varsha.pmdl"] then also delete the 4 lines above it (starting with "if len(sys.argv) == 1:", so you don't get an error Now, to to get it to run on startup...

@SidsEClassroom 7 жыл бұрын

Your project looks really cool. The wake word technique that i have shown is just a one of the ways to go about it, not the best way to do though. The best way would be to create a new trigger, make the snowboy a service that is a part of AIY and then start the snowboy service with the AIY. That is quite some work for some noobs and hence have not suggested it here. Hoping to make a video on that soon.. Thanks for stopping by and providing suggestions !

@IngeniousProjects-tu5cf 4 ай бұрын

Seems like Snowboy is no longer in use, kindly let me know any alternative method to make the custom wake word