Unreal Engine 5 Speech Recognition (Sphinx-UE4 Plugin)

Рет қаралды 9,094

Жыл бұрын

You asked for it, so here it is!
Little tutorial on how to use the Sphinx-UE4 Plugin in UE5, for speech recognition! Sorry for the crappy quality, I'm not really equipped for making videos.
Twitter: / waxolp
Twitch: / waxolp
Links for resources in video:
Instructions: unrealcommunity.wiki/speech-r...
Demo Files: nerivec.github.io/old-ue4-wik...
Github repo: github.com/ukustra/sphinx-ue4
UE5 doc for how to install plugins: docs.unrealengine.com/5.0/en-...

Пікірлер: 54

@H1JaX Жыл бұрын

Brilliant stuff! I look forward to trying this out soon, thanks alot!

@LiitonZZ 10 ай бұрын

It's Cool! Also looking forward to you updating your VR game related videos.

@VoicesFromTheDark Жыл бұрын

You just gave us the greatest tool to make an epic Global Game Jam 2023 entry, thank you from the Support Squad

@Waxolp Жыл бұрын

Let me know how it goes!

@H1JaX Жыл бұрын

Got it working! Thank you so much!

@iwt7099 Жыл бұрын

Omg I'm so glad to this video is uploaded😇 thanks for your kindness

@Alexei-im6dq Жыл бұрын

Thank you so much!

@chinccw4529 Жыл бұрын

cool stuff

@wolfsdendogsanctuary731 Жыл бұрын

Thanks for the upload, would appreciate a higher resolution than 360p tho.

@Waxolp Жыл бұрын

That's weird, you should be able to have 1080p...

@wolfsdendogsanctuary731 Жыл бұрын

@@Waxolp I'm only getting 360p. Tried in two browsers.

@Waxolp Жыл бұрын

@@wolfsdendogsanctuary731 Yeah don't know! I tried in Incognito mode and I still see all the qualities up to 1080 :s

@Kanermi 3 ай бұрын

Hello, i have a problemI can't get it to work on android, the errors I get are - Source/SpeechRecognition/Public/SpeechRecognition.h(81,16): error: assigning field to itself [-Werror,-Wself-assign-field] Source/SpeechRecognition/Public/SpeechRecognitionWorker.h(3,10): fatal error: 'sphinxbase/err.h' file not found

@DemianWeaver Жыл бұрын

I have a problem when trying to open a project "could not be compiled try rebuilding from source manually"

11 ай бұрын

Hi, when changing GameState, the game does not work in the client. Is there any way we can use this plugin without changing GameState? Or can we combine the previous GameState with the SpeechRecognitionState class?

@Millu30 Жыл бұрын

Really want to try it but i sucks at making stuff in UE😞😞

@DekelElz Жыл бұрын

Always when i press T in UE 5.1.1 Its write me an error.. i put api and all needed.. but its look its cant get my voice or something

@susannaalan9780 10 ай бұрын

Hi! How to set up microphone for speech recognition?

@jessyofficiel9632 10 ай бұрын

I have a bug, I am told: The SpeechRecognition plugin was designed for build 4.9.1 Attempt to load it anyway? i said yes and : The following modules are missing or built with a different engine version I said yes again and : "myproject" could not be compiled try building from souce manually How do I resolve this???

@SicoSiber Жыл бұрын

Hey! I liked this video! this is something I had been looking for, and you did an awesome job of explaining the whole setup and the various nodes! I appreciate the video, and I'll be checking back in on your YT in case you find any more of these cool niche goodies!

@Waxolp Жыл бұрын

Thanks man! Appreciate the comment! Currently building a new PC so I can develop more with VR, my current PC is really struggling. Hopefully I'll have more cool things to share soon! :)

@SicoSiber Жыл бұрын

@@Waxolp I'm tryin to get it to work on the quest 2, but when I'm launching it, I'm getting a plugin error, I did what it said in the documentation, but what all did you have to do to get that to work?

@Waxolp Жыл бұрын

@@SicoSiber Oof, good question. I only tried it with my Vive, so to be honest I don't know how to help. Can you try just running it without a VR pawn, maybe just in 1st or 3rd person?

@SicoSiber Жыл бұрын

@@Waxolp I got it working with first and third person, the plugin is just on the struggle bus when I try to export it, but it just might not support android yet 🤷‍♂ Thanks for the info though, and keep up the good work!

@susannaalan9780 10 ай бұрын

Hi! How can I check if microphone is connected?

@nessieloch5564 5 ай бұрын

and when we export the game, will it works ? :/ like build the game

@vaibhavbhati8100 11 күн бұрын

this plugin not working after packaging in unreal thnaks

@rnjt8960 8 ай бұрын

I followed every steps but still not work, there is no text come out when I speaked to them😢😢😢

@user-wn9vu6nz4k 5 ай бұрын

It did not work for me, is there an example project download for ue5? All examples I found were ue4.

@Neutromex Жыл бұрын

i dont know why it isn't working :(

@boyce-wei Жыл бұрын

Hi, Waxolp,everything was done according to your process but it didn't work, and I don't know what's wrong. What I would have done if I just wanted to translate what I said.

@user-nn3rk9fx6h Жыл бұрын

Hi, I rebooted the UE5 project after placing both the SpeechRecognition folder and the model folder in their places, but with the following error: "Missing myproject Modules The following modules are missing or built with a different engine version: SpeechRecognition Would you like to rebuild them now?" . There are two options: yes and no. After I click yes, error still appears: "myproject could not be compiled. Try rebuilding from source manually." Could you please tell me how to solve it? (I use a Macbook pro M1 pro, UE 5.0.1, and "myproject" is myproject name)🥲🥲🥲

@Ukraud 17 күн бұрын

That's because the version of UE5 you are using is lower than the version of the plugin, make sure you have the same version that the plugin supports.

@sterlydolce 10 ай бұрын

Good to put an AI Assistant inside your game, thats my idea

@REALVIBESTV Жыл бұрын

Can you use this as well for speech recognition with a metahuman

@Waxolp Жыл бұрын

Sure.. the plugin works as a stand-alone. You can use the events generated from the speech recognition to trigger anything, including interactions with metahumans. You just need to refactor the code to work how you want

@metalbor Жыл бұрын

hello, does this work on 4.26?

@finfamous2546 Жыл бұрын

I can't seem to get anything from any "Bind event to" Node, no debug is printing at all. This is also true no matter the word or tolerance. I'm pretty certain my mic is working because I also have proximity voice chat working in the game. Any ideas? I followed this tutorial more or less to the letter in version 5.1.

@Waxolp Жыл бұрын

Do you see all the other nodes? If so, that means at least the plugin is installed. If not, I would redo those steps. If you have the Speech Recognition Subsystem node, did you try pulling off that one to get the "Bind Event To" Node? Make sure you also have the GameState properly set in the project properties!

@finfamous2546 Жыл бұрын

Plugin is installed, I have the subsystem node and Bind event to on Words Spoken. Project properties is set up same as tutorial. Is there anything else possibly simple I am missing, After creating an actor with Bind word spoken event I am just dropping it into my scene. Is there maybe some box I haven't checked to initialise the code in the scene or something?

@christianbellamy8726 Жыл бұрын

I copied the code exactly as shown in the video, but when I test it I can't get anything to print verifying it understood what I said. I'm also not getting any errors. The only thing I can think of that may have caused an issue is that when I tried extracting the files it gave me an error saying "The same volume can not be used as both the source and destination" so I extracted it into a different drive and dragged the English model over(it was the only on that extracted) and followed the steps from there. Sorry that's alot but if anyone has any idea what I did wrong I'd appreciate it.

@christianbellamy8726 Жыл бұрын

finally fixed the issue, it WAS an issue with the model. I had to install the premade version just to copy over the models into my game and it FINALLY worked. Man I thought I was going nuts.

@Waxolp Жыл бұрын

@@christianbellamy8726 haha happy it worked man! Thanks for letting us know in case others have similar issues!

@christianbellamy8726 Жыл бұрын

@@Waxolp yeah fs, I didn't want to delete it in case someone else started goin through my troubles lol

@j_mokusei 4 ай бұрын

To anyone getting the "The same volume can not be used as both the source and destination" error and unable to extract any of the files, try using 7-zip to extract it. I was able to extract everything when once I finally used it.

@KalistosGaming 8 ай бұрын

Thanks for the tutorial, I made a new game state and used it with my existing game mode seems to work the same . In the game state I actually didnt configure nothing I changed from the details settings you mentioned the words I want works fine also same as with mannual integration like you did . My issue is I want to use this plug in for words that dont exist in the dictionary . I've added the words to the english en.dic file with the phonetics used by sphinx but it just doesnt recognises it. Any tips how to add new words I could try out for my project ? this is the word I added in the en.dic : lumoss L UW M OW S

@flysen Жыл бұрын

Hey, when I compile, I get an error: Building patch from 1 file(s) for Live coding module C:\Users\iGamer-EPIC\Documents\Unreal Projects\MMORPG\Plugins\SpeechRecognition\Binaries\Win64\UnrealEditor-SpeechRecognition.dll Could not spawn process C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.34.31933\bin\HostX64\x64\link.exe. Error: 267

@nessieloch5564 2 ай бұрын

we cannot build ? Did you figure it out ?

@flysen 2 ай бұрын

@@nessieloch5564 nah